Select Page

Data Management for Big Data and Analytics

eXtremeDB delivers accelerated storage to HPC infrastructure workloads.

eXtremeDB for High Performance Computing and Big Data is based on a blazingly fast storage engine delivering scalability, low latency and advanced analytical capabilities for HPC workloads.

Statistical Analysis

Exploring large amounts of data to discover underlying patterns is a cornerstone of modern business practices. Statistics are applied everywhere from machine learning to finance to digital marketing to healthcare and communications. eXtremeDB HPC comes with a library of more than 150 functions for performing statistical analysis on time series data, such as grand, group, grid and window averages to name a few.

Learn more about what makes eXtremeDB ideal for Time Series Data

Learn more about what makes eXtremeDB ideal for Financial Systems

u

Learn more about the eXtremeDB database for Big Data and analytics in our HPC FAQ

Fast statistical analysis is essential in a database for Big Data and Analytics

Pipelining

Pipelining refers to a series of data processing steps where the output of one step is the input to the next step. The pipelining of vector‐based statistical functions is key to eXtremeDB’s ability to accelerate performance when working with IoT and capital markets’ time series data. eXtremeDB’s extensive library of math functions are the building blocks that are assembled into pipelines to minimize data transfers and maximally exploit the CPU’s L1/L2/L3 cache. Don’t see the function your analytics require? No problem, write it yourself and use it alongside the built-in functions seamlessly.

Pipelining makes eXtremeDB the ideal database for big data and analytics

A database for Big Data and analytics should be the fastest available.  Since 2014, eXtremeDB for HPC has set records, then broken our own records.  See the stats.

I

Watch a 2 minute video on Pipelining.

Pipelining

Pipelining is referred to a series of data processing elements where the output of one element is the input of the next one. Pipelining vector‐based statistical functions is a key to accelerate performance when working with time series data, such as market data. eXtremeDB’s extensive library of math functions are building blocks that can be assembled into a pipeline to minimize data transfers and maximally exploit the CPU and L1/L2/L3 cache.

A database for Big Data and analytics should be the fastest available.  Since 2014, eXtremeDB for HPC has set records, then broken our own records.  See the stats.

I

Watch a 2 minute video on Pipelining.

Pipelining makes eXtremeDB the ideal database for big data and analytics

Columnar and Row-oriented Storage

Combining analytics and online transaction processing (OLTP) queries is a common requirement for today’s high-performance database systems. eXtremeDB supports two storage formats: Vertical (columnar) storage for time-series data, which is ideal for working with tick streams and machine-generated IoT data, while traditional row-oriented storage is de rigueur for OLTP workloads.

eXtremeDB stores time series data with a columnar layout, and “normal” data with a conventional row-based layout. The result is higher performance for time series analytics.

$

Learn about the advantages of an in-memory database for financial analytics

Learn more about eXtremeDB and in-database analytics

The benefits of columnar processing for time series data<br />

Horizontal Partitioning:  Sharding for Elastic Scalability

Efficient Big Data processing frequently requires data partitioning. eXtremeDB offers ultra-fast, elastically scalable data management through sharding — the horizontal partitioning of data. Sharding allows distribution of data over multiple physical nodes, or partitions on the same node, maximizing CPU load and exploiting storage media I/O concurrency.

Sharding makes eXtremeDB the idea DMBS for statistical analysis

The developer can specify the storage (in-memory or persistent) for each table, which is ideal for handling streaming and historical data within a single database architecture.

Since 2014, eXtremeDB for HPC has set records, then broken its own records. See the stats.

Scalable distributed database contrast and compare. This table summarizes the primary purpose and characteristics of each distributed database option.

The developer can specify the storage (in-memory or persistent) for each table, which is ideal for handling streaming and historical data within a single database architecture.

Since 2014, eXtremeDB for HPC has set records, then broken our own records.  See the stats.

Scalable distributed database contrast and compare.  This table summarizes primary purpose and characteristics of each distributed database option.

Sharding makes eXtremeDB the idea DMBS for statistical analysis

High Availability Options

eXtremeDB offers a comprehensive set of high availability capabilities through master-slave and multi-master (Cluster) database configurations, and the advanced Active Replication Fabric. Depending on the applications’ requirements, these capabilities can be deployed individually or can seamlessly work together ensuring maximum availability of data and promoting query load balancing in complex heterogeneous environments.

Review a chart of all eXtremeDB distributed database options

u

Learn how eXtremeDB Active Replication Fabric solves connectivity issues for developers.

$

Learn more about eXtremeDB Cluster distributed database for big data and analytics

eXtremeDB clustering database management system for High Availability

Choice of Programming Interface

eXtremeDB provides a set of libraries written in the C language that enables you to access databases from within any C or C++ program, and language bindings for Python, Java, Scala, PHP, Rust and Lua, and a RESTful API for browser-based apps. Whether you prefer SQL or a native (nonSQL) API, eXtremeDB has you covered. Each language binding defines its own interface to access eXtremeDB databases. SQL and nonSQL APIs, and multiple programming languages can be used simultaneously with the same database.

eXtremeDB offers a choice of interface with multiple APIs
U

Learn more about programming with eXtremeDB in our online documentation

Learn more about:

Choice of Programming Interface

eXtremeDB provides a set of libraries written in the C language that enables you to access databases from within any C or C++ program. Yet you are not limited to using C/C++. Whether you program in Python, C#, Java, Scala, PHP or Lua, and whether you prefer SQL or a native language no-SQL API, eXtremeDB has you covered. Each language binding defines its own interface to access eXtremeDB databases.

U

Learn more about programming with eXtremeDB in our online documentation

Learn more about:

eXtremeDB offers a choice of interface with  multiple APIs

eXtremeDB is database management wherever you need it.  It’s used by innovative industry leaders in over 30,000,000 deployments world-wide in these markets and others.

Network & Telecom

Network gear developers build on proven eXtremeDB speed and reliability, combined in-memory and persistent data layouts, optimized access methods and unmatched flexibility.

Consumer Electronics

JVC, DirecTV, GoPro and others all discovered that eXtremeDB’s small code size, portable data format and efficient use of compute & storage can reduce component cost while also supporting data-hungry new features.

Industrial Systems

eXtremeDB’s sophisticated event notification systems, time series data processing and high availability have powered its wide-spread adoption in SCADA, fleet management, smart building automation and other verticals.

Aerospace & Defense

Northrop Grumman, Lockheed Martin, British Aerospace, EADS and others depend on eXtremeDB’s reliability, unmatched performance and broad platform support.

Energy

eXtremeDB optimization technology can dramatically boost utilities’ power generation yields. Distribution networks can become self-healing and bi-directional, enabling end-users to contribute power back to the grid.

Finance

eXtremeDB’s unique hybrid row- and columnar-layout (OLTP and time series) couples with pipelined functions for statistical analysis and scalable distributed database architecture power record-setting STAC-M3 benchmark results.

Hard Real-time Systems

eXtremeDB/rt is the first and only deterministic embedded DBMS for mission- and safety-critical hard real-time applications. It is built to satisfy strict requirements for timely execution of avionics and aircraft navigation systems, driver assistance systems, critical medical equipment and similar systems’ data management.

Big Data & Analytics

Columnar and row-oriented storage, a SQL engine infused with advanced analytics, and a scalable distributed architecture deliver speed and reliability to complex data-driven applications.

Finance

Your content goes here. Edit or remove this text inline or in the module Content settings. You can also style every aspect of this content in the module

Embedded Systems

From inception, eXtremeDB’s resilient and optimized storage capabilities uniquely qualified it to fuel database management for safety-critical and resource-constrained embedded applications.

Internet of Things

eXtremeDB’s Active Replication Fabric™ creates a data management foundation for the IoT ecosystem that seamlessly integrates edge and cloud applications’ storage and ensuring data safety all around.

 Find eXtremeDB in over 30,000,000 deployments worldwide.

McObject has been helping industry leaders optimize their data management strategy since 2001.  See a partial list of customers.

Spirent

“It was more than twice as fast as the second-place database.”

GoldenSource

“In addition to speed and the ability to process large quantities of data, clients also require richer data sets for golden price generation, which is what  eXtremeDB will help us do outstandingly well.”

ViaSat

“After a stringent review process, we selected eXtremeDB because of its scalability; outstanding performance due to its sharding capability; and our confidence in McObject’s ability to offer a solid support team.”

TradeStation

eXtremeDB Financial Edition’s performance and fault-tolerance make it a natural fit for database processing in the enhanced order-execution system.”

Dalian Commodity Exchange

eXtremeDB-64 contributes significantly to trading platform robustness, with a proven database transaction mechanism that is optimized for high throughput.”

Outstanding Structured Database

Best Big Data Analytics & Technology Provider

Related Resources

White Papers for Professional Developers

We have been testing, improving on, and retesting our software from the beginning in 2001 in order to provide our clients with the best possible data management solutions. Read “Pipelining Vector-Based Statistical Functions for In-Memory Analytics” and more.

Review our research

Webinars for Professional Developers

Watch to on-demand Webinars, hosted by experts, about proven database management system practices.  Watch “Embedded Databases: Building In Always On High Availability” and others.

Review our list of Webinars

Review the Benchmark Test Results

eXtremeDB sets speed records year after year.  In multiple independently audited benchmark tests, eXtremeDB has broken its own earlier records for the best (lowest) mean response times and for lowest standard deviation of test results using the SQL database programming language.

 

Try eXtremeDB for HPC database for Big Data and Analytics on AWS

eXtremeDB for HPC is now available with its full set of features through the AWS Marketplace.  Cloud-based users may now evaluate, purchase and deploy within the almost unlimited AWS framework.

t

eXtremeDB for HPC FAQs

List of HPC features

i

eXtremeDB documentation

Mission- and Safety-critical Systems

eXtremeDB/rt is the first and only deterministic embedded database management system for mission- and safety-critical hard real-time applications.

Embedded and/or Client/Server

eXtremeDB runs on the device, gateway and server, leveraging staff skills to cut development time.

Internet of Things

eXtremeDB databases can be all-in-memory, all-persistent, or have a mix of in-memory and persistent tables with a simple database schema.  Our exclusive Active Replication Fabric™ offers reliable IoT data management by solving 5 key challenges.

High Performance Computing

eXtremeDB HPC for cloud, analytics and financial is built on a proven embedded database system to deliver scalability and performance. Offering Pipelined, vector-based analytics, flexible column and/or row data layout for time series data, elastic scalability and more.