Distributed Database Management

With eXtremeDB for HPC

What to choose: review our chart of distributed database choices and use cases

eXtremeDB for HPC delivers the benefits of distributed database management via distributed query processing, clustering and high availability options.

Distributed Query Processing

eXtremeDB for HPC partitions, or shards, a database and distributes query processing across multiple servers, CPUs and/or CPU cores. Performance is accelerated — dramatically, in some cases — via parallel execution of database operations and by harnessing the capabilities of many host computers rather than just one.

The benefits of distributed query processing are evident in McObjects recent STAC-M3 benchmarks. We partnered with E8 Storage, IBM, and Lucera Financial Infrastructures to name a few. In these tests, the eXtremeDB database was partitioned horizontally across up to 128 shards, resulting in record-setting performance managing tick data. Please use the following link to review a summary of the benchmark records.

eXtremeDB offers different distributed database options to address different objectives. Learn about Sharding with eXtremeDB, or review this table that lists different distributed database uses and options.

Learn more about eXtremeDB distributed database options in this chart

Read about using the eXtremeSQL distributed SQL engine in our on-line documentation



Learn more about eXtremeDB distributed query processing

Learn about Sharding for elastic scalability

Distributed query processing is one type of distributed database management from eXtremeDB

High Availability

High availability enables deployment of a master database and one or more synchronized replica databases. Replication is between separate hardware instances and features application-directed fail-over with strategies that include 2-safe (synchronous) and 1-safe (asynchronous). It delivers “five nines” (99.999% uptime) reliability, or better, with eXtremeDB for HPC’s unsurpassed performance. In addition, read-only replicas are available to support distribution/load-balancing of database query/analysis/reporting requirements.

Learn more about High Availability

Read about High Availability in our on-line documentation



Learn more about eXtremeDB time-cognizant eager replication

Read our Q&A, What is a Distributed Database?

High availability distributed database management

Learn more about High Availability

Read about High Availability in our on-line documentation



Learn more about eXtremeDB time-cognizant eager replication

Read our Q&A, What is a Distributed Database?

Clustering

In clustered deployments, every eXtremeDB HPC database instance serves as a master. This means that changes to one node are efficiently replicated to others. It is unique as the first clustering database system to offer an embedded architecture. The database system runs within the application process at every node, eliminating the need for separate client and server modules.

Learn more about Clustering

Read about clustering our on-line documentation



Learn more about eXtremeDB independently audited speed records.



Learn about other eXtremeDB distributed database options

Designed specifically as an in-memory database system, not an afterthought.

Learn why this matters.

Embedded & Real-time Systems

The eXtremeDB in-memory database system was designed specifically for use in resource-constrained, mission-critical and safety-critical embedded systems.



eXtremeDB enables the developer to easily combine both database paradigms – in-memory and on-disk – in a single database instance.



Learn more about eXtremeDB in-memory or hybrid in-memory/persistent database for embedded systems

Why is the IMDS an ideal way to reduce memory consumption in embedded systems?

Learn what makes eXtremeDB ideal in real-time systems

High Performance Computing

eXtremeDB in-database analytics offers breakthrough efficiency and can be used with the product’s in-memory database system (IMDS) capability, or independent of it.



Learn more about the IMDS as a powerful, persistent memory caching solution.



Learn about hybrid eXtremeDB for Big Data and Analytics or for Financial systems

Review our independently audited benchmark test results to learn how fast a hybrid in-memory database can be

Embedded and/or Client/Server

Fast, flexible, platform independent eXtremeDB is data management wherever you need it, and can be deployed as an embedded database system, and/or as a client/server database system.

eXtremeDB is fast, flexible database management wherever you need it. Learn more.

Hybrid In-memory and/or Persistent

Combine both database paradigms – in-memory and on-disk – in a single database instance. Specifying one set of data as transient (managed in memory), while choosing persistent storage for other record types, requires a simple database schema declaration.

Learn why starting with an in-memory database makes for a better hybrid system.

White papers and Webinars

These in-memory database system benchmarks and white papers review the distinction between an in-memory database vs. just running a disk database in-memory, and the performance results that a true IMDS can offer.

Watch one of our many on-demand webinars about use cases and best practices.

Close Window

In addition to unique features like Active Replication Fabric™, no other database management system offers such an extensive combination of features for developers to choose from.

Hybrid data storage

Unlike other IMDS, eXtremeDB can combine the strengths of on-disk and in-memory database systems. In other words, eXtremeDB databases can be all-in-memory, all-persistent, or have a mix of in-memory tables and persistent tables with a simple database schema. This unparalleled flexibility enables developers to tailor data management in order to optimize applications for speed and persistence. System developers can make intelligent trade-offs between performance, cost-efficiency, power consumption, and physical space-conserving data storage hardware.

Learn why starting with in-memory database system allows for improved performance.

Active Replication Fabric

Active Replication Fabric offers reliable IoT database management by solving key challenges for developers. eXtremeDB offers bidirectional replication, multi-tier replication (e.g. edge-to-gateway-to-gateway-to-cloud), compression to maximize limited bandwidth networks, and more.

Learn more about Active Replication Fabric

Row & Columnar Flexibility for Time Series Data

Time series data management systems require large volumes of information to be available continuously. eXtremeDB excels in this capability. eXtremeDB for HPC implements columnar data layout for fields of type ‘sequence’. Sequences can be combined to form a time series, ideal for working with tick streams, telemetry, and other sequential data. This technology supports database designs that combine row-based and column-based layouts, in order to best leverage the CPU cache speed. Learn how.



Learn more about eXtremeDB for time series data

Embedded and Client/Server

Fast, flexible eXtremeDB is data management wherever you need it, and can be deployed as an embedded database system, and/or as a client/server database system.



Compatible with all embedded/real-time operating systems

Read about cross-platform database application development in our on-line documentation

Close window

eXtremeDB HA and Cluster

Sharding allows for elastic scalability, and leverages the processing power, memory and bandwidth of multiple hardware nodes. Each database shard can have one or more backup (replica) copies. Cluster is McObject’s distributed real-time database system. It manages databases across multiple nodes, enabling two or more servers to share the workload. It dramatically increases available net processing power, reduces system expansion costs, and delivers a more scalable and reliable database solution. High Availability (HA) enables deployment of two or more synchronized databases within separate hardware instances using communication channels implemented over standard or proprietary protocols. Sharding is a core feature of eXtremeDB. Cluster and High Availability, all of which are offered in a separate add-on module. Here we compare and contrast Sharding, Cluster and High Availability. Close window