McObject Shows You Can Have Your In-Memory Database Performance – and Durability/Recoverability, Too
In-memory database systems – which work with data in main memory – are faster than conventional DBMSs, because the latter rely on slower persistent storage. But some potential users shy away from IMDSs due to the higher volatility of keeping records in RAM. Transaction logging, which keeps a record of changes to the database, addresses this concern by enabling recovery in the event of system failure. Naysayers argue that the persistent storage required to keep this transaction log defeats the purpose of using an IMDS, and counters any performance gains.
In one of the first tests of its kind, and using database system software from its eXtremeDB® product family, McObject measured the performance of an on-disk DBMS against an IMDS with transaction logging (IMDS+TL) using a variety of storage devices. For the database operations most likely to induce latency, the IMDS+TL storing its transaction log on a hard disk drive (HDD) outperformed the conventional DBMS using HDD storage several times over (even with the disk-based DBMS employing caching to minimize I/O). The gains were even more dramatic using state-of-the-art flash memory technology from Fusion-io. Swapping the hard drive used by the in-memory database system to store log data with a Fusion ioDrive enabled the IMDS with transaction logging to turn in a stunning 15.33x speed advantage over the disk-based DBMS.
“Near real-time performance is a key goal for telecommunications and high performance computing, , but data must also be recoverable in case of unexpected events. Transaction logging solutions like eXtremeDB and Fusion ioMemory can ensure customers have comprehensive protection for the data that runs their business,” said Tyler Smith, Fusion-io Vice President of Alliances. “We are pleased to work with McObject to achieve such impressive results, and we look forward to continuing to collaborate with innovative database experts to deliver ultra-low latency, flash memory performance .”
“These tests have important implications for high performance systems, chief among them that you don’t need to sacrifice data durability in order to gain high performance,” said Steve Graves, co-founder and CEO of McObject. “With transaction logging, software gains database recoverability yet still benefits from in-memory DBMSs’ tremendous speed. The performance advantage of an IMDS with transaction logging turns out to be dramatic even using basic hard disk storage; by moving to Fusion-io’s state-of-the-art memory tier storage, real-time embedded systems can obtain an advantage that is truly game-changing.”
McObject will publish a report about the testing process, components and results. A preview is available now at www.mcobject.com/imdstl.
Founded by embedded database and real-time systems experts, McObject offers proven data management technology that makes applications and devices smarter, more reliable and more cost-effective to develop and maintain. McObject counts among its customers industry leaders such BAE Systems, Siemens, Phillips, EADS, JVC, Tyco Thermal Controls, F5 Networks, CA, Motorola and Boeing. McObject, based in Issaquah, WA, is committed to providing innovative technology and first-rate services to customers and partners. The company can be reached at +1-425-888-8505, or visit www.mcobject.com.
McObject and eXtremeDB are registered trademarks of McObject LLC. All other company or product names mentioned herein are trademarks or registered trademarks of their respective owners.