Distributed Database Options
eXtremeDB Financial Edition delivers the benefits of distributed database management via distributed query processing, clustering and high availability options.
Distributed Query Processing
With this capability, eXtremeDB Financial Edition partitions, or shards, a database and distributes query processing across multiple servers, CPUs and/or CPU cores. Performance is accelerated — dramatically, in some cases — via parallel execution of database operations and by harnessing the capabilities of many host computers rather than just one.
The benefits of distributed query processing are evident in McObjects recent STAC-M3 benchmarks with partners IBM and Lucera Financial Infrastructures; in these tests, the eXtremeDB Financial Edition database was partitioned horizontally across 60+ shards, resulting in record-setting performance managing tick data.
High availability enables deployment of a master database and one or more synchronized replica databases within separate hardware instances, with application-directed failover. Replication strategies include 2-safe (synchronous) and 1-safe (asynchronous). This feature delivers “five nines” (99.999% uptime) reliability, or better, with eXtremeDB Financial Edition’s unsurpassed performance. Replica database instances are available for read-only operations, to support distribution/load-balancing of database query/analysis/reporting requirements.
In clustered deployments, every eXtremeDB Financial Edition database instance serves as a master. Changes to one node are efficiently replicated to others.
Figure 1. eXtremeDB Cluster delivers a simplified distributed database system. This low complexity enables McObject’s clustering software to deploy quickly and reduces cost-of-ownership.
Benefits include dramatically increased available net processing power, lower system expansion costs (through use of low-cost “commodity” hardware), and maximum scalability and reliability.
eXtremeDB is unique as the first embedded clustering DBMS: the database system runs within the application process at every node, without separate client and server modules. This design eliminates inter-process communication (IPC) overhead within database instances, for faster performance. It also reduces complexity, contributing to higher reliability and simplified deployment and maintenance.
A local tables option speeds processing by enabling nodes to define data sets to be managed without cluster-wide replication. For example, all nodes in a cluster might share a market data feed and historical database, but an application at node A might calculate, and store in a local table, volume-weighted average price (VWAP) while its counterpart at node B calculates and stores results of a mean reversion algorithm. In keeping with eXtremeDB Financial Edition’s embedded nature, the local tables option provides APIs that allow a node to “gather” a table from another node, and to “scatter” its local table(s) to another node(s).
Lower Complexity = Lower Costs
Clustering database solutions based on relational database management systems (RDBMSs) can entail separate sets of nodes for clients, database servers and SQL processing, as well as dedicated server and client software for management tasks.
Figure 2. Distributed database solutions based on cluster RDBMSs are highly complex, which makes them slow to roll out and expensive to implement and maintain.
With this level of complexity, it’s no surprise that extensive consulting engagements are typically part-and-parcel of RDBMS cluster deployments.
eXtremeDB Financial Edition’s streamlined architecture integrates the functions described above on the individual cluster nodes, greatly simplifying system deployment and updates. By eliminating complexity, McObject’s distributed database reduces cost-of-ownership.
Accelerated Performance, Powerful Features
In McObject’s benchmarks, eXtremeDB Financial Edition delivered breakthrough performance, including an astonishing 161% throughput improvement when scaling to four cluster nodes from one node.
Distributing the system across multiple hosts ensures continuous availability in the event of a failure on one node. The “shared nothing” clustering architecture in eXtremeDB Financial Edition eliminates reliance on a shared SAN or other storage resource. Multiple platforms (e.g. Linux and Windows) are supported within a single cluster.
eXtremeDB Financial Edition’s clustering supports ACID transactions, making it the best option for applications that demand integrity of distributed data.