NYSE Processing Petabyte Databases

 NYSE Processing Petabyte Databases, Dan Gatti, Big Data I/O Forum

Daily data volumes for NYSE Euronext are increasing up to 200 percent yearly, a level of growth that requires a fine-grained analytics system to measure and reduce latency across all transactions.

Operating the New York Stock Exchange, Euronext and NYSE Arca, NYSE Euronext is the world’s leading liquid exchange group, with ever-increasing data storage, compliance and analytical demands. Comprised of equities and derivatives exchanges across Europe and the United States, NYSE Euronext’s nearly 4,000 listed companies represent over $20 trillion in total global market capitalization. As market data moves at an ever-increasing speed, issuers, investors and financial institutions expect transparent and low-latency data services.

Given this exponential data growth, NYSE Euronext chose Greenplum to provide a reliable and scalable analytics system that could manage up to two terabytes of new data per day. Greenplum’s massively parallel database solutions, running on SunFire X4500 and X4540 server technology, fit NYSE Euronext’s needs for a robust and reliable system that can increase capacity easily and affordably. Greenplum offered what other analytics and data warehousing solutions did not.

According to Steve Hirsch, Chief Data Officer for NYSE Euronext, “Greenplum’s ability to support petabyte-scale databases on completely general-purpose hardware is a powerful and unique capability in the market today.”

Using Greenplum’s solutions, NYSE Euronext is prepared for the big data challenges that lie ahead. “Greenplum’s performance and scalability is altering us to evolve next-generation isolating applications that will hand over fresh innovations to the U.S. exchange marketplace,” said Hirsch. “The ability to process big amounts of information on a near real-time basis has greatly altered the value of data pulled off by NYSE Euronext in the U.S.”

Category: Uncategorized