The reason you won't install flash storage this year (part 2)
Financial firm sees 10X performance increase
By Bruce Hoard, Computerworld USA | Techworld | Published: 07:00, 15 March 2007
(Continued from part 1.)
Financial firm sees 10X performance increase
Driven by an intense in-house database application tied to rapidly changing stock market data, a financial firm in the Midwest initially responded to the need for extremely fast disk I/O by throwing faster servers and different versions of RAID at the problem. According to a senior systems engineer at the firm, which asked not to be named, when that tactic didn't work the firm upped the ante by beefing up a server with 32GB of memory in an effort to create a large, virtual RAM drive. The SSD RAM was supposed to help the firm gain control of the application that tracks stocks and attempts to make calculated real-time decisions based on the flow of the market. The result was less than a success.
"It was significantly faster than what we were doing before, but it still wasn't getting us the results we needed," the engineer says. "We wanted more speed. I don't know how many times we told all the vendors we were looking for raw speed."
Given the paucity of SSD vendors, it didn't take the financial firm long to narrow the field down to Xiotech Corp. and its Magnitude 3D 3000 SAN and the TagmaStore AMS1000 from Hitachi Data Systems. The HDS system was loaded up with read/write cache -- what the engineer calls "their claim to fame," but in the bakeoff with the Magnitude 3D 3000, the broadband-type cache wasn't fine-tunable enough to interoperate precisely with the application.
For its part, the Magnitude 3D 3000 gained a significant advantage based on a simple capability. "With the Xiotech SAN, we could basically take these solid-state disks, mount them as virtual memory sticks and refer to them via a drive letter. We could then dedicate the solid-state disks to our application just like you would with any other resource," he explains.
It didn't hurt that the Magnitude 3D 3000 provided 10 times the performance of its predecessor as it crunched away at tables of massive text files, making queries against them and extrapolating the results against the financial firm's proprietary requirements.
The firm currently has 4TB of raw data and 2TB of usable data in the SAN, and although there is a total of five servers dedicated to it, only the Xiotech machine is working directly with the stock tables application. The engineer defines raw data as the amount of physical space available before any RAID parity, and usable space as the amount of space after all RAID configuration has taken place.
Initial implementation last fall took only about six hours, and since then the Magnitude 3D 3000 has been rock-solid reliable.
"It's been running like clockwork; it's up seven by 24 by 365 and we haven't had to do anything," the engineer says. "Reliability was key for this application because of the nature of the data we've been pulling, and we've had zero downtime."
A 400 percent performance increase
IC Source Inc. is an information clearinghouse for electronic components. The company with just 12 employees maintains two SQL Server databases that serve its component vendors who list their inventories off the site as well as the customers who buy those components.
According to IC Source President Pete Moran, one database contains 79 line items and gets around 100,000 searches a day. Calling that "no big deal," he lauds the other database, which is used to import an average of 15-20 million inventory line item changes each day. Keeping up with that demand is what sent him into the SSD market.
Moran had been dabbling off and on in the flash memory market for several years, during which time he made occasional phone calls to CMOS-RAM SSD maker Texas Memory Systems Inc. However, as he explains it, "They kept coming back with these really expensive, tiny disk space drives" that topped off at 64GB, while his database was around 72GB.
The last time he made his yearly call to the vendor, it said it had introduced the RamSan 400, which the company claimed would hold 128GB, which was more than other, more expensive SSDs offered. Moran promptly lined up a 30-day demo and was so impressed by the results that he bought one of the $140,000 devices immediately. He had it delivered and, along with one other non-IT person, got it up and running within 20 minutes. He needed some additional help connecting the RamSan to a second database and IC Source's new Qlogic Fibre Channel Switch, which took about two hours, so the total install time was two hours and 20 minutes. Moran says he was extremely pleased that a product he thought would be extremely complex and difficult to work with turned out to be so user-friendly.
"There was really nothing to setting it up and configuring it. It was super easy to do," Moran says. "It didn't require any real technical support -- probably an hour on the phone with them."
The big payoff, however, was in the performance and reliability. Moran says the RamSan has provided a 400 percent performance increase over his old Hewlett-Packard array on smaller files and even more than that on larger ones. For example, inventories that used to take an entire weekend to post now run in 45 seconds. Moran says there hasn't been a single glitch with the system since it was installed, and even if there was, the RamSan is protected by supplemental hard drives and a powerful backup battery that lasts for two weeks.
Moran sums it up by saying, "Since we've had the RamSan, the site has been a lightning bolt."