Say 'No' to SQL
Movement against traditional databases gathers steam
By Eric Lai | Computerworld US | Published: 11:31, 02 July 2009
The NoSQL meet-up in San Francisco last month had a whiff of revolution about it. With nearly 150 attendees cramming into a meeting room at CBS Interactive, NoSQLers came to share how they had overthrown the tyranny of slow, expensive relational databases in favour of more efficient and cheaper ways of managing data.
"Relational databases give you too much. They force you to twist your object data to fit a RDBMS [relational database management system]," said Jon Travis, principal engineer at Java toolmaker SpringSource, one of the 10 presenters at the NoSQL confab.
NoSQL-based alternatives "just give you what you need," Travis said.
Related Articles on Techworld
The movement's chief champions are web and Java developers, many of whom learned to get by at their cash-strapped startups without Oracle by building their own data storage solutions, emulating those being built by Google and Amazon, and which they subsequently released as open source.
Now that their open source data stores manage hundreds of terabytes or even petabytes of data for thriving Web 2.0 and cloud computing vendors, switching back is neither technically, economically or even ideologically feasible.
"Web 2.0 companies can take chances and they need scalability," said Johan Oskarsson, the London-based organiser of the NoSQL meeting and, like most of the other attendees, a web developer (of music streaming site Last.fm). "When you have these two things in combination, it makes [NoSQL] very compelling."
Many, said Oskarsson, had even dumped the open-source MySQL database, a long-time Web 2.0 favourite, for a NoSQL alternative, because the advantages were too compelling to ignore.
FaceBook, for instance, created its Cassandra data store in-house to replace its use of MySQL. According to a presentation by FaceBook engineer Avinash Lakshman, Cassandra can write 50GB of data in 0.12 milliseconds, more than 2,500 times faster than MySQL.
What is NoSQL?
The names of these projects are as diverse as they are whimsical: Hadoop, Voldemort, Dynomite, and others.
But they are generally unified by a few things, including:
Don't call them databases. Amazon's CTO, Werner Vogels, refers to the company's influential Dynamo system as a "highly available key-value store." Google calls its BigTable, the other role model for many NoSQL adherents, a "distributed storage system for managing structured data."
They can blow through enormous amounts of data.Hypertable, an open-source column-based database modelled upon BigTable, is used by local search engine Zvents to write 1 billion cells of data per day, according to a presentation by Doug Judd (PDF document), a Zvents engineer.
