The Next-gen Databases [closed]

by

I would say next-gen database, not next-gen SQL.

SQL is a language for querying and manipulating relational databases. SQL is dictated by an international standard. While the standard is revised, it seems to always work within the relational database paradigm.

Here are a few new data storage technologies that are getting attention currently:

  • CouchDB is a non-relational database. They call it a document-oriented database.
  • Amazon SimpleDB is also a non-relational database accessed in a distributed manner through a web service. Amazon also has a distributed key-value store called Dynamo, which powers some of its S3 services.
  • Dynomite and Kai are open source solutions inspired by Amazon Dynamo.
  • BigTable is a proprietary data storage solution used by Google, and implemented using their Google File System technology. Google’s MapReduce framework uses BigTable.
  • Hadoop is an open-source technology inspired by Google’s MapReduce, and serving a similar need, to distribute the work of very large scale data stores.
  • Scalaris is a distributed transactional key/value store. Also not relational, and does not use SQL. It’s a research project from the Zuse Institute in Berlin, Germany.
  • RDF is a standard for storing semantic data, in which data and metadata are interchangeable. It has its own query language SPARQL, which resembles SQL superficially, but is actually totally different.
  • Vertica is a highly scalable column-oriented analytic database designed for distributed (grid) architecture. It does claim to be relational and SQL-compliant. It can be used through Amazon’s Elastic Compute Cloud.
  • Greenplum is a high-scale data warehousing DBMS, which implements both MapReduce and SQL.
  • XML isn’t a DBMS at all, it’s an interchange format. But some DBMS products work with data in XML format.
  • ODBMS, or Object Databases, are for managing complex data. There don’t seem to be any dominant ODBMS products in the mainstream, perhaps because of lack of standardization. Standard SQL is gradually gaining some OO features (e.g. extensible data types and tables).
  • Drizzle is a relational database, drawing a lot of its code from MySQL. It includes various architectural changes designed to manage data in a scalable “cloud computing” system architecture. Presumably it will continue to use standard SQL with some MySQL enhancements.
  • Cassandra is a highly scalable, eventually consistent, distributed, structured key-value store, developed at Facebook by one of the authors of Amazon Dynamo, and contributed to the Apache project.
  • Project Voldemort is a non-relational, distributed, key-value storage system. It is used at LinkedIn.com
  • Berkeley DB deserves some mention too. It’s not “next-gen” because it dates back to the early 1990’s. It’s a popular key-value store that is easy to embed in a variety of applications. The technology is currently owned by Oracle Corp.

Also see this nice article by Richard Jones: “Anti-RDBMS: A list of distributed key-value stores.” He goes into more detail describing some of these technologies.

Relational databases have weaknesses, to be sure. People have been arguing that they don’t handle all data modeling requirements since the day it was first introduced.

Year after year, researchers come up with new ways of managing data to satisfy special requirements: either requirements to handle data relationships that don’t fit into the relational model, or else requirements of high-scale volume or speed that demand data processing be done on distributed collections of servers, instead of central database servers.

Even though these advanced technologies do great things to solve the specialized problem they were designed for, relational databases are still a good general-purpose solution for most business needs. SQL isn’t going away.

I’ve written an article in php|Architect magazine about the innovation of non-relational databases, and data modeling in relational vs. non-relational databases. http://www.phparch.com/magazine/2010-2/september/

More Related Contents:

  1. Database EAV Pros/Cons and Alternatives
  2. SQL Data models
  3. Solutions for INSERT OR UPDATE on SQL Server
  4. How to randomly select rows in SQL?
  5. What’s the difference between TRUNCATE and DELETE in SQL
  6. SQL best practice to deal with default sort order
  7. How can I get column names from a table in Oracle?
  8. How Can I use “Date” Datatype in sql server?
  9. single fixed table with multiple columns vs flexible abstract tables
  10. Primary key or Unique index?
  11. How to get a list of column names on Sqlite3 database?
  12. How to run a stored procedure in sql server every hour?
  13. Composite Primary key vs additional “ID” column?
  14. Questions every good Database/SQL developer should be able to answer [closed]
  15. Why do you create a View in a database?
  16. Logging ALL Queries on a SQL Server 2008 Express Database?
  17. Storing time-series data, relational or non?
  18. Best database field type for a URL
  19. MySQL – how to front pad zip code with “0”?
  20. Oracle (Old?) Joins – A tool/script for conversion?
  21. sqlite select with condition on date
  22. How can I implement SQL INTERSECT and MINUS operations in MS Access
  23. Postgres Error: More than one row returned by a subquery used as an expression
  24. Does ‘Select’ always order by primary key?
  25. How do I create and query linked database servers in SQL Server?
  26. What does ON [PRIMARY] mean?
  27. How do you interpret a query’s explain plan?
  28. Oracle DB: How can I write query ignoring case?
  29. PostgreSQL nested INSERTs / WITHs for foreign key insertions
  30. SQL Server equivalent of WM_CONCAT function [duplicate]

Leave a Comment