Facebook , Google , LinkedIn , and Twitter today announced WebScaleSQL , a collaborative project where engineers from these companies will begin working together to solve challenges created by massive databases.
As its name suggests, WebScaleSQL is a customized version of MySQL and is designed for large web projects.
The four companies will work in parallel to create a new MySQL, which will be available to the public as it will be open source. MySQL technicians will also help in the project, and since it will be open, it is expected that many others who have the ability and resources will follow.
In a blog post, Facebook revealed who the technicians involved in WebScaleSQL will be and how they envision the new project so far:
- An automated framework that will, for each proposed change, run and publish the results of MySQL's built-in test system (mtr).
- A full new suite of stress tests and a prototype automated performance testing system.
- Several changes to the tests already found in MySQL, and to the structure of some existing code, to avoid problems where otherwise safe code changes had previously caused tests to fail or caused unnecessary conflicts. These changes make it easier to work on the code and helped us get started creating WebScaleSQL.
- Several changes to improve the performance of WebScaleSQL, including buffer pool flushing improvements (links here and here); optimizations to certain types of queries? support for NUMA interleave policy? and more.
- New features that make operating WebScaleSQL at true web scale easier, such as super_read_only, and the ability to specify sub-second client timeouts.

