Object store/active store designed for streaming data analysis
Shock is an object store / active store designed for streaming data analysis. It is intended for scientific data.
One of the challenges of large volume scientific data is that without often complex metadata it is of little to no value. Shock allows storage and querying of complex metadata.With a RESTful interface and a deliberately simple structure, SHOCK is used to stream large data volumes (current largest deployment is 1 PB) to hundreds of computational nodes for parallel data analytics.
SHOCK is used by MG-RAST as well as by other projects such as DOE KBase.