Scientific facilities and large scale experiments produce huge amounts of data up to hundreds of terabytes per day. A data facility serving many scientific communities with huge data volumes faces the typical problems in handling Big Data, e.g. capacities, data rates and data heterogeneity.

Several high level publications recommend activities [1,2,3] to address the involved problems, but a general solution and adequate services and tools are currently not available.

In the expert group "Software Methods" we develop and integrate cutting-edge technologies to provide new methods for:

  • federated data and meta data management
  • data and meta data organization
  • high performance data ingest and access
  • software for data management services
  • Large Scale Data Facility at KIT


LSDM

Copyright by SWM, KIT – Universität des Landes Baden-Württemberg und nationales Forschungszentrum in der Helmholtz-Gemeinschaft
Templates Joomla 1.7 by Wordpress themes free