Scientific applications face unique problems that are not readily addressed by existing data management tools. Specifically, information sources often do not share a common terminology, have a variety of data representation formats and management architectures, and exhibit complex relationships between data and tools used to analyze the data.
SDSC excels at integrating data, especially big or “messy” data (think unmonitored crowdsourced data with little or no thought given to metadata needs). We understand that data arrives in many states and formats, and from many sources with different standards. Our experts specialize in all aspects of data integration, including ontology building, file formatting, setting metadata standards, coordinating space conversions, and visualization.
SDSC’s Open Earth Framework visualization tools integrate world terrain maps with earthquake epicenter logs and subsurface models for the western US to reveal correlations between observed events and subsurface structures.
Learn more at Open Earth Framework
Many scientific discoveries today are a result of collaborations between researchers sharing data and resources. By allowing scientists to share data and tools (services) via the web, we can enable interactions between a larger group of researchers working on a common problem.
Researchers from the Advanced Cyberinfrastructure Development group at SDSC have developed a data integration framework in the realm of the geosciences. The goal is to respond to the pressing need in the geosciences to interlink and share multi-disciplinary datasets to understand the complex dynamics of Earth systems. Creating a infrastructure to integrate, analyze, and model geoscientific data poses many challenges due to the extreme heterogeneity of geoscience data formats, storage and computing systems and, most importantly, the ubiquity of differing conventions, terminologies, and ontological frameworks across disciplines. The data integration framework is distinct from other efforts in scientific data management due to: