DataDoc Methodology

DataDoc provides a methodology for using Parquet and embedded JSON-LD to support a superset of features provided by the traditional statistical data file formats of SAS, SPSS, and Stata.

DataDoc is used for both online analytics and archiving of research data.

Incorporating Multiple Metadata Standards

In addition to its own definitions, pieces of several other well-known ontologies or systems are incorporated into the DataDoc methodology.

• The tabular dataset and column descriptions make use of a subset of the W3C tabular metadata standard.
• Code lists for values and missing values are represented by a portion of the SKOS vocabulary with several extensions for ranged values.
• The Dublin Core vocabulary is used for descriptive citation information.
• Several terms from the DDI Lifecycle 4 Beta RDF.
• Several terms from Apache Iceberg’s format metadata.
• UNF data fingerprints.

Development

• The DataDoc ontology is managed via LinkML.
• Mappings to other ontologies via SSSOM.

Upcoming Tools

• Python pandas integration
• Colectica Datasets

Coming Soon!

Announcement Newsletter Signup