Data Stewardship Maturity Matrix Maturity Scales for Key Components Codelists for description of "datastewardship assessment results" ... compliant with ISO/TC 211 19115:2003 and 19139 GMX (and imported) namespace 1.0 2017-01-06 The state of being preservable Preservability Assessment not performed. Level 0. notAssessed Data is not preserved. Level 0. notAvailable Preservability Level 1 Ad Hoc. Not Managed. Any storage location. Data only. Level 1. adHoc Preservability Level 2 Minimal. Managed Limited. Non-designated repository. Redundancy . Limited archiving metadata. Level 2. minimal Preservability Level 3 Intermediate. Managed. Defined, partially implemented. Designated archive. Redundancy. Community-standard archiving metadata. Conforming to limited archiving standards. intermediate Preservability Advanced. Managed. Well-Defined, Fully Implemented. Level 3 +. Conforming to community archiving standards. advanced Preservability Level 5 Optimal. Level 4 +. Measured , Controlled , Audit. Level 4 +. Archiving process performance controlled, measured, and audited. Future archiving standard changes planned. optimal The state of being searchable and accessible publicly Accessibility Assessment not performed. Level 0. notAssessed Data is not accessed. Level 0. notAvailable Accessibility Level 1 Not publicly available Person-to-person adHoc Accessibility Level 2 Publicly available Direct file download (e.g., via anonymous FTP server) Collection/dataset level searchable online minimal Accessibility Level 3 Level 2 + Non-standard data service Limited data server performance Granule/file level searchable Limited search metrics intermediate Accessibility Level 4 Level 3 + Community-standard data service Enhanced data server performance Conforming to community search metrics Dissemination report metrics defined and implemented internally advanced Accessibility Level 5 Level 4 + Dissemination reports available online Future technology and standard changes planned optimal The state of being easy to use. Usability Assessment not performed. Level 0. notAssessed Data is not used. Level 0. notAvailable Usability Level 1 Extensive product-specific knowledge required No documentation online adHoc Usability Level 2 Non-standard data format Limited documentation (e.g., user’s guide) online minimal Usability Level 3 Community standard-based interoperable format and metadata Documentation (e.g., source code, product algorithm document, processing or/and data flow diagram) online intermediate Usability Level 4 Level 3 + Basic capability (e.g., subsetting, aggregating) and data characterization (overall/global, e.g., climatology, error estimates) available online advanced Usability Level 5 Level 4 + Enhanced online capability (e.g., visualization, multiple data formats) Community metrics of data characterization (regional/cell) online External ranking optimal The state of data production being sustainable and extendable. ProductionSustainability Assessment not performed. Level 0. notAssessed Data is not sustainable in production. Level 0. notAvailable Production Sustainability Level 1 Ad Hoc or Not applicable. No obligation or deliverable requirement. adHoc Production Sustainability Level 2 Short-term Individual PI’s commitment (grant obligations). minimal` Production Sustainability Level 3 Medium-term Institutional commitment (contractual deliverables with specs and schedule defined). intermediate Production Sustainability Level 4 Long-term Institutional commitment. Product improvement process in place. advanced Production Sustainability Level 5 Level 4 + National or international commitment. Changes for technology planned. optimal The state of data quality being assured. DataQualityAssurance Assessment not performed. Level 0. notAssessed Data quality is not assured. Level 0. notAvailable Data Quality Assurance Level 1 Data quality assurance (DQA) procedure unknown or none. adHoc Data Quality Assurance Level 2 Ad Hoc and random DQA procedure not defined and documented. minimal Data Quality Assurance Level 3 DQA procedure defined and documented and partially implemented. intermediate Data Quality Assurance Level 4 DQA procedure well documented, fully implemented and available online with master reference data Limited data quality assurance metadata. advanced Data Quality Assurance Level 5 Level 4 + DQA procedure monitored and reported Conforming to community quality metadata and standards External review. optimal The state of data quality being controlled and monitored. DataQualityControlMonitoring Assessment not performed. Level 0. notAssessed Data quality control is not monitored. Level 0. notAvailable Data Quality Control Monitoring Level 1 None or Sampling unknown or spotty Analysis unknown or random in time. adHoc Data Quality Control Monitoring Level 2 Sampling and analysis are regular in time and space Limited product-specific metrics defined and implemented minimal Data Quality Control Monitoring Level 3 Level 2+ Sampling and analysis are frequent and systematic but not automatic Community metrics defined and partially implemented Procedure documented and available online intermediate Data Quality Control Monitoring Level 4 Level 3 + Anomaly detection procedure well-documented and fully implemented using community metrics, automatic, tracked and reported Limited quality monitoring metadata advanced Data Quality Control Monitoring Level 5 Level 4 + Cross-validation of temporal and spatial characteristics Physical consistency check Conforming to community quality metadata and standards Dynamic providers/users feedback in place optimal The state of data quality being assessed. DataQualityAssessment Assessment not performed. Level 0. notAssessed Data quality is not assessed. Level 0. notAvailable Data Quality Assessment Level 1 Algorithm/method/model theoretical basis assessed (methods and results online) adHoc Data Quality Assessment Level 2 Level 1 + Research product assessed (methods and results online) minimal Data Quality Assessment Level 3 Level 2 + Operational product assessed (methods and results online) intermediate Data Quality Assessment Level 4 Level 3 + Operational product assessed (methods and results online) advanced Data Quality Assessment Level 5 Level 4 + Operational product assessed (methods and results online) optimal The state of being transparent, trackable, and traceable. TransparencyTraceability Assessment not performed. Level 0. notAssessed Transparency and Traceability is not assessed. Level 0. notAvailable Transparency Traceability Level 1 Limited product information available. Person-to-person. adHoc Transparency Traceability Level 2 Product information available in literature. minimal Transparency Traceability Level 3 Algorithm Theoretical Basis Document (ATBD) and source code online Dataset configuration managed (CM) Unique Object Identifier (OID) assigned (dataset, documentation, source code) Data citation tracked (e.g., utilizing Digital Object Identifier (DOI) system). intermediate Transparency Traceability Level 4 Level 3 + Operational Algorithm Description (OAD) online, OID assigned, and under CM. advanced Transparency Traceability Level 5 Level 4 + System information online Complete data provenance online. optimal The state of data integrity being verifiable. DataIntegrity Assessment not performed. Level 0. notAssessed Data Integrity is not assessed. Level 0. notAvailable Data Integrity Level 1 Unknown or no data ingest integrity check. adHoc Data Integrity Level 2 Data ingest integrity verifiable (e.g., checksum technology). minimal Data Integrity Level 3 Level 2 + Data archive integrity verifiable. intermediate Data Integrity Level 4 Level 3 + Data access integrity verifiable Conforming to community data integrity technology standard. advanced Data Integrity Level 5 Level 4 + Data authenticity verifiable (e.g., data signature technology) Performance of data integrity check monitored and reported. optimal