NESDIS Satellite Product Metadata

From NGDCWiki

(Difference between revisions)
Jump to: navigation, search
(Consolidated Product List)
m (Replacing page with 'out of date content - see history tab')
Line 1: Line 1:
-
NESDIS is continuing to work to improve documentation for our Satellite data and products. At present documentation is spread across many documents, databases, and file systems. We are now trying to unify this information into the Satellite Products End-to-End Documentation System (SPEEDS). The near-term goal is to unite SATPROD with the NOAA Metadata Manager and Repository. This will transition the SATPROD content into a standard framework based on the FGDC Remote Sensing Extensions with some ISO components. These metadata will then be shared with GeoSpatial One-Stop, NASA's Global Change Master Directory (GCMD), and FirstGov.
+
out of date content - see history tab
-
 
+
-
This page is the main source for information about SPEEDS and other information related to this aspect of NESDIS Satellite Product Metadata.
+
-
 
+
-
==Login to Editing System==
+
-
''The SPEEDS Database Editor requires that you [http://www.ngdc.noaa.gov/idb/struts/login login] to the Interface Database System using the user name and password that we gave you. You only need to login once per session. Once you log in, you will go to an Interface Database Utilities page. Press the back button once and you will be back where you started!''
+
-
==Weekly Meetings==
+
-
[[SPEEDS_GoTo_Meeting_Notes| SPEEDS Meetings]] are held on Tuesdays and Fridays, at 3 EST.
+
-
 
+
-
==POP Searches==
+
-
[[Image:POP List.png|thumb|POP List]]
+
-
At this point we are ready for PALs and POPs to review their SPEEDS content. We are starting that process by providing a [http://www.ngdc.noaa.gov/idb/struts/results?&t=103012&s=14&d=14 POP search] (Figure at right) that provides links to several views for each POP. At this point use these views to identify information that might need updating. We will worry about doing the updates later.
+
-
 
+
-
''Product List''
+
-
[[Image:ProductList.png|thumb|Product List]]
+
-
The first link goes to a list of products that are associated with each POP. This is the list you can use to identify out of date or even non-existent products. It also allows you to identify information about products that needs to be updated.
+
-
 
+
-
''Instruments / Channels''
+
-
[[Image:InstrumentList.png|thumb|Instrument List]]
+
-
We know that the SPEEDS information about Instruments and Channels may be incorrect for various reasons. At the same time, this information is critical to making SPEEDS work as a tool for finding users that may be impacted by various outages. The Instruments link shows the instruments and satellites associated with each product for a given POP. This view allows the POPs to identify associations between products, instruments, and satellites that might be incorrect for a variety of reasons.
+
-
 
+
-
[[Image:ChannelList.png|thumb|Channel List]]
+
-
The Channel link on this page provides details about the Channels that are used to create specific products. We know that this information is incorrect in many cases because of the paucity of information available when these channels were input into the database. At this point this display does not include an editing interface, but if it makes sense, we will add that.
+
-
 
+
-
''Links''
+
-
 
+
-
The Links link on this page shows the URLs that are currently associated with datasets. These are just simple strings. The ISO Metadata Standard provides a more robust model for Online Resources that include names (titles), descriptions, and functions (see the HTML links for the [http://www.ngdc.noaa.gov/metadata/published/19115/NESDIS_Products/1list.html ISO Metadata examples for NESDIS Products] for examples).
+
-
 
+
-
''Problem Links''
+
-
 
+
-
[http://www.orbit.nesdis.noaa.gov/goes/gcip/ GSIP Insolation CONUS (Surface)]<br>
+
-
[http://sgiot2.wwb.noaa.gov/COASTWATCH/prod02.htm CoastWatch IR Imagery (GOES)]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/goes/sdpi/ New DPI Lifted Index (Imager)]<br>
+
-
[http://www.ssd.noaa.gov/PS/CLAVRXGRIDCELL/ Cloud Flags (CLAVR)]<br>
+
-
[http://www.osdpd.noaa.gov/PSB/mirs Cloud Liquid Water (MIRS)]<br>
+
-
[http://www.ssd.noaa.gov/PS/TROP/genesis.html Tropical Cyclone Formation Parameters]<br>
+
-
[http://orbit29i.nesdis.noaa.gov Algal Bloom Emiliania huxleyi]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/arad/ht/ff/swi.html Soil Wetness Index Daily (SSM/I)]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/arad/ht/ff/pw.html Total Precipitable Water (Blended)]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/arad/fpdt/mb.html Maximum Theta-E Difference]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/goes/soundings/ Cross Sections- Mixing Ratios]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/arad/fpdt/turb.html Turbulence Index (TI) Daily]<br>
+
-
[http://sgiot2.wwb.noaa.gov/COASTWATCH/prod02.htm CoastWatch SST (GOES)]<br>
+
-
[http://orbit35i.nesdis.noaa.gov/orad/sub/circulation.html Ocean Surface Current Analysis]<br>
+
-
[http://manati.wwb.noaa.gov/oppt/sar/oil.html Oil Spill Mapping (SAR)]<br>
+
-
[http://manati.wwb.noaa.gov/oppt/sar/fish.html Vessel Positions-Fishery Monitoring/Enforcement]<br>
+
-
[http://www.orbit.nesdis.noaa.gov/goes/winds/ High Density IR Cloud Drift Winds (GOES)]<br>
+
-
 
+
-
 
+
-
By the way, the number of products / POP is:
+
-
<table width="50%">
+
-
<tr><td>COP</td><td>0</td><td>EPOP</td><td>35</td></tr>
+
-
<tr><td>ICAPOP</td><td>145</td><td>LSPOP</td><td>104</td></tr>
+
-
<tr><td>NOP</td><td>0</td><td>OCPOP</td><td>24</td></tr>
+
-
<tr><td>OPOP</td><td>55</td><td>PPOP</td><td>28</td></tr>
+
-
<tr><td>SOP</td><td>30</td><td>SPOP</td><td>94</td></tr>
+
-
<tr><td>WPOP</td><td>46</td><td>ACPOP</td><td>24</td></tr>
+
-
<tr><td>IDPOP</td><td>40</td></tr>
+
-
</table>
+
-
 
+
-
==Consolidated Product List==
+
-
[[Image:CPL.png|thumb|CPL Interface]]
+
-
The [http://www.ngdc.noaa.gov/speeds Consolidated Product List] provides access to information about NESDIS Satellite Products. It is presented as a dynamic list with the following capabilities:
+
-
* ''Filters'' - Radio buttons and a select box on the bottom left of the screen allow the user to filter the display by status (Developmental/Operational) or by Satellite Program.
+
-
* ''Column Sort'' - Click on the column title once or twice to sort the display by that column.
+
-
* ''Column Arrange'' - Press, hold, and drag a column title to rearrange the horizontal order of the columns.
+
-
* ''Export to CSV'' - Press the CSV Export button at the bottom of the display to export the currently displayed items as a Comma Separated Values (CSV) file. Add the ".csv" extension to the file name in the save dialog box to open the file with Excel.
+
-
* ''Product Details'' -  Click anywhere in the row for a product to see details for that product.
+
-
 
+
-
==Product Detail URL List==
+
-
 
+
-
The [http://www.ngdc.noaa.gov/nndc/struts/form?t=103006&s=250&d=250 Product Detail URL List] displays a list of products and the URL to the Product Details.
+
-
* Search by Measurement Category, Satellite Program, or Product Oversight Panel.
+
-
* Click on the URL so see the Product Detail Page.
+
-
 
+
-
==Links to Development Views==
+
-
===SPEEDS Interface===
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=102905&s=225&d=700 Using curl files] <br>
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=102905&s=225&d=800 Using database tables]<br>
+
-
 
+
-
===Product Searches===
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=102905&s=225&d=400 Search Measurement Categories]<br>
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=102905&s=225&d=404 Search Satellites]<br>
+
-
 
+
-
==Consistency Checks==
+
-
[http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.DATAFILE&sourceId=101691 Products] | [http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.CHANNEL&sourceId=101691 Channels] | [http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.INSTRUMENT&sourceId=101691 Instruments] | [http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.SATELLITE&sourceId=101691 Satellites] | [http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.LEVEL1BNOTICE2&sourceId=101691 Notices]
+
-
 
+
-
==Level1B Notices==
+
-
NESDIS notifies users of problems or changes in the Level1b data systems using the [http://www.osdpd.noaa.gov/PSB/PPP/notices/notices.html  Level 1B Notices] page. These notices have been created by hand over the years and are currently stored in a directory of html files. The SPEDDS project has ingested these notices into a database in order to improve consistency across all of the notices and to improve searchability and access.
+
-
 
+
-
The [http://www.ngdc.noaa.gov/idb/struts/results?eq_0=&ge_0=&le_0=&t=102953&s=100&d=30 SPEEDS Level 1b Notices] page and the notices linked to from that page mimic the current access approach and formatting. A [http://www.ngdc.noaa.gov/idb/struts/form?t=102953&s=30&d=30 Search] page and a [http://www.ngdc.noaa.gov/idb/tableMetadata.jsp?table=SATPROD.LEVEL1BNOTICE2&sourceId=101676 Histogram Viewer] are also available.
+
-
 
+
-
==SPEEDS Database Editor==
+
-
''The SPEEDS Database Editor requires that you [http://www.ngdc.noaa.gov/idb/struts/login login] to the Interface Database System using the user name and password that we gave you. You only need to login once per session. Once you log in, you will go to an Interface Database Utilities page. Press the back button once and you will be back here!''
+
-
 
+
-
The SPEEDS Database Editor is available for the following entities:
+
-
<table>
+
-
<tr>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=2&d=2 Product]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=10&d=10 Instrument]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=11&d=11 Keyword]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=13&d=13 Platform]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=14&d=14 POP]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=15&d=15 Processing System]</td><td>&nbsp;</td>
+
-
</tr>
+
-
<tr>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=1&d=1 Channel]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=16&d=16 Program]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=18&d=18 Satellite]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=22&d=22 Thesarus]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=25&d=25 Users]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=9&d=9 Glossary]</td>
+
-
</tr>
+
-
<tr>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=35&d=35 Requirements]</td>
+
-
<td>[http://www.ngdc.noaa.gov/idb/struts/form?t=103012&s=8&d=8 Formats]</td>
+
-
</tr>
+
-
 
+
-
</table>
+
-
The Editor has several views that are described below:
+
-
<table border="1" cellpadding="5">
+
-
<tr>
+
-
<td valign="top">
+
-
===Complete Search===
+
-
The complete search is available for each type of SPEEDS object, listed in the title and the header as the search target. Search values can be entered for text, numeric, and date fields. The required date formats are listed above each date field (yyyy/MM/DD in this case).</td>
+
-
<td valign="top">
+
-
[[Image:completeSearch.png|200 px]]</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
===Display===
+
-
The results of the search are displayed in a table on the next page with the search criteria are at the top of the list. The details of the displays are different for each type of object and the will certainly evolve with time. We expect the general features to remain the same.
+
-
 
+
-
There are three options for editing this content: Edit All Rows, Edit Single Row, and Create New Row.
+
-
</td>
+
-
<td valign="top">
+
-
[[Image:Display.png|200 px]]
+
-
</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
===Edit All Rows===
+
-
The Edit All Rows Interface allows users to update all of the rows in the current display and to cut and paste content between rows. The details of the displays are different for each type of object and the will certainly evolve with time. We expect the general features to remain the same.
+
-
 
+
-
Press the Update Record button when the changes are done to go to the Change Preview page.
+
-
</td>
+
-
<td valign="top">[[Image:EditAllRows.png|200 px]]
+
-
</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
 
+
-
===Edit Single Row===
+
-
The Edit Single Row Interface allows users to update all of the fields for a single row. The details of the displays are different for each type of object and the will certainly evolve with time. We expect the general features to remain the same.
+
-
 
+
-
Press the Update Record button when the changes are done to go to the Change Preview page.
+
-
</td>
+
-
<td valign="top">[[Image:EditSingleRow.png|200 px]]</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
 
+
-
===Create New Row===
+
-
The Create New Row Interface allows users to create a new row in the database using an existing row as a starting point. The details of the displays are different for each type of object and the will certainly evolve with time. We expect the general features to remain the same.
+
-
 
+
-
Press the Insert Record button when the changes are done to go to the Change Preview page.
+
-
</td>
+
-
<td valign="top">[[Image:CreateNewRow.png|200 px]]</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
 
+
-
===Change Preview===
+
-
This page allows the user to compare the old and new values for each change that are going to be made to the database. The changes '''have not''' been made when this page is displayed, so the user can use the back button to return to the editing page and revise the updates.
+
-
 
+
-
Press the Execute Updates button to make the changes.
+
-
</td>
+
-
<td valign="top">[[Image:ChangePreview.png|200 px]]</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
 
+
-
===Confirmation===
+
-
This page confirms that changes have been made to the database. The rows are colored green if the change only affects one row. This is the expected behavior, so '''Green is Good'''. Please let Ted or Denise know if red cells show up!
+
-
</td>
+
-
<td valign="top">[[Image:Confirmation.png|200 px]]</td>
+
-
</tr>
+
-
<tr>
+
-
<td valign="top">
+
-
 
+
-
===Display Changes===
+
-
After you have made changes to the database press the back button three times and reload to see the updated contents.
+
-
</td>
+
-
<td valign="top">[[Image:DisplayChanges.png|200 px]]</td>
+
-
</tr>
+
-
</table>
+
-
 
+
-
==SPEEDS RSS Feeds==
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=103012&s=25&d=725 Users]
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=103012&s=1&d=701 Channels]
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=103012&s=8&d=708 Formats]
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=103012&s=10&d=710 Instruments]
+
-
*[http://www.ngdc.noaa.gov/idb/struts/results?t=103012&s=13&d=713 Platforms]
+
-
 
+
-
==SATPROD Database==
+
-
* [[SATPROD Database Design]]
+
-
* [[SATPROD Database Characteristics]]
+
-
* [[SATPROD Database Diagram]]
+
-
* [[SATPROD Channel Information]]
+
-
* [[SATPROD Consistency]]
+
-
 
+
-
==Metadata Standards==
+
-
===Keywords===
+
-
[[NESDIS Satellite Product Keywords]]<br>
+
-
 
+
-
===Remote Sensing Extensions===
+
-
* [[FGDC Remote Sensing Extensions Instrument Information | Instrument Information]]
+
-
 
+
-
===ISO 19115 and Related Standards===
+
-
* [[ISO 19115 Instrument Information | Instrument Information]]
+
-
 
+
-
==Metadata Matchups==
+
-
[[NESDIS Satellite Product Metadata Matchups | SATPROD/NMMR Matchups]]
+
-
 
+
-
==Lineage==
+
-
===Graph Markup Language===
+
-
<table>
+
-
<tr>
+
-
<td align="top">[http://graphml.graphdrawing.org/ Graph Markup Language] can be used to describe a graph using XML. The language involves describing nodes and edges (links between nodes). The SATPROD database includes information about input and output products for almost 50 [http://www.ngdc.noaa.gov/idb/struts/results?t=102853&s=60&d=61 processing systems]. This information can also be viewed by [http://www.ngdc.noaa.gov/idb/struts/results?t=102853&s=60&d=70 datafile]. Can this information be used with GraphML to create simple flow charts?
+
-
 
+
-
This plot (for the NRT Processing System) serves as a legend for this version of the plots (all of these can be changed easily). This plot shows the two Product Groups (red boxes) that are related to the NRT Processing System (purple hexagon). These Product Groups have three types of associated Datafiles. Primary Inputs are shown as dark yellow ellipses connected to the Product Groups with solid lines. There is only one in this case. Secondary Inputs are shown as light yellow ellipses connected to the Product Groups with dashed lines. Again, there is only one in this case. Primary Outputs are shown as dark yellow hexagons connected to the Product Groups with purple dotted lines. There are three in this case.</td>
+
-
<td>[[Image:DataFlowLegend.png|300px|Dataflow Diagram Legend]]</td>
+
-
</tr>
+
-
</table>
+
-
 
+
-
Some other samples:
+
-
<table>
+
-
<tr>
+
-
<td>[[Image:GVI2.png|thumb|Product Groups and Datafiles related to the GVI2 Processing System]]</td>
+
-
<td>[[Image:GINI2.png|thumb|Product Groups and Datafiles related to the GINI2 Processing System]]</td>
+
-
<td>[[Image:ATOVS-Clouds.png|thumb|Datafiles related to the AOVS-Clouds Product Group ]]</td>
+
-
<td>[[Image:SSMT2.png|thumb|Product Groups and Datafiles related to the SSM/T2 Processing System]]</td>
+
-
<td>[[Image:ATOVS.png|thumb|Datafiles related to the ATOVS Processing System]]</td>
+
-
</tr>
+
-
</table>
+
-
See [[All Processing System Plots]]
+
-
 
+
-
These plots are provided in graphML which can be displayed and edited using the free graph editor yEd which is available from [http://www.yworks.com YWorks].
+
-
 
+
-
[[Category:NESDIS Satellite Product Metadata]]
+
-
[[Category:Metadata]]
+

Revision as of 14:49, 30 April 2013

out of date content - see history tab

Personal tools