Data Notification
Restructuring of Stream morphology map (DP4.00131.001) and Bathymetric and morphological maps (DP4.00132.001) data products
December 2, 2024
Stream morphology map and Bathymetric and morphological maps data products have been restructured to improve the usability of data contained in the download packages.
No protocol changes have been implemented in either data product. Changes described herein include only how datasets are now structured and presented.
The changes described below have been applied to the full period of record for both Stream morphology map and Bathymetric and morphological maps data products. The survey data provided as zip files with URL link in the downloaded data have been versioned for ease of use.
The changes described below have been applied to Provisional data. All data in RELEASE-2025 (to be published in January 2025) will include these changes. Because data Releases are static, data in previous Releases retain the original data formatting.
Changes to Stream morphology map (DP4.00131.001)
Eleven new data tables have been created which contain data that were previously available from cloud-storage locations and accessed via download links. These data have been re-structured and are now automatically included in basic and expanded download packages.
New tables for the Stream morphology map data product are listed in the table below.
| NEW TABLE NAME | NEW TABLE DESCRIPTION | DOWNLOAD PACKAGE |
|---|---|---|
| surveySummary | Summary data associated with the survey, including summary statistics such as survey completeness, physical channel characteristics, relationships between upstream and downstream sensor sets, and data download URLs | Basic |
| geomorphicFeatureCount | The type and total count of all geomorphic features mapped during the survey | Basic |
| processedSurveyData | Survey data generated during post-processing, including point classifications and real-world coordinates | Basic |
| thalwegByHabitatID | Data that describe each stream habitat unit mapped during the survey | Basic |
| thalwegByHabitatType | Summary level data for stream habitat units mapped during the survey | Basic |
| thalwegLongProfile | Data associated with points mapped on the streambed along the thalweg | Basic |
| transectBankfullWidths | Data that describe channel widths measured at mapped cross-section transects | Basic |
| rapidHabitatAssessment | Data associated with the rapid habitat assessment portion of the stream morphology protocol | Basic |
| trimbleData | Field collected spatial data | Expanded |
| rawSurveyData | Raw data generated during the survey, including a unique identifier and raw coordinate values for each point mapped | Expanded |
| surveyPoints | Data associated with mapped cross-section transects used to delineate hydrologic controls | Expanded |
Three data tables are no longer included in the Stream morphology map data product. Data that were previously contained in these tables are now included in new data tables that accompany the download package. Details are provided in the table below.
| REMOVED TABLE NAME | DETAILS |
|---|---|
| surveyFieldData | pebbleCountD5, pebbleCountD16, pebbleCountD50, and pebbleCountD84 fields are now contained in the pebbleFieldData table; the missingLineWorkflow field is now contained in the missingLine table |
| resultsFile | All fields that were formerly contained in this table are now included in the surveySummary table |
| rapidHabitatResultsFile | All fields that were formerly contained in this table are now included in the surveySummary table |
Certain datafiles associated with the Stream morphology map data product are contained in cloud-based storage locations and are accessed via URL links found in the surveySummary table (provided in both basic and expanded download packages). URL links contained in the dataFilePath field of this table provide users with post-processed data and links contained in the rawDataFilePath field provide users with raw data. These file types and the associated download link type are described in the table below.
| FILE TYPE | DOWNLOAD LINK FIELD NAME |
|---|---|
| Post-processed spatial data | dataFilePath |
| Spatial maps | dataFilePath |
| Survey field notes (if available) | dataFilePath |
| Post-processing notes | dataFilePath |
| Field collected spatial data (if collected) | rawDataFilePath |
Changes to Bathymetry and morphological maps (DP4.00132.001)
Six new data tables have been created, which contain data that were previously available from cloud-based storage locations and accessed via URL links. These data have been re-structured and are now automatically included in basic download packages.
New tables for the Bathymetric and morphological maps data product are listed in the table below.
| NEW TABLE NAME | NEW TABLE DESCRIPTION | DOWNLOAD PACKAGE |
|---|---|---|
| processedSiteLevelSummary | Summary data associated with the survey, including summary statistics and data download URLs | Basic |
| processedSonarTrackData | Summary data for the sonar track csv available in cloud-storage including data download URLs | Basic |
| processedVolumeData | Calculated volume values for each survey by water depth | Basic |
| processedHabitatResults | Assigned habitat types for each survey determined by sonar bottom type analysis and field ground truth data | Basic |
| processedPlantCoverage | Assigned plant coverage bins for all 2020 surveys and on determined by sonar plant analysis and field ground truth data | Basic |
| groundTruthPoints | Ground truth points metadata and spatial data when available | Basic |
Two data tables are no longer included in the Bathymetric and morphological maps data product. Data that were previously contained in these tables are now included in new data tables that accompany the download package. Details are provided in the table below.
| REMOVED TABLE NAME | DETAILS |
|---|---|
| resultsFile | All fields that were formerly contained in this table are now included in the processedSiteLevelSummary table |
| pointCollection | All fields that were formerly contained in this table are now included in the groundTruthPoints table |
Certain datafiles associated with the Bathymetric and morphological maps data product are still contained in cloud-based storage locations and accessed via links found in the processedSiteLevelSummary or processedSonarTrackData basic download package tables. The new versions of the L4 packages can be identified as having version E. Links contained in the dataFilePath or downloadFieldUrl fields provide users with processed data and links contained in the rawDataFilePath field provide users with raw data (see table below for more details). Downloading the ‘expanded’ package via neonUtilities will automatically download the processedSonarTrack.csv that is contained in cloud-based storage. These file types and the associated download link type are described in the table below.
| FILE TYPE | TABLE | DOWNLOAD LINK FIELD NAME |
|---|---|---|
| Post-processed spatial data | processedSiteLevelSummary | dataFilePath |
| Spatial maps | processedSiteLevelSummary | dataFilePath |
| Processed sonar data files | processedSiteLevelSummary | dataFilePath |
| Processing notes | processedSiteLevelSummary | dataFilePath |
| Field collected spatial data (if collected) | processedSiteLevelSummary | rawDataFilePath |
| Unprocessed sonar data files | processedSiteLevelSummary | rawDataFilePath |
| Processed sonar data tracks | processedSonarTrackData | downloadFileUrl |
Questions?
For a complete overview of the data included in each data product (including definitions and data relationships), see the NEON User Guide documents found in the data product landing pages for Stream morphology map and Bathymetric and morphological maps. Please use the Contact Us form if you have any questions about either data product and indicate you are inquiring about data product number DP4.00131.001 (Stream morphology map) or DP4.00132.001 (Bathymetric and morphological maps).
