Release 2025
Release Tag: RELEASE-2025
Release Date: January 29, 2025
Contents: JSON manifest
R neonUtilities: use v2.4.3 or higher
Python neonutilities: use v1.0.1 or higher
RELEASE-2025 includes 167 data products annotated by 134 DOIs.
- RELEASE-2025 includes Instrumented Systems (IS) data through June 2024, and Observational Systems (OS) and Airborne Observation Platform (AOP) data through December 2023.
- Data products that are exclusively hosted by an external repository are excluded. These are:
- Phenocam data products: Phenology images (DP1.00033.001), Land-water interface images (DP1.20002.001), and Snow depth and understory phenology images (DP1.00042.001);
- AERONET product Spectral sun photometer - calibrated sky radiances (DP1.00043.001)
- Gap-filled products hosted by AmeriFlux, including Temporally interpolated soil temperature (DP2.00006.001), Temporally interpolated shortwave and longwave radiation (net radiometer) (DP2.00020.001), and Temporally interpolated triple aspirated tower temperature (DP2.00023.001).
- Data products that are exclusively downloadable via another data product are associated with the DOI of the downloadable data product.
- Some data products or subsets of data products (certain date ranges or field sites) have been excluded. Data may be available in excluded products and time periods; these data are provisional, and subject to change. Please refer to the Data Exclusions table below.
- AOP data products will be exclusively available in this release until December 2025. The DOIs for the AOP data products in previous releases have been tombstoned.
Data Exclusions
| Data Product ID | Data Product Name | What is excluded for reasons other than general lag time | Reason for exclusion |
|---|---|---|---|
| DP*.300**.001 | All Rev .001 AOP Data Products | ARIK 2022-07, WREF 2022-07 | A portion of lidar lines were not originally included, also affecting downstream camera and spectrometer orthorectification. |
| DP*.300**.002 | All Rev .002 AOP Bidirectional Reflectance Data Products | All site-months collected between 2022 - 2023 | Bidirectional reflectance data was processed starting in Spring 2024; leaving provisional to allow for additional QA |
| DP*.300**.001 | All Rev .001 AOP Data Products | PUUM 2019-01, REDB 2019-05, UNDE 2019-06, UKFS 2019-05 | Dense atmospheric noise and mis-classified noise in the discrete lidar point cloud data, resulting in orthorectification artifacts in spectrometer and camera data products. In most cases, a small portion of each site is affected by this issue, and the large majority of the site is still accurately classified (lidar) and orthorectified (spectrometer and camera). |
| DP1.10020.001 | Ground beetle sequences DNA barcode | 2023 | Lab analyses pending for 2023 samples |
| DP1.10022.001 | Ground beetles sampled from pitfall traps | 2023 | Lab analyses pending for 2023 samples |
| DP1.10107.001 | Soil microbe metagenome sequences | 2023 | Sequencing pending for 2023 samples |
| DP1.20032.001 | Shortwave and longwave radiation above water on-buoy (net radiometer) | LIRO 2024-03 to 2024-06 | The incoming and outgoing data appear switched and may be able to be fixed |
| DP1.20048.001 | Discharge field collection | 2023-10, -11, and -12 | Discharge-related products are released by water year |
| DP1.20066.001 | Aquatic plant bryophyte macroalgae clip harvest | 2023 | Lab analyses pending for 2023 samples |
| DP1.20120.001 | Macroinvertebrate collection | 2023-08, -09, -10, -11, and -12 | Lab analyses pending for fall 2023 samples |
| DP1.20126.001 | Macroinvertebrate metabarcoding | 2023 | Lab analyses pending for 2023 samples |
| DP1.20219.001 | Zooplankton collection | 2022 and 2023 | Dilution factor investigation underway, data updates pending |
| DP1.20221.001 | Zooplankton metabarcoding | 2023 | Lab analyses pending for 2023 samples |
| DP1.20261.001 | Photosynthetically active radiation below water surface | TOMB 2023-07 to 2024-06 | The incoming and outgoing data appear switched and may be able to be fixed |
| DP1.20267.001 | Gauge height | 2023-10, -11, and -12 | Discharge-related products are released by water year |
| DP1.20279.001 | Benthic microbe metagenome sequences | 2023 | Sequencing pending for 2023 samples |
| DP1.20281.001 | Surface water microbe metagenome sequences | 2023 | Sequencing pending for 2023 samples |
| DP1.30001.001 | LiDAR slant range waveform | GUAN 2022-10, SRER 2022-08 | Withheld for further QA |
| DP1.30006.001 | Spectrometer orthorectified surface directional reflectance - flightline | All site-months collected between 2022 - 2023 | Directional reflectance data for AOP sites collected between 2022-2024 were processed starting in Spring 2024; leaving provisional to allow for additional QA |
| DP1.30008.001 | Spectrometer orthorectified at-sensor radiance - flightline | All site-months collected between 2022 - 2023 | Radiance data for AOP sites collected between 2022-2024 were processed starting in Spring 2024; leaving provisional to allow for additional QA |
| DP3.30014.001 | fPAR - spectrometer - mosaic | WOOD & DCFS 2017-06 | Filename included the incorrect Domain ID |
| DP4.00133.001 | Stage-discharge rating curves | 2023-10, -11, and -12 | Discharge-related products are released by water year. |
| DP4.00200.001 | Bundled data products - Eddy covariance | BARR 05-2017 to 08-2017 BART 12-2016 to 1-2017 BONA 10-2017 CLBJ 09-2017 to 10-2017 CPER 11-2017 DELA 02-2017 DSNY 02-2017 JORN 03-2017 to 08-2017 LAJA 08-2017 to 04-2018 NOGP 09-2017 ORNL 03-2017 to 06-2017 SERC 03-2017 to 05-2017 TEAK 06-2018 UNDE 02-2017 WREF 09-2017 to 02-2018 YELL 08-2017 |
Site start dates have been consistently defined in this release. The excluded site-months are prior to a site passing initial operation review or prior to installation of the 3D sonic anemometer. |
Changes between RELEASE-2024 and RELEASE-2025
- For all OS data products, data quality improvement and error correction are continuous and ongoing processes. Routine data entry errors (such as transcription errors, duplicate records, or adjusted spatial coordinates) have been corrected where possible. Due to the large volume of data (>20 million data records), these corrections are not described individually. The table below describes significant changes to data products between releases.
- Isolated sites and time periods for most IS products were reprocessed to incorporate corrections to sensor installation periods, geolocation data, and manual quality flags. The table below describes significant changes to specific data products between releases.
- For all AOP data products, data quality improvement is an ongoing process. The bulk of the changes in the 2025 Release involved updating lidar and camera data products to remove erroneous noise and properly classify mis-classified noise in the discrete lidar point cloud data, and to improve line to line adjustments between flight lines. The mis-classified noise and misaligned lidar data resulted in artifacts in the derived lidar data products, which propagated into orthorectification errors in the spectrometer and camera data products. Spectrometer data products for the affected sites were not updated for this release, since they will be updated as part of a major re-processing effort (including topographic and BRDF corrections) starting in Feb 2025. Finally, minor corrections were made to various AOP data products, sites, and years including colorizing discrete lidar point clouds and re-naming files in order to improve consistency and follow AOP's standard naming conventions. Due to the large volume of data, more minor corrections are not described individually, but the table below summarizes significant changes to data products between RELEASE-2024 and RELEASE-2025. For more information on the AOP 2025 Release Updates, please refer to AOP Data Availability Notification – Release 2025.
| Data Product ID | Data Product Name | Summary of changes between RELEASE-2023 and RELEASE-2024 |
|---|---|---|
| DP1.00006.001 | Precipitation | Primary weighing gauge precipitation data tables (labeled PRIPRE in the filename) were removed from DP1.00006.001 as part of the release of a new data product, DP1.00044.001: Weighing Gauge precipitation, which uses a new algorithm to resolve quality problems in precipation data collected with weighing gauge precipitation sensors. |
| DP1.00017.001 | Dust and particulate size distribution | Quality Control thresholds were updated and the full data record reprocessed. Acceptable data range now excludes very high readings but includes 0 values. Spike test was removed from processing due to overflagging valid data. MeasurementValidity flag was modified so that it no longer flags all data when any sensor reads zero. Field and software updates were made to reduce flow rate issues. |
| DP1.00044.001 | Precipitation - weighing gauge | This data product was split from DP1.00006.001 with the release of a new algorithm to handle known issues in weighing gauge precipitation data. The processing code was rewritten to significantly reduce or eliminate spurious precipitation measurements caused by noise in the raw data. This data product includes the full data record for all sites and time periods where weighing gauge collectors are deployed. |
| DP1.10003.001 | Breeding landbird point counts | The eventID field format has been changed from plotID.pointID.date to BRD.siteID.year.boutNumber |
| DP1.10023.001 | Herbaceous clip harvest | The eventID field format has been changed from code.year.siteID.weekBoutBegan to code.year.siteID.weekBoutBegan.plotType to better allow different handling of Tower and Distributed plots due to the different temporal frequency of collections. Tower plots are sampled annually, Distributed plots are sampled every five years. |
| DP1.10026.001 | Plant foliar traits | Crown polygon shapefiles have been projected on the UTM grid (in meters), whereas formerly they were delivered in the WGS1984 projection in decimal degrees |
| DP1.10072.001 | Small mammal box trapping | mammalGridSamplingType field was added and backfilled for all data in the mam_perplotnight table to distinguish between 'diveristy', 'pathogen', and 'recapture' grids. |
| DP1.10098.001 | Vegetation structure | Issues with legacy data from 2015 identified and data were deleted: 1) summer 2015 VST measurements at D08 DELA and LENO (plots were also measured that fall and those data remain); 2) D03 had two plots where AI records were made but no corresponding M&T records exist and those plots have never been resampled (OSBS_017 and OSBS_021). |
| DP1.20004.001 | Barometric pressure above water on-buoy | Pressure correction algorithm changed to use nominal site elevations rather than relying on availability of water level sensors. |
| DP1.20008.001 | Specific conductivity of surface water | New data product. Formulation presented in the product's Algorithm Theoretical Basis Document. |
| DP1.20015.001 | Specific conductivity in groundwater | The algorithm was updated and data were reprocesed using NEON’s new instrument processing pipeline. See Data Notification "Surface and groundwater elevation, conductivity, and temperature algorithm updates" for further details. |
| DP1.20016.001 | Elevation of surface water | The algorithm was updated and data were reprocessed using NEON’s new instrument processing pipeline. See Data Notification "Surface and groundwater elevation, conductivity, and temperature algorithm updates" for further details. |
| DP1.20046.001 | Air temperature above water on-buoy | This data product was discontinued because the data is already included in DP1.20271.001, which was renamed Relative humidity and air temperature above water on buoy. |
| DP1.20054.001 | Temperature (digital thermistor) of surface water | New data product. Formulation presented in the product's Algorithm Theoretical Basis Document. |
| DP1.20092.001 | Chemical properties of groundwater | All carbonate, bicarbonate, and external lab pH values were deleted for all sites. |
| DP1.20093.001 | Chemical properties of surface water | All carbonate, bicarbonate, and external lab pH values were deleted for all sites. Erroneous dissolved organic carbon values for D07 from 2018-2021 were deleted. |
| DP1.20100.001 | Elevation of groundwater | The algorithm was updated and data were reprocessed using NEON’s new instrument processing pipeline. See Data Notification "Surface and groundwater elevation, conductivity, and temperature algorithm updates" for further details. |
| DP1.20217.001 | Temperature of groundwater | The algorithm was updated and data were reprocessed using NEON’s new instrument processing pipeline. See Data Notification "Surface and groundwater elevation, conductivity, and temperature algorithm updates" for further details. |
| DP1.30003.001 | Discrete return LiDAR point cloud | ORNL 2015-08, ORNL 2017-09: Lidar point clouds were colorized by the camera imagery. |
| DP1.30003.001, DP3.30015.001, DP3.30024.001, DP3.30025.001, DP1.30010.001, DP3.30010.001 | Discrete return LiDAR point cloud, Ecosystem Structure, Elevation - LiDAR, Slope and Aspect - LiDAR, High-resolution orthorectified camera imagery, High-resolution orthorectified camera imagery mosaic |
HARV 2014-06 , DSNY 2014-05, ABBY 2018-07: Lidar data were re-processed to improve alignment between flightlines. Camera data were re-processed with the updated Lidar DSM to improve orthorectification issues. CHEQ (STEI/TREE) 2020-08, CLBJ 2018-04, MOAB 2019-08 and 2021-04, TOOL 2022-08: Lidar data were re-processed to remove and/or properly classify mis-classified noise in the discrete point clouds. Camera data were re-processed with the updated Lidar DSM to improve orthorectification issues. |
| DP4.00001.001 | Summary weather statistics | Precipitation data tables were removed from Summary Weather Statistics. The primary weighing gauge precipitation data previously included in Summary Weather Statistics were aggregated from the PRIPRE tables of DP1.00006.001 (Precipitation), which suffered from extremely poor data quality due to unmitigated sensor noise. The algorithm for primary weighing gauge precipitation was rewritten to resolve the poor data quality, and the full data record for all sites was published as a new product, DP1.00044.001: Precipitation - weighing gauge, which includes hourly and daily sums of precipitation. NEON expects to include the full data record of daily, monthly, and annual sums of precipitation sourced from the new DP1.00044.001 data product in RELEASE-2026 (next year) of Summary Weather Statistics. For RELEASE-2025, users are directed to the daily precipitation sums included in DP1.00044.001 for all sites and time periods. |
| DP4.00130.001 | Continuous discharge | Water year 2022 (2021-10-01 to 2022-09-30) for all sites, and water year 2021 (2020-10-01 to 2021-09-30) for BIGC were cleaned and gap filled. |
| DP4.00131.001 | Stream morphology map | Data product was restructured to improve the usability of data contained in the download packages. |
| DP4.00132.001 | Bathymetric and morphological maps | Data product was restructured to improve the usability of data contained in the download packages. |
| DP4.00200.001 | Bundled data products - eddy covariance | Wavelet high-frequency correction update. Now better aligns with Nordbo and Katul (2013) methods and MATLAB code. Main changes include: (1) Changed approach from using continuous wavelet transform to discrete wavelet and (2) Changed wavelet coefficient weighting and adjustments to better match methods described in the NK 2013 paper and code. Code specifically designed to correct timestamp offsets in all data products from Picarro instruments, including CH4 concentration (DP1.00030.001), atmospheric CO2 isotopes (DP1.00036.001), and atmospheric H2O isotopes (DP1.00037.001), has been applied during data processing. Quality indicators for stationarity and integral turbulence characteristics (ITCs) are provided for the turbulence flux data products. |