Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing values”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Farmers’ Perceptions of Marginal Land for Biofuel Crops

The dataset includes the survey results about farmers’ perceptions of marginal land availability and the likelihood of a land pixel being marginal based on a machine learning model trained from the survey. Two spreadsheet files are the farmer and farm characteristics (marginal_land_survey_data_shared.xlsx), and the existing land use of marginal lands (land_use_info_sharing.xlsx). Note: the blank cells in these two spreadsheets mean missing values in the survey response. The GeoTiff file includes two bands, one the marginal land likelihood in the Midwestern states (0-1), the other the dominant reason of land marginality (0-5; 0 for farm size, 1 for growing season precipitation, 2 for root zone soil water capacity, 3 for average slope, 4 for growing season mean temperature, and 5 for growing season diurnal range of temperature). To read the data, please use a GIS software such as ArcGIS or QGIS.

marginal land↗

Anion Data for the East River Watershed, Colorado (2014-2025)

The anion data for the East River Watershed, Colorado, consist of fluoride, chloride, sulfate, nitrate, and phosphate concentrations collected at multiple, long-term monitoring sites that include stream, groundwater, and spring sampling locations. These locations represent important and/or unique end-member locations for which solute concentrations can be diagnostic of the connection between terrestrial and aquatic systems. Such locations include drainages underlined entirely or largely by shale bedrock, land covered dominated by conifers, aspens, or meadows, and drainages impacted by historic mining activity and the presence of naturally mineralized rock. Developing a long-term record of solute concentrations from a diversity of environments is a critical component of quantifying the impacts of both climate change and discrete climate perturbations, such as drought, forest mortality, and wildfire, on the riverine export of multiple anionic species. Such data may be combined with stream gauging stations co-located at each monitoring site to directly quantify the seasonal and annual mass flux of these anionic species out of the watershed. This data package contains (1) a zip file (anion_data_2014_2025.zip) containing a total of 386 files: 387 data files of anion data from across the Lawrence Berkeley National Laboratory (LBNL) Watershed Function Scientific Focus Area (SFA) which is reported in .csv files per location and a locations.csv (1 file) with latitude and longitude for each location; (2) a file-level metadata (v7_20260901_flmd.csv) file that lists each file contained in the dataset with associated metadata; (3) a data dictionary (v7_20260901_dd.csv) file that contains terms/column_headers used throughout the files along with a definition, units, and data type; and (4) a anion MDL fact sheet (anion_MDLs_202608 in PDF and docx formats). Missing values within the anion data files are noted as either "-9999" or "0.0" for not detectable (N.D.) data. There are a total of 47 locations containing anion data. Update on 2022-06-10: versioned updates to this dataset was made along with these changes: (1) updated anion data for all locations up to 2021-12-31, (2) removal of units from column headers in datafiles, (3) added row underneath headers to contain units of variables, (4) restructure of units to comply with CSV reporting format requirements, and (5) the addition of the file-level metadata (flmd.csv) and data dictionary (dd.csv) were added to comply with the File-Level Metadata Reporting Format. Update on 2022-09-09: Updates were made to reporting format specific files (file-level metadata and data dictionary) to correct swapped file names, add additional details on metadata descriptions on both files, add a header_row column to enable parsing, and add version number and date to file names (v2_20220909_flmd.csv and v2_20220909_dd.csv). Update on 2022-12-20: Updates were made to both the data files and reporting format specific files. Conversion issues affecting ER-PLM locations for anion data was resolved for the data files. Additionally, the flmd and dd files were updated to reflect the updated versions of these files. Available data was added up until 2022-03-14. Update on 2023-08-08: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-05-19. The file level metadata and data dictionary files were updated to reflect the additional data added. Update on 2024-03-11: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until 2023-09-11. Further, revisions to the data files were made to remove incorrect data points (from 1970 and 2001). The reporting format specific files were updated to reflect the additional data added. Update on 2025-05-15: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until the end of WY2024 (September 30, 2024). International Generic Sample Numbers (IGSNs), when registered, were added to the data files. The reporting format specific files were updated to reflect the additional data added. Update on 2026-09-01: Updates were made to both the data files and reporting format specific files. New available anion data was added, up until the end of WY2025 (September 30, 2025). An anion MDL document was included in this update.

54 ENVIRONMENTAL SCIENCES↗

Gap-filled methane and carbon dioxide fluxes across two ecosystem states at the US-OWC AmeriFlux site (2015−2016, 2020−2022)

This dataset contains gap-filled measurements of methane flux (FCH4), net ecosystem CO2 exchange (NEE) partitioned into gross primary productivity (GPP) and ecosystem respiration (RE), as well as latent heat flux (LE) from a Great Lakes coastal freshwater wetland at the US-OWC AmeriFlux site. The dataset covers the peak growing seasons (June−September) of 2015−2016, dominated by Typha spp., and 2020−2022, characterized by floating-leaved species (lotus and water lily). These data were generated to investigate how rising water levels and vegetation shifts influence CH4 and CO2 fluxes across two distinct ecosystem states in this wetland. The dataset, provided in CSV format, includes half-hourly gap-filled flux data from June to September for 2015, 2016, 2020, 2021, and 2022. The gap-filled data refers to measurements where missing values due to instrument issues or quality control were filled using artificial neural networks (ANNs).

54 ENVIRONMENTAL SCIENCES↗

Data from a throughfall exclusion experiment: Fine root dynamics, morphology, chemistry, and AMF colonization across four lowland Panamanian forests

Fine roots regulate forest nutrient, carbon, and water cycling, yet their variation within and among tropical forests remains under-characterized. We quantified root productivity, disappearance, and stocks to 1 m using minirhizotron imaging, and we measured morphology, elemental composition [root carbon (C), root nitrogen (N), root phosphorus (P)], and arbuscular mycorrhizal fungi (AMF) colonization to 20 cm using ingrowth cores and sequential coring. Sampling took place in four distinct lowland Panamanian forests (32 plots; 8 per forest) from 2018 through 2022 under control and throughfall-exclusion (drought) treatments in the Panama Rainforest Changes with Experimental Drying (PARCHED) experiment.The dataset is presented as an Excel workbook with six tabs. The first tab is the data dictionary. Tab S1 contains ingrowth-core production and mortality, morphology and soil moisture. Tab S2 contains sequential-coring standing stocks with associated morphology and soil moisture. Tab S3 contains minirhizotron row data records to 1 m depth, including per-frame root length and diameter, normalized length metrics, and session timing. Tab S4 contains AMF colonization. Tab S5 contains fine-root chemistry at 0–10 cm, reporting %P, %C, %N, and C:N for samples collected via ingrowth cores and sequential-coring standing stocks. CSV mirrors for each tab are provided, and a KML file supplies coordinates for all 32 plots.Key variables span live and dead fine-root biomass (and coarse fractions where applicable), specific root length (SRL) and area (SRA), diameter, root tissue density (RTD), soil moisture, AMF colonization, root %N, %C, %P, and C:N, along with minirhizotron root length and diameter. Depth, season, treatment, and plot/site identifiers are included to support cross-tab integration and analysis from 0–100 cm (minirhizotron) and 0–20 cm (cores).Units are reported in-column and missing values are coded as NA. No special software is required to open or use the files (Excel, CSV, and KML compatible).

54 ENVIRONMENTAL SCIENCES↗

Sequential Projection Pursuit Principal Component Analysis – Dealing with Missing Data Associated with New -Omics Technologies

We present a new version of sequential projection pursuit Principal Component Analysis (sppPCA) that has the capability to perform PCA on large multivariate datasets that contain non-random missing values. We demonstrate that sppPCA generates more robust and informative low-dimensional representations of the data than imputation-based approaches and improved downstream statistical analyses, such as clustering or classification. A Java program to run sppPCA is freely available at https://www.biopilot.org/docs/Software/sppPCA.

Webb-Robertson, Bobbie-Jo M.↗

Methods for Data-based Delineation of Spatial Regions

In data analysis, it is often useful to delineate or segregate areas of interest from the general population of data in order to concentrate further analysis efforts on smaller areas. Three methods are presented here for automatically generating polygons around spatial data of interest. Each method addresses a distinct data type. These methods were developed for and implemented in the sample planning tool called Visual Sample Plan (VSP). Method A is used to delineate areas of elevated values in a rectangular grid of data (raster). The data used for this method are spatially related. Although VSP uses data from a kriging process for this method, it will work for any type of data that is spatially coherent and appears on a regular grid. Method B is used to surround areas of interest characterized by individual data points that are congregated within a certain distance of each other. Areas where data are “clumped” together spatially will be delineated. Method C is used to recreate the original boundary in a raster of data that separated data values from non-values. This is useful when a rectangular raster of data contains non-values (missing data) that indicate they were outside of some original boundary. If the original boundary is not delivered with the raster, this method will approximate the original boundary.

Algorithm↗

Multiclass classification experiments

We seek a multiclass classifier that can satisfy the following requirements. 1. Predict among at least three classes. 2. Handle a moderately large number of correlated predictors. 3. Handle mixed categorical and continuous predictors. 4. Handle missing values (in some way). 5. Be trained with about n = 1,000 responses, and 6. Quantify prediction uncertainty. Based on 5. above, it is assumed that accuracy of prediction is paramount (relative to, say, runtime). All methods considered in this document take on the order of minutes (most take seconds) on a 2.8 GHz Quad-Core Intel Core i7 processor with 16GB RAM. Secondly, quantification of uncertainty is assumed to be a secondary task, since, with this small data size, resampling methods (i.e. bootstrapping) are possible. Further studies should quantify the feasibility and accuracy of resampling methods, and/or other methods, for quantifying uncertainty. R was used for all software.

97 MATHEMATICS AND COMPUTING↗

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The ongoing growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Through access to a large number of time series data sets from different power plants, we have found common issues that impede the modeling process. Namely, the time series data are hard to transfer between groups due to differences in variable nomenclature, and the quality of the data sets can vary. We address the issue of variable nomenclature by FAIRifying spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. We have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. With access to large time series data sets across many power plants, we can utilize spatiotemporal coherence between the sites in order to improve the quality of our data. To solve the issue of data missingness, we propose the use of Spatiotemporal-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

Feature Extraction: Improving Remote Sensor Classification of Non-Proliferation

This research focuses on developing algorithms for nuclear non-proliferation detection using remote sensor modeling. To improve the performance of classification models, we implemented a data pipeline with feature extraction. This pipeline takes raw data and transforms it into smaller data points called features that still describe the model. Improving this classification works towards the departments of energy’s missions of ensuring American’s security and prosperity by creating technology that addresses nuclear challenges. To conduct this analysis, we used the Python programming language and some key packages, including tsfresh and TSFEL. Originally tsfresh was selected because it has the most statistical features out of all the packages. Later TSFEL was incorporated due to the additional features it can extract from data, such as temporal and spectral. However, feature extraction becomes challenging in the presence of missing values. In this case, two additional Python packages were added to our workflow, NumPy and pandas, allowing for the feature extraction process to handle unknown values. Our data pipeline was tested on data collected from a simulation that describes the process state of a physical example. The results show the pipeline’s capability to consume and extract a total 17 features from tabular data. Future work includes producing classifications using decision tree-based models such as XGBoost and improving data collection by analyzing feature importance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Jobs, jobs, jobs: what’s an analyst to do?

Analysts and economists often face the task of using employment metrics to characterize industries of interest. Some key challenges can be understanding where to find employment metrics, the differences in various employment metrics, and when each metric should be used. This article analyzes a variety of publicly available employment data for the United States and compares these data. A detailed description of the intricacies of each data source is provided, which covers factors such as regionality, industry breakout, periodicity, and the types of jobs included. This article provides several case study examples, using the oil and gas extraction, coal mining, and chemical manufacturing sectors to portray challenges data users may face when developing employment estimates that suit their needs. Data users should be aware of a variety of data sources to understand alternative analysis options when data limitations are present and to determine which data source best meets their needs. Instances may occur in which information from one dataset may be used to help impute missing values.

99 GENERAL AND MISCELLANEOUS↗

An Updated Global Grid Point Surface Air Temperature Anomaly Data Set: 1851-1990 (revised 1991) (NDP-020)

This NDP presents land-based monthly surface-air-temperature anomalies (departures from a 1951-1970 reference period mean) on a 5° latitude by 10° longitude global grid. Monthly surface-air-temperature anomalies (departures from a 1957-1975 reference period mean) for the Antarctic (grid points from 65°S to 85°S) are presented in a similar way as a separate data set. The data were derived primarily from the World Weather Records and from the archives of the United Kingdom Meteorological Office. This long-term record of temperature anomalies may be used in studies addressing possible greenhouse-gas-induced climate changes. To date, the data have been employed in producing regional, hemispheric, and global time series for determining whether recent (i.e., post-1900) warming trends have taken place. The present updated version of this data set is identical to the earlier version for all records from 1851-1978 except for the addition of the Antarctic surface-air-temperature anomalies beginning in 1957. Beginning with the 1979 data, this package differs from the earlier version in several ways. Erroneous data for some sites have been corrected after a review of the actual station temperature data, and inconsistencies in the representation of missing values have been removed. For some grid locations, data have been added from stations that had not contributed to the original set. Data from satellites have also been used to correct station records where large discrepancies were evident. The present package also extends the record by adding monthly surface-air-temperature anomalies for the Northern (grid points from 85°N to 0°) and Southern (grid points from 5°S to 60°S) Hemispheres for 1985-1990. In addition, this updated package presents the monthly-mean-temperature records for the individual stations that were used to produce the set of gridded anomalies. The periods of record vary by station. Northern Hemisphere data have been corrected for inhomogeneities, while Southern Hemisphere data are presented in uncorrected form.For access to the data files, click this link to the CDIAC data transition website: http://cdiac.ess-dive.lbl.gov/ndps/ndp020.html

54 ENVIRONMENTAL SCIENCES↗

STAIR 2.0: A Generic and Automatic Algorithm to Fuse Modis, Landsat, and Sentinel-2 to Generate 10 m, Daily, and Cloud-/Gap-Free Surface Reflectance Product

Remote sensing datasets with both high spatial and high temporal resolution are critical for monitoring and modeling the dynamics of land surfaces. However, no current satellite sensor could simultaneously achieve both high spatial resolution and high revisiting frequency. Therefore, the integration of different sources of satellite data to produce a fusion product has become a popular solution to address this challenge. Many methods have been proposed to generate synthetic images with rich spatial details and high temporal frequency by combining two types of satellite datasets—usually frequent coarse-resolution images (e.g., MODIS) and sparse fine-resolution images (e.g., Landsat). In this paper, we introduce STAIR 2.0, a new fusion method that extends the previous STAIR fusion framework, to fuse three types of satellite datasets, including MODIS, Landsat, and Sentinel-2. In STAIR 2.0, input images are first processed to impute missing-value pixels that are due to clouds or sensor mechanical issues using a gap-filling algorithm. The multiple refined time series are then integrated stepwisely, from coarse- to fine- and high-resolution, ultimately providing a synthetic daily, high-resolution surface reflectance observations. We applied STAIR 2.0 to generate a 10-m, daily, cloud-/gap-free time series that covers the 2017 growing season of Saunders County, Nebraska. Moreover, the framework is generic and can be extended to integrate more types of satellite data sources, further improving the quality of the fusion product. View Full-Text

47 OTHER INSTRUMENTATION↗

Quality Control Methods for Advanced Metering Infrastructure Data

While urban-scale building energy modeling is becoming increasingly common, it currently lacks standards, guidelines, or empirical validation against measured data. Empirical validation necessary to enable best practices is becoming increasingly tractable. The growing prevalence of advanced metering infrastructure has led to significant data regarding the energy consumption within individual buildings, but is something utilities and countries are still struggling to analyze and use wisely. In partnership with the Electric Power Board of Chattanooga, Tennessee, a crude OpenStudio/EnergyPlus model of over 178,000 buildings has been created and used to compare simulated energy against actual, 15-min, whole-building electrical consumption of each building. In this study, classifying building type is treated as a use case for quantifying performance associated with smart meter data. This article attempts to provide guidance for working with advanced metering infrastructure for buildings related to: quality control, pathological data classifications, statistical metrics on performance, a methodology for classifying building types, and assess accuracy. Advanced metering infrastructure was used to collect whole-building electricity consumption for 178,333 buildings, define equations for common data issues (missing values, zeros, and spiking), propose a new method for assigning building type, and empirically validate gaps between real buildings and existing prototypes using industry-standard accuracy metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Photochemical Phosphorus-Hydrogen-Oxygen Network for Hydrogen-dominated Exoplanet Atmospheres

Due to the detection of phosphine (PH 3 ) in the solar system gas giants Jupiter and Saturn, PH 3 has long been suggested to be detectable in exosolar substellar atmospheres too. However, to date, direct detection of phosphine has proven to be elusive in exoplanet atmosphere surveys. We construct an updated phosphorus-hydrogen-oxygen (PHO) photochemical network suitable for the simulation of gas giant hydrogen-dominated atmospheres. Using this network, we examine PHO photochemistry in hot Jupiter and warm Neptune exoplanet atmospheres at solar and enriched metallicities. Our results show for HD 189733b-like hot Jupiters that HOPO, PO, and P 2 are typically the dominant P carriers at pressures important for transit and emission spectra, rather than PH 3 . For GJ1214b-like warm Neptune atmospheres our results suggest that at solar metallicity PH 3 is dominant in the absence of photochemistry, but is generally not in high abundance for all other chemical environments. At 10 and 100 times solar, small oxygenated phosphorus molecules such as HOPO and PO dominate for both thermochemical and photochemical simulations. The network is able to reproduce well the observed PH 3 abundances on Jupiter and Saturn. Despite progress in improving the accuracy of the PHO network, large portions of the reaction rate data remain with approximate, uncertain, or missing values, which could change the conclusions of the current study significantly. Improving understanding of the kinetics of phosphorus-bearing chemical reactions will be a key undertaking for astronomers aiming to detect phosphine and other phosphorus species in both rocky and gaseous exoplanetary atmospheres in the near future.

atmospheric composition↗

NGEE Arctic Plant Traits: Shrub Transects, Kougarok Road Mile Marker 64, Seward Peninsula, Alaska, 2016-2017

Transect data is from point center quarter (PCQ) surveys for shrub density performed in July 2016 at the Kougarok site and in July 2017 at the Kougarok, Teller, and Council sites. For each sample point along the transects, moving averages for shrub density and shrub basal area are provided along with GPS coordinates. Average shrub height and active layer depth are recorded for each sample point as well. Target shrub species differ across the transects: some surveys targeted a mixture of tall shrub species while others targeted specific species. In 2017 insect damage was also quantified. The dataset contains two *.csv data files and one *.pdf. Missing Values are represented by "NA". The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Confidence-Based Feature Acquisition

Confidence-based Feature Acquisition (CFA) is a novel, supervised learning method for acquiring missing feature values when there is missing data at both training (learning) and test (deployment) time. To train a machine learning classifier, data is encoded with a series of input features describing each item. In some applications, the training data may have missing values for some of the features, which can be acquired at a given cost. A relevant JPL example is that of the Mars rover exploration in which the features are obtained from a variety of different instruments, with different power consumption and integration time costs. The challenge is to decide which features will lead to increased classification performance and are therefore worth acquiring (paying the cost). To solve this problem, CFA, which is made up of two algorithms (CFA-train and CFA-predict), has been designed to greedily minimize total acquisition cost (during training and testing) while aiming for a specific accuracy level (specified as a confidence threshold). With this method, it is assumed that there is a nonempty subset of features that are free; that is, every instance in the data set includes these features initially for zero cost. It is also assumed that the feature acquisition (FA) cost associated with each feature is known in advance, and that the FA cost for a given feature is the same for all instances. Finally, CFA requires that the base-level classifiers produce not only a classification, but also a confidence (or posterior probability).

Wagstaff, Kiri L.↗