Search NASA⌕ Search

SEARCH · Search NASA

Results for “truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

What can simulation test beds teach us about social science? Results of the ground truth program

The ground truth program used simulations as test beds for social science research methods. The simulations had known ground truth and were capable of producing large amounts of data. This allowed research teams to run experiments and ask questions of these simulations similar to social scientists studying real-world systems, and enabled robust evaluation of their causal inference, prediction, and prescription capabilities. We tested three hypotheses about research effectiveness using data from the ground truth program, specifically looking at the influence of complexity, causal understanding, and data collection on performance. We found some evidence that system complexity and causal understanding influenced research performance, but no evidence that data availability contributed. The ground truth program may be the first robust coupling of simulation test beds with an experimental framework capable of teasing out factors that determine the success of social science research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

AAPM Truth‐based CT (TrueCT) reconstruction grand challenge

Background: This Special Report summarizes the 2022, AAPM grand challenge on Truth-based CT image reconstruction. Purpose: To provide an objective framework for evaluating CT reconstruction methods using virtual imaging resources consisting of a library of simulated CT projection images of a population of human models with various diseases. Methods: Two hundred unique anthropomorphic, computational models were created with varied diseases consisting of 67 emphysema, 67 lung lesions, and 66 liver lesions. The organs were modeled based on clinical CT images of real patients. The emphysematous regions were modeled using segmentations from patient CT cases in the COPDGene Phase I dataset. For the lung and liver lesion cases, 1–6 malignant lesions were created and inserted into the human models, with lesion diameters ranging from 5.6 to 21.9 mm for lung lesions and 3.9 to 14.9 mm for liver lesions. The contrast defined between the liver lesions and liver parenchyma was 82 ± 12 HU, ranging from 50 to 110 HU. Similarly, the contrast between the lung lesions and the lung parenchyma was defined as 781 ± 11 HU, ranging from 725 to 805 HU. For the emphysematous regions, the defined HU values were −950 ± 17 HU ranging from −918 to −979 HU. The developed human models were imaged with a validated CT simulator. The resulting CT sinograms were shared with the participants. The participants reconstructed CT images from the sinograms and sent back their reconstructed images. Further, the reconstructed images were then scored by comparing the results against the corresponding ground truth values. The scores included both task-generic (root mean square error [RMSE] and structural similarity matrix [SSIM]), and task-specific (detectability index [d’] and lesion volume accuracy) metrics. For the cases with multiple lesions, the measured metric was averaged across all the lesions. To combine the metrics with each other, each metric was normalized to a range of 0 to 1 per disease type, with “0” and “1” being the worst and best measured values across all cases of the disease type for all received reconstructions. Results: The True-CT challenge attracted 52 participants, out of which 5 successfully completed the challenge and submitted the requested 200 reconstructions. Across all participants and disease types, SSIM absolute values ranged from 0.22 to 0.90, RMSE from 77.6 to 490.5 HU, d’ from 0.1 to 64.6, and volume accuracy ranged from 1.2 to 753.1 mm3. The overall scores demonstrated that participant “A” had the best performance in all categories, except for the metrics of d’ for lung lesions and RMSE for liver lesions. Participant “A” had an average normalized score of 0.41 ± 0.22, 0.48 ± 0.32, and 0.42 ± 0.33 for the emphysema, lung lesion, and liver lesion cases, respectively. Conclusions: The True-CT challenge successfully enabled objective assessment of CT reconstructions with the unique advantage of access to a diverse population of diseased human models with known ground truth. This study highlights the significant potential of virtual imaging trials in objective assessment of medical imaging technologies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Creating ground truth for nanocrystal morphology: a fully automated pipeline for unbiased transmission electron microscopy analysis

Control over colloidal nanocrystal morphology (size, size distribution, and shape) is important for tailoring the functionality of individual nanocrystals and their ensemble behavior. Despite this, traditional methods to quantify nanocrystal morphology are laborious. New developments in automated morphology classification will accelerate these analyses but the assessment of machine learning models is limited by human accuracy for ground truth, causing even unsupervised machine learning models to have inherent bias. Herein, we introduce synthetic image rendering to solve the ground truth problem of nanocrystal morphology classification. By simulating 2D images of nanocrystal shapes via a function of high-dimensional parameter space, we trained a convolutional neural network to link unique morphologies to their simulated parameters, defining nanocrystal morphology quantitatively rather than qualitatively. An automated pipeline then processes, quantitatively defines, and classifies nanocrystal morphology from experimental transmission electron microscopy (TEM) images. Using improved computer vision techniques, 42,650 nanocrystals were identified, assessed, and labeled with quantitative parameters, offering a 600-fold improvement in efficiency over best-practice manual measurements. Further, a classification algorithm was trained with a prediction accuracy of 99.5%, which can successfully analyze a range of concave, convex, and irregular nanocrystal shapes. The resulting pipeline was applied to differentiating two syntheses of nominally cuboidal CsPbBr 3 nanocrystals and uniquely classifying binary nickel sulfide nanocrystal phase based on morphology. This pipeline provides a simple, efficient, and unbiased method to quantify nanocrystal morphology and represents a practical route to construct large datasets with an absolute ground truth for training unbiased morphology-based machine learning algorithms.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2019

Ground-Truth Prediction to Accelerate Soft-Error Impact Analysis for Iterative Methods

Understanding the impact of soft errors on applications can be expensive. Often, it requires an extensive error injection campaign involving numerous runs of the full application in the presence of errors. In this paper, we present a novel approach to arriving at the ground truth--the true impact of an error on the final output--for iterative methods by observing a small number of iterations to learn deviations between normal and error-impacted execution. We develop a machine learning based predictor for three iterative methods to generate ground-truth results without running them to completion for every error injected. We demonstrate that this approach achieves greater accuracy than alternative prediction strategies, including three existing soft error detection strategies. We demonstrate the effectiveness of the ground truth prediction model in evaluating vulnerability and the effectiveness of soft error detection strategies in the context of iterative methods.

iterative methods, failure prediction, Soft error ↗
DOE OSTI2022

Evaluation of macadamia felted coccid (Hemiptera: Eriococcidae) damage and cultivar susceptibility using imagery from a small unmanned aerial vehicle ( sUAV ), combined with ground truthing

Abstract BACKGROUND Macadamia felted coccid, Acanthococcus ioronsidei (Williams) (Hemiptera: Eriococcidae), is a significant pest of macadamia nut, Macadamia integrifolia Maiden & Betche (Protaceae), in Hawaii, and heavy infestations can kill branches, resulting in characteristic dead, copper‐colored leaves. Small Unmanned Aerial Vehicles (sUAV) or ‘drones,’ combined with spatial data analysis, can provide growers with accurate and high‐resolution detection of plant stress due to pest infestations. We investigated the feasibility of using RGB (red‐green‐blue) color images from sUAV to detect dieback caused by macadamia felted coccid infestation and compared sUAV estimates with ground‐based damage estimates (ground truthing). RESULTS Spatial analysis showed clustering of foliar damage that reflected cultivar susceptibility to macadamia felted coccid infestation, with cultivars 344 and 856 being susceptible, and cultivars 800 and 333 being tolerant. sUAV and ground‐based estimates of foliar damage were similar for the cultivar 344, but ground‐based assessments were higher than sUAV for cultivar 856, possibly due to the differences in canopy architecture and significant early dieback in the lower canopy. At foliar damage levels <10%, sUAV and ground truthing data were significantly positively correlated, suggesting sUAV may be useful in detecting early stages of macadamia felted coccid infestation. CONCLUSIONS Cultivars showed varying susceptibility to macadamia felted coccid infestation and the foliage damage appeared in clusters. sUAV was able to detect the foliage damage under high and low infestation scenarios suggesting that it can be effectively used for the early detection of infestations. © 2022 The Authors. Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗
DOE OSTI2021

Characterizing uncertainties in ground “truth” of precipitation over complex terrain through high-resolution numerical modeling

Ground observation of precipitation over complex terrain is subject to large uncertainties due to inadequate sampling. This study explores a method that combines limited gauge data and a high-resolution numerical simulation to quantify the precipitation uncertainties in central Himalaya. Specifically, the Coefficient of spatial Variability (CV) of precipitation and the minimum Number of Required Stations (NRS) to obtain areal-mean precipitation ground truth values within a 0.25-degree area are investigated using fine-scale meteorological simulation at 1.5 km grid spacing. Evaluation over a densely-gauged area demonstrates comparable CV and NRS values between station observations and simulations. The simulated CV and NRS values in a larger area show a strong and positive dependence on each other and an expected positive (negative) correlation with topographic complexity (temporal scale). The proposed method sheds lights on evaluating precipitation products and holds promise for informing the layout of rain gauge networks in complex terrain.

Ouyang, Lin↗
DOE OSTI2021

Evaluation of KDP Estimation Algorithm Performance in Rain Using a Known-Truth Framework

Accurate estimation of specific differential phase ( K DP ) is necessary for rain rate estimation, attenuation correction, and hydrometeor classification algorithms. There are numerous published methods to process polarimetric radar observations of propagation differential phase shift (Φ DP ) and estimate K DP , but the corresponding K DP estimate uncertainty is unquantified. This study provides guidance on how commonly used K DP estimation algorithms perform in various environments. Here, we create numerous synthetic (“true”) K DP profiles, integrate over them to obtain “smoothed” Φ DP , and then add noise typical of S-band operational weather radar measurements. Each algorithm is applied to our noisy Φ DP profiles and compared to the true K DP profile such that the errors and uncertainty are quantified. The synthetic K DP profiles are Gaussian in shape, which allows systematic variations in their magnitude and width to determine how each algorithm performs in smooth, slowly changing K DP profiles, as well as steep profiles. Results demonstrate that algorithm performance is dependent on the Φ DP field received. These results are further supported by an error analysis of each algorithm for two more complicated synthetic K DP profiles. Some K DP algorithms allow users to change various tuning parameters; a subset of these tuning parameters is tested to provide guidance on how changing these parameters impacts algorithm performance. We then provide evidence that our known-truth framework provides insight into algorithm performance in observed data through two case studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

NGEE Arctic 2019 Alder Ground Truth Survey, Seward Peninsula AK

In July 2019 we made traveled the road system outside of Nome, AK and detailed the GPS coordinates of alder shrublands for the purpose of ground-truthing alder maps of the region. Both visual and ground-based observations were made for patches of alder shrublands greater 5x5m and larger, ideally 10x10m. Visual observations were made from the car and GPS coordinates are approximate, placed by dropping pins on georeferenced pdfs using the Avenza app. Visual observations included positive identified alder shrublands as well as thickets of non-alder shrubs. Ground Observations were made at a subset of locations where we were able to hike to alders shrubland areas. Ground observations include GPS points (made with Garmin InReach) as well as relevant features of a centrally located, representative alder shrub in the patch (max height, basal diameter of all ramets, soil depth). Aboveground biomass (weight dry mass) of the surveyed shrub was calculated based on alder-specific allometric equations in Berner et al 2015 which our team checked for accuracy for the Seward Peninsula as part of Salmon et al 2019. This dataset contains three data files, three data dictionaries, and one file-level metadata file all in*.csv format plus one *.txt README file. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Ground Truth for CSP Mirror Metrology (Full-Length)

The high optical accuracy required for concentrating solar power (CSP) systems in turn requires accurate metrology to assess mirror optical parameters during design, manufacturing, and operation. To meet this need, researchers have developed a variety of CSP optical metrology systems, which include complex calculations and calibration terms. This raises the question: How do we know these methods’ accuracy? One approach is to compare metrology system measurements against a ground truth reference.

14 SOLAR ENERGY↗
DOE OSTI2025

Seismic monitoring of underground vibration: database of seismic data and ground truth

Seismic waves provide valuable insights into underground activities, serving as an essential tool for monitoring anomalies that could signal containment breaches in geological repositories. We aim to test and refine underground detection and geolocation techniques to identify anomalous vibration signals indicative of potential breaches, thereby strengthening georepository safeguards. We evaluate the effectiveness of two distinct, low-maintenance sensing technologies (surface geophones and underground distributed acoustic sensing (DAS) fiber optic cable) leveraging existing datasets. This report details the experimental designs, instrumentation, and data characteristics for both seismic and DAS arrays. Additionally, we provide a ground truth database documenting relevant operational activities for each experiment.

58 GEOSCIENCES↗
DOE OSTI2025

Ground-Truthing: Exploratory Borehole Characterization and Modeling to Verify and Expand Techno-Economic Evaluation of Earth Source Heat at Cornell U

This report documents the successful completion of DOE award DE-EE0009255: Ground- Truthing: Exploratory Borehole Characterization and Modeling to Verify and Expand Techno- Economic Evaluation of Earth Source Heat at Cornell University . Cornell University is evaluating the technical and economic feasibility of using deep direct-use (DDU) geothermal energy, referred to locally as Earth Source Heat (ESH), to serve as a renewable energy source for campus heating. To meet this objective, Cornell drilled an approximately 3-kilometer-deep exploratory borehole: the Cornell University Borehole Observatory (CUBO), or ESH-1. The team conducted an extensive suite of geophysical, hydrologic, thermal, mechanical, and geochemical measurements to evaluate subsurface conditions and geothermal development potential. This report summarizes the well drilling and testing tasks, findings, and conclusions.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Original images, ground truth annotations, and precited masks from U-NET for a fungal species x nitrogen experiment

This document describes the “MicroVision-MV003” dataset. This folder contains three subfolders: “originals”, “predicted_masks”, and “gt_masks”. The “originals” folder contains 720 original images acquired using two imaging modalities: 360 images from overhead imaging and 360 images from transmission (raw) imaging. Naming scheme:YYYY-MM-dd__plate_strain_nitrogen-level_replication_experiment_imaging-modalityYYYY-MM-dd: 2024-12-20, 2024-12-21, 2024-12-22,2024-12-23,2024-12-24,2024-12-25,2024-12-26,2024-12-27,2024-12-28,2024-12-29,2024-12-30,2024-12-31.plate: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30.strain: FG, LE.nitrogen-level: N-1, N-10, N-100.replication: 1, 2, 3, 4, 5.experiment: MV.003.imaging-modality: overhead, transmission (raw). For example, the image2024-12-20__1_FG_N-10_3_MV.003_overheadwas taken on 2024-12-20. The plate number is 1, the fungal strain is FG, the nitrogen treatment is N-10, and the replication number is 3 for experiment MV.003, acquired using the overhead imaging modality. The “predicted_masks” folder contains masks generated by a trained U-Net model for the transmission imaging modality.The “gt_masks” folder contains 326 human hand-traced masks that serve as ground truth.

09 BIOMASS FUELS↗
DOE OSTI2025

In search of truth: In memory of Balraj Singh

Born in Punjab (India) in December 1941, Balraj Singh is not only the single most prolific nuclear data evaluator and disseminator of nuclear structure and decay data with 148 evaluations in Nuclear Data Sheets — 85 as the first and often only author — plus other journals, but his upmost curiosity and dedication brought him to be one of the finest nuclear physicists, with an everlasting influence on many of us. Furthermore, Balraj passed away about a year ago on 9 October 2023 in Ottawa, Ontario (Canada) at the age of 81, and at Atomic Data and Nuclear Data Tables we would like to commemorate some of his scientific achievements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗