Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Challenge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Shallow Marine High-Resolution 3D Seismics for Above-Zone CO2 Monitoring: A Case Study in Offshore Japan

Shallow marine high-resolution 3D (HR3D) seismic utilizes a novel seismic acquisition technology for imaging fine geological features not revealed by conventional 3D surveys. HR3D technology has been previously used for shallow subsurface studies, however is rarely implemented for monitoring injected fluids, and has not previously been used to monitor an active CO2 storage project. In this study, we for the first time demonstrate the acquisition, processing and initial interpretation of a HR3D seismic survey in Tomakomai, offshore Japan, where a large-scale CO2 storage project is being undertaken. As a seismic monitoring tool, the HR3D survey images the geologic overburden (< 1000 ms), aiming to detect potential CO2 leakage pathways above the injection reservoir. The HR3D acquisition system comprises a 210 in3 GI air gun and 4 streamers that are 25 m in length with 10 m inline separation. Each streamer has 8 channels with a 3.125 m group interval, yielding a very small final bin size of 3 x 3 m. The short offset and low-fold coverage of the HR3D data creates new challenges in seismic data processing, which demands a different data processing workflow tailored to the HR3D acquisition. We present a data processing workflow involving multiple software processing packages, which tackled high-resolution related static issues and significantly reduced various noise elements. Dip-steering and structural filtering were employed on the stacked volume to further enhance the lateral coherence and to remove random noise and suppress acquisition footprints. The final volume shows flat and coherent above-zone stratigraphy, suggesting a good seal quality above the CO2 reservoir. The successful implementation of HR3D acquisition and the customized processing workflow verify the feasibility of HR3D seismics for the above- zone monitoring of offshore CO2 injection and storage projects.

Feng, Ye Erickson↗

SHALLOW MARINE HIGH-RESOLUTION 3D SEISMICS FOR ABOVE- ZONE CO2MONITORING: A CASE STUDY IN OFFSHORE JAPAN

Shallow marine high-resolution 3D (HR3D) seismic utilizes a novel seismic acquisition technology for imaging fine geological features not revealed by conventional 3D surveys. HR3D technology has been previously used for shallow subsurface studies, however is rarely implemented for monitoring injected fluids, and has not previously been used to monitor an active CO2 storage project. In this study, we for the first time demonstrate the acquisition, processing and initial interpretation of a HR3D seismic survey in Tomakomai, offshore Japan, where a large-scale CO2 storage project is being undertaken. As a seismic monitoring tool, the HR3D survey images the geologic overburden (< 1000 ms), aiming to detect potential CO2 leakage pathways above the injection reservoir. The HR3D acquisition system comprises a 210 in3 GI air gun and 4 streamers that are 25 m in length with 10 m inline separation. Each streamer has 8 channels with a 3.125 m group interval, yielding a very small final bin size of 3 x 3 m. The short offset and low-fold coverage of the HR3D data creates new challenges in seismic data processing, which demands a different data processing workflow tailored to the HR3D acquisition. We present a data processing workflow involving multiple software processing packages, which tackled high-resolution related static issues and significantly reduced various noise elements. Dip-steering and structural filtering were employed on the stacked volume to further enhance the lateral coherence and to remove random noise and suppress acquisition footprints. The final volume shows flat and coherent above-zone stratigraphy, suggesting a good seal quality above the CO2 reservoir. The successful implementation of HR3D acquisition and the customized processing workflow verify the feasibility of HR3D seismics for the above-zone monitoring of offshore CO2 injection and storage projects.

Feng, Ye E.↗

On the Need to Align Intent and Implementation in Uncertainty Quantification for Machine Learning

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and estimation across disciplines, and (b) the varying technical requirements for establishing trustworthy uncertainties in diverse problem contexts. In this position paper, we aim to clarify the depth of these challenges by identifying these inconsistencies and articulating how different contexts impose distinct epistemic demands. We examine the current landscape of estimation targets (e.g., prediction, inference, simulation-based inference), uncertainty constructs (e.g., frequentist, Bayesian, fiducial), and the approaches used to map between them. Drawing on the literature, we highlight and explain examples of problematic mappings. To help address these issues, we advocate for standards that promote alignment between the \textit{intent} and \textit{implementation} of uncertainty quantification (UQ) approaches. We discuss several axes of trustworthiness that are necessary (if not sufficient) for reliable UQ in ML models, and show how these axes can inform the design and evaluation of uncertainty-aware ML systems. Our practical recommendations focus on scientific ML, offering illustrative cases and use scenarios, particularly in the context of simulation-based inference (SBI).

Trivedi, Shubhendu [MIT] (ORCID:0000000312374301)↗

Managing Large Datasets for Atmospheric Research

Since the mid-1980s, airborne and ground measurements have been widely used to provide comprehensive characterization of atmospheric composition and processes. Field campaigns have generated a wealth of insitu data and have grown considerably over the years in terms of both the number of measured parameters and the data volume. This can largely be attributed to the rapid advances in instrument development and computing power. The users of field data may face a number of challenges spanning data access, understanding, and proper use in scientific analysis. This tutorial is designed to provide an introduction to using data sets, with a focus on airborne measurements, for atmospheric research. The first part of the tutorial provides an overview of airborne measurements and data discovery. This will be followed by a discussion on the understanding of airborne data files. An actual data file will be used to illustrate how data are reported, including the use of data flags to indicate missing data and limits of detection. Retrieving information from the file header will be discussed, which is essential to properly interpreting the data. Field measurements are typically reported as a function of sampling time, but different instruments often have different sampling intervals. To create a combined data set, the data merge process (interpolation of all data to a common time base) will be discussed in terms of the algorithm, data merge products available from airborne studies, and their application in research. Statistical treatment of missing data and data flagged for limit of detection will also be covered in this section. These basic data processing techniques are applicable to both airborne and ground-based observational data sets. Finally, the recently developed Toolsets for Airborne Data (TAD) will be introduced. TAD (tad.larc.nasa.gov) is an airborne data portal offering tools to create user defined merged data products with the capability to provide descriptive statistics and the option to treat measurement uncertainty.

Chen, Gao↗

Modern Scientific Data Governance Framework

Science has entered the era of Big Data with new challenges related to data governance, stewardship, and management. The existing data governance practices must catch up to ensure proper data management. Existing data governance policies and stewardship best practices tend to be disconnected from operational data management practices and enforcement and mainly exist in well-meaning documents or reports. These governance policies are, at best, partially implemented and rarely monitored or audited. In addition, existing governance policies keep adding additional data management steps that require a human, ‘a data steward’, in the loop, and the cost of data management can no longer scale proportionately with the current and future increased data volume and complexity. The goal for developing an updated data governance framework is to modernize scientific data governance to the reality of Big data and align it with the current technology trends such as cloud computing and AI. The goals of this framework are two folds. One is to ensure thoroughness that the governance adequately covers the entire data life cycle. Two, provide a practical approach that offers a consistent and repeatable process for different projects. Three core principles ground this framework. First, focus on just enough governance and prevent data governance from becoming a roadblock toward the scientific process. Remove any unnecessary processes and steps. Second, automate data management steps where possible. Actively remove steps that require ‘human in the loop’ within the management process to be efficient and scale with increasing data. Third, all the processes should continually be optimized using quantified metrics to streamline the monitoring and auditing workflows.

Rahul Ramachandran↗

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗

The future of Sinbad: learning from the best practices of ICSBEP - 24622

Two projects sanctioned by the Organisation for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) have over two decades of experience established comprehensive data sets in handbooks supporting criticality safety and reactor physics. The International Criticality Safety Benchmark Evaluation Project (ICSBEP), and later the International Reactor Physics Experiment Evaluation Project (IRPhEP) that was patterned after the success of the ICSBEP, serves as an example of quality and excellence in preserving our nuclear data heritage and establishing benchmark standards upon which current and future modeling, validation, and safety efforts can be supported. Many of the best practices and lessons learned from these benchmark projects can be adopted and adapted for use with the Shielding Integral Benchmark Archive and Database (SINBAD) to prepare higher quality shielding benchmark data to effectively expand the availability of qualified experimental data available to the nuclear community. The unique experiments performed and aggregated within SINBAD represent characteristic measurements, techniques, and applications not captured with the specificity of nuclear criticality safety or traditional reactor physics applications. Application of evaluated SINBAD benchmark data would challenge and enhance our current nuclear data and modeling and simulation strategies. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-mission ground data systems - breakthroughs and challenges

Given the cost-constrained nature of JPL Flight Projects, especially Discovery Class missions, there is more and more pressure to reduce the costs associated with mission operations, particularly the costs for the Ground Data System. This paper explores the successes (and failures) of using the Mission Management Office (MMO) GDS team to provide a common set of services, tools, procedures, and products to JPL Flight Projects.

GDS↗

Fusing time-varying mosquito data and continuous mosquito population dynamics models

Climate change is arguably one of the most pressing issues affecting the world today and requires the fusion of disparate data streams to accurately model its impacts. Mosquito populations respond to temperature and precipitation in a nonlinear way, making predicting climate impacts on mosquito-borne diseases an ongoing challenge. Data-driven approaches for accurately modeling mosquito populations are needed for predicting mosquito-borne disease risk under climate change scenarios. Many current models for disease transmission are continuous and autonomous, while mosquito data is discrete and varies both within and between seasons. This study uses an optimization framework to fit a non-autonomous logistic model with periodic net growth rate and carrying capacity parameters for 15 years of daily mosquito time-series data from the Greater Toronto Area of Canada. The resulting parameters accurately capture the inter-annual and intra-seasonal variability of mosquito populations within a single geographic region, and a variance-based sensitivity analysis highlights the influence each parameter has on the peak magnitude and timing of the mosquito season. This method can easily extend to other geographic regions and be integrated into a larger disease transmission model. This method addresses the ongoing challenges of data and model fusion by serving as a link between discrete time-series data and continuous differential equations for mosquito-borne epidemiology models.

97 MATHEMATICS AND COMPUTING↗

Multifold Insights for Power System Dynamics From Data Assimilation: Meeting Current Challenges

The world’s electric power grids have evolved over the last 120 years from a single power line to today’s large networks. The evolution will continue at an accelerated rate with extensive smart grid development worldwide. Here for example, the U.S. government has set a goal of reaching 100 percent carbon pollution-free electricity by 2035, while the Department of Energy (DOE) shared a goal to deploy 30 GW and 110 GW of offshore wind by 2030 and 2050, respectively. To meet such ambitious goals, in the years to come, a significant percentage of electricity will come from intermittent renewable sources, electric vehicles (EVs), and be supplied to a vast number of loads that will actively respond to grid conditions and incentive signals. This development is largely driven by environmental and economic factors, such as reducing carbon emissions and saving electricity cost for consumers. These energy resources lead to new uncertain behaviors and dynamics which the grid has never seen and were not considered in its design. Operating such a dynamic grid with sufficient reliability and efficiency is a monumental challenge.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Nuclide inventory validation: radiochemical assay data quality and modeling challenges in benchmark models development

Oak Ridge National Laboratory is conducting radiochemical assay experiments, using high-precision analytical protocols validated with a comprehensive quality assurance plan, to expand the nuclide inventory validation basis for high burnup spent nuclear fuel. Preliminary measurement data for key actinides and fission products in two pressurized water reactor spent fuel samples are being used to investigate the impact of measurement data uncertainty on the sample burnup estimation. These measurement data are also being used to examine the impact of assumptions applied when developing best-estimate computational models to simulate fuel irradiation history. The simulations are being performed using depletion capabilities in the SCALE code system. Comparison of calculated and measured nuclide concentrations shows good agreement for the considered nuclides. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Laser confocal microscope for analysis of 3013 inner container closure weld region

As part of the protocol to investigate the corrosion in the inner container closure weld region (ICCWR) a laser confocal microscope (LCM) was used to perform close visual examination of the surface and measurements of corrosion features on the surface. However, initial analysis of selected destructively evaluated (DE) containers using the LCM revealed several challenges for acquiring, processing and interpreting the data. These challenges include topography of the ICCWR sample, surface features, and the amount of surface area for collecting data at high magnification conditions. In FY17, the LCM parameters were investigated to identify the appropriate parameter values for data acquisition and identification of regions of interest. Using these parameter values, selected DE containers were analyzed to determine the extent of the ICCWR to be examined.

36 MATERIALS SCIENCE↗

Networked Microgrid Ownership, Data, and Control Implications: Challenges and Open Questions

Microgrid deployments increasingly favor the potential to form networks for greater benefits to resilience, reliability, and energy sovereignty. Both independent and networked micro-grids predominantly have a single-entity-ownership and control, where the associations from ownership to data requirements to control functions to microgrid objectives is linear. The emerging model, however, is cyclical, with bidirectional causal impacts between each of the 4 pillars: there are more complex mixed ownership models across the physical, electrical, data, communications, protection, and control boundaries that impact the data requirements for meeting control functions that help realize the use-cases or objectives. This paper is the first to delineate the pillars for effective ownership and controllability of both independent as well as networked microgrids through the cyclical model, and present barriers to the adoption of such a model.

Sundararajan, Aditya↗

Integrating Multiple Types of Data for Signaling Research: Challenges and Opportunities

New technologies promise to provide unprecedented amounts of information that can provide a foundation for creating predictive models of cell signaling pathways. To be useful, however, this information must be integrated into a coherent framework. In addition, the sheer volume of data gathered from the new technologies requires computational approaches for its analysis. Unfortunately, there are many barriers to data integration and analysis, mostly because of a lack of adequate data standards and their inconsistent use by scientists. However, solving the fundamental issues of data sharing will enable the investigation of entirely new areas of cell signaling research.

59 BASIC BIOLOGICAL SCIENCES↗

Data from: "Reply to ‘The challenge of defining effectively-no-snow’"

This repository contains the data and code associated with the paper titled "Reply to ‘The challenge of defining effectively-no-snow’" published in Nature Reviews Earth and Environment, 2026. In this reply, we argue that the 10th percentile of peak SWE (Snow Water Equivalent), which we propose in the original article, can be used as intended given it's a standardized, impact-based benchmark for comparing snow conditions across regions, not as a literal measure of snow absence. We present new evidence with SNOwpack TELemetry (SNOTEL) data showing that years meeting the threshold are overwhelmingly associated with subsequent drought (given United States Drought Monitor conditions), supporting its hydrologic and societal relevance. We conclude that while the distinction between "effectively no snow" and "zero snow" should be clearly communicated, the original definition remains appropriate for assessing impacts on snow-dependent water systems. The file code_nree_ML_reply_2026.Rmd contains the main processing scripts which analyze the SNOTEL data. Data from the US Drought Monitor was downloaded at: https://usdmdataservices using the Get Drought Severity Statistics By Area Percent' option, saved to the *_HUC4_delineated.csv files (Hydrologic Unit Code), which are labeled accordingly. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > TERRESTRIAL HYDROSPHERE > SNOW/ICE↗

Modal data for the BARC challenge problem Test Report

Modal testing was performed on the uncut BARC structure as a whole and broken into its two sub-assemblies. The structure was placed on soft foam during the test. Excitation was provided with a small modal hammer attached to an actuator. Responses were measured using a 3D Scanning Laser Doppler Vibrometer. Data, shapes, and geometry from this test can be downloaded in Universal File Format from the Sandia Connect SharePoint site.

47 OTHER INSTRUMENTATION↗

Working Group on Virtual Data Integration

This report is the outcome of a workshop commissioned by the U.S. Department of Energy’s (DOE) Climate and Environmental Sciences Division (CESD) to examine current and future data infrastructure requirements foundational for achieving CESD scientific mission goals in advancing a robust, predictive understanding of Earth’s climate and environmental systems. Over the past several years, data volumes in CESD disciplines have risen sharply to unprecedented levels (tens of petabytes). Moreover, the complexity and diversity of this research data— including simulations, observations, and reanalysis— have grown significantly, posing new challenges for data capture, storage, verification, analysis, and integration. With the trends of increased data volume (in the hundreds of petabytes), more complex analysis processes, and growing cross-disciplinary collaborations, it is timely to investigate whether the CESD community has the computational and data support needed to fully realize the scientific potential of its data collections. In recognition of the challenges, a partnership is forming across CESD and among national and international agencies to examine the viability of creating an integrated, collaborative data infrastructure: a Virtual Laboratory. The overarching goal of this report is to identify the community’s key data technology requirements and high-priority development needs for sustaining and growing its scientific discovery potential. The report also aims to map these requirements to existing solutions and to identify gaps in current services, tools, and infrastructure that will need to be addressed in the short, medium, and long term to advance scientific progress.

54 ENVIRONMENTAL SCIENCES↗

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗