Search NASA⌕ Search

SEARCH · Search NASA

Results for “data challenges”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Challenges and Opportunities in Turning Large U.S. Archives of Analog Seismograms into a Modern Usable Resource

Abstract Quantitative seismology is based firmly on the analysis of actual ground motions, and the transition to digital recording in the 1980s enabled sophisticated new capabilities to extract useful results from waveforms. With some effort, these tools can also be applied to analog records. Focusing on assets available within U.S. institutions, we review the necessary steps and the challenges in enabling “data rescue”—that is, preserving the scientific information latent in large analog seismogram archives and making it usable. They include: determining what assets are available (the analog seismogram archives held by various institutions, with associated metadata on instrument responses, station locations, and timing information); developing a consensus on the top level of a triage process (which analog records most definitely should be rescued?); deciding the level of quality needed in copying original seismograms to media suitable for digitizing; assessing the relative merits of scanning and digitizing; and, the need for a community service in distributing scans and digital records, as they accumulate. The necessary level of effort can benefit from practical experience. For example, specific studies have used digitized versions of analog recordings to model earthquake sources and assess seismic hazard. Other studies have used them to gain experience with nuclear explosion signals recorded at regional distances, noting that regional signals enable explosions to be monitored down to levels much lower than those attainable teleseismically. The opportunities presented by large archives of analog seismograms include the insights they present to current and future seismologists studying earthquakes and explosions, into the practical areas of assessing seismic hazard, monitoring for test ban compliance down to low explosion yields—and prompt characterization of actual explosions should they occur, as well the traditional academic pursuit of a better understanding of earthquake physics.

Geochemistry & Geophysics↗
DOE OSTI2020

ASCR@40

One page flyers on: A Revolution in Modeling and Simulation; Applying Equations to Complex Problems; Uncertainty Quantification; Moving Big Data; Grid Computing for High-Speed Collaboration; Making Sense of Big Data; Overcoming Scaling Challenges; Building Better Computers; World-Leading Computing Facilities; Supporting Science Through Open-Source Software; and Building the Computational Workforce. Content provided by Department of Energy multiprogram laboratory researchers. Prepared by the Krell Institute for the ASCAC Subcommittee on the 40-year History of ASCR.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Assessing the nexus between groundwater and solar energy plants in a desert basin with a dual-model approach under uncertainty

Globally, many solar power plants and other types of renewable energy are being located in water-scarce regions. Many projects rely on groundwater resources whose sustainability is uncertain. In the Chuckwalla Basin in California, quantification of recharge and trans-valley underflow is needed to estimate the impacts of solar project withdrawals on the water table. However, such estimates are highly challenging due to data scarcity, heterogeneous soils and long residence times. Conventional assessment employs isolated groundwater models configured with crude and uniform estimates of recharge. Here, we employ a data-constrained surface subsurface processes model, PAWS+CLM, to provide an ensemble of recharges and underflows with perturbed parameters. Then, the Parameter Estimation (PEST) package is used to calibrate MODFLOW aquifer conductivity and filter out implausible recharges. The novel dual-model approach, potentially applicable in other arid regions, can effectively assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was assumed, it resulted in under-estimated drawdown and larger uncertainty bounds. The withdrawals are approaching total inflow, suggesting the system will be nearing, if not exceeding, its sustainable groundwater production capacity, and a boom of such projects will not be sustainable. Especially, the cost/benefit of pumped-storage projects is called into question as the initial-fill phase depletes entire area’s recharge. Our study highlights the stress on groundwater resources of solar development, and that the speed of groundwater recovery does not indicate sustainability. Main point 1: A novel dual model approach, involving an integrated surface/subsurface model and a groundwater parameter-estimation model, was able to better constrain the model. Main point 2: The groundwater system may be nearing, if not exceeding, its sustainable groundwater production capacity and the speed of recovery is not indicative of sustainability. Main point 3: Results from using conventionally-assumed uniform recharge distort calibrated K fields and impacts assessment

14 SOLAR ENERGY↗
DOE OSTI2024

Evolving Multi-hazard Machine Learning Modeling for Advanced Risk-Informed Infrastructure Resilience Assessment

The socioeconomic impacts of pipeline incidents have escalated over the past three decades, revealing the limitation of traditional risk modeling methods when applied to extensive pipeline networks. This research aims to develop machine learning (ML) models that effectively identify, rank, and predict the diverse hazards and socioeconomic consequences associated with pipeline incidents. Utilizing historical data on pipeline incidents alongside weather and oceanographic data from the 1980s onward, the Houston metropolitan area serves as a testbed for the proposed methodologies. The research segments the combined datasets into three consecutive periods, demonstrating the efficacy of the updated model in predicting future events, particularly concerning precipitation rate data. Despite the challenges posed by a relatively limited dataset, local-level ML modeling offers valuable insights into the spatial and temporal dynamics of multiple hazards that contribute to pipeline incidents. These findings hold significant implications for future research, particularly in understanding and mitigating risks in various locations across the Gulf Coast and other coastal regions.

42 ENGINEERING↗
DOE OSTI2025

Application of Artificial Intelligence/Machine Learning to Operations Research

This report examines the transformative impact of Artificial Intelligence (AI) and Machine Learning (ML) on operations research, private industry, and government sectors, highlighting their applications in automating processes, enhancing decision-making, and optimizing complex systems. AI/ML technologies have revolutionized industries through predictive maintenance, supply chain optimization, and autonomous systems, while also advancing public safety and defense operations. However, challenges such as data integrity, model transparency, and the need for human oversight persist, particularly in high-consequence environments. The report emphasizes the critical role of explainable AI (XAI) and human-computer interaction models like Human-in-the-Loop (HITL) and Human-on-the-Loop (HOTL) in fostering trust and accountability. Balancing automation with ethical responsibility and transparency is essential for the continued successful integration of AI/ML into operational and strategic decision-making frameworks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗
DOE OSTI2025

Computational Prediction of Infrasound Arrival Times and Directions from Stationary and Moving Impulsive Sources

This report addresses the need to predict infrasound signal arrival times and back azimuths at monitoring stations, enabling more focused and efficient searches within recorded waveform data. The primary challenge is estimating expected signal arrival windows for stationary and moving acoustic sources, such as chemical explosions, volcanic eruptions, meteoroids, and spacecraft re-entry events. To address this challenge, a reproducible methodology is described that uses simplified propagation speeds for boundary layer, tropospheric, stratospheric, and thermospheric atmospheric waveguides. While the Python source code itself is not freely available, this document provides detailed, step-by-step instructions, and equations enabling users to replicate and adapt the method independently. The method reliably predicts signal arrival intervals and back azimuths, thereby supporting rapid detection and accurate interpretation of infrasound events. Results demonstrate that this method effectively identifies plausible signal arrival intervals and directions, facilitating faster event detection and more reliable interpretation. This methodology directly supports atmospheric monitoring, planetary defense, and forensic analysis of explosive atmospheric events.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Decision Tree for Variable Selection vs. Impact on Durability for Biomass and Biochar Burial Pathways [Slides]

Quantifying durability for lower-TRL BiCRS pathways has been challenging as limited data are available from real-world projects and long-term experiments, resulting in an overall lack of scientific consensus. We develop a decision tree that aims to summarize the current scientific understanding and state-of-the-art project experience. The decision tree can be used to (1) guide the selection of key variables and evaluate their relative impact on durability, (2) identify data and knowledge gaps for future research.

09 BIOMASS FUELS↗
DOE OSTI2026

Thriving in the Carbon-Aware Market: How to Account for Emissions in the Era of Carbon-Centered Trade Policies

Emerging global policies, such as the European Union's enacted Carbon Border Adjustment Mechanism and similar policies under development in Canada, Australia and the United Kingdom, will place a premium on goods traded into their territories with higher embedded emissions than those produced domestically. U.S. manufacturers could stand to benefit from such policies; given the investments U.S. industry has made to reduce the energy and emission intensities of its operations. For example, the overall GHG intensity of U.S. steel production in 2019 was ~0.96 t CO2/t steel, less than half that of China (~1.97 t CO2/t steel), and bested only by Italy. To realize these benefits, transparent, accurate, interoperable and accepted embedded emissions accounting and calculation methods are required. Achieving this requires overcoming challenges related to data availability, boundary definitions, and product definitions among others, both at individual facilities as well as through value chains. We will present technical findings on methodology considerations and data-availability constraints for determining the emissions of traded goods, using steel as a pilot and leveraging publicly available data. Issues such as determining the appropriate scope for emissions accounting, implications of the specificity of product chosen, emissions allocation in multi-product facilities, and enumeration of emissions for products manufactured across multiple facilities will be discussed. By sharing the results of our efforts, we aim to inform the development and execution of embedded emissions accounting methods from a technical perspective such that U.S. manufacturers can thrive in emerging global markets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Experimental studies at low $Q^2$ of the spin structure of the nucleon at Jefferson Lab

We summarize the experimental program of Jefferson Lab that studies the nucleon spin structure at low $Q^2$. This program completes the precise experimental mapping of the nucleon spin structure functions $g_1(\nu, Q^2)$ and $g_2(\nu, Q^2)$ and their moments started at SLAC, CERN and DESY at high $Q^2$, and continued at Jefferson Lab at intermediate $Q^2$. The results presented cover the domain where Chiral Effective Field Theory ($\chi$EFT) should describe the strong interaction. They provide a comprehensive set of benchmark measurements for $\chi$EFT. The preliminary conclusion is that nucleon spin structure data are still challenging for $\chi$EFT in spite of the notable improvements in these calculations.

Deur, Alexandre↗
DOE OSTI2022

Small experiment, Big Data: the data production of the Muon $g-2$ Experiment

The Muon $g-2$ Experiment at Fermilab aims to measure the muon anomalous magnetic moment with the unprecedented precision of 140 parts per billion (ppb). In April 2021 the collaboration published the first measurement, based on the first year of data taking. The result confirmed the previous experiment at Brookhaven National Laboratory (BNL), and increased the long-standing tension with the Standard Model prediction to 4.2 $\sigma$. The experiment is now running the sixth year of data acquisition of positive muon data, having accumulated a total of $\sim$19 times the statistics of the BNL experiment. A collaboration-wide effort is now in place to help produce the multi-petabyte-sized data sets, a challenge typically faced by much bigger experiments. Having a quick production turnaround time is of critical importance in order to achieve a timely analysis and publication schedule. In this paper I will describe the production workflow, the former and current challenges, the resources, tools, and the future prospects of the Muon $g-2$ Experiment.

Girotti, Paolo↗
DOE OSTI2024

Advanced manufacturing and digital twin technology for nuclear energy*

Advanced manufacturing techniques and digital twin technology are rapidly transforming the nuclear industry, offering the potential to enhance productivity, safety, and cost-effectiveness. Customized parts are being produced using additive manufacturing, automation, and robotics, while digital twin technology enables the virtual modeling and optimization of complex systems. These advanced technologies can significantly improve operational efficiency, predict system behavior, and optimize maintenance schedules in the nuclear energy sector, leading to heightened safety and reduced downtime. However, the nuclear industry demands the highest levels of safety and security, as well as intricate manufacturing processes and operations. Thus, challenges such as data management and cybersecurity must be addressed to fully realize the potential of advanced manufacturing techniques and digital twin technology in the nuclear industry. This comprehensive review highlights the critical role of digital twin technology with advanced manufacturing toward nuclear energy to improve performance, minimize downtime, and heighten safety, ultimately contributing to the global energy mix by providing dependable and low-carbon electricity.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Improving robustness for model discerning synthesis process of uranium oxide with unsupervised domain adaptation

The quantitative characterization of surface structures captured in scanning electron microscopy (SEM) images has proven to be effective for discerning provenance of an unknown nuclear material. Recently, many works have taken advantage of the powerful performance of convolutional neural networks (CNNs) to provide faster and more consistent characterization of surface structures. However, one inherent limitation of CNNs is their degradation in performance when encountering discrepancy between training and test datasets, which limits their use widely. The common discrepancy in an SEM image dataset occurs at low-level image information due to user-bias in selecting acquisition parameters and microscopes from different manufacturers. Therefore, in this study, we present a domain adaptation framework to improve robustness of CNNs against the discrepancy in low-level image information. Furthermore, our proposed approach makes use of only unlabeled test samples to adapt a pretrained model, which is more suitable for nuclear forensics application for which obtaining both training and test datasets simultaneously is a challenge due to data sensitivity. Through extensive experiments, we demonstrate that our proposed approach effectively improves the performance of a model by at least 18% when encountering domain discrepancy, and can be deployed in many CNN architectures.

scanning electron microscopy↗
DOE OSTI2024

Transforming Agricultural Productivity with AI-Driven Forecasting: Innovations in Food Security and Supply Chain Optimization

Global food security is under significant threat from climate change, population growth, and resource scarcity. This review examines how advanced AI-driven forecasting models, including machine learning (ML), deep learning (DL), and time-series forecasting models like SARIMA/ARIMA, are transforming regional agricultural practices and food supply chains. Through the integration of Internet of Things (IoT), remote sensing, and blockchain technologies, these models facilitate the real-time monitoring of crop growth, resource allocation, and market dynamics, enhancing decision making and sustainability. The study adopts a mixed-methods approach, including systematic literature analysis and regional case studies. Highlights include AI-driven yield forecasting in European hydroponic systems and resource optimization in southeast Asian aquaponics, showcasing localized efficiency gains. Furthermore, AI applications in food processing, such as plasma, ozone and Pulsed Electric Field (PEF) treatments, are shown to improve food preservation and reduce spoilage. Key challenges—such as data quality, model scalability, and prediction accuracy—are discussed, particularly in the context of data-poor environments, limiting broader model applicability. The paper concludes by outlining future directions, emphasizing context-specific AI implementations, the need for public–private collaboration, and policy interventions to enhance scalability and adoption in food security contexts.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Topological network analysis of patient similarity for precision management of acute blood pressure in spinal cord injury

Background: Predicting neurological recovery after spinal cord injury (SCI) is challenging. Using topological data analysis, we have previously shown that mean arterial pressure (MAP) during SCI surgery predicts long-term functional recovery in rodent models, motivating the present multicenter study in patients. Methods: Intra-operative monitoring records and neurological outcome data were extracted (n = 118 patients). We built a similarity network of patients from a low-dimensional space embedded using a non-linear algorithm, Isomap, and ensured topological extraction using persistent homology metrics. Confirmatory analysis was conducted through regression methods. Results: Network analysis suggested that time outside of an optimum MAP range (hypotension or hypertension) during surgery was associated with lower likelihood of neurological recovery at hospital discharge. Logistic and LASSO (least absolute shrinkage and selection operator) regression confirmed these findings, revealing an optimal MAP range of 76–[104-117] mmHg associated with neurological recovery. Conclusions: We show that deviation from this optimal MAP range during SCI surgery predicts lower probability of neurological recovery and suggest new targets for therapeutic intervention. Funding: NIH/NINDS: R01NS088475 (ARF); R01NS122888 (ARF); UH3NS106899 (ARF); Department of Veterans Affairs: 1I01RX002245 (ARF), I01RX002787 (ARF); Wings for Life Foundation (ATE, ARF); Craig H. Neilsen Foundation (ARF); and DOD: SC150198 (MSB); SC190233 (MSB); DOE: DE-AC02-05CH11231 (DM).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Deconvolute individual genomes from metagenome sequences through short read clustering

Metagenome assembly from short next-generation sequencing data is a challenging process due to its large scale and computational complexity. Clustering short reads by species before assembly offers a unique opportunity for parallel downstream assembly of genomes with individualized optimization. However, current read clustering methods suffer either false negative (under-clustering) or false positive (over-clustering) problems. Here we extended our previous read clustering software, SpaRC, by exploiting statistics derived from multiple samples in a dataset to reduce the under-clustering problem. Using synthetic and real-world datasets we demonstrated that this method has the potential to cluster almost all of the short reads from genomes with sufficient sequencing coverage. The improved read clustering in turn leads to improved downstream genome assembly quality.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Application of the DNAS framework expansion to occupant population synthesis

Research in occupant behaviour is now using a more elaborate framework of building occupant interaction. Researchers often face challenges in collecting data, particularly for the data to meet the minimum number of required data points and the data interoperability requirements. Researchers address the first issue with the synthetic population and the latter with data ontologies. While synthetic population is commonly used to address the first issue, data ontology development is used to address the latter. The two solutions are complementary to each other. One of the known ontologies in building occupant behaviour research is the Drivers-Needs-Actions-Systems (DNAS) ontology, which has been used by building modelers to describe energy-related occupant behaviour. This paper describes the ontology-based synthetic population generation that can be used in the agent-based modeling (ABM) applications. This paper considers multiple data sources, including ASHRAE Thermal Comfort DB II and IEA Annex 66 data sets. A case study of an office building is used to present the workflow of DNAS framework expansion, synthetic population generation, and agent-based modeling.

Chandra Putra, Handi↗