Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Policy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Using mixed methods to construct and analyze a participatory agent-based model of a complex Zimbabwean agro-pastoral system

Complex social-ecological systems can be difficult to study and manage. Simulation models can facilitate exploration of system behavior under novel conditions, and participatory modeling can involve stakeholders in developing appropriate management processes. Participatory modeling already typically involves qualitative structural validation of models with stakeholders, but with increased data and more sophisticated models, quantitative behavioral validation may be possible as well. In this study, we created a novel agent-basedmodel applied to a specific context: Zimbabwean non-governmental organization the Muonde Trust has been collecting data on their agro-pastoral system for the last 35 years and had concerns about land-use planning and the effectiveness of management interventions in the face of climate change. We collaboratively created an agent-based model of their system using their data archive, qualitatively calibrating it to the observed behavior of the real system without tuning any parameters to match specific quantitative outputs. We then behaviorally validated the model using quantitative community-based data and conducted a sensitivity analysis to determine the relative impact of underlying parameter assumptions, Indigenous management interventions, and different rainfall variation scenarios. We found that our process resulted in a model which was successfully structurally validated and sufficiently realistic to be useful for Muonde researchers as a discussion tool. The model was inconsistently behaviorally validated, however, with some model variables matching field data better than others. We observed increased model system instability due to increasing variability in underlying drivers (rainfall), and also due to management interventions that broke feedbacks between the components of the system. Interventions that smoothed year-to-year variation rather than exaggerating it tended to improve sustainability. The Muonde trust has used the model to successfully advocate to local leaders for changes in land-use planning policy that will increase the sustainability of their system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Comparative Assessment of Data-driven Process Models in Health Information Technology

Process mining for conformance analysis consists of comparing a reference process model against a data-driven process model generated via log files from information technology systems. However, in the absence of a complete reference process model, we found no suggested approaches in the literature to address the need for evaluating process conformance among different healthcare facilities to assess standardization of care. Our goal is to find similarities and dissimilarities in data-driven process models among US Veterans Health Administration (VHA) facilities that can be indicative of patient safety issues. Our hypothesis was that the analysis would not produce statistically significant differences in outcome. We present a unique implementation of conformance analysis in process mining that consists of combining process mining, process mapping and statistical metrics. We illustrate our approach by applying it to the analysis of two clinical radiology order process models generated from healthcare data provided by two similar facilities in the VHA. The comparative assessment showed that about 70% of the orders completed successfully and 30% were not completed due to policy and duplications. Our analysis found a good statistical correlation between both facilities, as the Spearman’s correlation coefficient between facilities for the frequency of cases per total hours was 0.87879, for the frequency of cases by state transition was 0.79702 and for the throughput time per state transition was 0.63582. Additional statistical analyses using the Mann-Whitney U test and the root mean square error both produced values that were not significant. The foregoing approach validated our hypothesis by demonstrating a good statistical correlation of data describing the flow of clinical radiology orders absent a credible reference model. Finding good agreement between both facilities was important in confirming that the clinical orders flow in a similar manner, suggesting standardization of care.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Operating Dynamic Reserve Dimensioning Using Probabilistic Forecasts

The rapid integration of variable energy sources (VRES) into power grids increases variability and uncertainty of the net demand, making the power system operation challenging. Operating reserve is used by system operators to manage and hedge against such variability and uncertainty. Traditionally, reserve requirements are determined by rules-of-thumb (static reserve requirements, e.g., NERC Reliability Standards), and more recently, dynamic reserve requirements from tools and methods which are in the adoption process (e.g., DynADOR, DRD, and RESERVE, among others). While these methods/tools significantly improve the static rule-of-thumb approaches, they rely exclusively on deterministic data (i.e., best guess only). Consequently, these methods disregard the probabilistic uncertainty thresholds associated with specific days and their weather conditions (i.e., best guess plus probabilistic uncertainty). This work presents practical approaches to determine the operating reserve requirements leveraging the wealth information from probabilistic forecasts. Proposed approaches are validated and tested using actual data from the CAISO system. Furthermore, results show the benefits in terms of risk reduction of considering the probabilistic forecast information into the dimensioning process of operating reserve requirements.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Learning Optimal Power Flow Solutions using Linearized Models in Power Distribution Systems

Solving nonlinear optimal power flow (OPF) problem is computationally expensive, and poses scalability challenges for power distribution networks. An alternative to solving the original nonlinear OPF is the linear approximated OPF models. Although, these linear approximated OPF models are fast, the resulting solutions may result in significant optimality gap. Lately, the application of machine learning (ML) methods in successfully solving the nonlinear OPF has been reported. These methods learn and estimate the nonlinear control policies using a purely data-driven approach. In this paper, we propose an approach to complements the ML based approach to solving OPF using solutions from known linearized OPF model. Specifically, we use supervised learning to map the solutions of linear OPF to nonlinear control variables. Unlike, the traditional ML based methods for OPF that approximate the full distribution feeder model using function approximation, our approach uses a two-node approximation of radial networks. The proposed approach is validated using IEEE 123 bus test system for OPF solutions obtained using the nonlinear OPF models.

optimal power flow, power distribution systems, su↗
DOE OSTI2023

Examining Rail Transportation Route of Crude Oil in the United States Using Crowdsourced Social Media Data

Safety issues associated with transporting crude oil by rail have been a concern since the boom of the U.S. domestic shale oil production in 2012. During the last decade, over 300 crude-oil-by-rail incidents have occurred in the United States. Some of them have caused adverse consequences including fire and hazardous materials leakage. However, only limited information on crude-on-rail routes and their associated risks is available to the public. To this end, this study proposed an unconventional way to reconstruct crude-on-rail routes using geotagged photos harvested from the Flickr website. The proposed method linked the geotagged photos of crude oil trains posted online with national railway networks to identify potential railway segments that those crude oil trains were traveling on. Here, a shortest path-based method was applied to infer the complete crude-on-rail routes, by utilizing the confirmed railway segments as well as their directional information. Validation of the inferred routes was performed using a public map and official crude oil incident data. The results suggested that the inferred routes based on geotagged photos had high coverage, with approximately 96% of the documented crude oil incidents aligned with the reconstructed crude-on-rail network. The inferred crude oil train routes were found to pass through several metropolitan areas of high population density, who were exposed to potential risk. These findings could improve situational awareness for policy makers and transportation planners. In addition, with the inferred routes, this study has established a good foundation for future crude oil train risk-analyses along the rail route.

42 ENGINEERING↗
DOE OSTI2024

Power Sharing-Based Framework for Allocating Automatic Generation Control in Distributed Energy Resources: Preprint

The recent proliferation of distributed energy resources (DERs) in the power network along with the retirement of conventional generators has made it challenging to regulate system frequency. In this paper, we present a centralized control framework to leverage the potential of DERs in the distribution network in provisioning secondary frequency control services to the grid. The proposed framework is based on network volt-watt sensitivity analysis and takes into account DER operational and network-imposed constraints to allocate the automatic generation control (AGC) request among the aggregated units. The proposed framework was implemented on the IEEE 8500-node test feeder and results were validated against a standard linear programming-based scheme. Numerical results indicate that the proposed framework can successfully utilize the available power production headroom of the network to meet the AGC request while maintaining nodal voltages within acceptable limits.

distributed energy resources↗
DOE OSTI2023

Beyond Price Taker: Conceptual Design and Optimization of Integrated Energy Systems Using Machine Learning Market Surrogates

Future electricity generation systems must be optimized to provide flexibility that counteracts the variability of non-dispatchable renewable energy sources and ensures the reliability and safety of critical infrastructure, including the electric grid. The current state-of-the-art is to co-optimize the design and operation of integrated energy systems (IES) treating historical or predicted time-series electricity prices as fixed parameters. Recent literature has shown the limitations of this price taker assumption, which neglects how IES optimization decisions influence market outcomes. As such, this paper proposes a new optimization formulation that uses machine learning surrogate models, trained from a library of annual market operation simulations, to embed IES market interactions into the co-optimization problem directly. Using a thermal generator example built in the open-source IDAES computational environment, we show that the price taker approach routinely over-predicts annual revenues by 8% or more compared to a validation simulation, where the proposed approach has a typical relative error of 1% or less.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Field Evaluation of the Caney Shale as an Emerging Unconventional Play, Southern Oklahoma

The Mississippian-age Caney Shale is an emerging unconventional oil and gas (UOG) resource play in the southern Midcontinent and is prospective in the Anadarko, Ardmore, Marietta and western Arkoma basins. This play is enigmatic in that time equivalent Fayetteville Shale in the eastern Arkoma basin and Barnett Shale in the Ft. Worth Basin are major unconventional plays, whereas Caney Shale production is sparse and unpredictable (Cardott, 2017). In the Anadarko, Ardmore and Marietta basins, the Caney Shale is in the oil window, but its resource potential has not been adequately assessed. The Caney reservoir is about 60-300 m thick, is rich in total organic carbon, contains a large oil resource base, and has a strong natural gas drive; however, development has been hampered by high clay content and reactivity of the formation with water. The main objective of this initial four-year research project was to address these issues by establishing a Caney Shale Field Laboratory in the Ardmore Basin of southern Oklahoma to (a) conduct a comprehensive field characterization (b) perform field experiments, and (c) validate cost-effective technologies that will lead to a comprehensive and efficient development strategy plan for Caney Shale.

02 PETROLEUM↗
DOE OSTI2025

EVI-Rental: A Scalable Model to Quantify the Impact of Rental Car Electrification

This fact sheet describes the Electric Vehicle Infrastructure - Rental Car (EVI-Rental) tool, a flexible and comprehensive simulation tool that addresses key questions about the charging demand, infrastructure needs, and business impacts of adding growing numbers of electric vehicles (EVs) to rental fleets. To validate the EVI-Rental model, the Athena research team conducted a case study at Dallas-Fort Worth International Airport (DFW) to understand the impact of state-of-charge requirements, different charger types and charging schedules, solar power generation, and behind-the-meter storage on a fully electrified rental car fleet.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

2022 Combined Heat and Power/District Energy System Portfolio Meeting (Summary Report)

The U.S. Department of Energy’s (DOE’s) Advanced Manufacturing Office held the 2022 Combined Heat and Power & District Energy System Portfolio Meeting on June 7–9, 2022. The meeting brought together approximately 50 researchers from industry, national laboratories, and research institutes. The purpose of the meeting was for DOE to understand the performance of the projects being sponsored through the CHP program and the status of the technology development, which informs future program planning. This report summarizes the presentations that took place at this event.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Challenges and Opportunities in Magnetospheric Space Weather Prediction

Abstract Space Weather is the study of the dynamics of the coupled Solar‐Terrestrial environment, as these dynamics impact technological systems and human activity. This paper reviews a selection of the advances, challenges, and new opportunities for magnetospheric space weather, and while the focus is on specific phenomena, many other aspects of space weather will have similar challenges and needs. As a scientific field with direct applications, the field of space weather is partly driven by imperatives from both policy and operations. We provide an introduction to some of the context in which the field exists and discuss how this might shape future developments and norms within the space weather enterprise. We briefly examine benchmarking, as a policy and operationally driven activity, as it provides immediate societal relevance and an opportunity to stretch scientific understanding. As numerical space weather prediction now becomes routine, and exascale computing is in the near future, we identify challenges relating to computational expense and big data, capturing and accounting for uncertainties, and specification of boundary conditions. Here, as with the observations supporting numerical space weather prediction, the key challenge lies in extending the lead time of predictions. We also discuss the role of data, particularly in regard to model validation and empirical modeling. Due to the growing societal impact of space weather, we also examine the relationships between space weather and its terrestrial counterpart and look at the importance of continuous evaluation, monitoring progress in predictive capability, and communication with researchers, forecasters, and end users.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

A systematic analytical framework for multi-source municipal solid waste characterization for energy recovery

Advancing municipal solid waste (MSW) management from disposal-oriented practices toward circular, value-driven systems requires standardized methodologies capable of identifying material composition and resource recoverable potential at the point of generation. Despite extensive research, MSW characterization remains fragmented due to inconsistences in sampling methodologies, waste sorting categories, and temporal coverage across previous studies which limit cross-site comparability, reproducibility, and constrain the reliable evaluation of potential resource recovery pathways. This lack of consistency has hindered the development of a unified framework for MSW characterization and resource assessment. This study introduces a standardized, field-validated protocol for MSW sampling and composition analysis that ensures consistent, traceable data across diverse waste sources. The protocol integrates randomized spatial sampling, systematic material sorting, and controlled subsampling for multi-site and multi-season field campaigns. Validation included MSW collection from residential, grocery, restaurant, and school MSW streams across five U.S. states, including Maryland, Idaho, Virginia, Ohio, and Mississippi, to demonstrate the protocol’s ability to identify source-based composition patterns relevant to resource recovery applications. Grocery and restaurant streams were dominated by food waste and high-moisture organics, while school waste contained higher paper content and residential waste showed greater heterogeneity. Aggregation into energy-relevant fractions highlighted practical recovery pathways via anaerobic digestion or gasification, supporting data-driven planning, policy, and circular economy strategies for sustainable waste management across waste sources.

09 BIOMASS FUELS↗
DOE OSTI2022

Mass Detection for Heavy-Duty Vehicles using Gaussian Belief Propagation

Predicting vehicle mass is critical to accurately estimate energy use and emissions of commercial trucks. However, data from vehicle telematics is often not at sufficient temporal resolution or accuracy for use in model-based detection methods. In this work, a new statistical mass prediction technique is described for heavy-duty vehicles that incorporates the use Gaussian Belief Propagation (GBP) for probabilistic inference. Similar to Bayesian inference models, the GBP model typically requires less labeled training data than other contemporary machine learning techniques. First, a factor graph is constructed, and a set of Gaussian belief nodes with associated means and variances are fitted to the training data. To better handle noisy input data, the GBP mass prediction model utilizes a k-nearest factors (kNF) algorithm for probabilistic inference on unseen testing data. The proposed method is compared with a classical weighted k-nearest neighbors (kNN) regressor. This statistical kNF-GBP model works even with low-quantity, low-quality initial training data, while being capable of realtime mass estimation. Unlike the kNN regressor, the GBP model produces a measure of uncertainty with its predictions. The proposed method is validated using curve-sampled driving data collected from multiple cloud-connected Class 8 regional haul diesel trucks. Both the kNN regressor and the kNF-GBP mass prediction model were able to predict payload mass with coefficients of determination above 0.97 with minimal data preprocessing.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Individual low-carbon behaviors and influencing factors: Insights from a behavior survey study in China

Climate change is a major global concern. Greenhouse gas emissions that cause global climate change are directly or indirectly affected by human activities. Individual low-carbon behaviors are crucial in reducing CO 2 emissions and improving environmental and ecological health. To effectively promote individual low-carbon behavior, this study designed a questionnaire on the factors influencing individual low-carbon intentions and behavior based on theoretical models of environmental behavior. A total of 2430 valid questionnaires were collected in China. This study focuses on analyzing the impact of demographic characteristics, internal and external factors on individual low-carbon behaviors and their interrelationships. The research shows correlations between internal and external factors in determining low-carbon intention or behaviors. Internal factors-related low-carbon behavior is not closely linked with demographic variables, whereas the external factors-related low-carbon behavior vary significantly by age, residence, education, marital status, occupation, and income. The findings have important implications for designing effective policies to promote low-carbon behaviors, such as creating a more favorable external environment and increasing the use of policy tools for reducing CO 2 emission.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

DSS-SimPy-RL (Open-DSS and SimPy based Cyber-Physical RL environment) [SWR-23-29]

Recently, numerous data-driven approaches to control an electric grid using machine learning techniques have been investigated. With the advancement of reinforcement learning (RL) based techniques, gradually the conventional optimization based solvers are being replaced with RL approach where there is uncertainty in the environment such as renewable generation or cyber system emulation. However, to train an agent efficiently, it requires numerous interactions with an environment to learn the best policies. There are numerous RL environments for the power systems based on some well-known simulators, similarly there are environment for communication domains. While majority of the cyber emulators are based in an UNIX environment, the power simulators are based in the Windows-based operating system, the generation of cyber-physical mixed domain RL environment has been challenging. Existing co-simulation methods are efficient but resource and time intensive to generate large scale data set for training RL agents. Hence, this software focuses on development and validation of a mixed domain RL environment using Open DSS for the physical side and leverages a discrete event simulator python package, SimPy, for cyber-side emulation which is Operating Systems agnostic. Further utilizing this software co-simulation and training RL agents for re-routing based resilient control for network reconfiguration and volt-var control in power distribution feeder are performed.

Sahu, Abhijeet↗
DOE OSTI2020

Recent progress in microscale modeling of RF sheaths

The microscale properties of RF sheaths in the ion cyclotron range of frequencies (ICRF) are investigated by means of analytical theory, nonlinear fluid and particle-in-cell (PIC) code modeling. Previous work that parametrized RF sheath properties, specifically the RF sheath impedance and the rectified (DC) sheath potential, is generalized to include the effect of net DC current flow through the sheath. Analytical results are presented in the low frequency limit where the displacement current is negligible, and tested against results from a fluid numerical model. Here, it is shown that when the sheath draws DC electron current, the voltage rectification is reduced from the zero current case, and the electron admittance is increased. In separate but related work on the microscale model, selected cases have been simulated with PIC codes to validate, further illuminate and extend fluid model results and their parametrizations. Quantitative agreement in trends for voltage rectification and sheath admittance vs. RF driving voltage is found.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

A Unified Metric for Fast Frequency Response in Low-Inertia Power Systems

Future power systems with more inverter-based resources (IBRs), will be vulnerable to frequency decline contingencies. Fast frequency response (FFR) provided by IBRs is a good candidate to arrest frequency excursions. Diverse types of FFR have been proposed, and some have been deployed in our power systems. Without a unified quantification of FFR, it is hard for the grid operators to compare and fully leverage the FFR capabilities of IBRs. This work introduces a potential unified metric that quantifies two key characteristics of FFR and describes its application to three prevailing FFR types. We then use metric-to-frequency mapping to validate the accuracy of the metric in predicting the impact of a given FFR on the trajectory of a frequency event. The results show that the proposed metric is simple yet accurately captures the ability of diverse forms of FFR to improve system frequency dynamics.

effective inertia↗
DOE OSTI2025

Characterization of Infrasonic Signatures of Earth-Grazing Fireballs as Analogues to Hypersonic Vehicles (Final Report)

Accurate detection, discrimination, and characterization of high-altitude hypersonic events using infrasonic monitoring are critical to planetary defense and global strategic surveillance. This report synthesizes recent advances achieved through rigorous analysis of infrasonic signatures from natural meteoroids, emphasizing shallow entry-angle meteoroids as essentially proxies for artificial hypersonic systems. Meteoroids naturally encompass diverse velocities, trajectories, altitudes, and fragmentation behaviors, enabling systematic validation of empirical period–yield relationships, waveform morphology classifiers, and trajectory-induced back-azimuth deviation models. Integration of adaptive array-processing enhancements within Cardinal software further extends infrasonic detection sensitivity and signal classification reliability. Collectively these advances, based solely on infrasonic signatures or limited optical data, offer robust methodologies for distinguishing natural from artificial hypersonic sources, significantly reducing event geolocation uncertainties and refining source-function determination. The outcomes detailed herein lay foundational groundwork for improved global hypersonic event-surveillance frameworks, supporting improved security preparedness and informing strategic monitoring and defense policies.

54 ENVIRONMENTAL SCIENCES↗