Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Policy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Too Good to Be True? Evaluation of Colonoscopy Sensitivity Assumptions Used in Policy Models

Background: Models can help guide colorectal cancer screening policy. Although models are carefully calibrated and validated, there is less scrutiny of assumptions about test performance. Methods: We examined the validity of the CRC-SPIN model and colonoscopy sensitivity assumptions. Standard sensitivity assumptions, consistent with published decision analyses, assume sensitivity equal to 0.75 for diminutive adenomas (<6 mm), 0.85 for small adenomas (6–10 mm), 0.95 for large adenomas (≥10 mm), and 0.95 for preclinical cancer. We also selected adenoma sensitivity that resulted in more accurate predictions. Targets were drawn from the Wheat Bran Fiber study. In the study, we examined how well the model predicted outcomes measured over a three-year follow-up period, including the number of adenomas detected, the size of the largest adenoma detected, and incident colorectal cancer. Results: Using standard sensitivity assumptions, the model predicted adenoma prevalence that was too low (42.5% versus 48.9% observed, with 95% confidence interval 45.3%–50.7%) and detection of too few large adenomas (5.1% versus 14.% observed, with 95% confidence interval 11.8%–17.4%). Predictions were close to targets when we set sensitivities to 0.20 for diminutive adenomas, 0.60 for small adenomas, 0.80 for 10- to 20-mm adenomas, and 0.98 for adenomas 20 mm and larger. Conclusions: Colonoscopy may be less accurate than currently assumed, especially for diminutive adenomas. Alternatively, the CRC-SPIN model may not accurately simulate onset and progression of adenomas in higher-risk populations. Impact: Misspecification of either colonoscopy sensitivity or disease progression in high-risk populations may affect the predicted effectiveness of colorectal cancer screening. When possible, decision analyses used to inform policy should address these uncertainties.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Data Validation for Hosting Capacity Analyses: Executive Summary

The usefulness of Hosting Capacity Analysis (HCA) is dependent on users' confidence that the results accurately reflect grid conditions. This report provides the findings and recommendations from research, conducted by The National Renewable Energy Lab (NREL) and The Interstate Renewable Energy Council (IREC), into HCA data validation best practices. The goal is to provide utilities, regulators, and stakeholders best practices for HCA data validation procedures so that future HCA deployments avoid uncertainties and potential mistakes from earlier rollouts and provide useful and accurate data from the day they are published.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Tree-ring evidence marks year 2022 as the driest spring season in nearly four centuries in the Western Himalayas

The Hindukush-Karakoram-Himalayan region is a crucial freshwater source for billions across South Asia, yet its climate remains poorly understood due to limited long-term records. Winter and spring precipitation govern snow accumulation and downstream water availability in dry months particularly across the Western Himalayas (WH), but recent decades show intensifying droughts with unclear long-term context. Here, we have reconstructed a nearly four-century-long spring i.e. February to May (FMAM) precipitation for the Lahaul region of the (WH), an area dominated by the Western Disturbances. This record was developed using moisture-sensitive Cedrus deodara (Deodar) tree-rings from three high-elevation sites. A regional composite tree-ring-width chronology, developed through a Nested Principal Component Analysis and modeled with a nonlinear Generalized Additive Model (GAM) that explains 71 % of the variance during the calibration period. We identified the last two decades as the most precipitation deficit phase and the year 2022 showing the driest FMAM on record. The observed rise in the FMAM dry episodes post 1999 CE in our reconstruction, corresponds to the meteorological records. This recent drying is linked to a northward shift of the subtropical westerly jet and reduced moisture transport, both associated with unusual sea surface temperature patterns in the tropical Indian Ocean and the Western Pacific Ocean. Our results provide compelling evidence of long-term hydroclimatic instability in the WH and emphasize the value of tree-ring records in extending precipitation histories beyond the instrumental observations. Such reconstructions can be benchmarks to validate high-resolution climate models and formulate adaptation policies to mitigate future risks.

Cedrus deodara↗
NASA NTRS2005

Common Badging and Access Control System (CBACS)

The goals of the project are: Achieve high business value through a common badging and access control system that integrates with smart cards. Provide physical (versus logical) deployment of smart cards initially. Provides a common consistent and reliable environment into which to release the smart card. Gives opportunity to develop agency-wide consistent processes, practices and policies. Enables enterprise data capture and management. Promotes data validation prior to SC issuance.

Baldridge, Tim↗
NASA NTRS2009

Validation of Model Forecasts of the Ambient Solar Wind

Independent and automated validation is a vital step in the progression of models from the research community into operational forecasting use. In this paper we describe a program in development at the CCMC to provide just such a comprehensive validation for models of the ambient solar wind in the inner heliosphere. We have built upon previous efforts published in the community, sharpened their definitions, and completed a baseline study. We also provide first results from this program of the comparative performance of the MHD models available at the CCMC against that of the Wang-Sheeley-Arge (WSA) model. An important goal of this effort is to provide a consistent validation to all available models. Clearly exposing the relative strengths and weaknesses of the different models will enable forecasters to craft more reliable ensemble forecasting strategies. Models of the ambient solar wind are developing rapidly as a result of improvements in data supply, numerical techniques, and computing resources. It is anticipated that in the next five to ten years, the MHD based models will supplant semi-empirical potential based models such as the WSA model, as the best available forecast models. We anticipate that this validation effort will track this evolution and so assist policy makers in gauging the value of past and future investment in modeling support.

Macneice, P. J.↗
NASA NTRS2023

Robotic and Crewed Mars Missions Increasing the Demand for Planetary Protection Technology Needs

Planetary protection (PP) policy seeks to avoid harmful contamination by limiting biological and relevant organic contamination from spacecraft as well as preventing adverse changes to Earth’s biosphere when extraterrestial samples are brought back to Earth. The PP policy at NASA was updated in 2021 (NPR 8715.24) and 2022 (NASA-STD-8719.27) to enable missions by expanding the decades old prescriptive requirements to allow for an option of adopting performance-based requirements that are objectivesdriven, risk-informed and case-assured. In parallel, the final PP knowledge gap workshop was completed representing the international consensus on the key areas to be considered in developing crew PP policy. These knowledge gaps focused on key technology development areas in 1) microbial and human health monitoring, 2) technical and operations needed for contamination control and 3) natural transport of contamination on Mars. As robotic missions start to implement performance-based approaches and research and technology efforts commence to inform crew policy the demand for data quality driven verification and validation in relevant space environments. Examples of the types of testing that is envisioned includes test as you fly validation and verification of decontamination systems in a relevant on-orbit and Mars environment, developing lethality curves of terrestrial organisms to further our understanding of the biocidal impacts of Mars and the space environment, and particle transport model validation and verification. Thus, the PP discipline has identified the need for groundbased space environments to perform preliminary testing as validation and verification of flight systems and to advance the technology readiness level prior to further testing on-orbit or lunar environments to prepare for Mars.

J. Nick Benardini↗
NASA NTRSDate not supplied

Robotic and Crewed Mars Missions Increasing the Demand for Planetary Protection Technology Needs

Planetary protection (PP) policy seeks to avoid harmful contamination by limiting biological and relevant organic contamination from spacecraft as well as preventing adverse changes to Earth’s biosphere when extraterrestrial samples are brought back to Earth. The PP policy at NASA was updated in 2021 (NPR 8715.24) and 2022 (NASA-STD-8719.27) to enable missions by expanding the decades old prescriptive requirements to allow for an option of adopting performance-based requirements that are objectives-driven, risk-informed and case-assured. In parallel, the final PP knowledge gap workshop was completed representing the international consensus on the key areas to be considered in developing crew PP policy. These knowledge gaps focused on key technology development areas in 1) microbial and human health monitoring, 2) technical and operations needed for contamination control and 3) natural transport of contamination on Mars. As robotic missions start to implement performance-based approaches and research and technology efforts commence to inform crew policy the demand for data quality driven verification and validation in relevant space environments. Examples of the types of testing that is envisioned includes test as you fly validation and verification of decontamination systems in a relevant on-orbit and Mars environment, developing lethality curves of terrestrial organisms to further our understanding of the biocidal impacts of Mars and the space environment, and particle transport model validation and verification. Thus, the PP discipline has identified the need for ground-based space environments to perform preliminary testing as validation and verification of flight systems and to advance the technology readiness level prior to further testing on-orbit or lunar environments to prepare for Mars.

J Nick Benardini↗
DOE OSTI2021

Foundational Open Source Solar System Modeling Through Improvement and Validation of the System Advisor Model and PVWatts (FY19-FY21 Final Technical Report)

Accelerating intelligent deployment of solar energy technologies demands accurate system modeling every step of the way. From project development to policy research, grid integration studies to development of novel technologies, industry and researchers alike need validated, transparent, easy-to-use, extensible, cutting-edge, and accurate models of both the performance and financing of solar systems. The System Advisor Model (SAM) and PVWatts tools provide a platform to fill that need. The overarching goal of this set of software tools is to enable accurate PV system modeling across the industry, and our usage metrics indicate that we continue to succeed in that endeavor, with a user starting SAM every 2 minutes globally, and over 17 million PVWatts hits per month. This project leveraged DOEs past investment in the SAM and PVWatts platforms to continue to provide valuable and extensible PV, battery, and financial modeling resources to the larger solar community. We pursued multiple avenues in parallel: software maintenance and technical support that are foundational to the continued usability of the SAM and PVWatts platforms; platform and PV model improvements and stakeholder engagement activities that are core to the continued relevance of the platforms; and open source activities to foster the continued creation of a vibrant open-source community around the SAM and PVWatts tools, which opens up exciting new opportunities for industry interaction.

14 SOLAR ENERGY↗
DOE OSTI2022

Nuclear Forensics

Nuclear forensics is a key part of the nuclear security strategy for the United States and the international community. The NACS Division is central to the leadership role that LLNL has had in nuclear forensics over the past 25 years. Our current nuclear forensic program includes conducting R&D on provenance and attribution signatures, collaborating with international partners, training the next generation of nuclear forensic experts, developing test materials for verification and validation exercises, and providing expert advice to national and international policy makers. Key to our success in these areas has been the strong and continuing involvement in nuclear forensic casework obtained through law enforcement and intelligence channels as well as our outstanding analytical capabilities. NACS must continue to conduct forward-thinking R&D in nuclear forensics that supports operational programs and addresses intelligence gaps. To maintain leadership in nuclear forensics, we must attract, develop, and retain the best talent. The NNSA has a central leadership role in developing educational initiatives for nuclear forensics. In concert with the Glenn T. Seaborg Institute, the NACS Division will continue to participate in all nuclear forensic educational initiatives (undergraduate, graduate, postdoctoral) and incorporate LLNL’s D&I vision into its student and postdoc recruitment efforts. We will continue to build formal relationships with key academic partners and institutions with active and emerging nuclear forensic research interests. We will also strengthen relationships with NNSA DNN and SSAA funded university consortia (e.g. NSSC, ACE, CNEC, CVT, ETI, MTV), helping them conduct research of interest and relevance to nuclear forensics, while at the same time evaluating and recruiting promising talent from these programs.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS2000

The NPARC Alliance Verification and Validation Archive

The NPARC Alliance (National Project for Applications oriented Research in CFD) maintains a publicly-available, web-based verification and validation archive as part of the development and support of the WIND CFD code. The verification and validation methods used for the cases attempt to follow the policies and guidelines of the ASME and AIAA. The emphasis is on air-breathing propulsion flow fields with Mach numbers ranging from low-subsonic to hypersonic.

Slater, John W.↗
NASA NTRS2013

SILHIL Replication of Electric Aircraft Powertrain Dynamics and Inner-Loop Control for V&V of System Health Management Routines

Software-in-the-loop and Hardware-in-the-loop testing of failure prognostics and decision making tools for aircraft systems will facilitate more comprehensive and cost-effective testing than what is practical to conduct with flight tests. A framework is described for the offline recreation of dynamic loads on simulated or physical aircraft powertrain components based on a real-time simulation of airframe dynamics running on a flight simulator, an inner-loop flight control policy executed by either an autopilot routine or a human pilot, and a supervisory fault management control policy. The creation of an offline framework for verifying and validating supervisory failure prognostics and decision making routines is described for the example of battery charge depletion failure scenarios onboard a prototype electric unmanned aerial vehicle.

Verification and Validation↗
NASA NTRS2017

Towards a Preservation Content Standard for Earth Observation Data

Information from Earth observing missions (remote sensing with airborne and spaceborne instruments, and in situ measurements such as those from field campaigns) is proliferating in the world. Many agencies across the globe are generating important datasets by collecting measurements from instruments on board aircraft and spacecraft, globally and constantly. The data resulting from such measurements are a valuable resource that needs to be preserved for the benefit of future generations. These observations are the primary record of the Earths environment and therefore are the key to understanding how conditions in the future will compare to conditions today. Earth science observational data, derived products and models are used to answer key questions of global significance. In the near-term, as long as the missions data are being used actively for scientific research, it continues to be important to provide easy access to the data and services commensurate with current information technology. For the longer term, when the focus of the research community shifts toward new missions and observations, it is essential to preserve the previous mission data and associated information. This will enable a new user in the future to understand how the data were used for deriving information, knowledge and policy recommendations and to repeat the experiment to ascertain the validity and possible limitations of conclusions reached in the past and to provide confidence in long term trends that depended on data from multiple missions. Organizations that collect, process, and utilize Earth observation data today have a responsibility to ensure that the data and associated content continue to be preserved by them or are gathered and handed off to other organizations for preservation for the benefit of future generations. In order to ensure preservation of complete content necessary for understanding and reusing the data and derived digital products from todays missions, it is necessary to develop a specification of such preservation content. While there are existing standards that address archival and preservation in general, there are no existing international standards or specifications today to address what content should be preserved. The purpose of this paper is to outline briefly the existing standards that apply to preservation, describe a recent effort in getting an international standard in place for specifying preservation content for Earth observation data and derived digital data products and the remaining work needed to arrive at a standard.

ISO Standards↗
NASA NTRS2012

Asthma and Air Quality in the Presence of Fires - A Foundation for Public Health Policy in Florida

Outdoor air quality and its associated impacts on respiratory problems in Florida are of public health significance. Air quality in Florida can be poor during the extended wildfire season, threatening persons with compromised respiratory systems each year. Studies have demonstrated that particulate matter, which is generally elevated in the vicinity of wildfires, is associated with increases in hospital admissions and occurrences of acute asthma exacerbations. However, few studies have examined the modifying effect of socio-demographic characteristics of cities or regional areas on the relationship between air quality and health outcomes. In an ongoing university/multi-agency project, asthma hospital/emergency room (patient) data are being used to create a health outcome indicator of human response to environmental air quality. Environmental data are derived from satellite measurements, with special attention being given to the effect of wildfires and prescribed burns on air quality. This presentation will focus on the environmental data sets particulate matter, location of fires, smoke plumes that are being collected and processed for linkage with health data. After this linkage has been performed, space-time models of asthma rates as a function of air quality data and socio-demographic variables will be developed and validated. The Florida Department of Health (FDOH) will work with county health department staff and representatives from the medical community to establish a protocol with triggers for issuing public health advisories/alerts based on the developed and validated health outcome indicators. From this effort, a science-based policy for issuing public health advisories/alerts for asthma relating to air quality will be developed, giving FDOH the ability to (1) predict, with stated levels of uncertainty, case load of hospital admissions based on air quality, (2) reduce asthma exacerbations by forewarning asthmatics to limit outside activities on poor air quality days, (3) apply management practices on the rates of hospital/emergency room visits for asthma, and (4) provide information that would help translate interventions into policy decisions, thereby reducing the economic burden and increasing well being of asthmatics. Further, the results of the study will be incorporated into Florida s Environmental Public Health Tracking (EPHT) program, which is part of the Centers for Disease Control and Prevention's (CDC's) EPHT network.

Crosson, William↗
DOE OSTI2026

ORCHID: Orchestrated Retrieval-Augmented Classification of High-Risk Property with Intelligent Decision-Making

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We propose ORCHID, a modular agentic framework for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy based outputs that can be audited. Small cooperating agents—retrieval, description refiner, classifier, validator, and feedback logger—coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an "Item to Evidence to Decision" loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts—illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗
DOE OSTI2024

Integrating PCTRAN with AI-Driven Host-Intrusion Detection and Secured Container Systems for Advanced Malware Analysis (Summer Internship Report)

This study presents a solution for enhancing the security of the Personal Computer Transient Analyzer (PCTRAN) PC-based Nuclear Power Plant Simulator by integrating the software with an artificial intelligence (AI)-driven host-intrusion detection system (HIDS), in addition to a secured container system, for malware analysis. PCTRAN is a Windows XP-based software package that has the ability to simulate a variety of accident and transient conditions for nuclear power plants (NPPs). It offers a high-resolution replica of the Nuclear Steam Supply System (NSSS) and displays the status of important parameters allowing for operator interaction. By including AI-driven HIDS for the NSSS, the framework can identify security threats in real-time, ensuring the integrity of the nuclear simulation environment. Additionally, the secured container system offers the ability to isolate and analyze malware, preventing potential threats from affecting core systems. The integration process involves extensive testing and validation in order to ensure accuracy, reliability, and compliance with security policies. This framework sets a new precedent for secure simulation and training in NPP operations, and offers insight for future advancements in cybersecurity.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRSDate not supplied

Validation of A Simulation Environment for Future Space Traffic Management

This study presents initial results of a newly developed simulation environment intendedto explore and assess future Space Traffic Management (STM) scenarios. The number ofnew Resident Space Objects (RSOs) in near-Earth orbit is expected to increase significantlywith the expected future deployment of a number of large constellations. These futurescenarios involve the addition of many tens of thousands of new RSOs, making the analysisinto their impact on collision risk extend beyond what traditional data-mining of present-dayconjunction data can reliably predict. To address this, a robust simulation environment wasdeveloped that implements a full force-model for orbit propagation, and computes continuousall-on-all conjunction statistics for arbitrarily large catalog sizes and simulation timeframes.Collision avoidance and station-keeping maneuvers can be optionally implemented based onconfigurable user inputs including physical characteristics and spacecraft meta-data (e.g.,commercial/government, owner country, etc.). Constellation build-out and de-orbit scenarioswere also implemented and modeled based on real-data analysis. Validation of the simulationresults was a critical component of the simulation development, and was done using the currentcatalog with comparisons against both public and internal NASA data-sets. The comparisonsdemonstrate that, with the appropriate settings, representative levels of conjunction ratesand probabilities can be obtained, providing confidence that the simulation tool can generatemeaningful outcomes for test scenarios. As an initial demonstration of the tool’s capabilities,year-long simulations with station-keeping were conducted to examine conjunction historiesusing both the current object catalog (5800 active satellites) and a hypothetical 60,000 objectscenario involving five potential large constellations. Output metrics include the number ofconjunction events, estimates of collision consequence (fragmentation), delta-V maneuver costs,and the probability of at least one collision occurring. The results highlight the potential thatthe simulation tool has for incorporating and running performance comparisons between, e.g.,various sets of maneuver guidelines, industry norms, and definitions of risk, with the overallobjective of providing actionable data to STM policy makers. The presentation will providean overview of the simulation development and validation efforts, as well as a discussion ofobservations gathered from the initial simulations performed.

conjunction assessment↗
NASA NTRS1985

Considerations for policy on man-made debris propagation control

The present rates of man-made, space object propagation are such that there is a real probability of self propagation which, if uncontrolled can lead to a serious limitation to future uses of spacecraft for beneficial purposes. Effective control over the debris issue requires adoption and adherence to policy at a world wide level (any one nation's unknowing, selfish or deliberately adverse action can conceivably jeopardize other useful applications of space satellites for years into the future). The near-term environment may not seriously jeopardize the near-term missions. However, absence of control and/or nonadherence to a control policy in the near-term can result in a debris environment that can severely limit long - term mission opportunities. The data upon which these observations are based continues to be investigated. These investigations tend to validate the preceding observations and emphasize the need for near-term action to establish responsible control policy and implementation actions.

Fielder, D.↗
NASA NTRS1992

Evaluation of ultrasonic cavitation of metallic and non-metallic surfaces

1,1,2 trichloro-1,2,2 trifluoro ethane (CFC-113) commercially known as Freon-113 is the primary test solvent used for validating the cleaned hardware at the Kennedy Space Center (KSC). Due to the ozone depletion problem, the current United States policy calls for the phase out of Freons by 1995. NASAs chlorofluorocarbon (CFC) replacement group at KSC has opted to use water as a replacement fluid for the validation process since water is non-toxic, inexpensive, and is environmentally friendly. The replacement validation method calls for the ultrasonification of the small parts with water at 52 C for a cycle or two of 10 min duration wash using commercial ultrasonic baths. In this project, experimental data was obtained to assess the applicability of the proposed validation method for any damage of the metallic and non-metallic surfaces resulting from ultrasonic cavitation.

Mehta, Narinder K.↗