Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Refined Sensitivity Estimates for Single-Molecule Magnet Dark Matter Detectors

We revisit the sensitivity of Single Molecule Magnet (SMM) crystals as detectors for low-mass dark matter. In previous work, we established the concept of the ``magnetic bubble chamber'', where energy deposited by dark matter triggers a magnetic avalanche in a metastable crystal. The original sensitivity estimates relied on a conservative criterion requiring the spin relaxation time to be strictly shorter than the thermal diffusion time. Here, we demonstrate that this criterion effectively ignores the stochastic nature of spin relaxation. We derive a refined analytic estimate which accounts for the fraction of spins that relax even when diffusion is fast. We show that the Zeeman energy released by this fraction contributes to local heating, significantly lowering the energy threshold for avalanche formation. We present simulation results confirming this effect and report on experimental verification of the assumed low-temperature thermal properties of two representative SMM crystals, Mn$_{12}$-acetate and Mn$_{32}$. Together, these efforts extend this pathfinder program toward the realization of SMM-based detectors with controlled material properties and enhanced dark matter sensitivity.

Eberhardt, Andrew [Tokyo U., IPMU]↗

SAPHIRE 8 Software Independent Verification and Validation Plan

SAPHIRE 8 is being developed with a phased or cyclic iterative rapid application development methodology. Due to this approach, a similar approach is being taken for the IV&V activities on each vital software object. The IV&V plan is structured around NUREG/BR-0167, “Software Quality Assurance Program and Guidelines,” February 1993. The Nuclear Regulatory Research Office Instruction No.: PRM-12, “Software Quality Assurance for RES Sponsored Codes,” March 26, 2007 specifies that RES-sponsored software is to be evaluated against NUREG/BR-0167. Per the guidance in NUREG/BR-0167, SAPHIRE is classified as “Level 1.” Level 1 software corresponds to technical application software used in a safety decision.

99 GENERAL AND MISCELLANEOUS↗

High Level Requirements for the Nuclear Energy -- Knowledge Base for Advanced Modeling and Simulation (NE-KAMS)

The US Department of Energy, Office of Nuclear Energy (DOE-NE), has been tasked with the important mission of ensuring that nuclear energy remains a compelling and viable energy source in the U.S. The motivations behind this mission include cost-effectively meeting the expected increases in the power needs of the country, reducing carbon emissions and reducing dependence on foreign energy sources. In the near term, to ensure that nuclear power remains a key element of U.S. energy strategy and portfolio, the DOE-NE will be working with the nuclear industry to support safe and efficient operations of existing nuclear power plants. In the long term, to meet the increasing energy needs of the U.S., the DOE-NE will be investing in research and development (R&D) and working in concert with the nuclear industry to build and deploy new, safer and more efficient nuclear power plants. The safe and efficient operations of existing nuclear power plants and designing, licensing and deploying new reactor designs, however, will require focused R&D programs as well as the extensive use and leveraging of advanced modeling and simulation (M&S). M&S will play a key role in ensuring safe and efficient operations of existing and new nuclear reactors. The DOE-NE has been actively developing and promoting the use of advanced M&S in reactor design and analysis through its R&D programs, e.g., the Nuclear Energy Advanced Modeling and Simulation (NEAMS) and Consortium for Advanced Simulation of Light Water Reactors (CASL) programs. Also, nuclear reactor vendors are already using CFD and CSM, for design, analysis, and licensing. However, these M&S tools cannot be used with confidence for nuclear reactor applications unless accompanied and supported by verification and validation (V&V) and uncertainty quantification (UQ) processes and procedures which provide quantitative measures of uncertainty for specific applications. The Nuclear Energy Knowledge base for Advanced Modeling and Simulation (NE-KAMS) is being developed at the Idaho National Laboratory in conjunction with Bettis Laboratory, Sandia National Laboratories, Argonne National Laboratory, Utah State University and others with the objective of establishing a comprehensive and web-accessible knowledge base that will provide technical services and resources for V&V and UQ of M&S in nuclear energy sciences and engineering. The knowledge base will serve as an important resource for technical exchange and collaboration that will enable credible and reliable computational models and simulations for application to nuclear reactor design, analysis and licensing. NE-KAMS will serve as a valuable resource for the nuclear industry, academia, the national laboratories, the U.S. Nuclear Regulatory Commission (NRC) and the public and will help ensure the safe, economical and reliable operation of existing and future nuclear reactors. From its inception, NE-KAMS will directly support nuclear energy research, development and demonstration programs within the U.S. Department of Energy (DOE), including the CASL, NEAMS, Light Water Reactor Sustainability (LWRS), Small Modular Reactors (SMR), and Next Generation Nuclear Power Plant (NGNP) programs. These programs all involve M&S of nuclear reactor systems, components and processes, and it is envisioned that NE-KAMS will help to coordinate and facilitate collaboration and sharing of resources and expertise for V&V and UQ across these programs.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

SAPHIRE 8 Software Independent Verification and Validation Plan

SAPHIRE 8 is being developed with a phased or cyclic iterative rapid application development methodology. Due to this approach, a similar approach is being taken for the IV&V activities on each vital software object. The IV&V plan is structured around NUREG/BR-0167, “Software Quality Assurance Program and Guidelines,” February 1993. The Nuclear Regulatory Research Office Instruction No.: PRM-12, “Software Quality Assurance for RES Sponsored Codes,” March 26, 2007 specifies that RES-sponsored software is to be evaluated against NUREG/BR-0167. Per the guidance in NUREG/BR-0167, SAPHIRE is classified as “Level 1.” Level 1 software corresponds to technical application software used in a safety decision.

99 GENERAL AND MISCELLANEOUS↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavordsky, Bradley↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavodsky, Bradley↗

An unattended verification station for UF 6 cylinders: Field trial findings

In recent years, the International Atomic Energy Agency (IAEA) has pursued innovative techniques and an integrated suite of safeguards measures to address the verification challenges posed by the front end of the nuclear fuel cycle. Among the unattended instruments currently being explored by the IAEA is an Unattended Cylinder Verification Station (UCVS), which could provide automated, independent verification of the declared relative enrichment, 235 U mass, total uranium mass, and identification for all declared uranium hexafluoride cylinders in a facility (e.g., uranium enrichment plants and fuel fabrication plants). Under the auspices of the United States and European Commission Support Programs to the IAEA, a project was undertaken to assess the technical and practical viability of the UCVS concept. The first phase of the UCVS viability study was centered on a long-term field trial of a prototype UCVS system at a fuel fabrication facility. A key outcome of the study was a quantitative performance evaluation of two nondestructive assay (NDA) methods being considered for inclusion in a UCVS: Hybrid Enrichment Verification Array (HEVA), and Passive Neutron Enrichment Meter (PNEM). This paper provides a description of the UCVS prototype design and an overview of the long-term field trial. In conclusion, analysis results and interpretation are presented with a focus on the performance of PNEM and HEVA for the assay of over 200 “typical” Type 30B cylinders, and the viability of an “NDA Fingerprint” concept as a high-fidelity means to periodically verify that material diversion has not occurred.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

System Testing of Ground Cooling System Components

This internship focused primarily upon software unit testing of Ground Cooling System (GCS) components, one of the three types of tests (unit, integrated, and COTS/regression) utilized in software verification. Unit tests are used to test the software of necessary components before it is implemented into the hardware. A unit test determines that the control data, usage procedures, and operating procedures of a particular component are tested to determine if the program is fit for use. Three different files are used to make and complete an efficient unit test. These files include the following: Model Test file (.mdl), Simulink SystemTest (.test), and autotest (.m). The Model Test file includes the component that is being tested with the appropriate Discrete Physical Interface (DPI) for testing. The Simulink SystemTest is a program used to test all of the requirements of the component. The autotest tests that the component passes Model Advisor and System Testing, and puts the results into proper files. Once unit testing is completed on the GCS components they can then be implemented into the GCS Schematic and the software of the GCS model as a whole can be tested using integrated testing. Unit testing is a critical part of software verification; it allows for the testing of more basic components before a model of higher fidelity is tested, making the process of testing flow in an orderly manner.

Unit Test↗

Verification studies of Seasat-A satellite scatterometer /SASS/ measurements

Two comparisons between Seasat-A satellite scatterometer (SASS) data and surface truth, obtained from the Gulf of Alaska Seasat Experiment and the Joint Air-Sea Interaction program, have been made to determine the behavior of SASS and its algorithms. The performance of SASS was first evaluated irrespective of the algorithms employed to convert the SASS data to geophysical parameters, which was done by separating the backscatter measurements into small bins of incidence and azimuth angles and polarity and regression against wind speed measurements. The algorithms were then tested by comparing their predicted slopes and y intercepts with those derived from the regressions, and by comparing each SASS backscatter measurement with the backscatter derived from the algorithms, and the given wind velocity from the observations. It was shown that SASS was insensitive to winds at high incidence angles for horizontal polarizations. Fairly high correlations were found between backscatter and wind speeds. The algorithms functioned well at mid-ranges of incidence angle and backscattering coefficient.

Halberstam, I.↗

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Whitmore, Mihriban↗

Risk Reduction on X-33/RLV Engines

Risk management has received considerable attention in the X-33 and Reusable Launch Vehicle (RLV) program due to aggressive schedules, limited funding. and planned private investment to develop the commercial VentureStar vehicle. As an X-33 and RLV team member and main propulsion supplier, Boeing Rocketdyn Propulsion and Power has addressed risk through a methodical application of systems engineering in identifying, assessing, and mitigating risks. The methods employed involve rigorous risk mitigation planning early in development, continuous risk monitoring and assessment during the course of development, and the systematic verification of compliance with technical requirements prior to delivery. In addition, an engine system reliability analysis was conducted to reduce risk. In July 1996, NASA selected Lockheed Martin's "Skunk Works" (LMSW) as the lead contractor for the X-33 and RLV program. The X-33 vehicle is a half-scale pathfinder for the full-scale RLV. The LMSW RLV design is a lifting body shaped vehicle employing linear aerospike engine provided propulsion. The initial X-33 flight is planned for the summer of 2000, and the initial VentureStar flight is planned for between 2005 and 2007.

Crowley, Tim↗

Bringing Together Users and Developers of Forest Biomass Maps

Forests store carbon and thus represent important sinks for atmospheric carbon dioxide. Reducing uncertainty in current estimates of the amount of carbon in standing forests will improve precision of estimates of anthropogenic contributions to carbon dioxide in the atmosphere due to deforestation. Although satellite remote sensing has long been an important tool for mapping land cover, until recently aboveground forest biomass estimates have relied mostly on systematic ground sampling of forests. In alignment with fiscal year 2010 congressional direction, NASA has initiated work toward a carbon monitoring system (CMS) that includes both maps of forest biomass and total carbon flux estimates. A goal of the project is to ensure that the products are useful to a wide community of scientists, managers, and policy makers, as well as to carbon cycle scientists. Understanding the needs and requirements of these data users is helpful not just to the NASA CMS program but also to the entire community working on carbon-related activities. To that end, this meeting brought together a small group of natural resource managers and policy makers who use information on forests in their work with NASA scientists who are working to create aboveground forest biomass maps. These maps, derived from combining remote sensing and ground plots, aim to be more accurate than current inventory approaches when applied at local and regional scales. Meeting participants agreed that users of biomass information will look to the CMS effort not only to provide basic data for carbon or biomass measurements but also to provide data to help serve a broad range of goals, such as forest watershed management for water quality, habitat management for biodiversity and ecosystem services, and potential use for developing payments for ecosystem service projects. Participants also reminded the CMS group that potential users include not only public sector agencies and nongovernmental organizations but also the private sector because much forest acreage in the United States is privately held and needs data for forest management. Additional key outcomes identified by meeting participants include the following: (1) Priority should be given to building into the biomass product ease of use and low costs (including costs of hardware, software, and analysis requirements), (2) CMS products should also be relevant to other biomass measures for forest watershed management, habitat protection for biodiversity, and assessment of markets for ecosystem services, (3) CMS leadership should engage with the Subsidiary Body for Scientific and Technological Advice of the United Nations Framework Convention on Climate Change as they establish measuring, reporting, and verification standards, and (4) CMS leadership should continue to keep sister agencies and other organizations informed as CMS develops, particularly via the agencies active in the U.S. Global Change Research Program Carbon Cycle Interagency Working Group (U.S. Geological Survey, U.S. Department of Agriculture, and National Oceanic and Atmospheric Administration) and nongovernmental organizations.

Forest↗

LCLS-II-HE Cryomodule Testing at Fermilab

22 Linac Coherent Light Source II (LCLS-II) cryomodules were successfully tested at the Cryomodule Test Facility (CMTF) at Fermilab. Following the completion of the LCLS-II testing program, CMTF has shifted to testing cryomodules for the LCLS-II High Energy upgrade (LCLS-II-HE). The first LCLS-II-HE cryomodule, the verification cryomodule (vCM), was successfully tested and verified the readiness of LCLS-II-HE cryomodule testing at CMTF, and production cryomodule testing has begun. Presented here are the production cryomodule test acceptance criteria, testing plan, and cryomodule test results so far.

43 PARTICLE ACCELERATORS↗

Reported Energy and Cost Savings from the DOE ESPC Program

The objective of this work was to determine the realization rate of energy and cost savings from the Department of Energy's Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 134 Measurement and Verification (M&V) reports to determine reported, estimated, and guaranteed cost savings and reported and estimated energy savings for the previous contract year. Because the quality of the reports varied, it was not possible to determine all of these parameters for each project. For 133 of the 134 projects, there was sufficient information to compare estimated, reported, and guaranteed cost savings. For this group, the total estimated cost savings for the reporting periods addressed were $\$$95.7 million, total reported cost savings were $\$$96.8 million, and total guaranteed cost savings were $\$$92.1 million. This means that on average: ESPC contractors guaranteed 96% of the estimated cost savings, projects reported achieving 101% of the estimated cost savings, and projects reported achieving 105% of the guaranteed cost savings. For 129 of the projects examined, there was sufficient information to compare estimated and reported energy savings. On the basis of site energy, estimated savings for those projects for the previous year totaled 5.371 million MMBtu, and reported savings were 5.374 million MMBtu, just over 100% of the estimated energy savings. On the basis of source energy, total estimated energy savings for the 129 projects were 10.400 million MMBtu, and reported saving were 10.405 million MMBtu, again, just over 100.0% of the estimated energy savings.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Reported Energy and Cost Savings from the DOE ESPC Program: FY 2012

The objective of this work was to determine the realization rate of energy and cost savings from the Department of Energy’s Energy Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 142 Measurement and Verification (M&V) reports to determine reported, estimated, and guaranteed cost savings and reported and estimated energy savings for the previous contract year. Because the quality of the reports varied, it was not possible to determine all of these parameters for each project.

Slattery, Bob S.↗

Reported Energy and Cost Savings from the DOE ESPC Program: FY 2013

The objective of this work was to determine the realization rate of energy and cost savings from the Department of Energy’s Energy Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 152 Measurement and Verification (M&V) reports to determine reported, estimated, and guaranteed cost savings and reported and estimated energy savings for the previous contract year. Because the quality of the reports varied, it was not possible to determine all of these parameters for each project.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Specification Section 01065S ES&H for Service Contracts

Section Includes: Requirements and guidelines in performance of work concerning protection of environment and property, and the safety and health of Contractors, Sandia National Laboratories (SNL) and Department of Energy (DOE) employees, visitors to SNL, and members of the public. This Section is applicable only to Service Contracts that do not involve construction or construction-like activities. Construction and construction-like activities are covered by Section 01065, Environment, Safety and Health (ES&H) for Construction Contracts. The entire ES&H program shall focus on safe-by-design intent, understanding the technical basis for the work, identifying and controlling energy sources, unacceptable consequences, risk assessments, and positive verification.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Reported Energy and Cost Savings from the DOE ESPC Program: FY 2014

The objective of this work was to determine the realization rate of energy and cost savings from the Department of Energy’s Energy Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 156 Measurement and Verification (M&V) reports to determine reported, estimated, and guaranteed cost savings and reported and estimated energy savings for the previous contract year. Because the quality of the reports varied, it was not possible to determine all of these parameters for each project. For all 156 projects, there was sufficient information to compare estimated, reported, and guaranteed cost savings. For this group, the total estimated cost savings for the reporting periods addressed were $\$$210.6 million, total reported cost savings were $\$$215.1 million, and total guaranteed cost savings were $\$$$204.5 million. This means that on average: ESPC contractors guaranteed 97% of the estimated cost savings; projects reported achieving 102% of the estimated cost savings; and projects reported achieving 105% of the guaranteed cost savings. For 155 of the projects examined, there was sufficient information to compare estimated and reported energy savings. On the basis of site energy, estimated savings for those projects for the previous year totaled 11.938 million MMBtu, and reported savings were 12.138 million MMBtu, 101.7% of the estimated energy savings. On the basis of source energy, total estimated energy savings for the 155 projects were 19.052 million MMBtu, and reported saving were 19.516 million MMBtu, 102.4% of the estimated energy savings.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗