Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Precise and Scalable Static Program Analysis of NASA Flight Software

Recent NASA mission failures (e.g., Mars Polar Lander and Mars Orbiter) illustrate the importance of having an efficient verification and validation process for such systems. One software error, as simple as it may be, can cause the loss of an expensive mission, or lead to budget overruns and crunched schedules. Unfortunately, traditional verification methods cannot guarantee the absence of errors in software systems. Therefore, we have developed the CGS static program analysis tool, which can exhaustively analyze large C programs. CGS analyzes the source code and identifies statements in which arrays are accessed out of bounds, or, pointers are used outside the memory region they should address. This paper gives a high-level description of CGS and its theoretical foundations. It also reports on the use of CGS on real NASA software systems used in Mars missions (from Mars PathFinder to Mars Exploration Rover) and on the International Space Station.

Brat, G.↗

Development and experimental qualification of a calculation scheme for the evaluation of gamma heating in experimental reactors. Application to MARIA and Jules Horowitz (JHR) MTR Reactors

Precise computational determination of nuclear heating which consists predominantly of gamma heating (more than 80 %) is one of the challenges in material testing reactor exploitation. Due to sophisticated construction and conditions of experimental programs planned in JHR it became essential to use most accurate and precise gamma heating model. Before the JHR starts to operate, gamma heating evaluation methods need to be developed and qualified in other experimental reactor facilities. This is done inter alia using OSIRIS, MINERVE or EOLE research reactors in France. Furthermore, MARIA - Polish material testing reactor - has been chosen to contribute to the qualification of gamma heating calculation schemes/tools. This reactor has some characteristics close to those of JHR (beryllium usage, fuel element geometry). To evaluate gamma heating in JHR and MARIA reactors, both simulation tools and experimental program have been developed and performed. For gamma heating simulation, new calculation scheme and gamma heating model of MARIA have been carried out using TRIPOLI4 and APOLLO2 codes. Calculation outcome has been verified by comparison to experimental measurements in MARIA reactor. To have more precise calculation results, model of MARIA in TRIPOLI4 has been made using the whole geometry of the core. This has been done for the first time in the history of MARIA reactor and was complex due to cut cone shape of all its elements. Material composition of burnt fuel elements has been implemented from APOLLO2 calculations. An experiment for nuclear heating measurements and calculation verification has been done in September 2014. This involved neutron, photon and nuclear heating measurements at selected locations in MARIA reactor using in particular Rh SPND, Ag SPND, Ionization Chamber (all three from CEA), KAROLINA calorimeter (NCBJ) and Gamma Thermometer (CEA/SCK CEN). Measurements were done in forty points using four channels. Maximal nuclear heating evaluated from measurements is of the order of 2.5 W/g at half of the possible MARIA power - 15 MW. The approach and the detailed program for experimental verification of calculations will be presented. The following points will be discussed: - Development of a gamma heating model of MARIA reactor with TRIPOLI 4 (coupled neutron-photon mode) and APOLLO2 model taking into account the key parameters like: configuration of the core, experimental loading, control rod location, reactor power, fuel depletion); - Design of specific measurement tools for MARIA experiments including for instance a new single-cell calorimeter called KAROLINA calorimeter; - MARIA experimental program description and a preliminary analysis of results; - Comparison of calculations for JHR and MARIA cores with experimental verification analysis, calculation behavior and n-γ 'environments'. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Runtime Verification with State Estimation

We introduce the concept of Runtime Verification with State Estimation and show how this concept can be applied to estimate theprobability that a temporal property is satisfied by a run of a program when monitoring overhead is reduced by sampling. In such situations, there may be gaps in the observed program executions, thus making accurate estimation challenging. To deal with the effects of sampling on runtime verification, we view event sequences as observation sequences of a Hidden Markov Model (HMM), use an HMM model of the monitored program to "fill in" sampling-induced gaps in observation sequences, and extend the classic forward algorithm for HMM state estimation (which determines the probability of a state sequence, given an observation sequence) to compute the probability that the property is satisfied by an execution of the program. To validate our approach, we present a case study based on the mission software for a Mars rover. The results of our case study demonstrate high prediction accuracy for the probabilities computed by our algorithm. They also show that our technique is much more accurate than simply evaluating the temporal property on the given observation sequences, ignoring the gaps.

sampling↗

Will the Measurement Robots Take Our Jobs? An Update on the State of Automated M&V for Energy Efficiency Programs

Trustworthy savings calculations are critical to convincing regulators of both the cost-effectiveness of energy efficiency program investments and their ability to defer supply-side capital investments. Today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of energy efficiency programs. They also require time-consuming data acquisition. A spectrum of savings calculation approaches is used, with some relying more heavily on measured data and others relying more heavily on estimated, modeled, or stipulated data. The rising availability of “smart” meters and devices that report near-real time data, combined with new analytical approaches to quantifying savings, offers potential to conduct M&V more quickly and at lower cost, with comparable or improved accuracy. Commercial energy management and information systems (EMIS) technologies are beginning to offer M&V capabilities, and program administrators want to understand how they might assist programs in quickly and accurately measuring energy savings. This paper presents the results of recent testing of the ability to use automation to streamline some parts of M&V. Here in this paper, we detail metrics to assess the performance of these new M&V approaches, and a framework to compute the metrics. We also discuss the accuracy, cost, and time trade-offs between more traditional M&V, and these emerging streamlined methods that use high-resolution energy data and automated computational intelligence. Finally we discuss the potential evolution of M&V and early results of pilots currently underway to incorporate M&V automation into ratepayer-funded programs and professional implementation and evaluation practice.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

International Space Station Passive Thermal Control System Analysis, Top Ten Lessons-Learned

The International Space Station (ISS) has been on-orbit for over 10 years, and there have been numerous technical challenges along the way from design to assembly to on-orbit anomalies and repairs. The Passive Thermal Control System (PTCS) management team has been a key player in successfully dealing with these challenges. The PTCS team performs thermal analysis in support of design and verification, launch and assembly constraints, integration, sustaining engineering, failure response, and model validation. This analysis is a significant body of work and provides a unique opportunity to compile a wealth of real world engineering and analysis knowledge and the corresponding lessons-learned. The analysis lessons encompass the full life cycle of flight hardware from design to on-orbit performance and sustaining engineering. These lessons can provide significant insight for new projects and programs. Key areas to be presented include thermal model fidelity, verification methods, analysis uncertainty, and operations support.

Iovine, John↗

International Space Station Passive Thermal Control System Top Ten Lessons-Learned

Final document not an Abstract attached. The International Space Station (ISS) has been on-orbit for nearly 20 years, and there have been numerous technical challenges along the way from design to assembly to on-orbit anomalies and repairs. The Passive Thermal Control System (PTCS) management team has been a key player in successfully dealing with these challenges. The PTCS team performs thermal analysis in support of design and verification, launch and assembly constraints, integration, sustaining engineering, failure response, and model validation. This analysis is a significant body of work and provides a unique opportunity to compile a wealth of real world engineering and analysis knowledge and the corresponding lessons-learned. The PTCS lessons encompass the full life cycle of flight hardware from design to on-orbit performance and sustaining engineering. These lessons can provide significant insight for new projects and programs. Key areas to be presented include thermal model fidelity, verification methods, analysis uncertainty, and operations support.

Iovine, John V.↗

International Space Station Passive Thermal Control System Top Ten Lessons-Learned

Final document not an Abstract attached. The International Space Station (ISS) has been on-orbit for nearly 20 years, and there have been numerous technical challenges along the way from design to assembly to on-orbit anomalies and repairs. The Passive Thermal Control System (PTCS) management team has been a key player in successfully dealing with these challenges. The PTCS team performs thermal analysis in support of design and verification, launch and assembly constraints, integration, sustaining engineering, failure response, and model validation. This analysis is a significant body of work and provides a unique opportunity to compile a wealth of real world engineering and analysis knowledge and the corresponding lessons-learned. The PTCS lessons encompass the full life cycle of flight hardware from design to on-orbit performance and sustaining engineering. These lessons can provide significant insight for new projects and programs. Key areas to be presented include thermal model fidelity, verification methods, analysis uncertainty, and operations support.

Iovine, John V.↗

Measurements of 222 Rn, 220 Rn, and CO 2 Emissions in Natural CO 2 Fields in Wyoming: MVA Techniques for Determining Gas Transport and Caprock Integrity

An integrated field-laboratory program evaluated the use of radon and CO 2 flux measurements to constrain source and timescale of CO 2 fluxes in environments proximate to CO 2 storage reservoirs. By understanding the type and depth of the gas source, the integrity of a CO 2 storage reservoir can be assessed and monitored. The concept is based on correlations of radon and CO 2 fluxes observed in volcanic systems. This fundamental research is designed to advance the science of Monitoring, Verification, and Accounting (MVA) and to address the Carbon Storage Program goal of developing and validating technologies to ensure 99 percent storage performance. Graduate and undergraduate students conducted the research under the guidance of the Principal Investigators; in doing so they were provided with training opportunities in skills required for implementing and deploying CCS technologies. Although a final method or “tool” was not developed, significant progress was made. The field program identified issues with measuring radon in environments rich in CO 2 . Laboratory experiments determined a correction factor to apply to radon measurements made in CO 2 -bearing environments. The field program also identified issues with radon and CO 2 -flux measurements in soil gases at a natural CO 2 analog. A systematic survey of radon and CO 2 flux in soil gases at the LaBarge CO 2 Field in Southwest Wyoming indicates that measurements of 222 Rn (radon), 220 Rn (thoron), and CO 2 flux may not be a robust method for monitoring the integrity of a CO 2 storage reservoir. The field program was also not able to correlate radon and CO 2 flux in the CO 2 -charged springs of the Thermopolis hydrothermal system. However, this part of the program helped to motivate the aforementioned laboratory experiments that determined correction factors for measuring radon in CO 2 -rich environments. A graduate student earned a Master of Science degree for this part of the field program; she is currently employed with a geologic consulting company. Measurement of radon in springs has improved significantly since the field program first began; however, in situ measurement of 222 Rn and particularly 220 Rn in springs is problematic. Future refinements include simultaneous salinity measurements and systematic corrections, or adjustments to the partition coefficient as needed for more accurate radon concentration determination. A graduate student earned a Master of Science degree for this part of the field program; he is currently employed with a geologic consulting company. Both graduate students are poised to begin work in a CCS technology area. Laboratory experiments evaluated important process-level fundamentals that effect measurements of radon and CO 2 . Laboratory tests established that fine-grained source minerals yield higher radon emissivity compared to coarser-sized source minerals; subtleties in the dataset suggest that grain size alone is not fully representative of all the processes controlling the ability of radon to escape its mineral host. Emissivity for both 222 Rn and 220Rn increases linearly with temperature due to reaction of rocks with water, consistent with faster diffusion and enhanced mineral dissolution at higher temperatures. The presence of CO 2 changes the relative importance of the factors that control release of radon. Emissivity for both 222 Rn and 220 Rn in CO 2 -bearing experiments is greater at all temperatures compared to the experiments without CO 2 , but emissivity does not increase as a simple function of temperature. Governing processes may include a balance between enhanced dissolution versus carbonate mineral formation in CO 2 -rich waters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Detecting the undetected: Dealing with non-routine events using advanced M&V meter-based savings approaches

In a rapidly evolving energy industry, utilities are dealing with new challenges like integrating distributed energy resources and market saturation for advanced lighting retrofits. Demand-side management programs require new approaches to meet aggressive carbon reduction goals. Advanced measurement & verification (M&V) is an energy data analysis method using smart meter data in combination with analytics to quantify energy efficiency project savings. Advanced M&V shows great promise for supporting next generation commercial programs including retro commissioning, multi-measure retrofits, and behavior change programs. Advanced M&V captures real project impacts at the meter, but sometimes non-project events can also impact consumption (so-called “non-routine events” [NREs]). Accurately detecting and accounting for NREs is important for reducing uncertainty of savings estimates and helps manage investment risk for different stakeholders (e.g., utilities, building owners, ESCOs). Recent research has shown promise in establishing data-driven techniques to identify and adjust for NREs, but fundamental questions still remain, such as: how can you distinguish NREs from acceptable noise in energy consumption profiles? What is the frequency and magnitude of NREs? Can their detection and adjustment be automated and streamlined? This paper documents the state of the art in NRE quantification and analysis. The results of research to quantify the frequency, nature and direction of NREs, and methods and metrics for determining a trigger threshold for taking action on NREs are presented. The paper also documents the latest technical guidance on application of NRE detection and adjustment methods.

Fernandes, Samuel↗

Traditional versus rule-based programming techniques - Application to the control of optional flight information

A traditional programming technique for controlling the display of optional flight information in a civil transport cockpit is compared to a rule-based technique for the same function. This application required complex decision logic and a frequently modified rule base. The techniques are evaluated for execution efficiency and implementation ease; the criterion used to calculate the execution efficiency is the total number of steps required to isolate hypotheses that were true and the criteria used to evaluate the implementability are ease of modification and verification and explanation capability. It is observed that the traditional program is more efficient than the rule-based program; however, the rule-based programming technique is more applicable for improving programmer productivity.

Ricks, Wendell R.↗

The new geospatial tools: global transparency enhancing safeguards verification

This paper focuses on the importance and potential role of the new, freely available, geospatial tools for enhancing IAEA safeguards and how, together with commercial satellite imagery, they can be used to promote 'all-source synergy'. As additional 'open sources', these new geospatial tools have heralded a new era of 'global transparency' and they can be used to substantially augment existing information-driven safeguards gathering techniques, procedures, and analyses in the remote detection of undeclared facilities, as well as support ongoing monitoring and verification of various treaty (e.g., NPT, FMCT) relevant activities and programs. As an illustration of how these new geospatial tools may be applied, an original exemplar case study provides how it is possible to derive value-added follow-up information on some recent public media reporting of a former clandestine underground plutonium production complex (now being converted to a 'Tourist Attraction' given the site's abandonment by China in the early 1980s). That open source media reporting, when combined with subsequent commentary found in various Internet-based Blogs and Wikis, led to independent verification of the reporting with additional ground truth via 'crowdsourcing' (tourist photos as found on 'social networking' venues like Google Earth's Panoramio layer and Twitter). Confirmation of the precise geospatial location of the site (along with a more complete facility characterization incorporating 3-D Modeling and visualization) was only made possible following the acquisition of higher resolution commercial satellite imagery that could be correlated with the reporting, ground photos, and an interior diagram, through original imagery analysis of the overhead imagery.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

New Developments and Research Findings: NASA Hydrazine Arcjets

In 1984, the market for commercial geosynchronous communications satellites (comsats) was expanding and there was strong competition between spacecraft builders for market share. The propellant required for the north-south stationkeeping (NSSK) function was a major mission limiter, and the small chemical and resistojet systems then in use were at or near their physical limits. Thus, conditions were right for the development of a high performance NSSK system, and after an extensive survey of both propulsion technologies and the aerospace community, the NASA program chose hydrazine arcjets for development. A joint government/industry development program ensued which culminated in the acceptance of arcjet technology. NASA efforts included fundamental feasibility assessments, hardware development and verification, and multiple efforts aimed at the demonstration of critical operational characteristics of arcjet systems. Throughout the program, constant contact with the user community was maintained to determine system requirements. Both contracted and cooperative programs with industry were supported. First generation, kW-class arcjets are now operational for NSSK on the Telstar 401 satellite launched in December of 1993 and are baselined for use on multiple future satellite series (Intelsat 8, AsiaSat, Echostar). Arcjet development efforts are now focusing on the development of both high performance (600 s), 2 kW thrusters for application on next generation comsats and low power (Pe approximately 0.5 kW) for a variety of applications on power limited satellites. This paper presents a review of the NASA's role in the development of hydrazine arcjets with a focus on approaches, lessons learned, and the future.

Curren, Francis M.↗

Improved best estimate plus uncertainty methodology including advanced validation concepts to license evolving nuclear reactors

Many evolving nuclear energy programs plan to use advanced predictive multi-scale multi-physics simulation and modeling capabilities to reduce cost and time from design through licensing. Historically, the role of experiments was primary tool for design and understanding of nuclear system behavior while modeling and simulation played the subordinate role of supporting experiments. In the new era of multi-scale multi-physics computational based technology development, the experiments will still be needed but they will be performed at different scales to calibrate and validate models leading predictive simulations. Cost saving goals of programs will require us to minimize the required number of validation experiments. Utilization of more multi-scale multi-physics models introduces complexities in the validation of predictive tools. Traditional methodologies will have to be modified to address these arising issues. This paper lays out the basic aspects of a methodology that can be potentially used to address these new challenges in design and licensing of evolving nuclear technology programs. The main components of the proposed methodology are verification, validation, calibration, and uncertainty quantification. An enhanced calibration concept is introduced and is accomplished through data assimilation. The goal is to enable best-estimate prediction of system behaviors in both normal and safety related environments. To achieve this goal requires the additional steps of estimating the domain of validation and quantification of uncertainties that allow for extension of results to areas of the validation domain that are not directly tested with experiments, which might include extension of the modeling and simulation (M&S) capabilities for application to full-scale systems. The new methodology suggests a formalism to quantify an adequate level of validation (predictive maturity) with respect to required selective data so that required testing can be minimized for cost saving purposes by showing further testing wold not enhance the quality of the validation of predictive tools. The proposed methodology is at a conceptual level. When matured and if considered favorably by the stakeholders, it could serve as a new framework for the next generation of the best estimate plus uncertainty licensing methodology that USNRC developed previously. In order to come to that level of maturity it is necessary to communicate the methodology to scientific, design and regulatory stakeholders for discussion and debates. This paper is the first step to establish this communication.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Chapter 21: Estimating Net Savings - Common Practices. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures

This chapter focuses on the methods used to estimate net energy savings in evaluation, measurement, and verification (EM and V) studies for energy efficiency (EE) programs. The chapter provides a definition of net savings, which remains an unsettled topic both within the EE evaluation community and across the broader public policy evaluation community, particularly in the context of attribution of savings to a program. The chapter differs from the measure-specific Uniform Methods Project (UMP) chapters in both its approach and work product. Unlike other UMP resources that provide recommended protocols for determining gross energy savings, this chapter describes and compares the current industry practices for determining net energy savings but does not prescribe methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SEE Action Guide for States: Evaluation, Measurement, and Verification Frameworks$-$Guidance for Energy Efficiency Portfolios Funded by Utility Customers

This guide describes frameworks for evaluation, measurement, and verification (EM&V) of utility customer–funded energy efficiency programs. The authors reviewed multiple frameworks across the United States and gathered input from experts to prepare this guide. This guide provides the reader with both the contents of an EM&V framework, along with the processes used to develop and update these frameworks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Digital Twin Development of FASTR

This work package is focused on creating a digital twin (DT) of the Facility to Alleviate Salt Technology Risks (FASTR) experiment. FASTR is a high-profile facility tasked with maturing molten salt applications such as liquid salt energy storage, concentrated solar power facilities, and molten salt cooling systems supporting other advanced reactor technologies, all of which may be incorporated as components within the Integrated Energy Systems (IES) program. As part of creating a digital twin (DT), verification and validation (V&V) has been performed for the physics-based model, and gaps have been identified. Additionally, a preliminary integration of the FASTR model has been completed with the existing physics-based model of the Thermal Energy Distribution System (TEDS)/Microreactor AGile Non-nuclear Experimental Testbed (MAGNET) facility at Idaho National Laboratory (INL). A Functional Mock-up Unit (FMU) of the physics-based system model and a reduced-order model (ROM) were both used to test for a preliminary hardware in the loop operation when the physical loop was offline. Future tasks could include improving the physics-based model to better match the available experimental data, improving the hardware in the loop integration, and improving the integration with the TEDS model.

14 SOLAR ENERGY↗

Development and testing of the infrared radiometer for the Mariner Venus/Mercury 1973 spacecraft

The science objectives, development history, functional description, and testing of the Mariner Venus/Mercury 1973 infrared radiometer are discussed. Included in the functional description section is a thorough discussion of the IRR optical system, electronic operation, and thermal control. Signal development and its conversion to engineering units is traced, starting with the radiant space object, passing through the IRR optics and electronics, and culminating with data number development and interpretation. The test program section includes discussion of IRR calibration and alignment verification. Finally, the problems and failures encountered by the IRR during the period of its development and testing are reviewed.

Clarke, T. C.↗