Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗

Commercial Building Partnerships Replication and Diffusion

This study presents findings from survey and interview data investigating replication efforts of Commercial Building Partnership (CBP) partners that worked directly with the Pacific Northwest National Laboratory (PNNL). PNNL partnered directly with 12 organizations on new and retrofit construction projects, which represented approximately 28 percent of the entire U.S. Department of Energy (DOE) CBP program. Through a feedback survey mechanism, along with personal interviews, PNNL gathered quantitative and qualitative data relating to replication efforts by each organization. These data were analyzed to provide insight into two primary research areas: 1) CBP partners’ replication efforts of technologies and approaches used in the CBP project to the rest of the organization’s building portfolio (including replication verification), and, 2) the market potential for technology diffusion into the total U.S. commercial building stock, as a direct result of the CBP program. The first area of this research focused specifically on replication efforts underway or planned by each CBP program participant. Factors that impact replication include motivation, organizational structure and objectives firms have for implementation of energy efficient technologies. Comparing these factors between different CBP partners revealed patterns in motivation for constructing energy efficient buildings, along with better insight into market trends for green building practices. The second area of this research develops a diffusion of innovations model to analyze potential broad market impacts of the CBP program on the commercial building industry in the United States.

Commercial Building Partnerships↗

Independent Validation and Verification of Process Design and Optimization Technology Diagnostic and Control of Natural Gas Fired Furnaces via Flame Image Analysis Technology

The United States Department of Energy, Industrial Technologies Program has invested in emerging Process Design and Optimizations Technologies (PDOT) to encourage the development of new initiatives that might result in energy savings in industrial processes. Gas fired furnaces present a harsh environment, often making accurate determination of correct air/fuel ratios a challenge. Operation with the correct air/fuel ratio and especially with balanced burners in multi-burner combustion equipment can result in improved system efficiency, yielding lower operating costs and reduced emissions. Flame Image Analysis offers a way to improve individual burner performance by identifying and correcting fuel-rich burners. The anticipated benefit of this technology is improved furnace thermal efficiency, and lower NOx emissions. Independent validation and verification (V&V) testing of the FIA technology was performed at Missouri Forge, Inc., in Doniphan, Missouri by Environ International Corporation (V&V contractor) and Enterprise Energy and Research (EE&R), the developer of the technology. The test site was selected by the technology developer and accepted by Environ after a meeting held at Missouri Forge. As stated in the solicitation for the V&V contractor, 'The objective of this activity is to provide independent verification and validation of the performance of this new technology when demonstrated in industrial applications. A primary goal for the V&V process will be to independently evaluate if this technology, when demonstrated in an industrial application, can be utilized to save a significant amount of the operating energy cost. The Seller will also independently evaluate the other benefits of the demonstrated technology that were previously identified by the developer, including those related to product quality, productivity, environmental impact, etc'. A test plan was provided by the technology developer and is included as an appendix to the summary report submitted by Environ (Appendix A). That plan required the V&V contractor to: (1) Establish the as-found furnace operating conditions; (2) Tune the furnace using currently available technology to establish baseline conditions; (3) Tune the furnace using the FIA technology; and (4) Document the improved performance that resulted from application of the FIA technology. It is important to note that the testing was not designed to be a competition or comparison between two different methodologies that could be used for furnace tuning. Rather, the intent was to quantify improvements in furnace performance that could not be achieved with existing technology. Therefore, the measure of success is improvement beyond the furnace efficiency obtainable using existing furnace optimization methods rather than improvement from the as found condition.

03 NATURAL GAS↗

CSRI Summer Proceedings 2021

The Computer Science Research Institute (CSRI) brings university faculty and students to Sandia National Laboratories for focused collaborative research on Department of Energy (DOE) computer and computational science problems. The institute provides an opportunity for university researches to learn about problems in computer and computational science at DOE laboratories, and help transfer results of their research to programs at the labs. Some specific CSRI research interest areas are: scalable solvers, optimization, algebraic preconditioners, graph-based, discrete, and combinatorial algorithms, uncertainty estimation, validation and verification methods, mesh generation, dynamic load-balancing, virus and other malicious-code defense, visualization, scalable cluster computers, beyond Moore’s Law computing, exascale computing tools and application design, reduced order and multiscale modeling, parallel input/output, and theoretical computer science. The CSRI Summer Program is organized by CSRI and includes a weekly seminar series and the publication of a summer proceedings.

97 MATHEMATICS AND COMPUTING↗

CSRI Summer Proceedings 2021

The Computer Science Research Institute (CSRI) brings university faculty and students to Sandia National Laboratories for focused collaborative research on Department of Energy (DOE) computer and computational science problems. The institute provides an opportunity for university researches to learn about problems in computer and computational science at DOE laboratories, and help transfer results of their research to programs at the labs. Some specific CSRI research interest areas are: scalable solvers, optimization, algebraic preconditioners, graph-based, discrete, and combinatorial algorithms, uncertainty estimation, validation and verification methods, mesh generation, dynamic load-balancing, virus and other malicious-code defense, visualization, scalable cluster computers, beyond Moore’s Law computing, exascale computing tools and application design, reduced order and multiscale modeling, parallel input/output, and theoretical computer science. The CSRI Summer Program is organized by CSRI and includes a weekly seminar series and the publication of a summer proceedings.

97 MATHEMATICS AND COMPUTING↗

ORNL Report for the Preparation and Verification of a U-233 Spike Solution

In response to a Letter Request from the International Atomic Energy Agency to the United States Support Program, the NNSA’s Nuclear Reference Material Program (NRMP) tasked the Material Signatures and Isotopic Standards (MSIS) group at Oak Ridge National Laboratory to prepare 50 units of a U-233 CRM standard with a unit size of approximately 10 µg of U-233.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Visualization design and verification of Ada tasking using timing diagrams

The use of timing diagrams is recommended in the design and testing of multi-task Ada programs. By displaying the task states vs. time, timing diagrams can portray the simultaneous threads of data flow and control which characterize tasking programs. This description of the system's dynamic behavior from conception to testing is a necessary adjunct to other graphical techniques, such as structure charts, which essentially give a static view of the system. A series of steps is recommended which incorporates timing diagrams into the design process. Finally, a description is provided of a prototype Ada Execution Analyzer (AEA) which automates the production of timing diagrams from VAX/Ada debugger output.

Vidale, R. F.↗

ECAR: Baseline Characterization Database Verification Report – PCEA Billet 01D3-35

The purpose of this engineering calculations and analysis report (ECAR) is to present data collected in the Baseline Graphite Characterization Program, which is directly tasked with supporting the Idaho National Laboratory’s (INL’s) research and development efforts on the Advanced Reactor Technologies (ART) Program. This program populates a comprehensive database that reflects the baseline properties of nuclear-grade graphite with regard to individual grade, billet, and position within individual billets. The physical- and mechanical-property information collected will be transferred to the Nuclear Data Management and Analysis System (NDMAS), and that database will help populate the handbook of property data available to member nations of the Generation-IV International Forum. Transfer of these data from the applicable technical lead to the dissemination databases available to other end users requires a full review of the test procedures and data-collection efforts through an analysis of the multiple summary spreadsheets and values being collected. This report represents the analysis for PCEA Billet 01D3-35 and facilitates release of associated data to the NDMAS custodians.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Mapping National Forest Aboveground Biomass in Mexico By Integrating GEDI and Landsat Times Series Data

Mexico is one of the countries with great potential for the UN's Reducing Emissions from Deforestation and Forest Degradation (REDD+) program, a key nature-based solution for the forest sector. To monitor carbon stock changes, there is a growing demand for unbiased Monitoring Reporting Verification (MRV) systems to facilitate effective forest management and climate change mitigation strategies. Remote sensing-based national aboveground biomass density (AGBD) estimation over Mexico is scarce and often limited to one-time static mapping, leading to spatiotemporal inconsistency in inputs. As an effort under NASA's Carbon Monitoring System (CMS) program, we have developed a remote sensing-based approach to create consistent historical AGBD maps of Mexico using multi-stream remote sensing data, including spaceborne lidar GEDI and long-term Landsat time series, as well as topographic information. We employ the continuous change detection and classification (CCDC) algorithm for temporal modeling of Landsat surface reflectance, followed by the inference of forest AGBD using a random forest machine learning algorithm with the temporal information of land surface dynamics extracted by the CCDC as input. GEDI provides unprecedented forest structure and AGBD sampling datasets for model training and validation practices. In this presentation, we share the progress made in developing a spatially explicit mapping of historical AGBD changes associated with land surface changes and post-disturbance landscapes.

Taejin Park↗

A Testbed of Parallel Kernels for Computer Science Research

For several decades, computer scientists have sought guidance on how to evolve architectures, languages, and programming models for optimal performance, efficiency, and productivity. Unfortunately, this guidance is most often taken from the existing software/hardware ecosystem. Architects attempt to provide micro-architectural solutions to improve performance on fixed binaries. Researchers tweak compilers to improve code generation for existing architectures and implementations, and they may invent new programming models for fixed processor and memory architectures and computational algorithms. In today's rapidly evolving world of on-chip parallelism, these isolated and iterative improvements to performance may miss superior solutions in the same way gradient descent optimization techniques may get stuck in local minima. In an initial study, we have developed an alternate approach that, rather than starting with an existing hardware/software solution laced with hidden assumptions, defines the computational problems of interest and invites architects, researchers and programmers to implement novel hardware/ software co-designed solutions. Our work builds on the previous ideas of computational dwarfs, motifs, and parallel patterns by selecting a representative set of essential problems for which we provide: An algorithmic description; scalable problem definition; illustrative reference implementations; verification schemes. For simplicity, we focus initially on the computational problems of interest to the scientific computing community but proclaim the methodology (and perhaps a subset of the problems) as applicable to other communities. We intend to broaden the coverage of this problem space through stronger community involvement. Previous work has established a broad categorization of numerical methods of interest to the scientific computing, in the spirit of the NAS Benchmarks, which pioneered the basic idea of a 'pencil and paper benchmark' in the 1990s. The initial result of the more modern study was the seven dwarfs, which was subsequently extended to 13 motifs. These motifs have already been useful in defining classes of applications for architecture-software studies. However, these broad-brush problem statements often miss the nuance seen in individual kernels. For example, the computational requirements of particle methods vary greatly between the naive (but more accurate) direct calculations and the particle-mesh and particle-tree codes. Thus we commenced our study with an enumeration of problems, but then proceeded by providing not only reference implementations for each problem, but more importantly a mathematical definition that allows one to escape iterative approaches to software/hardware optimization. To ensure long term value, we have augmented each of our reference implementations with both a scalable problem generator and a verification scheme. In a paper we have prepared that documents our efforts, we describe in detail this process of problem definition, scalable input creation, verification, and implementation of reference codes for the scientific computing domain. Table 1 enumerates and describes the level of support we've developed for each kernel. We group these important kernels using the Berkeley dwarfs/motifs taxonomy using a red box in the appropriate column. As kernels become progressively complex, they build upon other, simpler computational methods. We note this dependency via orange boxes. After enumeration of the important numerical problems, we created a domain-appropriate high-level definition of each problem. To ensure future endeavors are not tainted by existing implementations, we specified the problem definition to be independent of both computer architecture and existing programming languages, models, and data types. Then, to provide context as to how such kernels productively map to existing architectures, languages and programming models, we produced reference implementations for most of the kernel (see table). These sample codes should be viewed as 'hints,' designed to show how other designers have mapped a problem's operands and operators to existing hardware and software. Since we wanted such implementations to be illustrative, we tried to ensure they were the most straightforward implementation in the easiest to understand languages using familiar architectures. To that end, most of the linear algebra-oriented computations are written in MATLAB using array indexing to process matrices, rather than one-line library calls to compute the same kernel. This ensures that the kernel's computation is explicit and readable in the implementation and not hidden behind a library. For other problems, such as the Barnes-Hut n-Body solver, the implementations were written in pure C, without any supporting library computations. Along this line, we have also created a scalable problem generator to accompany each computation.

97 MATHEMATICS AND COMPUTING↗

Guidelines for Verification Strategies to Minimize RISK Based on Mission Environment, -Application and -Lifetime (MEAL)

There is a trend of compromising verification testing to address the cost and schedule constraints, which poses a high-risk posture for programs/projects. Current and emerging aerospace scientific and/or human exploration programs continue to pose new technological challenges. These technological challenges combined with finite budgets and truncated schedules are forcing designers, scientists, engineers, and managers to push technologies to their physical limits. In addition, budget and schedule pressures challenge how those technologies/missions are verified. A clear understanding of the different verification processes is needed to ensure the proper verification of the technology within the mission (i.e., capabilities, advantages, and limitations). The goal of verification is to prove through test, analysis, inspection, and/or demonstration that a product provides its required function while meeting the performance requirements. It is important that verification yield understanding of representative performance under worst-case conditions so that margins to failure can be evaluated for proposed applications. The capabilities, advantages, and limitations of the testing and inspection performed at each level are different, and the risk incurred by omitting a verification step depends on the level of integration as well as Mission, Environment, Application and Lifetime (MEAL). This paper focuses on verification processes. The goal of the verification process is to ensure the given avionics technology could be safely implemented on the given MEAL consistent with the program/project risk posture.

Gonzalez, Oscar↗

Benchmark Evaluation of Uranium Metal Annuli and Cylinders with Beryllium Reflectors

An extensive series of delayed critical experiments were performed at the Oak Ridge Critical Experiments Facility using enriched uranium metal during the 1960s and 1970s in support of criticality safety operations at the Y-12 Plant. These experiments were designed to evaluate the storage, casting, and handling limits of the Y-12 Plant and to provide data for the verification of cross sections and calculation methods utilized in nuclear criticality safety applications. Many of these experiments have already been evaluated and included in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook: unreflected (HEU-MET-FAST-051), graphite-reflected (HEU-MET-FAST-071), and polyethylene-reflected (HEU-MET-FAST-076). Three of the experiments consisted of highly-enriched uranium (HEU, ~93.2% 235U) metal parts reflected by beryllium metal discs. The first evaluated experiment was constructed from a stack of 7-in.-diameter, 4-1/8-in.-high stack of HEU discs top-reflected by a 7-in.-diameter, 5-9/16-in.-high stack of beryllium discs. The other two experiments were formed from stacks of concentric HEU metal annular rings surrounding a 7-in. diameter beryllium core. The nominal outer diameters were 13 and 15 in. with a nominal stack height of 5 and 4 in., respectively. These experiments have been evaluated for inclusion in the ICSBEP Handbook.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Symbolic Analysis of Concurrent Programs with Polymorphism

The current trend of multi-core and multi-processor computing is causing a paradigm shift from inherently sequential to highly concurrent and parallel applications. Certain thread interleavings, data input values, or combinations of both often cause errors in the system. Systematic verification techniques such as explicit state model checking and symbolic execution are extensively used to detect errors in such systems [7, 9]. Explicit state model checking enumerates possible thread schedules and input data values of a program in order to check for errors [3, 9]. To partially mitigate the state space explosion from data input values, symbolic execution techniques substitute data input values with symbolic values [5, 7, 6]. Explicit state model checking and symbolic execution techniques used in conjunction with exhaustive search techniques such as depth-first search are unable to detect errors in medium to large-sized concurrent programs because the number of behaviors caused by data and thread non-determinism is extremely large. We present an overview of abstraction-guided symbolic execution for concurrent programs that detects errors manifested by a combination of thread schedules and data values [8]. The technique generates a set of key program locations relevant in testing the reachability of the target locations. The symbolic execution is then guided along these locations in an attempt to generate a feasible execution path to the error state. This allows the execution to focus in parts of the behavior space more likely to contain an error.

Rungta, Neha Shyam↗

thermal-grid-jba v1.0.0

This is a software repository that contains models for a feasibility study of a thermal energy network for Joint Base Andrews. The work has been conducted under the ESTCP program in the project https://serdp-estcp.mil/projects/details/0694868a-3d58-4a14-a587-b8f638bfcd5c The repository contains models for energy system selection and for verification of design. The DoD management intends to give access to this code for future feasibility studies at Joint Base Andrews and possibly other bases.

Wetter, Michael [Lawrence Berkeley National Labora↗

On the relationship between aerosol content and errors in telephotometer experiments.

This paper presents an invariant imbedding theory of multiple scattering phenomena contributing to errors in telephotometer experiments. The theory indicates that there is a simple relationship between the magnitudes of the errors introduced by successive orders of scattering and it is shown that for all optical thicknesses each order can be represented by a coefficient which depends on the field of view of the telescope and the properties of the scattering medium. The verification of the theory and the derivation of the coefficients have been accomplished by a Monte Carlo program. Both monodisperse and polydisperse systems of Mie scatterers have been treated. The results demonstrate that for a given optical thickness the coefficients increase strongly with the mean particle size particularly for the smaller fields of view.

Thomas, R. W. L.↗

Transonic wind tunnel tests of A.015 scale space shuttle orbiter model, volume 1

Transonic wind tunnel tests were run on a 0.015 scale model of the Space Shuttle Orbiter Vehicle in an eight-foot tunnel during August 1975. The purpose of the program was to obtain basic shuttle aerodynamic data through a full range of elevon and aileron deflections, verification of data obtained at other facilities, and effects of Reynolds numbers. The first part of a discussion of test procedures and results in both tabular and graphical form were presented. Tests were performed at Mach numbers from 0.35 to 1.20, and at Reynolds numbers for 3.5 million to 8.2 million per foot. The angle of attack was varied from -1 to +20 degrees at sideslip angles of -2, 0, +2 degrees. Sideslip was varied from -6 to +8 degrees at constant angles of attack from 0 to +20 degrees. Various aileron and ailevon settings were tested for various angles of attack.

Struzynski, N. A.↗

Transonic wind tunnel tests of a .015 scale space shuttle orbiter model, volume 2

Transonic wind tunnel tests were run on a 0.015 scale model of the Space Shuttle Orbiter Vehicle in an eight-foot tunnel during August 1975. The purpose of the program was to obtain basic shuttle aerodynamic data through a full range of elevon and aileron deflections, verification of data obtained at other facilities, and effects of Reynolds numbers. The second part of a discussion of test procedures and results in both tabular and graphical form were presented. Tests were performed at Mach numbers from 0.35 to 1.20, and at Reynolds numbers from 3.5 million to 8.2 million per foot. The angle of attack was varied from -2 to +20 degrees at sideslip angles of -2, 0, +2 degrees. Sideslip was varied from -6 to +8 degrees at constant angles of attack from 0 to +20 degrees. Various aileron and ailevon settings were tested for various angles of attack.

Struzynski, N. A.↗

Transonic high Reynolds number stability and control characteristics of a 0.015-scale remotely controlled elevon model (44-0) of the space shuttle orbiter tested in calspan 8-foot TWT (LA70)

Transonic Wind Tunnel tests were run on a .015 scale model of the space shuttle orbiter vehicle in the 8-foot transonic wind tunnel. Purpose of the test program was to obtain basic shuttle aerodynamic data through a full range of elevon and aileron deflections, verification of data obtained at other facilities, and effects of Reynolds number. Tests were performed at Mach numbers from .35 to 1.20 and Reynolds numbers from 3,500,000 to 8,200,000 per foot. The high Reynolds number conditions (nominal 8,000,000/foot) were obtained using the ejector augmentation system. Angle of attack was varied from -2 to +20 degrees at sideslip angles of -2, 0, and +2 degrees. Sideslip was varied from -6 to +8 degrees at constant angles of attack from 0 to +20 degrees. Aileron settings were varied from -5 to +10 degrees at elevon deflections of -10, 0, and +10 degrees. Fixed aileron settings of 0 and 2 degrees in combination with various fixed elevon settings between -20 and +5 degrees were also run at varying angles of attack.

Parrell, H.↗