Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Validation of Methods to Predict Vibration of a Panel in the Near Field of a Hot Supersonic Rocket Plume

This paper describes the measurement and analysis of surface fluctuating pressure level (FPL) data and vibration data from a plume impingement aero-acoustic and vibration (PIAAV) test to validate NASA s physics-based modeling methods for prediction of panel vibration in the near field of a hot supersonic rocket plume. For this test - reported more fully in a companion paper by Osterholt & Knox at 26th Aerospace Testing Seminar, 2011 - the flexible panel was located 2.4 nozzle diameters from the plume centerline and 4.3 nozzle diameters downstream from the nozzle exit. The FPL loading is analyzed in terms of its auto spectrum, its cross spectrum, its spatial correlation parameters and its statistical properties. The panel vibration data is used to estimate the in-situ damping under plume FPL loading conditions and to validate both finite element analysis (FEA) and statistical energy analysis (SEA) methods for prediction of panel response. An assessment is also made of the effects of non-linearity in the panel elasticity.

Bremner, P. G.↗
DOE OSTI2017

Modeling the direct sun component in buildings using matrix algebraic approaches: Methods and validation

Simulation tools that enable annual energy performance analysis of optically-complex fenestration systems have been widely adopted by the building industry for use in building design, code development, and the development of rating and certification programs for commercially-available shading and daylighting products. The tools rely on a three-phase matrix operation to compute solar heat gains, using as input low-resolution bidirectional scattering distribution function (BSDF) data (10–15° angular resolution; BSDF data define the angle-dependent behavior of light-scattering materials and systems). Measurement standards and product libraries for BSDF data are undergoing development to support solar heat gain calculations. Simulation of other metrics such as discomfort glare, annual solar exposure, and potentially thermal discomfort, however, require algorithms and BSDF input data that more accurately model the spatial distribution of transmitted and reflected irradiance or illuminance from the sun (0.5° resolution). This study describes such algorithms and input data, then validates the tools (i.e., an interpolation tool for measured BSDF data and the five-phase method) through comparisons with ray-tracing simulations and field monitored data from a full-scale testbed. Simulations of daylight-redirecting films, a micro-louvered screen, and venetian blinds using variable resolution, tensor tree BSDF input data derived from interpolated scanning goniophotometer measurements were shown to agree with field monitored data to within 20% for greater than 75% of the measurement period for illuminance-based performance parameters. The three-phase method delivered significantly less accurate results. We discuss the ramifications of these findings on industry and provide recommendations to increase end user awareness of the current limitations of existing software tools and BSDF product libraries.

14 SOLAR ENERGY↗
DOE OSTI2024

Summary Report of the FY24 DOE Contributions to the GIF VHTR CMVB

The Generation-IV Forum (GIF) Very-High-Temperature Reactor-Computational Methods Validation and Benchmark (VHTR-CMVB) initiative, involving organizations from Korea Atomic Energy Research Institute (KAERI) (South Korea), Institute of Nuclear and New Energy Technology of Tsinghua University (INET) (China), U.S. Department of Energy (DOE) (U.S.), Joint Research Centre (JRC) (Europe), and Japan Atomic Energy Agency (JAEA) (Japan), is dedicated to the verification and validation of tools for High-Temperature Gas-Cooled Reactors (HTGRs) analysis, using data shared by Computational Methods Validation and Benchmark (CMVB) signatories. For FY24, the US DOE CMVB has committed to several critical activities. Under WP1, led by the US, the integration of the High Temperature Gas Cooled Reactor - Pebble-Bed Module (HTR-PM) Phenomena Identification and Ranking Table (PIRT) into the comparative PIRT is progressing, with a new draft of the comparison tables issued earlier this year and currently being utilized by INET for their contribution. Neutronic validation efforts under WP3 include the preparation of the burnup analysis benchmark, preliminary calculations, and the development of reference models and results. In WP2, a validation exercise for hot gas mixing in the lower plenum of HTR-PM is in progress, using experimental data from INET (China) to validate modeling approaches. A model of the experimental facility has been developed using StarCCM+, with initial calculations slated for presentation at the GIF CMVB meeting this fall. Another WP2 activity focuses on validating numerical models for air-cooled Reactor Cavity Cooling System (RCCS) with experimental data from the Wisconsin Madison RCCS facility. A high-fidelity model, developed using NEK-RS, is currently being validated with available data from a low power forced convection test. These efforts are aimed at enhancing and confirming the accuracy of HTGR analysis tools, ensuring their alignment with experimental data and regulatory requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1991

Meteorological radar methods for validating space observations of precipitation

Meteorological approaches to verification of space measurements of rainfall are examined; validation of Tropical Rainfall Measuring Mission (TRMM) observations is expected to depend significantly on ground-based radars. Two methods of comparison are initially contemplated. TRMM rainfall data over time periods of a month for large areas (500 x 500 km) are averaged and compared with similarly averaged ground truth measurements. Both the rainfall and height distribution data from TRMM are compared with the instantaneous values observed at one or more 'ground truth' stations and from airborne radar and radiometers as available.

Thiele, Otto W.↗
DOE OSTI2018

Topographic Effects on Radiation in the WRF Model with the Immersed Boundary Method: Implementation, Validation, and Application to Complex Terrain

Abstract Topographic effects on radiation, including both topographic shading and slope effects, are included in the Weather Research and Forecasting (WRF) Model, and here they are made compatible with the immersed boundary method (IBM). IBM is an alternative method for representing complex terrain that reduces numerical errors over sloped terrain, thus extending the range of slopes that can be represented in WRF simulations. The implementation of topographic effects on radiation is validated by comparing land surface fluxes, as well as temperature and velocity fields, between idealized WRF simulations both with and without IBM. Following validation, the topographic shading implementation is tested in a semirealistic simulation of flow over Granite Mountain, Utah, where topographic shading is known to affect downslope flow development in the evening. The horizontal grid spacing is 50 m and the vertical grid spacing is approximately 8–27 m near the surface. Such a case would fail to run in WRF with its native terrain-following coordinates because of large local slope values reaching up to 55°. Good agreement is found between modeled surface energy budget components and observations from the Mountain Terrain Atmospheric Modeling and Observations (MATERHORN) program at a location on the east slope of Granite Mountain. In addition, the model captures large spatiotemporal inhomogeneities in the surface sensible heat flux that are important for the development of thermally driven flows over complex terrain.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2019

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗
NASA NTRS1989

Evidence flow graph methods for validation and verification of expert systems

The results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems are given. A translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis were developed. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could affect the output from a set of rules.

Becker, Lee A.↗
NASA NTRS1988

Evidence flow graph methods for validation and verification of expert systems

This final report describes the results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems. This was approached by developing a translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could effect the output from a set of rules.

Becker, Lee A.↗
DOE OSTI2026

Diesel Fuel Consumption in Prominent U.S. Open-Pit Mines: Site-Level Estimates

This report presents a comprehensive framework for estimating diesel fuel consumption and prices at open-pit mines in the United States. The framework includes transparent methods for calculating site-level diesel energy use when direct reporting is unavailable, and a structured confidence evaluation for each method. The framework is demonstrated to estimate current diesel consumption at 21 open-pit mines in the United States. Initial findings support ongoing efforts to strengthen the competitiveness and security of the U.S. industrial base by supporting data-driven supply chain analysis and decision-making, improved transparency in mining sector energy use, and targeted deployment of energy innovation and cost-reduction strategies. Future updates to the dataset—coupled with expanded data transparency and method validation—will help ensure that the findings remain relevant as the sector continues to evolve.

02 PETROLEUM↗
NASA NTRS1992

Evaluation of ultrasonic cavitation of metallic and non-metallic surfaces

1,1,2 trichloro-1,2,2 trifluoro ethane (CFC-113) commercially known as Freon-113 is the primary test solvent used for validating the cleaned hardware at the Kennedy Space Center (KSC). Due to the ozone depletion problem, the current United States policy calls for the phase out of Freons by 1995. NASAs chlorofluorocarbon (CFC) replacement group at KSC has opted to use water as a replacement fluid for the validation process since water is non-toxic, inexpensive, and is environmentally friendly. The replacement validation method calls for the ultrasonification of the small parts with water at 52 C for a cycle or two of 10 min duration wash using commercial ultrasonic baths. In this project, experimental data was obtained to assess the applicability of the proposed validation method for any damage of the metallic and non-metallic surfaces resulting from ultrasonic cavitation.

Mehta, Narinder K.↗
NASA NTRS1999

Lidar Altimeter Measurements of Canopy Structure: Methods and Validation for Closed Canopy, Broadleaf Forests

Lidar altimeter observations of vegetated landscapes provide a time-resolved measure of laser pulse backscatter energy from canopy surfaces and the underlying ground. Airborne lidar altimeter data was acquired using the Scanning Lidar Imager of Canopies by Echo Recovery (SLICER) for a successional sequence of four, closed-canopy, deciduous forest stands in eastern Maryland. The four stands were selected so as to include a range of canopy structures of importance to forest ecosystem function, including variation in the height and roughness of the outer-most canopy surface and the vertical organization of canopy stories and gaps. The character of the SLICER backscatter signal is described and a method is developed that accounts for occlusion of the laser energy by canopy surfaces, transforming the backscatter signal to a canopy height profile (CHP) that quantitatively represents the relative vertical distribution of canopy surface area. The transformation applies an increased weighting to the backscatter amplitude as a function of closure through the canopy and assumes a horizontally random distribution of the canopy components. SLICER CHPs, averaged over areas of overlap where lidar ground tracks intersect, are shown to be highly reproducible. CHP transects across the four stands reveal spatial variations in vegetation, at the scale of the individual 10 m diameter laser footprints, within and between stands. Averaged SLICER CHPs are compared to analogous height profile results derived from ground-based sightings to plant intercepts measured on plots within the four stands. Tbe plots were located on the segments of the lidar ground tracks from which averaged SLICER CHPs were derived, and the ground observations were acquired within two weeks of the SLICER data acquisition to minimize temporal change. The differences in canopy structure between the four stands is similarly described by the SLICER and ground-based CHP results, however a Chi-square test of similarity documents differences that are statistically significant. The differences are discussed in terms of measurement properties that define the smoothness of the resulting CHPs and Lidar Altimeter Measurements of Canopy Structure - Harding et al. canopy properties that may vertically bias the CHP representations of canopy structure. The statistical differences are most likely due to the more noisy character of the ground-based CHPs, especially high in the canopy where ground-based sightings are rare resulting in an underestimate of canopy surface area and height, and to departures from the assumption of horizontal randomness which bias the CHPs toward the observer (upward for SLICER and downward for ground-based CHPs). The results demonstrate that the SLICER observations reliably provide a measure of canopy structure that reveals ecologically interesting structural variations such as those characterizing a successional sequence of closed-canopy, broadleaf forest stands.

Harding, D. J.↗
NASA NTRS1987

Design and validation of fault-tolerant flight systems

Flight systems must be validated to show that they are consistent with the requirements of their intended applications. While high reliability is difficult to validate, the additional complexity of fault tolerance further compounds the validation problem. The objective of NASA’s research is to develop a methodology for designing validatable fault-tolerant systems. Under the design-for-validation philosophy, emphasis is placed on developing validation methods that can be incorporated into the design process right from the start and design methods and guidance which, while incorporating fault tolerance, can assure validatability. This paper examines the statistical issues of validating highly reliable, fault tolerant system. There are many problems associated with traditional methods of designing and validating these potentially complex hardware and software systems. Useful design-for-validation methods, which include structured specification and design methodologies, mathematical proof techniques, analytical modeling, simulation and emulation, and physical testing, are discussed. Important design issues associated with fault tolerance are presented along with the related validation concerns which must be addressed. Experience has shown that synchronization and Byzantine resilience must accompany fault tolerance. Other design attributes associated with fault tolerance may be used by a designer on the basis of cost, weight, performance, and validation considerations.

Computer systems↗
DOE OSTI2018

Clustering Methods and Validation of Representative Distribution Feeders

Clustering has received a lot of focus globally in recent years to determine representative feeders for validating smart grid technologies; however, clear reasoning on why a particular technique was used to accomplish a clustering step and whether similar results can be obtained from different techniques has not been reported. Further, and most importantly, validating final representative feeders and clusters when a sizeable feeder data set is used has not been completed. This paper addresses these issues. This paper also highlights the parameters that were determined to be critical for photovoltaic hosting capacity based on this analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Modeling Isothermal Reduction of Iron Ore Pellet Using Finite Element Analysis Method: Experiments & Validation

Iron ore pellet reduction experiments were performed with pure hydrogen (H2) and mixtures with carbon monoxide (CO) at different ratios. For direct reduction processes that switch dynamically between reformed natural gas and hydrogen as the reductant, it is important to understand the effects of the transition on the oxide reduction kinetics to optimize the residence time of iron ore pellets in a shaft reactor. Hence, the reduction rates were studied by varying experimental parameters such as the temperature (800, 850 & 900 °C), reactant gas flow rate (100, 150 & 200 cm3/min), pellet size and composition of the reactant gas mixture. The rate of reduction was observed to increase with an increase in temperature and reactant gas flow rate, but it decreased with an increase in pellet size. SEM greyscale analysis was performed to analyze the porosity and phase composition of partially reduced pellets. The porosity of the pellets was observed to increase from 0.3 for unreacted pellet to 0.42 for a completely reduced pellet. Energy-dispersive X-ray spectroscopy (EDAX) analysis was performed to identify the phases observed in the SEM images. The fraction of iron phase was observed to increase from the shell region of the pellet to the core region with an increase in the degree of reduction. A 2D-axisymmetric numerical model was developed on COMSOL Multiphysics, and it was validated using the conversion (X) vs. time curves obtained from each experiment. The model was able to accurately predict the total time needed for the complete conversion of a single iron ore pellet for multiple experiments. Effects of changes in the porosity and tortuosity of the pellet on the model were also studied and the rate of reduction was observed to be sensitive to changes in both porosity and tortuosity. The SEM analysis and the model results show that tortuosity is higher for pellets reduced with H2 than for pellets reduced with H2-CO gas mixtures.

08 HYDROGEN↗
NASA NTRS1975

Development and validation of methods for man-made machine interface evaluation

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Malone, T. B.↗
NASA NTRS1990

Prediction of forces and moments for flight vehicle control effectors. Part 1: Validation of methods for predicting hypersonic vehicle controls forces and moments

Many types of hypersonic aircraft configurations are currently being studied for feasibility of future development. Since the control of the hypersonic configurations throughout the speed range has a major impact on acceptable designs, it must be considered in the conceptual design stage. The ability of the aerodynamic analysis methods contained in an industry standard conceptual design system, APAS II, to estimate the forces and moments generated through control surface deflections from low subsonic to high hypersonic speeds is considered. Predicted control forces and moments generated by various control effectors are compared with previously published wind tunnel and flight test data for three configurations: the North American X-15, the Space Shuttle Orbiter, and a hypersonic research airplane concept. Qualitative summaries of the results are given for each longitudinal force and moment and each control derivative in the various speed ranges. Results show that all predictions of longitudinal stability and control derivatives are acceptable for use at the conceptual design stage. Results for most lateral/directional control derivatives are acceptable for conceptual design purposes; however, predictions at supersonic Mach numbers for the change in yawing moment due to aileron deflection and the change in rolling moment due to rudder deflection are found to be unacceptable. Including shielding effects in the analysis is shown to have little effect on lift and pitching moment predictions while improving drag predictions.

Maughmer, Mark D.↗
NASA NTRS2004

Methods for Validation and Intercomparison of Remote Sensing and In situ Ice Water Measurements: Case Studies from CRYSTAL-FACE and Model Results

Remote sensing observations, such as those from AURA, are necessary to understand the role of cirrus in determining the radiative and humidity budgets of the upper troposphere. Using these measurements quantitatively requires comparisons with in situ measurements that have previously been validated. However, a direct comparison of remote and in situ measurements is difficult due to the requirement that the spatial and temporal overlap be sufficient in order to guarantee that both instruments are measuring the same air parcel. A difficult as this might be for gas phase intercomparisons, cloud inhomogeneities significantly exacerbate the problem for cloud ice water content measurements. The CRYSTAL-FACE mission provided an opportunity to assess how well such intercomparisons can be performed and to establish flight plans that will be necessary for validation of future satellite instruments. During CRYSTAL-FACE, remote and in situ instruments were placed on different aircraft (NASA's ER-2 and WB-59, and the two planes flew in tandem so that the in situ payload flew in the field of view of the remote instruments. We show here that, even with this type of careful flight planning, it is not always possible to guarantee that remote and in situ instruments are viewing the same air parcel. We use ice water data derived from the in situ Harvard Total Water (HV-TW) instrument, and the remote Goddard Cloud Radar System (CRS) and show that agreement between HV-TW and CRS is a strong function of the horizontal separation and the time delay between the aircraft transects. We also use a cloud model to simulate possible trajectories through a cloud and evaluate the use of statistical analysis in determining the agreement between the two instruments. This type of analysis should guide flight planning for future intercomparison efforts, whether for aircraft or satellite-borne instrumentation.

Sayres, D.S.↗