Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Investigating Core Gaps and the Development of Subcomponent Validation Methods for Wind Turbine Blades: Preprint

Core gaps are a common manufacturing defect observed in wind blade composite sandwich constructions, which occur when sheets of core material are not properly butted up against each other in the mold. The aim of this study was to characterize core gaps in composite sandwich constructions at the coupon scale. This was to gain an initial understanding of the defect before developing appropriate methodologies for more complex subcomponents as part of a much broader wind blade structural validation and damage tolerance program. Long beam flexure in 4-point-bending was chosen as the most appropriate loading scenario. Beam specimens were characterized with and without 10 mm core gaps in fiberglass/balsa sandwich beams. The core gaps were characterized with two separate resin systems; a Hexion epoxy and Arkema's Elium resins system (a novel, infusible thermoplastic). Results showed that the Elium beams without the core gaps were had a 15% lower static strength than their epoxy counterparts. The introduction of the core gap to the epoxy beams reduced their static strength by 35%. The Elium beams, however, exhibited negligible strength reductions with the inclusion of the core gap. Overall, this characterization study provided pertinent information with regards to core gaps as a manufacturing defect to allow for continued development of damage tolerance and subcomponent validation methodologies with the inclusion of manufacturing defects.

17 WIND ENERGY↗
DOE OSTI2024

Cyber-Informed Engineering Validation Methods and Guidance

Validation is an important step in any systems engineering process to ensure the correct system was made to fulfill stakeholders’ needs, goals, and expectations. In the context of Cyber-Informed Engineering (CIE), validation ensures cyber impact is reduced through implemented design choices and CIE requirements. This document details a process in validating CIE-based design choices relative to their effectiveness at mitigating high consequence events. The document includes a case study to illustrate the CIE validation process. The case study explores the implementation of CIE validation within the engineering lifecycle of a chemical mixing plant.

42 ENGINEERING↗
DOE OSTI2024

Method Validation Summary for L16.2 AD-ISO-0015 for ISO-17025 / NFAC Applications

Methods for the analysis of semi-volatile organic compounds are employed at Savannah River National Laboratory (SRNL) for routine and non-routine samples from tank waste, process control, waste acceptance, and a wide array of other process and research samples. A method has been developed by SRNL, based on existing methods for semi-volatile analysis, for the analysis of nitroaromatic high explosives by gas chromatography / mass spectrometry in soils and sediments. Relative to past work performed at SRNL on nitroaromatic explosives, this developed, optimized, and validated method can achieve lower limits of detection and quantitation, greater precision, lower bias, higher linearity, and accuracy across a greater linear range.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1979

Validation Methods for Fault-Tolerant avionics and control systems, working group meeting 1

The proceedings of the first working group meeting on validation methods for fault tolerant computer design are presented. The state of the art in fault tolerant computer validation was examined in order to provide a framework for future discussions concerning research issues for the validation of fault tolerant avionics and flight control systems. The development of positions concerning critical aspects of the validation process are given.

Source record↗
NASA NTRS2012

Space Suit Joint Torque Measurement Method Validation

In 2009 and early 2010, a test method was developed and performed to quantify the torque required to manipulate joints in several existing operational and prototype space suits. This was done in an effort to develop joint torque requirements appropriate for a new Constellation Program space suit system. The same test method was levied on the Constellation space suit contractors to verify that their suit design met the requirements. However, because the original test was set up and conducted by a single test operator there was some question as to whether this method was repeatable enough to be considered a standard verification method for Constellation or other future development programs. In order to validate the method itself, a representative subset of the previous test was repeated, using the same information that would be available to space suit contractors, but set up and conducted by someone not familiar with the previous test. The resultant data was compared using graphical and statistical analysis; the results indicated a significant variance in values reported for a subset of the re-tested joints. Potential variables that could have affected the data were identified and a third round of testing was conducted in an attempt to eliminate and/or quantify the effects of these variables. The results of the third test effort will be used to determine whether or not the proposed joint torque methodology can be applied to future space suit development contracts.

Valish, Dana↗
NASA NTRSDate not supplied

Exercising Prediction Validation Methods for Analysis of Quiet Supersonic Overflight

En route noise certification procedures for quiet supersonic aircraft are in development under the International Civil Aviation Organization for a proposed standard that could enable civil supersonic overland flight. While these quiet supersonic aircraft do not exist yet, methods are being developed and evaluated using existing N-wave empirical datasets and low-boom simulation datasets. One potential aspect of future certification methods is the ability to use a validated prediction model to predict the certification noise level under reference day weather conditions. Methods to validate predictions, such as the two-sample t-test, Fisher’s combined probability test, two-sample Kolmogorov-Smirnov test, and equivalence testing, have been exercised and modified for this application. While some methods compare mean values, others compare values across the distribution, and a combination of methods can be used. The methods were applied to a subset of an N-wave dataset to demonstrate the applicability and identify potential areas for improvement. Atmospheric turbulence variability was included as a factor in these analyses through KZKFourier propagation simulations with parameters matching actual flights and weather conditions. Results are presented for six noise metrics (PL, ASEL, BSEL, DSEL, ESEL, and ISBAP), and plans to expand the analyses are discussed.

sonic boom↗
DOE OSTI2023

Design and Scoping Tests on Alloy 617 Using Notched Specimen Geometry to Validate Methods for Multiaxial Stress Relaxation

In FY 2022, a development effort was initiated at the US Department of Energy’s Oak Ridge National Laboratory (ORNL) to examine the multiaxial stress-relaxation behavior and multiaxial stress-state effect on the creep-fatigue (CF) performance for Alloy 617 at elevated temperatures. This effort supported the development of the design rules in the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5. In this work, two types of the notch specimen geometries were designed. An inelastic constitutive model was used to investigate the stress triaxiality and elastic follow-up effects on the notch specimens under CF deformation in the finite element (FE) simulations. The numerical study demonstrated that the stress triaxiality and elastic follow-up caused by the notches both play significant roles in the stress-relaxation behavior. In addition, Alloy 617 CF experiments were designed, and the testing on the notch specimens is ongoing. CF test failure data will be generated on the specimens with notches under various conditions in FY 2023, and the results will be used to validate methods for accounting for the multiaxial stress relaxation effect in the design code.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

SAGE III/ISS Validation Methods

Spatiotemporal collocation of measurements between instruments is an essential yet challenging component of the data validation process. Traditional methods of collocation may simply consider length of time and physical distance between measurements. However, the distribution of atmospheric constituents may change rapidly over time and space, so care must be taken to ensure that matched measurements represent the same environment and will not introduce unnecessary bias. More advanced collocation methods may consider additional physical parameters to minimize inappropriate matches with large differences caused by local circulation. We report results of SAGE III/ISS validation with ground-based measurements using advanced collocation methods, and assessments are performed on the quality and presence of trends in both datasets.

Mary Cate McKee↗
NASA NTRS1993

A time-accurate finite volume method valid at all flow velocities

A finite volume method to solve the Navier-Stokes equations at all flow velocities (e.g., incompressible, subsonic, transonic, supersonic and hypersonic flows) is presented. The numerical method is based on a finite volume method that incorporates a pressure-staggered mesh and an incremental pressure equation for the conservation of mass. Comparison of three generally accepted time-advancing schemes, i.e., Simplified Marker-and-Cell (SMAC), Pressure-Implicit-Splitting of Operators (PISO), and Iterative-Time-Advancing (ITA) scheme, are made by solving a lid-driven polar cavity flow and self-sustained oscillatory flows over circular and square cylinders. Calculated results show that the ITA is the most stable numerically and yields the most accurate results. The SMAC is the most efficient computationally and is as stable as the ITA. It is shown that the PISO is the most weakly convergent and it exhibits an undesirable strong dependence on the time-step size. The degenerated numerical results obtained using the PISO are attributed to its second corrector step that cause the numerical results to deviate further from a divergence free velocity field. The accurate numerical results obtained using the ITA is attributed to its capability to resolve the nonlinearity of the Navier-Stokes equations. The present numerical method that incorporates the ITA is used to solve an unsteady transitional flow over an oscillating airfoil and a chemically reacting flow of hydrogen in a vitiated supersonic airstream. The turbulence fields in these flow cases are described using multiple-time-scale turbulence equations. For the unsteady transitional over an oscillating airfoil, the fluid flow is described using ensemble-averaged Navier-Stokes equations defined on the Lagrangian-Eulerian coordinates. It is shown that the numerical method successfully predicts the large dynamic stall vortex (DSV) and the trailing edge vortex (TEV) that are periodically generated by the oscillating airfoil. The calculated streaklines are in very good comparison with the experimentally obtained smoke picture. The calculated turbulent viscosity contours show that the transition from laminar to turbulent state and the relaminarization occur widely in space as well as in time. The ensemble-averaged velocity profiles are also in good agreement with the measured data and the good comparison indicates that the numerical method as well as the multipletime-scale turbulence equations successfully predict the unsteady transitional turbulence field. The chemical reactions for the hydrogen in the vitiated supersonic airstream are described using 9 chemical species and 48 reaction-steps. Consider that a fast chemistry can not be used to describe the fine details (such as the instability) of chemically reacting flows while a reduced chemical kinetics can not be used confidently due to the uncertainty contained in the reaction mechanisms. However, the use of a detailed finite rate chemistry may make it difficult to obtain a fully converged solution due to the coupling between the large number of flow, turbulence, and chemical equations. The numerical results obtained in the present study are in good agreement with the measured data. The good comparison is attributed to the numerical method that can yield strongly converged results for the reacting flow and to the use of the multiple-time-scale turbulence equations that can accurately describe the mixing of the fuel and the oxidant.

Kim, S.-W.↗
NASA NTRS1998

A Case Study for Probabilistic Methods Validation (MSFC Center Director's Discretionary Fund, Project No. 94-26)

Probabilistic method is not a universally accepted approach for the design and analysis of aerospace structures. The validity of this approach must be demonstrated to encourage its acceptance as it viable design and analysis tool to estimate structural reliability. The objective of this Study is to develop a well characterized finite population of similar aerospace structures that can be used to (1) validate probabilistic codes, (2) demonstrate the basic principles behind probabilistic methods, (3) formulate general guidelines for characterization of material drivers (such as elastic modulus) when limited data is available, and (4) investigate how the drivers affect the results of sensitivity analysis at the component/failure mode level.

Price J. M.↗
NASA NTRS1984

Flight critical system design guidelines and validation methods

Efforts being expended at NASA-Langley to define a validation methodology, techniques for comparing advanced systems concepts, and design guidelines for characterizing fault tolerant digital avionics are described with an emphasis on the capabilities of AIRLAB, an environmentally controlled laboratory. AIRLAB has VAX 11/750 and 11/780 computers with an aggregate of 22 Mb memory and over 650 Mb storage, interconnected at 256 kbaud. An additional computer is programmed to emulate digital devices. Ongoing work is easily accessed at user stations by either chronological or key word indexing. The CARE III program aids in analyzing the capabilities of test systems to recover from faults. An additional code, the semi-Markov unreliability program (SURE) generates upper and lower reliability bounds. The AIRLAB facility is mainly dedicated to research on designs of digital flight-critical systems which must have acceptable reliability before incorporation into aircraft control systems. The digital systems would be too costly to submit to a full battery of flight tests and must be initially examined with the AIRLAB simulation capabilities.

Holt, H. M.↗
DOE OSTI2025

ARCADE Analysis Methods & Validation Pathway

The Advanced Reactor Cyber Analysis and Development Environment (ARCADE) provides an automated analysis system which supports risk-informed performance based (RIPB) evaluations of nuclear control systems. Every possible cyber threat which could lead to consequence is identified by simulating the unsafe control action sequences which transform digital harm into physical harm. Eliminating the simulation of complex digital cyber attack chains cuts out unnecessary computational overhead and focuses directly on the physics of cyber-physical attacks. This focus enables designers to make informed decisions which can entirely eliminate categories of cyber threats against advanced reactors through the physical nature of the plant design. This narrowing of cyber threat against nuclear power plants through the physics of the system is intended to make any remaining threat management and cost efficient. This is the goal of the Tiered Cyber Analysis (TCA) outlined in NRC Draft Regulation Guide (RG) 5.96, which provides a RIPB cybersecurity approach for new reactors. ARCADE has been custom developed to meet the demands of the rigorous analysis required in Tier 1 of the TCA, which forms the foundation of the TCA process. Currently, ARCADE is still under development, but has made significant leaps in capability. A pilot analysis on the opensource Asherah simulator was performed which demonstrated key functionality goals. The next stage of ARCADE development involves improvements to the applications which support the analysis system, and enabling the analysis system to utilize the full suite of unsafe control action simulations. Since the analysis method’s core functions are complete, validation of the analysis method will be started concurrent to the next development stages. The automated analysis ARCADE will provide can radically change the cybersecurity design process for advanced reactors, reducing the cost of security implementation while enhancing cyber resilience. The pathway for ARCADE’s development to this goal has become much clearer. The majority of technical hurdles have been cleared, and the remaining development needs have been solidified. ARCADE is now capable of assisting the advanced reactor design process and directly support advanced reactor industry RIPB practices.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1980

Validation Methods Research for Fault-Tolerant Avionics and Control Systems: Working Group Meeting, 2

The validation process comprises the activities required to insure the agreement of system realization with system specification. A preliminary validation methodology for fault tolerant systems documented. A general framework for a validation methodology is presented along with a set of specific tasks intended for the validation of two specimen system, SIFT and FTMP. Two major areas of research are identified. First, are those activities required to support the ongoing development of the validation process itself, and second, are those activities required to support the design, development, and understanding of fault tolerant systems.

Gault, J. W.↗
NASA NTRS1998

Tropical Tropospheric Ozone (TTO) Maps from Nimbus 7 and Earth-Probe TOMS by the Modified-Residual Method: Validation, Evaluation and Trends based on Atlantic Regional Time Series - 1

The well-known wave-one pattern seen in tropical total ozone [Shiotani, 1992; Ziemke et al., 1996, 1998] has been used to develop a modified-residual (MR) method for retrieving time-averaged stratospheric ozone and tropospheric ozone column amount from TOMS (Total Ozone Mapping Spectrometer) over the 14 complete calendar years of Nimbus 7 observations (1979-1992) and from TOMS on the Earth-Probe (1996-present) and ADEOS platforms (1996- 1997). Nine- to sixteen-day averaged tropical tropospheric ozone (TTO) maps, validated with ozonesondes, show a seasonality expected from dynamical and chemical influences. The maps may be viewed on a homepage: http://metosrv2.umd.edu/~tropo. Stratospheric column ozone, which is also derived by the modified-residual method, compares well with sondes (to within 6-7 DU) and with stratospheric ozone column derived from other satellites (within 8-10 DU). Validation of the TTO time-series is presently limited to ozonesonde comparisons with Atlantic stations and sites on the adjacent continents (Ascension Island, Natal, Brazil; Brazzaville); for the sounding periods, TTO at all locations agrees with the sonde record to +/-7 DU. TTO time-series and the magnitude of the wave-one pattern show ENSO signals in the strongest El Nifio periods from 1979-1998. From 12degN and 12degS, zonally averaged tropospheric ozone shows no significant trend from 1980-1990. Trends are also not significant during this period in localized regions, e.g. from just west of South America across to southern Africa. This is consistent with the ozonesonde record at Natal, Brazil (the only tropical ozone data publicly available for the 1980's), which shows a not statistically significant increase. The lack of trend in tropospheric ozone agrees with a statistical analysis based on another method for deriving TTO from TOMS, the so-called Convective-Cloud-Differential approach of Ziemke et al. [1998].

Thompson, Anne M.↗
DOE OSTI2026

Forensic characterization of surrogate nuclear explosion debris: radiochemical and spectroscopic strategies for method validation

Surrogate nuclear explosion debris (SNED) has emerged as a critical platform for advancing post-detonation nuclear forensic analysis in the absence of readily accessible historic materials. SNED enables controlled investigation and validation of analytical methodologies used to interrogate the chemical, isotopic, radiological, and microstructural signatures preserved in nuclear explosion debris. This review presents an integrated assessment of destructive and non-destructive analytical techniques commonly employed within decision-driven nuclear forensic workflows. Each technique is discussed individually while highlighting how it contributes to different stages of post-detonation analysis. Core methods – including gamma and alpha spectrometry, ICP-MS, TIMS, SIMS, SEM-EDS, XRF, LIBS, vibrational spectroscopy, and X-ray absorption spectroscopy – are critically evaluated with respect to forensic maturity, information content, and matrix limitations. Emphasis is placed on the role of SNED in benchmarking multi-modal workflows and identifying gaps in reproducing heterogeneity, fractionation, and radiation-driven evolution relevant to forensic attribution.

X-ray spectroscopic methods↗
NASA NTRS2020

Bennu Shape Model Validation Methods and Results

The OSIRIS-REx Independent Shape Modeling Team, staffed by the Jet Propulsion Laboratory (JPL), has used stereophotoclinometry (SPC) to produce a three-dimensional shape model of Bennu. The SPC process is informed by (but is separate from) orbit determination, so it is important to ensure that the resulting shape model is consistent with all available spacecraft tracking data. Specifically, checking the shape model’s consistency with LIDAR measurements can illuminate any discrepancies, because LIDAR measurements are highly correlated with the shape model. This study focuses on the JPL experience with these LIDAR measurements and the greater context of the shape model validation process.

Lauretta, Dante S.↗
NASA NTRS1983

Validation methods for flight crucial systems

Research to develop techniques that can aid in determining the reliability and performance of digital electronic fault-tolerant systems, that have probability of catastrophic system failure on the order of 10 to the -9th at 10 hours, is reviewed. The computer-aided reliability estimation program (CARE III) provides general-purpose reliability analysis and a design tool for fault-tolerant systems; large reduction of state size; and a fault-handling model based on probabilistic description of detection, isolation, and recovery mechanisms. The application of design proof techniques as part of the design and development of the software implemented fault-tolerance computer is mentioned. Emulation techniques and experimental procedures are verified using specimens of fault-tolerant computers and the capabilities of the validation research laboratory, AIRLAB.

Holt, H. M.↗