Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
NASA NTRS2007

Replica-based Crack Inspection

A surface replica-based crack inspection method has recently been developed for use in Space Shuttle main engine (SSME) hydrogen feedline flowliners. These flowliners exist to ensure favorable flow of liquid hydrogen over gimble joint bellows, and consist of two rings each containing 38 elongated slots. In the summer of 2002, multiple cracks ranging from 0.1 inches to 0.6 inches long were discovered; each orbiter contained at least one cracked flowliner. These long cracks were repaired and eddy current inspections ensured that no cracks longer than 0.075 inches were present. However, subsequent fracture-mechanics review of flight rationale required detection of smaller cracks, and was the driving force for development of higher-resolution inspection method. Acetate tape surface replicas have been used for decades to detect and monitor small cracks. However, acetate tape replicas have primarily been limited to laboratory specimens because complexities involved in making these replicas - requiring acetate tape to be dissolved with acetone - are not well suited for a crack inspection tool. More recently developed silicon-based replicas are better suited for use as a crack detection tool. A commercially available silicon-based replica product has been determined to be acceptable for use in SSME hydrogen feedlines. A method has been developed using this product and a scanning electron microscope for analysis, which can find cracks as small as 0.005 inches and other features (e.g., pits, scratches, tool marks, etc.) as small as 0.001 inches. The resolution of this method has been validated with dozens of cracks generated in a laboratory setting and this method has been used to locate 55 cracks (ranging in size from 0.040 inches to 0.004 inches) on space flight hardware. These cracks were removed by polishing away the cracked material and a second round of replicas confirmed the repair.

Newman, John A.↗
NASA NTRS2014

Prediction Interval Development for Wind-Tunnel Balance Check-Loading

Results from the Facility Analysis Verification and Operational Reliability project revealed a critical gap in capability in ground-based aeronautics research applications. Without a standardized process for check-loading the wind-tunnel balance or the model system, the quality of the aerodynamic force data collected varied significantly between facilities. A prediction interval is required in order to confirm a check-loading. The prediction interval provides an expected upper and lower bound on balance load prediction at a given confidence level. A method has been developed which accounts for sources of variability due to calibration and check-load application. The prediction interval method of calculation and a case study demonstrating its use is provided. Validation of the methods is demonstrated for the case study based on the probability of capture of confirmation points.

Landman, Drew↗
NASA NTRS2015

Experimental Validation of the Dynamic Inertia Measurement Method to Find the Mass Properties of an Iron Bird Test Article

This presentation describes the DIM method and how it measures the inertia properties of an object by analyzing the frequency response functions measured during a ground vibration test (GVT). The DIM method has been in development at the University of Cincinnati and has shown success on a variety of small scale test articles. The NASA AFRC version was modified for larger applications.

dynamic structural analysis↗
NASA NTRS2015

Testing and Validation of the Dynamic Interia Measurement Method

This presentation describes the DIM method and how it measures the inertia properties of an object by analyzing the frequency response functions measured during a ground vibration test (GVT). The DIM method has been in development at the University of Cincinnati and has shown success on a variety of small scale test articles. The NASA AFRC version was modified for larger applications.

vibration tests↗
NASA NTRS2016

Validation of High-Resolution CFD Method for Slosh Damping Extraction of Baffled Tanks

The predicted slosh damping values from Loci-Stream-VOF agree with experimental data very well for all fill levels in the vicinity of the baffle. Grid refinement study is conducted and shows that the current predictions are grid independent. The increase of slosh damping due to the baffle is shown to arise from: a) surface breakup; b) cascade of energy from the low order slosh mode to higher modes; and c) recirculation inside liquid phase around baffle. The damping is a function of slosh amplitude, consistent with previous observation. Miles equation under predicts damping in the upper dome section.

Yang, H. Q.↗
NASA NTRS2018

Fast Linearized Coronagraph Optimizer (FALCO) II: Optical Model Validation and Time Savings over Other Methods

We have developed the Fast Linearized Coronagraph Optimizer (FALCO), a new software toolbox for high-contrast, coronagraphic wavefront sensing and control. FALCO rapidly calculates the linearized deformable mirror (DM) response matrices, also called control Jacobians, and can be used for the design, simulation, or testbed operation of several types of coronagraphs. In this paper, we demonstrate that the optical propagation used in FALCO is accurate and matches PROPER. In addition, we demonstrate the drastic reduction in runtime when using FALCO for DM Jacobian calculations instead of the conventional method used, for example with a model of the Wide-Field Infrared Survey Telescope (WFIRST) Coronagraph Instrument (CGI). We then compare the relative accuracy between optical models in FALCO and PROPER.

Coker, Carl↗
DOE OSTI2023

Systems and methods for enhanced power system model validation

A system for enhanced power system model validation is provided. The system includes a computing device including at least one processor in communication with at least one memory device. The at least one processor is programmed to store a plurality of models for a plurality of devices and a plurality of input files associated with the plurality of models, receive, from a user, a selection of model of the plurality of models to simulate, retrieve one or more input files of the plurality of input files, perform a model validity check on the selected model, if the selected model passed the model validity check, perform a model calibration on the selected model, and if the selected model passed the model calibration, perform a post evaluation on the selected model.

Wang, Honggang↗
NASA NTRS1992

Prediction of space sickness in astronauts from preflight fluid, electrolyte, and cardiovascular variables and Weightless Environmental Training Facility (WETF) training

Nine preflight variables related to fluid, electrolyte, and cardiovascular status from 64 first-time Shuttle crewmembers were differentially weighted by discrimination analysis to predict the incidence and severity of each crewmember's space sickness as rated by NASA flight surgeons. The nine variables are serum uric acid, red cell count, environmental temperature at the launch site, serum phosphate, urine osmolality, serum thyroxine, sitting systolic blood pressure, calculated blood volume, and serum chloride. Using two methods of cross-validation on the original samples (jackknife and a stratefied random subsample), these variables enable the prediction of space sickness incidence (NONE or SICK) with 80 percent sickness and space severity (NONE, MILD, MODERATE, of SEVERE) with 59 percent success by one method of cross-validation and 67 percent by another method. Addition of a tenth variable, hours spent in the Weightlessness Environment Training Facility (WETF) did not improve the prediction of space sickness incidences but did improve the prediction of space sickness severity to 66 percent success by the first method of cross-validation of original samples and to 71 percent by the second method. Results to date suggest the presence of predisposing physiologic factors to space sickness that implicate fluid shift etiology. The data also suggest that prior exposure to fluid shift during WETF training may produce some circulatory pre-adaption to fluid shifts in weightlessness that results in a reduction of space sickness severity.

Simanonok, K.↗
DOE OSTI2020

Subsurface Trend Analysis domains for the northern Gulf of Mexico

Geologic domains for the northern Gulf of Mexico derived using the Subsurface Trend Analysis (STA) method. The domains were postulated using geologic province, lithologic, and structural information and validated using statistical methods. Publication detailing the STA method: Rose, K., Bauer, J.R., and Mark-Moser, M. (2020) Subsurface trend analysis, a multi-variate geospatial approach for subsurface evaluation and uncertainty reduction, Interpretation, vol. 8, issue 1 https://library.seg.org/doi/abs/10.1190/int-2019-0019.1 Detailed discussion of domain formation and analysis: Mark-Moser, M., Miller, R., Bauer, J., Rose, K., and C. Disenhof. 2018, Analysis of Subsurface Reservoir Properties Using a Novel Geospatial Approach, Offshore Gulf of Mexico. NETL-TRS-2018 https://edx.netl.doe.gov/dataset/detailed-analysis-of-geospatial-trends-of-hydrocarbon-accumulations-offshore-gulf-of-mexico

geology↗
NASA NTRS1983

Comparison of measured and predicted flight effects on high-bypass coaxial jet exhaust noise

A semi-empirical model for predicting the noise generated by conventional-velocity profile coaxial jets is compared with full scale flight data and model scale simulated flight data for high bypass nozzles. The prediction model was shown to agree with small scale static data for primary jet velocities from 215 to 795 m/s for a wide range of area, temperature, and velocity ratios between streams. However, there were insufficient model nozzle, simulated flight data available at that time to permit validation of the flight effects prediction. The comparisons presented demonstrate that the prediction method is also valid in flight.

Stone, J. R.↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Verification and Validation of Progressive Damage and Failure Analysis Methods for Intralaminar Failure Modes in Thermoplastic Composites

Current progressive damage and failure analysis (PDFA) methods were developed around thermoset material systems and their physical behavior. However, the applicability of these analysis methods has not been evaluated for use in modeling thermoplastic material systems. As part of the Hi-Rate Composite Aircraft Manufacturing (HiCAM) Project sponsored by NASA, intralaminar failure characterization was completed on a thermoplastic material system, AS4D/PEKK-FC, with off-axis tension (OAT) and off-axis compression (OAC) testing. The experiments were able to capture matrix non-linear shear behavior and the failure envelope of the material system. Two PDFA methods, LS-DYNA MAT299 and NASA’s CompDam-DGD, were then employed to simulate individual coupon behavior and simulation results were compared to published verification and validation guidelines from the CMH-17 crashworthiness working group. The results found that the two modeling methods provided suitable representation of material behavior of thermoplastics.

PDFA↗
NASA NTRSDate not supplied

Verification and Validation of Progressive Damage and Failure Analysis Methods for Intralaminar Failure Modes in Thermoplastic Composites

Current progressive damage and failure analysis (PDFA) methods were developed around thermoset material systems and their physical behavior. However, the applicability of these analysis methods has not been evaluated for use in modeling thermoplastic material systems. As part of the Hi-Rate Composite Aircraft Manufacturing (HiCAM) Project sponsored by NASA, intralaminar failure characterization was completed on a thermoplastic material system, AS4D/PEKK-FC, with off-axis tension (OAT) and off-axis compression (OAC) testing. The experiments were able to capture matrix non-linear shear behavior and the failure envelope of the material system. Two PDFA methods, LS-DYNA MAT299 and NASA’s CompDam-DGD, were then employed to simulate individual coupon behavior and simulation results were compared to published verification and validation guidelines from the CMH-17 crashworthiness working group. The results found that the two modeling methods provided suitable representation of material behavior of thermoplastics.

PDFA↗
DOE OSTI2020

A Pattern-Recognition-Based Ensemble Data Imputation Framework for Sensors from Building Energy Systems

Building operation data are important for monitoring, analysis, modeling, and control of building energy systems. However, missing data is one of the major data quality issues, making data imputation techniques become increasingly important. There are two key research gaps for missing sensor data imputation in buildings: the lack of customized and automated imputation methodology, and the difficulty of the validation of data imputation methods. In this paper, a framework is developed to address these two gaps. First, a validation data generation module is developed based on pattern recognition to create a validation dataset to quantify the performance of data imputation methods. Second, a pool of data imputation methods is tested under the validation dataset to find an optimal single imputation method for each sensor, which is termed as an ensemble method. The method can reflect the specific mechanism and randomness of missing data from each sensor. The effectiveness of the framework is demonstrated by 18 sensors from a real campus building. The overall accuracy of data imputation for those sensors improves by 18.2% on average compared with the best single data imputation method.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Data-Driven Digital Twin for Reliability Assessment of DC/DC Buck Converter

In commercial applications, the operation of DC/DC converters significantly impacts overall system performance and long-term reliability. This study introduces a data-driven digital twin (DT) approach for estimating critical degradation parameters of DC/DC BUCK converter under steady-state condition. Initially, a circuit-level MATLAB/Simulink digital model (DM C ) is refined against a hardware prototype’s switching model dataset using offline particle swarm optimization. The optimized digital model’s steady-state response is then verified with its average model response while varying the duty and load. Subsequently, degradation profiles are imposed on the inductor, capacitor, MOSFET in the DMC. A large dataset is generated from this model, allowing training, validation, and testing of machine learning (ML) models for component health regression tasks. The proposed method employs random forest ML models, achieving impressive regression results with a squared R value as high as 0.99978 and a root mean square error of 4.2× 10 –6 . The method is further validated on a medium power level DC/DC BUCK prototype with varying load conditions, and includes the analysis of MOSFET’s on-resistance under degradation conditions. This data-driven DT method shows promise for identifying parasitic degradation and ohmic loss parameters, enhancing converter reliability assessments in a non-invasive, generalized, and computationally efficient manner.

14 SOLAR ENERGY↗
NASA NTRS1995

[Quantification and monitoring of vascular resistance in the lower limbs by the Doppler method (animal model)]

The object of this study was to define and validate a non-invasive method of evaluation and monitoring of vascular resistances in the leg. Blood flow velocity was measured by Doppler ultrasound in an animal model (ewe) with similar blood flow characteristics in the lower limb as man and allowing access to the required invasive measurements for validation of the method (pressure and flow). Vascular resistances distal to the measuring point (femoral, for example) were assessed using the resistance index R = D/S, S being the peak systolic deflection and D that of diastolic reflux of the Doppler spectral analysis of flow in the femoral artery. The values and variations of this resistance index were compared with the vascular resistances calculated from measurements of pressure and flow at the point of Doppler sampling and expressed in mmHg/ml/min. Femoral flow was measured by Doppler ultrasound (Doppler-echo), and mean pressure by an arterial catheter introduced into the abdominal aorta. Compression of the lower limb veins induced a venous return resulting in a reduction of cardiac output and femoral flow. During compression, femoral flow decreased by an average of 29% (p < 0.001) although mean pressure and heart rate did not change significantly. The femoral resistance index (Rf) increased by an average of 37.5% (p < 0.01) and vascular resistances increased by 45.9% (p < 0.01). Injection of 1 mg adrenaline induced peripheral vasoconstriction with an increase in blood pressure and a decrease in heart rate and femoral flow.(ABSTRACT TRUNCATED AT 250 WORDS).

Non-NASA Center↗