Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Modeling Isothermal Reduction of Iron Ore Pellet Using Finite Element Analysis Method: Experiments & Validation

Iron ore pellet reduction experiments were performed with pure hydrogen (H2) and mixtures with carbon monoxide (CO) at different ratios. For direct reduction processes that switch dynamically between reformed natural gas and hydrogen as the reductant, it is important to understand the effects of the transition on the oxide reduction kinetics to optimize the residence time of iron ore pellets in a shaft reactor. Hence, the reduction rates were studied by varying experimental parameters such as the temperature (800, 850 & 900 °C), reactant gas flow rate (100, 150 & 200 cm3/min), pellet size and composition of the reactant gas mixture. The rate of reduction was observed to increase with an increase in temperature and reactant gas flow rate, but it decreased with an increase in pellet size. SEM greyscale analysis was performed to analyze the porosity and phase composition of partially reduced pellets. The porosity of the pellets was observed to increase from 0.3 for unreacted pellet to 0.42 for a completely reduced pellet. Energy-dispersive X-ray spectroscopy (EDAX) analysis was performed to identify the phases observed in the SEM images. The fraction of iron phase was observed to increase from the shell region of the pellet to the core region with an increase in the degree of reduction. A 2D-axisymmetric numerical model was developed on COMSOL Multiphysics, and it was validated using the conversion (X) vs. time curves obtained from each experiment. The model was able to accurately predict the total time needed for the complete conversion of a single iron ore pellet for multiple experiments. Effects of changes in the porosity and tortuosity of the pellet on the model were also studied and the rate of reduction was observed to be sensitive to changes in both porosity and tortuosity. The SEM analysis and the model results show that tortuosity is higher for pellets reduced with H2 than for pellets reduced with H2-CO gas mixtures.

08 HYDROGEN↗

Development and validation of methods for man-made machine interface evaluation

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Malone, T. B.↗

Prediction of forces and moments for flight vehicle control effectors. Part 1: Validation of methods for predicting hypersonic vehicle controls forces and moments

Many types of hypersonic aircraft configurations are currently being studied for feasibility of future development. Since the control of the hypersonic configurations throughout the speed range has a major impact on acceptable designs, it must be considered in the conceptual design stage. The ability of the aerodynamic analysis methods contained in an industry standard conceptual design system, APAS II, to estimate the forces and moments generated through control surface deflections from low subsonic to high hypersonic speeds is considered. Predicted control forces and moments generated by various control effectors are compared with previously published wind tunnel and flight test data for three configurations: the North American X-15, the Space Shuttle Orbiter, and a hypersonic research airplane concept. Qualitative summaries of the results are given for each longitudinal force and moment and each control derivative in the various speed ranges. Results show that all predictions of longitudinal stability and control derivatives are acceptable for use at the conceptual design stage. Results for most lateral/directional control derivatives are acceptable for conceptual design purposes; however, predictions at supersonic Mach numbers for the change in yawing moment due to aileron deflection and the change in rolling moment due to rudder deflection are found to be unacceptable. Including shielding effects in the analysis is shown to have little effect on lift and pitching moment predictions while improving drag predictions.

Maughmer, Mark D.↗

Methods for Validation and Intercomparison of Remote Sensing and In situ Ice Water Measurements: Case Studies from CRYSTAL-FACE and Model Results

Remote sensing observations, such as those from AURA, are necessary to understand the role of cirrus in determining the radiative and humidity budgets of the upper troposphere. Using these measurements quantitatively requires comparisons with in situ measurements that have previously been validated. However, a direct comparison of remote and in situ measurements is difficult due to the requirement that the spatial and temporal overlap be sufficient in order to guarantee that both instruments are measuring the same air parcel. A difficult as this might be for gas phase intercomparisons, cloud inhomogeneities significantly exacerbate the problem for cloud ice water content measurements. The CRYSTAL-FACE mission provided an opportunity to assess how well such intercomparisons can be performed and to establish flight plans that will be necessary for validation of future satellite instruments. During CRYSTAL-FACE, remote and in situ instruments were placed on different aircraft (NASA's ER-2 and WB-59, and the two planes flew in tandem so that the in situ payload flew in the field of view of the remote instruments. We show here that, even with this type of careful flight planning, it is not always possible to guarantee that remote and in situ instruments are viewing the same air parcel. We use ice water data derived from the in situ Harvard Total Water (HV-TW) instrument, and the remote Goddard Cloud Radar System (CRS) and show that agreement between HV-TW and CRS is a strong function of the horizontal separation and the time delay between the aircraft transects. We also use a cloud model to simulate possible trajectories through a cloud and evaluate the use of statistical analysis in determining the agreement between the two instruments. This type of analysis should guide flight planning for future intercomparison efforts, whether for aircraft or satellite-borne instrumentation.

Sayres, D.S.↗

A Global Evaluation of IMERG Precipitation Occurrence Using SMAP Detected Soil Moisture Change

A globally consistent ground validation method for remotely sensed precipitation products is crucial for building confidence in these products. This study develops a new methodology to validate the IMERG precipitation products through the use of SMAP soil moisture changes as a proxy for precipitation occurrence. Using a standard 2x2 contingency table method, preliminary results provide confidence in SMAP’s ability to be utilized as a validation tool for IMERG as results are comparable to previous validation studies. However, the method allows for an overestimate of false alarm frequency due to light precipitation events that can evaporate before the subsequent SMAP overpass and changes in overpass-to-overpass SMAP soil moisture that are within the range of SMAP uncertainty. To counter these issues, a 3x3 contingency table is used to reduce noise and extract more signal from the detection method. Through the use of this novel approach, the validation method produces a global mean POD of 0.64 and global mean FAR of 0.40, the first global-scale ground validation skill scores for the IMERG products. Advancing the method to validate precipitation quantity and the development of a real-time validation for the IMERG Early product are the crucial next developments.

Precipitation↗

Design and Validation of a High-Throughput Reductive Catalytic Fractionation Method

Reductive catalytic fractionation (RCF) is a promising method to extract and depolymerize lignin from biomass, and bench-scale studies have enabled considerable progress in the past decade. RCF experiments are typically conducted in pressurized batch reactors with volumes ranging between 50 and 1000 mL, limiting the throughput of these experiments to one to six reactions per day for an individual researcher. Here, we report a high-throughput RCF (HTP-RCF) method in which batch RCF reactions are conducted in 1 mL wells machined directly into Hastelloy reactor plates. The plate reactors can seal high pressures produced by organic solvents by vertically stacking multiple reactor plates, leading to a compact and modular system capable of performing 240 reactions per experiment. Using this setup, we screened solvent mixtures and catalyst loadings for hydrogen-free RCF using 50 mg poplar and 0.5 mL reaction solvent. The system of 1:1 isopropanol/methanol showed optimal monomer yields and selectivity to 4-propyl substituted monomers, and validation reactions using 75 mL batch reactors produced identical monomer yields. To accommodate the low material loadings, we then developed a workup procedure for parallel filtration, washing, and drying of samples and a 1H nuclear magnetic resonance spectroscopy method to measure the RCF oil yield without performing liquid-liquid extraction. As a demonstration of this experimental pipeline, 50 unique switchgrass samples were screened in RCF reactions in the HTP-RCF system, revealing a wide range of monomer yields (21-36%), S/G ratios (0.41-0.93), and oil yields (40-75%). These results were successfully validated by repeating RCF reactions in 75 mL batch reactors for a subset of samples. We anticipate that this approach can be used to rapidly screen substrates, catalysts, and reaction conditions in high-pressure batch reactions with higher throughput than standard batch reactors.

BIOMASS FUELS,INORGANIC, ORGANIC, PHYSICAL, AND AN↗

Validation of Microgrid Algorithms using At-Scale Simulation and Emulation Real-Time (ASSERT) Framework

This paper presents a novel framework for validating microgrid algorithms using a At-Scale Simulation and Emulation Real-Time (ASSERT) setup. The proposed universal microgrid validation framework was developed at Advanced Research on Integrated Energy Systems (ARIES) platform at National Renewable Energy Laboratory in Golden, Colorado, USA. As the number of intercommunicating devices grow in power systems, along with more integration of inverter-based resources, developing and validating microgrid operation and control algorithms is becoming complex and time-consuming task. The ASSERT framework is designed to provide a comprehensive, accurate, and efficient solution for validating microgrid algorithms. It combines at-scale simulations and real-time emulation to create a virtual environment that closely mimics the behavior of a physical microgrids which are characteristic of future smart distribution systems, such as: (1) increasing variability in the physical size of new energy technologies; (2) requiring control large numbers of interconnected devices, and (3) integrating diverse technologies that have not previously worked together. The paper describes the technical details of the ASSERT framework, its validation process, and its benefits over traditional validation methods. The framework's ability to validate the performance of various algorithms is demonstrated through a case study, which shows that it can effectively identify the weaknesses of an algorithm and optimize its performance. Overall, the ASSERT framework is a promising tool that can significantly enhance the development and validation of microgrid algorithms, leading to more reliable and efficient microgrid operation.

at-scale↗

JPL control-structure interaction technology: Micro-precision CSI

The NASA Control-Structure Interaction (CSI) Program is described in outline and graphic form. Particular emphasis is given to the activities of the Jet Propulsion Lab. The goals of the program are (1) controlled structure performance enhancement, (2) controlled structure unified methods for design/analysis, and (3) ground validation methods for CSI flight systems.

Laskin, Robert A.↗

Synthesis of aircraft structures using integrated design and analysis methods

A systematic research is reported to develop and validate methods for structural sizing of an airframe designed with the use of composite materials and active controls. This research program includes procedures for computing aeroelastic loads, static and dynamic aeroelasticity, analysis and synthesis of active controls, and optimization techniques. Development of the methods is concerned with the most effective ways of integrating and sequencing the procedures in order to generate structural sizing and the associated active control system, which is optimal with respect to a given merit function constrained by strength and aeroelasticity requirements.

Sobieszczanski-Sobieski, J.↗

Experimental validation of structural optimization methods

The topic of validating structural optimization methods by use of experimental results is addressed. The need for validating the methods as a way of effecting a greater and an accelerated acceptance of formal optimization methods by practicing engineering designers is described. The range of validation strategies is defined which includes comparison of optimization results with more traditional design approaches, establishing the accuracy of analyses used, and finally experimental validation of the optimization results. Examples of the use of experimental results to validate optimization techniques are described. The examples include experimental validation of the following: optimum design of a trussed beam; combined control-structure design of a cable-supported beam simulating an actively controlled space structure; minimum weight design of a beam with frequency constraints; minimization of the vibration response of helicopter rotor blade; minimum weight design of a turbine blade disk; aeroelastic optimization of an aircraft vertical fin; airfoil shape optimization for drag minimization; optimization of the shape of a hole in a plate for stress minimization; optimization to minimize beam dynamic response; and structural optimization of a low vibration helicopter rotor.

Adelman, Howard M.↗

Optimizing Urban Air Mobility Research Through Bi-Directional Integration Processes for Effective Verification and Validation

Urban Air Mobility (UAM), a subset of Advanced Air Mobility (AAM), aims to revolutionize metropolitan transportation. This paper explores an engineering process framework within National Aeronautics and Space Administration (NASA)’s Air Mobility Pathfinders (AMP) project, which is focused on the safe scaling and seamless integration of UAM operations within the National Airspace System (NAS). Progressing through three phases — Initial, Midterm, and Mature — the Federal Aviation Administration (FAA)’s UAM Concept of Operations (ConOps) describes a proposed path for the evolution of UAM operations, presenting multifaceted challenges in technology, regulation, and stakeholder engagement. With this ConOps as a basis, the AMP project is executing research, development, test, and evaluation activities aimed at delivering validated reference architectures for the Midterm phase. This paper illuminates the pivotal role of the systems engineering process in managing these technical efforts. Robust verification and validation methods, along with systematic bi-directional integration process, enhance the ability to conduct research into the design and evolution of safe, efficient, and reliable UAM systems. In this paper a systematic framework will be presented and shown to facilitate interactions between UAM stakeholders and to effectively manage the complex architecture of UAM operations in the NAS.

National Airspace System↗

Viscosity Measurement of Highly Viscous Liquids Using Drop Coalescence in Low Gravity

The method of drop coalescence is being investigated for use as a method for determining the viscosity of highly viscous undercooled liquids. Low gravity environment is necessary in this case to minimize the undesirable effects of body forces and liquid motion in levitated drops. Also, the low gravity environment will allow for investigating large liquid volumes which can lead to much higher accuracy for the viscosity calculations than possible under 1 - g conditions. The drop coalescence method is preferred over the drop oscillation technique since the latter method can only be applied for liquids with vanishingly small viscosities. The technique developed relies on both the highly accurate solution of the Navier-Stokes equations as well as on data from experiments conducted in near zero gravity environment. In the analytical aspect of the method two liquid volumes are brought into contact which will coalesce under the action of surface tension alone. The free surface geometry development as well as its velocity during coalescence which are obtained from numerical computations are compared with an analogous experimental model. The viscosity in the numerical computations is then adjusted to bring into agreement of the experimental results with the calculations. The true liquid viscosity is the one which brings the experiment closest to the calculations. Results are presented for method validation experiments performed recently on board the NASA/KC-135 aircraft. The numerical solution for this validation case was produced using the Boundary Element Method. In these tests the viscosity of a highly viscous liquid, in this case glycerine at room temperature, was determined to high degree of accuracy using the liquid coalescence method. These experiments gave very encouraging results which will be discussed together with plans for implementing the method in a shuttle flight experiment.

Antar, Basil N.↗

Semi-implicit method to solve compressible multiphase fluid flows without acoustic time step restrictions

A new 3D multiphase numerical capability is presented here for simulating multiphase flow regimes at all Mach numbers (M). The new method is a semi-implicit extension of the finite volume discrete equation method (DEM) of Chinnaya et al. (2004), which originally used explicit time-stepping. The capability is also developed to work with another extension of the DEM to moving grids for arbitrary Lagrangian-Eularian (ALE) methods detailed in Dunn (2011). Rather than solving all phase equations simultaneously, the DEM reduces the equations to a system of single-phase Riemann solves, where each phase has its own velocity and thermodynamic state. Exchanges between the phases are modeled through source terms accounting for the phase interactions. Furthermore, since the original multiphase scheme uses an explicit time-advancement scheme, it has time step restrictions dictated by the speed of sound, which limits the model's ability to simulate weakly compressible flows which typically need to be integrated for longer time periods. Here, we extend the current multiphase formulation by implementing a pressure-correcting step to enable implicit calculations and remove acoustic time step limitations. The new semi-implicit algorithm allows use of relatively large time steps compared to an explicit method. Validation and benefits of the new implicit time-step method are illustrated using several examples including weakly compressible flows and strong shock waves. The scheme presented here is general and may be used for a variety of applications which require capabilities for handling multiphase flow at a wide range of Mach numbers. However, the goal of this research is to simulate all stages of high energy explosions, including the shock formation (high Mach numbers) and evolution of the buoyant cloud (low Mach numbers).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Composite load spectra for select space propulsion structural components

The work performed to develop composite load spectra (CLS) for the Space Shuttle Main Engine (SSME) using probabilistic methods. The three methods were implemented to be the engine system influence model. RASCAL was chosen to be the principal method as most component load models were implemented with the method. Validation of RASCAL was performed. High accuracy comparable to the Monte Carlo method can be obtained if a large enough bin size is used. Generic probabilistic models were developed and implemented for load calculations using the probabilistic methods discussed above. Each engine mission, either a real fighter or a test, has three mission phases: the engine start transient phase, the steady state phase, and the engine cut off transient phase. Power level and engine operating inlet conditions change during a mission. The load calculation module provides the steady-state and quasi-steady state calculation procedures with duty-cycle-data option. The quasi-steady state procedure is for engine transient phase calculations. In addition, a few generic probabilistic load models were also developed for specific conditions. These include the fixed transient spike model, the poison arrival transient spike model, and the rare event model. These generic probabilistic load models provide sufficient latitude for simulating loads with specific conditions. For SSME components, turbine blades, transfer ducts, LOX post, and the high pressure oxidizer turbopump (HPOTP) discharge duct were selected for application of the CLS program. They include static pressure loads and dynamic pressure loads for all four components, centrifugal force for the turbine blade, temperatures of thermal loads for all four components, and structural vibration loads for the ducts and LOX posts.

Newell, J. F.↗

Report for Task 15: Developed Tool Verification/Validation Report (Deliverable D11): AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency

This report summarizes the verification report for the developed modules. The team conducted verification in two phases. In phase 1, the modules were validated using offline validation methods and in phase 2 the modules were subjected to real-time validation. This report outlines the approach and the results for the modules under offline and real-time settings. The rest of the report details the functional workflow of AGGREGATE modules, we then transition to offline validation followed by real-time validation of modules. We conclude the report by discussing some of the key points of this report.

14 SOLAR ENERGY↗

Dynamic Ground Effects Simulation Using OVERFLOW-D

This presentation is broken into 5 logical sections. The Background Information section describes the technical issues being address by this study. The Approach section describes the organization of the contract effort which was laid out as the most effective means of quantifying, with validated methods, the magnitude of dynamic ground effects for the TCA (Technology Concept Aircraft) configuration. The Validation Case section describes the analysis of the XB-70 configuration in both static and dynamic ground effect, with comparisons to wind tunnel and flight test data. The TCA Analysis section then describes the application of the same codes and methodologies to the TCA in both static and dynamic ground effect. Comparisons are made between the static and dynamic, as well as to early static data from a recent wind tunnel test on the TCA configuration. Finally, the work to date is summarized and the future direction of this study is outlined.

Dwyer, Bill↗