SEARCH · Search NASA
Results for “Validation Methods”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The Upper Atmosphere of Uranus from Stellar Occultations. I. Methods and Validation
Explore the source record for details and available documents.
A Global Evaluation of IMERG Precipitation Occurrence Using SMAP Detected Soil Moisture Change
A globally consistent ground validation method for remotely sensed precipitation products is crucial for building confidence in these products. This study develops a new methodology to validate the IMERG precipitation products through the use of SMAP soil moisture changes as a proxy for precipitation occurrence. Using a standard 2x2 contingency table method, preliminary results provide confidence in SMAP’s ability to be utilized as a validation tool for IMERG as results are comparable to previous validation studies. However, the method allows for an overestimate of false alarm frequency due to light precipitation events that can evaporate before the subsequent SMAP overpass and changes in overpass-to-overpass SMAP soil moisture that are within the range of SMAP uncertainty. To counter these issues, a 3x3 contingency table is used to reduce noise and extract more signal from the detection method. Through the use of this novel approach, the validation method produces a global mean POD of 0.64 and global mean FAR of 0.40, the first global-scale ground validation skill scores for the IMERG products. Advancing the method to validate precipitation quantity and the development of a real-time validation for the IMERG Early product are the crucial next developments.
JPL control-structure interaction technology: Micro-precision CSI
The NASA Control-Structure Interaction (CSI) Program is described in outline and graphic form. Particular emphasis is given to the activities of the Jet Propulsion Lab. The goals of the program are (1) controlled structure performance enhancement, (2) controlled structure unified methods for design/analysis, and (3) ground validation methods for CSI flight systems.
Synthesis of aircraft structures using integrated design and analysis methods
A systematic research is reported to develop and validate methods for structural sizing of an airframe designed with the use of composite materials and active controls. This research program includes procedures for computing aeroelastic loads, static and dynamic aeroelasticity, analysis and synthesis of active controls, and optimization techniques. Development of the methods is concerned with the most effective ways of integrating and sequencing the procedures in order to generate structural sizing and the associated active control system, which is optimal with respect to a given merit function constrained by strength and aeroelasticity requirements.
Experimental validation of structural optimization methods
The topic of validating structural optimization methods by use of experimental results is addressed. The need for validating the methods as a way of effecting a greater and an accelerated acceptance of formal optimization methods by practicing engineering designers is described. The range of validation strategies is defined which includes comparison of optimization results with more traditional design approaches, establishing the accuracy of analyses used, and finally experimental validation of the optimization results. Examples of the use of experimental results to validate optimization techniques are described. The examples include experimental validation of the following: optimum design of a trussed beam; combined control-structure design of a cable-supported beam simulating an actively controlled space structure; minimum weight design of a beam with frequency constraints; minimization of the vibration response of helicopter rotor blade; minimum weight design of a turbine blade disk; aeroelastic optimization of an aircraft vertical fin; airfoil shape optimization for drag minimization; optimization of the shape of a hole in a plate for stress minimization; optimization to minimize beam dynamic response; and structural optimization of a low vibration helicopter rotor.
Optimizing Urban Air Mobility Research Through Bi-Directional Integration Processes for Effective Verification and Validation
Urban Air Mobility (UAM), a subset of Advanced Air Mobility (AAM), aims to revolutionize metropolitan transportation. This paper explores an engineering process framework within National Aeronautics and Space Administration (NASA)’s Air Mobility Pathfinders (AMP) project, which is focused on the safe scaling and seamless integration of UAM operations within the National Airspace System (NAS). Progressing through three phases — Initial, Midterm, and Mature — the Federal Aviation Administration (FAA)’s UAM Concept of Operations (ConOps) describes a proposed path for the evolution of UAM operations, presenting multifaceted challenges in technology, regulation, and stakeholder engagement. With this ConOps as a basis, the AMP project is executing research, development, test, and evaluation activities aimed at delivering validated reference architectures for the Midterm phase. This paper illuminates the pivotal role of the systems engineering process in managing these technical efforts. Robust verification and validation methods, along with systematic bi-directional integration process, enhance the ability to conduct research into the design and evolution of safe, efficient, and reliable UAM systems. In this paper a systematic framework will be presented and shown to facilitate interactions between UAM stakeholders and to effectively manage the complex architecture of UAM operations in the NAS.
Viscosity Measurement of Highly Viscous Liquids Using Drop Coalescence in Low Gravity
The method of drop coalescence is being investigated for use as a method for determining the viscosity of highly viscous undercooled liquids. Low gravity environment is necessary in this case to minimize the undesirable effects of body forces and liquid motion in levitated drops. Also, the low gravity environment will allow for investigating large liquid volumes which can lead to much higher accuracy for the viscosity calculations than possible under 1 - g conditions. The drop coalescence method is preferred over the drop oscillation technique since the latter method can only be applied for liquids with vanishingly small viscosities. The technique developed relies on both the highly accurate solution of the Navier-Stokes equations as well as on data from experiments conducted in near zero gravity environment. In the analytical aspect of the method two liquid volumes are brought into contact which will coalesce under the action of surface tension alone. The free surface geometry development as well as its velocity during coalescence which are obtained from numerical computations are compared with an analogous experimental model. The viscosity in the numerical computations is then adjusted to bring into agreement of the experimental results with the calculations. The true liquid viscosity is the one which brings the experiment closest to the calculations. Results are presented for method validation experiments performed recently on board the NASA/KC-135 aircraft. The numerical solution for this validation case was produced using the Boundary Element Method. In these tests the viscosity of a highly viscous liquid, in this case glycerine at room temperature, was determined to high degree of accuracy using the liquid coalescence method. These experiments gave very encouraging results which will be discussed together with plans for implementing the method in a shuttle flight experiment.
Composite load spectra for select space propulsion structural components
The work performed to develop composite load spectra (CLS) for the Space Shuttle Main Engine (SSME) using probabilistic methods. The three methods were implemented to be the engine system influence model. RASCAL was chosen to be the principal method as most component load models were implemented with the method. Validation of RASCAL was performed. High accuracy comparable to the Monte Carlo method can be obtained if a large enough bin size is used. Generic probabilistic models were developed and implemented for load calculations using the probabilistic methods discussed above. Each engine mission, either a real fighter or a test, has three mission phases: the engine start transient phase, the steady state phase, and the engine cut off transient phase. Power level and engine operating inlet conditions change during a mission. The load calculation module provides the steady-state and quasi-steady state calculation procedures with duty-cycle-data option. The quasi-steady state procedure is for engine transient phase calculations. In addition, a few generic probabilistic load models were also developed for specific conditions. These include the fixed transient spike model, the poison arrival transient spike model, and the rare event model. These generic probabilistic load models provide sufficient latitude for simulating loads with specific conditions. For SSME components, turbine blades, transfer ducts, LOX post, and the high pressure oxidizer turbopump (HPOTP) discharge duct were selected for application of the CLS program. They include static pressure loads and dynamic pressure loads for all four components, centrifugal force for the turbine blade, temperatures of thermal loads for all four components, and structural vibration loads for the ducts and LOX posts.
Dynamic Ground Effects Simulation Using OVERFLOW-D
This presentation is broken into 5 logical sections. The Background Information section describes the technical issues being address by this study. The Approach section describes the organization of the contract effort which was laid out as the most effective means of quantifying, with validated methods, the magnitude of dynamic ground effects for the TCA (Technology Concept Aircraft) configuration. The Validation Case section describes the analysis of the XB-70 configuration in both static and dynamic ground effect, with comparisons to wind tunnel and flight test data. The TCA Analysis section then describes the application of the same codes and methodologies to the TCA in both static and dynamic ground effect. Comparisons are made between the static and dynamic, as well as to early static data from a recent wind tunnel test on the TCA configuration. Finally, the work to date is summarized and the future direction of this study is outlined.
TPSAS-NF1676L-30290-DND
The Summer 2017 Ozone Water Land Environmental Transition Study (OWLETS) mission set out to compare the differences in ozone concentrations between inland measurements of air quality, specifically at Langley Research Center (LaRC), and measurements taken over water, specifically on the Chesapeake Bay Bridge Tunnel (CBBT), as well as the vertical profiles above each location. Current weather models often predict a gradient in ozone concentration between land and ocean and this campaign attempted to capture this difference using hand-held Personal Ozone Monitors (POMs) in correspondence to ozonesondes and LIDAR measurements. The Tropospheric Emissions: Monitoring of Pollution (TEMPO) is the first geostationary satellite that will take hourly measurements to monitor air pollutants across North America using solar backscatter. The small footprint allows for higher spatial resolution readings of many parameters including O3, NO2 , and aerosol. TEMPO’s higher resolution readings would benefit from validation techniques on the ground. Validation methods usually include comparison to air quality monitoring stations, but they could also incorporate other forms of validation such as comparison to small sensors. In cooperation with TEMPO, OWLETS aims to provide the user community high resolution temporal and spatial, both horizontal and vertical, variability of O3 simultaneously over the land and water during various air quality events to improve forecast models and air quality satellite retrievals. Together, these missions will improve spatial resolution and capture temporal variability of air quality over North America.
Utilization of Low Gravity Environment for Measuring Liquid Viscosity
The method of drop coalescence is used for determining the viscosity of highly viscous undercooled liquids. Low gravity environment is necessary in order to allow for examining large volumes affording much higher accuracy for the viscosity calculations than possible for smaller volumes available under 1 - g conditions. The drop coalescence method is preferred over the drop oscillation technique since the latter method can only be applied for liquids with vanishingly small viscosities. The technique developed relies on both the highly accurate solution of the Navier-Stokes equations as well as on data from experiments conducted in near zero gravity environment. Results are presented for method validation experiments recently performed on board the NASA/KC-135 aircraft. While the numerical solution was produced using the Boundary Element Method. In these tests the viscosity of a highly viscous liquid, glycerine at room temperature, was determined using the liquid coalescence method. The results from these experiments will be discussed.
TROPOMI Methane Validation in the GeoCarb Domain
Objective: GeoCarb validation •Purpose: •Do the four TCCON sites in the GeoCarb domain characterize satellite validation? •Method: •Assess the error estimates globally vs. in the GeoCarb domain •Assess the use of GML/DOE aircraft for CH4 validation •Systematic error estimate (from Kulawik, 2016): •+ regional bias (stdevof average bias versus validation at each station) •+ correlated error (stdev of daily average versus validation) •-co-location error (above quantities for model@satelliteminus model@valid) •-validation error (systematic error of validation estimates, e.g. model extension) Aircraft validation error •CH4 profile extension error estimate: 7 ppb •Extend aircraft observations to the top of the atmosphere with different model configurations •CAMS, scaling to stratosphere, then taking stratosphere •Extend by repeating top aircraft value to the troposphere, then taking CAMS •Extend with GEOS-Chem run (from 2010). •Difference CAMS-Scale vs. CAMS-Tropo: •3.6 +-5.5 ppb •Systematic error: 6.6 ppb •Extending aircraft to tropopause is blatantly wrong, but these two have the same stratosphere. •Difference CAMS-Scale vs. GEOS-Scale: •6.2 +-8.7 ppb •Do not consider bias since model is 10 years off. Systematic error ~8.7 ppb. •Estimate of systematic error from profile extension (possibly underestimated, resulting in possibly higher TROPOMI error estimate) •7 ppb •Would likely vary some by season, site, other conditions •Aircraft measurement error: 1 ppb •1 ppb from measurement error3
Validation of a High-Order Compact Code for Nonlinear Flows About Complex Geometric
The slides review computational requirements for nozzle exhaust flow and noise calculations and the current numerical method, validation of prefactored compact scheme on CAA benchmark problems, a curvilinear grid performance test of gust response of a Joukowski airfoil, airfoil surface RMS pressure distribution and far field noise radiation results for Joukowski airfoil in a vortical gust, boundary distance study for Joukowski airfoil problem, and performance of ICOMP parallel Macintosh cluster.
An Investigation Into Transecting Satellites in Future Space Traffic Management Scenarios
The number of satellites expected to populate the near-Earth space environment is set to dramatically increase in the coming decade as new large constellations are approved and deployed. Current strategies for placing new batches of these satellites on orbit often involve launching into an initial orbit, and then performing apogee raising maneuvers to reach a target altitude. Similarly, end-of-life planning for these constellation satellites can consist of de-orbit burns that lower perigee to permit disposal via re-entry. Both the raising and de-orbiting maneuvers can result in the individual satellites traveling in high-eccentricity orbits that have the potential to transect other spacecraft trajectories. While individual large constellations may be able to coexist in separate altitude and inclination bands, having thousands of satellites moving between these bands as new satellites are replaced and old ones are removed could pose additional collision risks. Similar concerns have been raised regarding the impact that large numbers of university-class CubeSats might have in terms of their overall collision risk, especially as these satellites typically do not have propulsion systems for active maneuvering. To assess the impact that transecting satellites might have to future space traffic management strategies, this study explored a variety of future realistic scenarios using a high-fidelity simulation tool. The model can simulate the orbit of tens of thousands of resident space objects (RSOs) simultaneously, to include active satellites, debris, rocket bodies, or even future hypothetical scenarios, using a realistic force model that incorporates non-spherical gravity, atmospheric drag, solar radiation pressure, and more. As the model is run forward in time, various statistics and meta-data are gathered on any predicted conjunction event, providing insight into the nature and frequency of potential collisions, e.g., what size are the two satellites, who operates the satellites, are they active or passive objects, etc. Additional customization is available in terms of how probability of collision is computed, and how the probability ellipsoids and screening volumes are determined. The simulation tool also allows for rule-based maneuvers for active satellites, e.g, given an advance conjunction “warning,” one or both of the satellites can maneuver to a safe distance. A wide range of maneuvers can be implemented using impulsive or low-thrust methods, and the latencies can also be varied, e.g., using maneuver lead times of 48 hours, 24 hours, or 12 hours. Validation of the simulation results is performed against current and historical datasets available, to include comparisons to prior conjunction data messages (CDMs), object properties (mass, volume, etc.), and two-line-element records from both public and internal sources. Using the simulation environment, an assessment on the general risks that transecting satellites might pose for hypothetical future space object environments will be presented. This will involve the simulation of approximately 50,000 new large constellation satellites, in addition to the existing catalog of approximately 20,000 known resident space objects (RSOs), over propagation periods of one month to one year. A description of the simulation methodologies, scenarios evaluated, and validation methods will also be presented, as well as a preliminary assessment of the effectiveness of several candidate maneuver strategies that have the potential to reduce collision risk between active satellites.
Display format, highlight validity, and highlight method: Their effects on search performance
Display format and highlight validity were shown to affect visual display search performance; however, these studies were conducted on small, artificial displays of alphanumeric stimuli. A study manipulating these variables was conducted using realistic, complex Space Shuttle information displays. A 2x2x3 within-subjects analysis of variance found that search times were faster for items in reformatted displays than for current displays. Responses to valid applications of highlight were significantly faster than responses to non or invalidly highlighted applications. The significant format by highlight validity interaction showed that there was little difference in response time to both current and reformatted displays when the highlight validity was applied; however, under the non or invalid highlight conditions, search times were faster with reformatted displays. A separate within-subject analysis of variance of display format, highlight validity, and several highlight methods did not reveal a main effect of highlight method. In addition, observed display search times were compared to search time predicted by Tullis' Display Analysis Program. Benefits of highlighting and reformatting displays to enhance search and the necessity to consider highlight validity and format characteristics in tandem for predicting search performance are discussed.
Implications of Simulation Conceptual Model Development for Simulation Management and Uncertainty Assessment
A simulation conceptual model is a simulation developers way of translating modeling requirements (i. e., what is to be represented by the simulation or its modification) into a detailed design framework (i. e., how it is to be done), from which the software, hardware, networks (in the case of distributed simulation), and systems/equipment that will make up the simulation can be built or modified. A conceptual model is the collection of information which describes a simulation developers concept about the simulation and its pieces. That information consists of assumptions, algorithms, characteristics, relationships, and data. Taken together, these describe how the simulation developer understands what is to be represented by the simulation (entities, actions, tasks, processes, interactions, etc.) and how that representation will satisfy the requirements to which the simulation responds. Thus the conceptual model is the basis for judgment about simulation fidelity and validity for any condition that is not specifically tested. The more perspicuous and precise the conceptual model, the more likely it is that the simulation development will both fully satisfy requirements and allow demonstration that the requirements are satisfied (i. e., validation). Methods used in simulation conceptual model development have significant implications for simulation management and for assessment of simulation uncertainty. This paper suggests how to develop and document a simulation conceptual model so that the simulation fidelity and validity can be most effectively determined. These ideas for conceptual model development apply to all simulation varieties. The paper relates these ideas to uncertainty assessments as they relate to simulation fidelity and validity. The paper also explores implications for simulation management from conceptual model development methods, especially relative to reuse of simulation components.
Validation of Safety-Critical Systems for Aircraft Loss-of-Control Prevention and Recovery
Validation of technologies developed for loss of control (LOC) prevention and recovery poses significant challenges. Aircraft LOC can result from a wide spectrum of hazards, often occurring in combination, which cannot be fully replicated during evaluation. Technologies developed for LOC prevention and recovery must therefore be effective under a wide variety of hazardous and uncertain conditions, and the validation framework must provide some measure of assurance that the new vehicle safety technologies do no harm (i.e., that they themselves do not introduce new safety risks). This paper summarizes a proposed validation framework for safety-critical systems, provides an overview of validation methods and tools developed by NASA to date within the Vehicle Systems Safety Project, and develops a preliminary set of test scenarios for the validation of technologies for LOC prevention and recovery