SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

NASA NTRS2003

The Stable Isotope Fractionation of Abiotic Reactions: A Benchmark in the Detection of Life

One very important tool in the analysis of biogenic, and potentially biogenic, samples is the study of their stable isotope distributions. The isotope distribution of a sample depends on the process(es) that created it. One important application of the analysis of C & N stable isotope ratios has been in the determination of whether organic matter in a sample is of biological origin or was produced abiotically. For example, the delta C-13 of organic material found embedded in phosphate grains was cited as a critical part of the evidence for life in 3.8 billion year old samples. The importance of such analysis in establishing biogenicity was highlighted again by the role this issue played in the recent debate over the validity of what had been accepted as the Earth s earliest microfossils. These kinds of analysis imply a comparison with the fractionation that one would have seen if the organic material had been produced by alternative, abiotic, pathways. Could abiotic reactions account for the same level of fractionation? Additionally, since the fractionation can vary between different abiotic reactions, understanding their fractionations can be important in distinguishing what reactions may have been significant in the formation of different abiological samples (such as extraterrestrial samples). There is however, a scarcity of data on the fractionation of carbon and nitrogen by abiotic reactions. In order to interpret properly what the stable isotope ratios of samples tell us about their biotic or abiotic nature, more needs to be known about how abiotic reactions fractionate C and N. Carbon isotope fractionations have been studied for a few abiotic processes. These studies presumed the presence of a reducing atmosphere, focusing on reactions involving spark discharge, W photolysis of reducing gas mixtures, and cyanide polymerization in the presence of ammonia. They did find that the initial products showed a depletion in I3C with values in the range of a few per mil to as low as -60 % (potentially comparable to that which accompanies the biosynthesis of organic matter). We need to understand what kind of fractionations are observed with reactions under the non-reducing or mildly reducing conditions now thought to be present on the early Earth. While nitrogen is receiving increased attention as a tool for these kinds of analyses, almost nothing is known about the isotope fractionation that one would expect for abiotic sources of fixed/reduced nitrogen. This project will measure the fixation from a series of abiotic reactions that may have been present on the early Earth (and other terrestrial planets) and produced organic material that could have ended up in the rock record. The work will look at a number of reactions, under a non- reducing, or mildly reducing, atmosphere, covering sources of prebiotic organic C & N from shock heating, to photochemistry, to hydrothermal reactions. Some reactions that we plan to study are; Shock heating of a non-reducing atmosphere to produce CO and NO (in collaboration with Chris McKay), formation of formaldehyde (and related compounds) from COY the formation of ammonia from nitrogen oxides (ultimately from NO) by ferrous iron reduction, and the hydrothermal synthesis of compounds including the hydrocarboxylation/hydrocarbonylation reaction (in collaboration with George Cody), reactions of oxalate to form hydrocarbons and other oxygenated compounds and the formation of lipids from oxalic/formic acid (in collaboration with Tom McCollom), and reactions of carbon monoxide & carbon dioxide with N2, ammonia or nitritehitrate to form hydrogen cyanide, nitriles, ammonia/amines and nitrous

Summers, David P.↗

NASA NTRS1992

Exploratory study on performance measures as indicators of IS effectiveness

The Information Systems Directorate at JSC/NASA has undertaken the reevaluation of its performance measures process and measures. Under the direction of a quality approach it is essential to identify an external perspective of how well an organization is performing. This study was conducted with two major objectives: (1) survey and summarize the academic literature on performance measures as indicators of information systems (IS) effectiveness; and (2) survey organizations for their experience in measuring for IS effectiveness. Four approaches to measuring the effectiveness of IS performance were identified: (1) listen to the customer for the things they need; (2) align with corporate goals; (3) benchmark against well-respected organizations; and (4) ask yourself what critical factors lead to success. The list of known methods for soliciting customer feedback are as follows: (1) executive visit; (2) survey, interview, and focus group; (3) complaints and compliments; and (4) service level agreements. A common set of characteristics that satisfy customers was identified from the literature. The list includes elements such as the following: accuracy, timeliness, relevance, understandability, reliability, and completeness. Future research in this topic area should prove beneficial to determine the metrics for external validity.

Bishop, Peter C.↗

NASA NTRS2024

NASA Engineering and Safety Center Technical Bulletin No. 24-04: 6DOF Check Cases

In 2015, the NESC released benchmark Earth-based check-cases for well specified, rigid-body, six-degree-of-freedom (6DOF) aero/spacecraft models to promote consistent and accurate flight simulations across multiple Agency tools and facilities. Recently, the NESC expanded upon that effort to add Lunar-based check-cases to support new lunar exploration initiatives. This study produced a smaller, focused set of cases that exercise new and unique features of missions in the lunar environment in comparison with 8 high-fidelity NASA simulation tools and provides a measure of validation for simulations supporting Human Landing Systems.

Flight Mechanics↗

NASA NTRSDate not supplied

CLARREO Pathfinder Mission Overview and its Intercalibration Capabilities

NASA's Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission will deploy an Earth-observing reflected solar (RS) spectrometer, designed to measure Earth-reflected solar radiation from the International Space Station with a remarkable SI-traceable radiometric uncertainty of 0.3% (k=1). This spectrometer, known as the Hyperspectral Imager for Climate Science (HySICS), will provide measurements within a spectral range of 350-2300 nm with 3-nm spectral intervals. Covering a nadir swath of 70 km, HySICS captures 480 discrete measurement pixels that provide spectrally-resolved Earth-reflected radiances. The CPF mission encompasses two principal objectives. The first objective is to demonstrate on-orbit calibration methodologies that achieve and uphold an unprecedented level of accuracy while maintaining traceability to SI standards. The second objective is to showcase an innovative on-orbit intercalibration approach, which involves the intercalibration of two other RS sensors—namely, the shortwave (SW) channel of the Clouds and the Earth’s Radiant Energy System (CERES) and the Reflective Solar (RS) bands of the Visible Infrared Imager Radiometer Suite (VIIRS)—against CPF benchmark measurements. The targeted intercalibration methodology uncertainty for these target instruments is 0.3% (k=1). Empowered by the CPF payload's two-axis pointing capability, moderate spatial sampling of 0.5 km, and wide spectral coverage, the CPF instrument will capture near-simultaneous temporal, spatial, angular, and spectrally matched observations with intercalibration targets. The CPF intercalibration science development team has devised novel methods to address spatial, spectral, polarization, and angular differences between CPF and the target instruments' intercalibration footprints to achieve the stringent 0.3% intercalibration methodology uncertainty. Comprehensive details of these methods and their validation will be elaborated upon during the conference presentation.

Hyperspectral↗

NASA NTRS2021

K2-138 g: Spitzer Spots a Sixth Planet for the Citizen Science System

K2 greatly extended Kepler's ability to find new planets, but it was typically limited to identifying transiting planets with orbital periods below 40 days. While analyzing K2 data through the Exoplanet Explorers project, citizen scientists helped discover one super-Earth and four sub-Neptune sized planets in the relatively bright (V = 12.21, K = 10.3) K2-138 system, all which orbit near 3:2 mean-motion resonances. The K2 light curve showed two additional transit events consistent with a sixth planet. Using Spitzer photometry, we validate the sixth planet's orbital period of 41.966 ± 0.006 days and measure a radius of 3.44 (+0.32,-.031)Rꚛ, solidifying K2-138 as the K2 system with the most currently known planets. There is a sizeable gap between the outer two planets, since the fifth planet in the system, K2-138 f, orbits at 12.76 days. We explore the possibility of additional nontransiting planets in the gap between f and g. Due to the relative brightness of the K2-138 host star, and the near resonance of the inner planets, K2-138 could be a key benchmark system for both radial velocity and transit-timing variation mass measurements, and indeed radial velocity masses for the inner four planets have already been obtained. With its five sub-Neptunes and one super-Earth, the K2-138 system provides a unique test bed for comparative atmospheric studies of warm to temperate planets of similar size, dynamical studies of near-resonant planets, and models of planet formation and migration.

Kevin K. Hardegree-Ullman↗

NASA NTRS1999

The Isothermal Dendritic Growth Experiment (IDGE)

The Isothermal Dendritic Growth Experiment (IDGE) constituted a series of three NASA-supported microgravity experiments, all of which flew aboard the space shuttle, Columbia. This experimental space flight series was designed and operated to grow and record dendrite solidification in the absence of gravity-induced convective heat transfer, and thereby produce a wealth of benchmark-quality data for testing solidification scaling laws. The data and analysis performed on the dendritic growth speed and tip size in Succinontrie (SCN) demonstrates that although the theory yields predictions that are reasonably in agreement with experiment, there are significant discrepancies. However, some of these discrepancies can be explained by accurately describing the diffusion of heat. The key finding involves recognition that the actual three-dimensional shape of dendrites includes time-dependent side-branching and a tip region that is not a paraboloid of revolution. Thus, the role of heat transfer in dendritic growth is validated, with the caveat that a more realistic model of the dendrite then a paraboloid is needed to account for heat flow in an experimentally observed dendrite. We are currently conducting additional analysis to further confirm and demonstrate these conclusions. The data and analyses for the growth selection physics remain much less definitive. From the first flight, the data indicated that the selection parameter, sigma*, is not exactly a constant, but exhibits a slight dependence on the supercooling. Additional data from the second flight are being examined to investigate the selection of a unique dendrite speed, tip size and shape. The IDGE flight series is now complete. We are currently completing analyses and moving towards final data archiving. It is gratifying to see that the IDGE published results and archived data sets are being used actively by other scientists and engineers. In addition, we are also pleased to report that the techniques and IDGE hardware system that the authors developed with NASA, are being currently employed on both designated flight experiments, like EDSE, and on flight definition experiments, like TDSE.

Glicksman, Martin E.↗

NASA NTRS2005

Partially-Averaged Navier Stokes Model for Turbulence: Implementation and Validation

Partially-averaged Navier Stokes (PANS) is a suite of turbulence closure models of various modeled-to-resolved scale ratios ranging from Reynolds-averaged Navier Stokes (RANS) to Navier-Stokes (direct numerical simulations). The objective of PANS, like hybrid models, is to resolve large scale structures at reasonable computational expense. The modeled-to-resolved scale ratio or the level of physical resolution in PANS is quantified by two parameters: the unresolved-to-total ratios of kinetic energy (f(sub k)) and dissipation (f(sub epsilon)). The unresolved-scale stress is modeled with the Boussinesq approximation and modeled transport equations are solved for the unresolved kinetic energy and dissipation. In this paper, we first present a brief discussion of the PANS philosophy followed by a description of the implementation procedure and finally perform preliminary evaluation in benchmark problems.

Girimaji, Sharath S.↗

NASA NTRS2016

A Quasi-Global Approach to Improve Day-Time Satellite Surface Soil Moisture Anomalies through the Land Surface Temperature Input

Passive microwave observations from various spaceborne sensors have been linked to the soil moisture of the Earth's surface layer. A new generation of passive microwave sensors are dedicated to retrieving this variable and make observations in the single theoretically optimal L-band frequency (1-2 GHz). Previous generations of passive microwave sensors made observations in a range of higher frequencies, allowing for simultaneous estimation of additional variables required for solving the radiative transfer equation. One of these additional variables is land surface temperature, which plays a unique role in the radiative transfer equation and has an influence on the final quality of retrieved soil moisture anomalies. This study presents an optimization procedure for soil moisture retrievals through a quasi-global precipitation-based verification technique, the so-called Rvalue metric. Various land surface temperature scenarios were evaluated in which biases were added to an existing linear regression, specifically focusing on improving the skills to capture the temporal variability of soil moisture. We focus on the relative quality of the day-time (01:30 pm) observations from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E), as these are theoretically most challenging due to the thermal equilibrium theory, and existing studies indicate that larger improvements are possible for these observations compared to their night-time (01:30 am) equivalent. Soil moisture data used in this study were retrieved through the Land Parameter Retrieval Model (LPRM), and in line with theory, both satellite paths show a unique and distinct degradation as a function of vegetation density. Both the ascending (01:30 pm) and descending (01:30 am) paths of the publicly available and widely used AMSR-E LPRM soil moisture products were used for benchmarking purposes. Several scenarios were employed in which the land surface temperature input for the radiative transfer was varied by imposing a bias on an existing regression. These scenarios were evaluated through the Rvalue technique, resulting in optimal bias values on top of this regression. In a next step, these optimal bias values were incorporated in order to re-calibrate the existing linear regression, resulting in a quasi-global uniform LST relation for day-time observations. In a final step, day-time soil moisture retrievals using the re-calibrated land surface temperature relation were again validated through the Rvalue technique. Results indicate an average increasing Rvalue of 16.5%, which indicates a better performance obtained through the re-calibration. This number was confirmed through an independent Triple Collocation verification over the same domain, demonstrating an average root mean square error reduction of 15.3%. Furthermore, a comparison against an extensive in situ database (679 stations) also indicates a generally higher quality for the re-calibrated dataset. Besides the improved day-time dataset, this study furthermore provides insights on the relative quality of soil moisture retrieved from AMSR-E's day- and night-time observations.

soil moisture↗

NASA NTRS2002

The New NASA Orbital Debris Engineering Model ORDEM2000

The NASA Orbital Debris Program Office at Johnson Space Center has developed a new computer-based orbital debris engineering model, ORDEM2000, which describes the orbital debris environment in the low Earth orbit region between 200 and 2000 km altitude. The model is appropriate for those engineering solutions requiring knowledge and estimates of the orbital debris environment (debris spatial density, flux, etc.). ORDEM2000 can also be used as a benchmark for ground-based debris measurements and observations. We incorporated a large set of observational data, covering the object size range from 10 mm to 10 m, into the ORDEM2000 debris database, utilizing a maximum likelihood estimator to convert observations into debris population probability distribution functions. These functions then form the basis of debris populations. We developed a finite element model to process the debris populations to form the debris environment. A more capable input and output structure and a user-friendly graphical user interface are also implemented in the model. ORDEM2000 has been subjected to a significant verification and validation effort. This document describes ORDEM2000, which supersedes the previous model, ORDEM96. The availability of new sensor and in situ data, as well as new analytical techniques, has enabled the construction of this new model. Section 1 describes the general requirements and scope of an engineering model. Data analyses and the theoretical formulation of the model are described in Sections 2 and 3. Section 4 describes the verification and validation effort and the sensitivity and uncertainty analyses. Finally, Section 5 describes the graphical user interface, software installation, and test cases for the user.

Liou, Jer-Chyi↗

NASA NTRS2004

Computation of Gust-Cascade Interaction Using the CE/SE Method

The problem 2 in Category 3 of the 4th Computational Aeroacoustic(CAA) Workshop is solved using the space-time conservation element and solution element (CE/SE) method. This problem models rotor-stator interaction in a 2D cascade. It involves complex geometries and flow physics including vortex shedding and acoustic radiation. The parallel version of the 2D nonlinear Euler solver is used with an unstructured triangular mesh to solve this problem. The Giles approach is incorporated with the CE/SE method to handle non-equal pitches of the rotor and stator. Validation on the Giles approach is performed using Problem 3.1 in the 2nd CAA Workshop. The space-time CE/SE method is a finite volume method with second-order accuracy in both space and time. The flux conservation is enforced in both space and time instead of space only. It has low numerical dissipation and dispersion errors. It uses simple non-reflecting boundary conditions and is compatible with unstructured meshes. It is simple, flexible, and generate reasonably accurate solutions. The CE/SE method has been successfully applied to solve numerous practical problems, especially aeroacoustic problems. Some preliminary numerical results of the benchmark problem 3.2 of the 4th CAA Workshop are shown. The steady-state pressure contour is plotted. The mean pressure distribution on the blade surface is compared with Turbo solution showing a good agreement. The sound pressure level versus the rotor harmonic n at the six designated positions on the blade surface, three locations at inlet plane, and three locations at the outlet plane are plotted. It can be seen that the acoustic response exists only at the excitation frequencies (n = 1,2,3). On the blade surface, the acoustic wave at n = 1 is dominant, while at the inlet and outlet planes, the sound pressure level at n = 2 becomes the largest, which is similar to the results presented. The distribution of sound pressure level at different spatial modes along the z- direction is plotted for n = 1,2,3, respectively. It shows that the spatial modes m = -32 and 22 at n = 1 exponentially decay, and the spatial modes m = 10 at n = 2, m = -42 and 12 at n = 3 propagate both upstream and downstream, which agrees with the prediction based on the linearized theory. Some oscillations are observed, which needs to be investigated further. In the final paper, the numerical results will be compared with a frequency-domain solver LINFLUX solution if it is available.

Wang, X.-Y.↗

NASA NTRSDate not supplied

Tutorial on LuNaMaps Developed Tools andProcesses for Mapping the Lunar Surface

The main contribution of this project is the combined knowledge of terrain relative navigation experts and lunar scientists who are familiar with both the lunar orbital imagery and the instruments that collected the data as well as how a TRN system utilizes map data. This knowledge comes in the form of published technical papers, benchmark map data sets, and software tools that can help others automate the process of creating the necessary maps for their own landing sites in the future. This presentation provides a brief overview of the tools and processes developed by the project.

optical navigation↗

NASA NTRS1994

Parabolized stability equations

The parabolized stability equations (PSE) are a new approach to analyze the streamwise evolution of single or interacting Fourier modes in weakly nonparallel flows such as boundary layers. The concept rests on the decomposition of every mode into a slowly varying amplitude function and a wave function with slowly varying wave number. The neglect of the small second derivatives of the slowly varying functions with respect to the streamwise variable leads to an initial boundary-value problem that can be solved by numerical marching procedures. The PSE approach is valid in convectively unstable flows. The equations for a single mode are closely related to those of the traditional eigenvalue problems for linear stability analysis. However, the PSE approach does not exploit the homogeneity of the problem and, therefore, can be utilized to analyze forced modes and the nonlinear growth and interaction of an initial disturbance field. In contrast to the traditional patching of local solutions, the PSE provide the spatial evolution of modes with proper account for their history. The PSE approach allows studies of secondary instabilities without the constraints of the Floquet analysis and reproduces the established experimental, theoretical, and computational benchmark results on transition up to the breakdown stage. The method matches or exceeds the demonstrated capabilities of current spatial Navier-Stokes solvers at a small fraction of their computational cost. Recent applications include studies on localized or distributed receptivity and prediction of transition in model environments for realistic engineering problems. This report describes the basis, intricacies, and some applications of the PSE methodology.

Herbert, Thorwald↗

NASA NTRS2001

Validation of the galactic cosmic ray and geomagnetic transmission models

A very high-momentum resolution particle spectrometer called the Alpha Magnetic Spectrometer (AMS) was flown in the payload bay of the Space Shuttle in a 51.65 degrees x 380-km orbit during the last solar minimum. This spectrometer has provided the first high statistics data set for galactic cosmic radiation protons, and helium, as well as limited spectral data on carbon and oxygen nuclei in the International Space Station orbit. First measurements of the albedo protons at this inclination were also made. Because of the high-momentum resolution and high statistics, the data can be separated as a function of magnetic latitude. A related investigation, the balloon borne experiment with a superconducting solenoid spectrometer (BESS), has been flown from Lynn Lake, Canada and has also provided excellent high-resolution data on protons and helium. These two data sets have been used here to study the validity of two galactic cosmic ray models and the geomagnetic transmission function developed from the 1990 geomagnetic reference field model. The predictions of both the CREME96 and NASA/JSC models are in good agreement with the AMS data. The shape of the AMS measured albedo proton spectrum, up to 2 GeV, is in excellent agreement with the previous balloon and satellite observations. A new LIS spectrum was developed that is consistent with both previous and new BESS 3He observations. Because the astronaut radiation exposures onboard ISS will be highest around the time of the solar minimum, these AMS measurements and these models provide important benchmarks for future radiation studies. AMS-02 slated for launch in September 2003, will provide even better momentum resolution and higher statistics data. Published by Elsevier Science Ltd.

unmanned↗

NASA NTRS1992

A status of the activities of the NASA/MSFC pump stage technology team

The Consortium for Computational Fluid Dynamics (CFD) Application in Propulsion Technology was established to aid the transfer of CFD related advancements among academia, government agencies, and industry. The specific goals of the Consortium are to develop CFD methodologies necessary to solve propulsion problems, to validate these methodologies, and to apply these methodologies in the design process. To accomplish these goals, a team of experts in various related fields was formed, a schedule of activities necessary to meet the goals was generated, and funding for the activities was obtained from NASA. During the past year (Mar. 1991 - Mar. 1992) the team's activities have focused on preliminary code validation and on the design of an advanced impeller. Six codes were used to calculate the flow in a Rocketdyne 0.3 flow coefficient inducer, and the results were compared to L2F data available for the inducer. This activity identified shortcomings in the experimental data sets and in the analytical solutions which must be surmounted in any future team activity. The design of the advanced impeller relied heavily on CFD results to obtain an optimized geometry. The optimized geometry was analyzed using four different codes, at design and off-design conditions. Activities for the next year include the optimization of a tandem blade impeller design, benchmark of CFD codes for diffuser and volute flows, the collection of L2F data for 'state-of-the-art' impeller and inducer, and the verification of the advanced pump team impeller design in a water rig.

Garcia, R.↗

NASA NTRSDate not supplied

Composite Progressive Delamination Analysis of Thin Ply Buckling

The NASA Advanced Composites Project is a multi-year consortium of government, industry and academia to develop and validate technology that will reduce development and certification of advanced composite materials for aircraft structures. One of its tasks is to simulate and predict composite damage progression accurately through high fidelity finite element models. It included a subtask to verify an approach based on the Virtual Crack Closure Technology (VCCT) as well as Floating Node Method (FNM). This paper discusses predicted damage onset and growth in a thin-ply buckling problem. Sensitivity of the simulations to various initial crack length is studied. The compressive load-displacement curves are plotted and the crack growth critical load is predicted. Overall, the crack progression follows simulation benchmarks well. However, the critical-load overshoot phenomenon is observed in both VCCT and FNM, suggesting further investigation may be worth pursuing.

damage progression↗

NASA NTRS1990

Flight data acquisition methodology for validation of passive ranging algorithms for obstacle avoidance

The automation of low-altitude rotorcraft flight depends on the ability to detect, locate, and navigate around obstacles lying in the rotorcraft's intended flightpath. Computer vision techniques provide a passive method of obstacle detection and range estimation, for obstacle avoidance. Several algorithms based on computer vision methods have been developed for this purpose using laboratory data; however, further development and validation of candidate algorithms require data collected from rotorcraft flight. A data base containing low-altitude imagery augmented with the rotorcraft and sensor parameters required for passive range estimation is not readily available. Here, the emphasis is on the methodology used to develop such a data base from flight-test data consisting of imagery, rotorcraft and sensor parameters, and ground-truth range measurements. As part of the data preparation, a technique for obtaining the sensor calibration parameters is described. The data base will enable the further development of algorithms for computer vision-based obstacle detection and passive range estimation, as well as provide a benchmark for verification of range estimates against ground-truth measurements.

Smith, Phillip N.↗

NASA NTRS2004

Effects of Angle of Attack and Velocity on Trailing Edge Noise

Trailing edge (TE) noise measurements for a NACA 63-215 airfoil model are presented, providing benchmark experimental data for a cambered airfoil. The effects of flow Mach number and angle of attack of the airfoil model with different TE bluntnesses are shown. Far-field noise spectra and directivity are obtained using a directional microphone array. Standard and diagonal removal beamforming techniques are evaluated employing tailored weighting functions for quantitatively accounting for the distributed line character of TE noise. Diagonal removal processing is used for the primary database as it successfully removes noise contaminates. Some TE noise predictions are reported to help interpret the data, with respect to flow speed, angle of attack, and TE bluntness on spectral shape and peak levels. Important findings include the validation of a TE noise directivity function for different airfoil angles of attack and the demonstration of the importance of the directivity function s convective amplification terms.

Hutcheson, Florence V.↗

NASA NTRS2006

Effects of Angle of Attack and Velocity on Trailing Edge Noise

Hutcheson, Florence V.↗