Search NASA⌕ Search

SEARCH · Search NASA

Results for “internal validity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

Validation of International Space Station Electrical Performance Model via On-orbit Telemetry

The first U.S. power module on International Space Station (ISS) was activated in December 2000. Comprised of solar arrays, nickel-hydrogen (NiH2) batteries, and a direct current power management and distribution (PMAD) system, the electric power system (EPS) supplies power to housekeeping and user electrical loads. Modeling EPS performance is needed for several reasons, but primarily to assess near-term planned and off-nominal operations and because the EPS configuration changes over the life of the ISS. The System Power Analysis for Capability Evaluation (SPACE) computer code is used to assess the ISS EPS performance. This paper describes the process of validating the SPACE EPS model via ISS on-orbit telemetry. To accomplish this goal, telemetry was first used to correct assumptions and component models in SPACE. Then on-orbit data was directly input to SPACE to facilitate comparing model predictions to telemetry. It will be shown that SPACE accurately predicts on-orbit component and system performance. For example, battery state-of-charge was predicted to within 0.6 percentage points over a 0 to 100 percent scale and solar array current was predicted to within a root mean square (RMS) error of 5.1 Amps out of a typical maximum of 220 Amps. First, SPACE model predictions are compared to telemetry for the ISS EPS components: solar arrays, NiH2 batteries, and the PMAD system. Second, SPACE predictions for the overall performance of the ISS EPS are compared to telemetry and again demonstrate model accuracy.

Jannette, Anthony G.↗
NASA NTRS1988

CFD validation experiments for internal flows

Computational Fluid Dynamics (CFD) validation experiments at NASA Lewis Research Center are described. The material presented summarizes the research in three areas: Inlets, Ducts and Nozzles; Turbomachinery; and Chemically Reacting Flows. The specific validation activities are concerned with shock-boundary layer interactions, vortex generator effects, large low speed centrifugal compressor measurements, transonic fan shock structure, rotor/stator kinetic energy distributions, stator wake shedding characteristics, boundary layer transition, multiphase flow and reacting shear layers. These experiments are intended to provide CFD validation data for the internal flow fields within aerospace propulsion system components.

Povinelli, Louis A.↗
NASA NTRS1988

CFD validation experiments for internal flows

Computational Fluid Dynamics (CFD) validation experiments at NASA Lewis are described. The material presented summarized the research in 3 areas: Inlets, ducts and nozzles; Turbomachinery; and Chemically reacting flows. The specific validation activities are concerned with shock boundary layer interactions, vortex generator effects, large low speed centrifugal compressor measurements, transonic fan shock structure, rotor/stator kinetic energy distributions, stator wake shedding characteristics, boundary layer transition, multiphase flow and reacting shear layers. These experiments are intended to provide CFD validation data for the internal flow fields within aerospace propulsion system components.

Povinelli, Louis A.↗
NASA NTRS2008

EAQUATE: An International Experiment for Hyper-Spectral Atmospheric Sounding Validation

The international experiment called EAQUATE (European AQUA Thermodynamic Experiment) was held in September 2004 in Italy and the United Kingdom to demonstrate certain ground-based and airborne systems useful for validating hyperspectral satellite sounding observations. A range of flights over land and marine surfaces were conducted to coincide with overpasses of the AIRS instrument on the EOS Aqua platform. Direct radiance evaluation of AIRS using NAST-I and SHIS has shown excellent agreement. Comparisons of level 2 retrievals of temperature and water vapor from AIRS and NAST-I validated against high quality lidar and drop sonde data show that the 1K/1km and 10%/1km requirements for temperature and water vapor (respectively) are generally being met. The EAQUATE campaign has proven the need for synergistic measurements from a range of observing systems for satellite cal/val and has paved the way for future cal/val activities in support of IASI on the European Metop platform and CrIS on the US NPP/NPOESS platform.

Taylor, J. P.↗
NASA NTRS1996

Atomic Oxygen Durability Testing of an International Space Station Solar Array Validation Coupon

An International Space Station solar array validation coupon was exposed in a directed atomic oxygen beam for space environment durability testing at the NASA Lewis Research Center. Exposure to atomic oxygen and intermittent tensioning of the solar array were conducted to verify the solar array#s durability to low Earth orbital atomic oxygen and to the docking threat of plume loading both of which are anticipated over its expected mission life of fifteen years. The validation coupon was mounted on a specially designed rotisserie. The rotisserie mounting enabled the solar and anti-solar facing side of the array to be exposed to directed atomic oxygen in a sweeping arrival process replicating space exposure. The rotisserie mounting also enabled tensioning, in order to examine the durability of the array and its hinge to simulated plume loads. Flash testing to verify electrical performance of the solar array was performed with a solar simulator before and after the exposure to atomic oxygen and tensile loading. Results of the flash testing indicated little or no degradation in the solar array#s performance. Photographs were also taken of the array before and after the durability testing and are included along with comparisons and discussions in this report. The amount of atomic oxygen damage appeared minor with the exception of a very few isolated defects. There were also no indications that the simulated plume loadings had weakened or damaged the array, even though there was some erosion of Kapton due to atomic oxygen attack. Based on the results of this testing, it is apparent that the International Space Station#s solar arrays should survive the low Earth orbital atomic oxygen environment and docking threats which are anticipated over its expected mission life.

Forkapa, Mark J.↗
NASA NTRS2018

Blind Study Validating Parametric Costing Tools PRICE TruePlanning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Paul D Friz↗
NASA NTRS2019

Blind Study Validating Parametric Costing Tools PRICE True Planning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE True Planning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE True Planning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Friz, Paul D.↗
NASA NTRSDate not supplied

Blind Validation Study of PRICE TruePlanning and SEER-H

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning by PRICE Systems, and System Estimation and Evaluation of Resources-Hardware (SEER-H) by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. This study is an independent verification of the accuracy of these tools and was originally published in 2018. The purpose of this presentation is to circulate the findings of that study among the NASA cost community. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER-H had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. Nine of the twelve mission's actual costs fell within the 80% confidence interval of SEER's probabilistic estimates; however, none of the missions fell within PRICE’s confidence intervals. There were several factors independent of PRICE and SEER-H which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

SEER↗
NASA NTRS2006

Diurnal Variability of Vertical Structure from a TRMM Passive Microwave "Virtual Radar" Retrieval

Robust description of the diurnal cycle from TRMM observations is complicated by the limitations of Low Earth Orbit (LEO) sampling; from a 'climatological' perspective, sufficient sampling must exist to control for both spatial and seasonal variability, before tackling an additional diurnal component (e.g., with 8 additional 3-hourly or 24 1-hourly bins). For documentation of vertical structure, the narrow sample swath of the TRMM Precipitation Radar limits the resolution of any of these components. A neural-network based 'virtual radar" retrieval has been trained and internally validated, using multifrequency / multipolarization passive microwave(TM1) brightness temperatures and textures parameters and lightning (LIS) observations, as inputs, and PR volumetric reflectivity as targets (outputs). By training the algorithms (essentially highly multivariate, nonlinear regressions) on a very large sample of high-quality co-located data from the center of the TRMM swath, 3D radar reflectivity and derived parameters (VIL, IWC, Echo Tops, etc.) can be retrieved across the entire TMI swath, good to 8-9% over the dynamic range of parameters. As a step in the retrieval (and as an output of the process), each TMI multifrequency pixel (at 85 GHz resolution) is classified into one of the 25 archetypal radar profile vertical structure "types", previously identified using cluster analysis. The dynamic range of retrieved vertical structure appears to have higher fidelity than the current (Version 6) experimental GPROF hydrometeor vertical structure retrievals. This is attributable to correct representation of the prior probabilities of vertical structure variability in the neural network training data, unlike the GPROF cloud-resolving model training dataset used in the V6 algorithms. The LIS lightning inputs are supplementary inputs, and a separate offline neural network has been trained to impute (predict) LIS lightning from passive-microwave-only data. The virtual radar retrieval is thus, in principle, extensible to Aqua/AMSR-E and NPOESS/CMIS passive microwave instruments. The virtual radar approach yields a threefold increase in effective sampling from the mission, albeit of lower-quality "retrieved" data, reducing the variance of local estimates by one third (or the standard deviation by-0.57). In this talk, the variance reduction is leveraged to more finely resolve global diurnal variability in both space and time (local hour).

Boccippio, Dennis J.↗
NASA NTRS2016

Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties

Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.

spectroscopy↗
NASA NTRSDate not supplied

Assessment of Segmentation-Induced Deviations of Porosity Metrics in Powder Bed Fusion Additively Manufactured Components

Post processing X-ray computational tomography (CT) inspection data for additively manufactured (AM) components can induce deviations in defect quantification, affecting subsequent fatigue and failure predictions. To assess the influence and potential impact of segmentation-induced measurement deviations, this paper applies several segmentation techniques to X-ray CT data for powder bed fusion Ti-6Al-4V specimens exhibiting porosity conditions. X-ray CT reconstructions were segmented with varying techniques including Otsu’s thresholding, random forest, k-nearest neighbors, and the multilayer perceptron. Metrics such as pore size and global porosity were compared for internal validity. Then, top-down X-ray CT measurements of surface-breaking porosity were compared to optical profilometry for cross-validation.

Data fusion↗
NASA NTRS1998

Report of the Cost Assessment and Validation Task Force on the International Space Station

The Cost Assessment and Validation (CAV) Task Force was established for independent review and assessment of cost, schedule and partnership performance on the International Space Station (ISS) Program. The CAV Task Force has made the following key findings: The International Space Station Program has made notable and reasonable progress over the past four years in defining and executing a very challenging and technically complex effort. The Program size, complexity, and ambitious schedule goals were beyond that which could be reasonably achieved within the $2.1 billion annual cap or $17.4 billion total cap. A number of critical risk elements are likely to have an adverse impact on the International Space Station cost and schedule. The schedule uncertainty associated with Russian implementation of joint Partnership agreements is the major threat to the ISS Program. The Fiscal Year (FY) 1999 budget submission to Congress is not adequate to execute the baseline ISS Program, cover normal program growth, and address the known critical risks. Additional annual funding of between $130 million and $250 million will be required. Completion of ISS assembly is likely to be delayed from one to three years beyond December 2003.

Source record↗
NASA NTRS1998

Cost Assessment and Validation Task Force on the International Space Station

The Cost Assessment and Validation (CAV) Task Force was established for independent review and assessment of cost, schedule and partnership performance on the International Space Station (ISS) Program. The CAV Task Force has made the following key findings: The International Space Station Program has made notable and reasonable progress over the past four years in defining and executing a very challenging and technically complex effort; The Program, size, complexity, and ambitious schedule goals were beyond that which could be reasonably achieved within the $2.1 billion annual cap or $17.4 billion total cap; A number of critical risk elements are likely to have an adverse impact on the International Space Station cost and schedule; The schedule uncertainty associated with Russian implementation of joint Partnership agreements is the major threat to the ISS Program; The Fiscal Year (FY) 1999 budget submission to Congress is not adequate to execute the baseline ISS Program, cover normal program, growth, and address the known critical risks. Additional annual funding of between $130 million and $250 million will be required; and Completion of ISS assembly is likely to be delayed from, one to three years beyond December 2003.

Source record↗
NASA NTRSDate not supplied

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) Validation of Ozone and Water Vapor Data

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed four years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. Recently, the latest version 5.2 data product has been released to the public. This presentation shows the validation results of comparing v5.2 SAGE III/ISS ozone and water vapor vertical profiles with those of in situ and satellite data.

SAGE Stratosphere Stratospheric Mesospheric Ozone ↗
NASA NTRSDate not supplied

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS): Validation of Ozone Using In-situ Measurements

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed four years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the validation results of comparing SAGE III/ISS ozone vertical profiles from the newly released v5.2 science product with those of balloon launched ozonesonde and frost point hygrometer measurements, LIDAR, and satellite data from the Microwave Limb Sounder.

stratospheric ozone↗
NASA NTRSDate not supplied

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) Validation of the Latest Version 5.2 Data Products

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed over three and a half years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the improvements to the SAGE water vapor product with the release of the newest data version. It also focuses on validation by comparing SAGE III/ISS v5.2 ozone and water vapor vertical profiles with those of in situ and satellite data.

SAGE↗
NASA NTRSDate not supplied

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) Validation of Three Years of Ozone and Water Vapor Data

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed three years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the validation results of comparing SAGE III/ISS ozone and water vapor vertical profiles with those of in situ and satellite data.

stratospheric ozone↗
NASA NTRSDate not supplied

Stratospheric Aerosol and Gas Experiment III on the International Space Station(SAGE III/ISS) Validation of Three Years of Ozone and Water Vapor Data

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed three years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the validation results of comparing SAGE III/ISS ozone and water vapor vertical profiles with those of in situ and satellite data.

SAGE III ISS ozone water vapor validation↗