Results for “validation data sets” — Page 6

NASA NTRS1976

Assessment of NDE Reliability Data

Twenty sets of relevant Nondestructive Evaluation (NDE) reliability data have been identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations has been formulated. A model to grade the quality and validity of the data sets has been developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, have been formulated for each NDE method. A comprehensive computer program has been written to calculate the probability of flaw detection at several confidence levels by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. Probability of detection curves at 95 and 50 percent confidence levels have been plotted for individual sets of relevant data as well as for several sets of merged data with common sets of NDE parameters.

Yee, B. G. W.↗

NASA NTRS2003

Validation of Spacecraft Active Cavity Radiometer Total Solar Irradiance (TSI) Long Term Measurement Trends Using Proxy TSI Least Squares Analyses

Long-term, incoming total solar irradiance (TSI) measurement trends were validated using proxy TSI values, derived from indices of solar magnetic activity. Spacecraft active cavity radiometers (ACR) are being used to measure longterm TSI variability, which may trigger global climate changes. The TSI, typically referred to as the solar constant, was normalized to the mean earth-sun distance. Studies of spacecraft TSI data sets confirmed the existence of a 0.1 %, long-term TSI variability component within a 10-year period. The 0.1% TSI variability component is clearly present in the spacecraft data sets from the 1984-2004 time frame. Typically, three overlapping spacecraft data sets were used to validate long-term TSI variability trends. However, during the years of 1978-1984, 1989-1991, and 1993-1996, three overlapping spacecraft data sets were not available in order to validate TSI trends. The TSI was found to vary with indices of solar magnetic activity associated with recent 10-year sunspot cycles. Proxy TSI values were derived from least squares analyses of the measured TSI variability with the solar indices of 10.7-cm solar fluxes, and with limb-darked sunspot fluxes. The resulting proxy TSI values were compared to the spacecraft ACR measurements of TSI variability to detect ACR instrument degradation, which may be interpreted as TSI variability. Analyses of ACR measurements and TSI proxies are presented primarily for the 1984-2004, Earth Radiation Budget Experiment (ERBE) ACR solar monitor data set. Differences in proxy and spacecraft measurement data sets suggest the existence of another TSI variability component with an amplitude greater than or equal to 0.5 Wm-2 (0.04%), and with a cycle of 20 years or more.

Lee, Robert Benjamin, III↗

NASA NTRS2020

How Long Is Too Long? Variogram Analysis of AERONET Data to Aid Aerosol Validation and Intercomparison Studies

Geophysical data sets derived from satellite sensors, ground/airborne instrumentation, and computational models are often compared against each other. A common example is the validation of satellite aerosol optical depth (AOD) retrievals against measurements from Aerosol Robotic Network (AERONET) Sun photometers. Spatiotemporal mismatch between data set sampling means that uncaptured variation in the underlying geophysical field introduces apparent disagreement into such comparisons, known as representation or collocation matchup uncertainty. This study uses variogram analysis of AERONET data to estimate temporal mismatch uncertainties and decorrelation time scales for the global AERONET record. As well as total AOD, the fine‐ and coarse‐mode AODs, Ångström Exponent (AE), and fine‐mode fraction (FMF) of AOD are analyzed. Globally, a time difference of 30 min typically induces from 0.011–0.035 variation in AOD. For total, fine, and coarse AODs the typical time to decorrelation is around 2–10 days. For AE and FMF it is 3–33 days; that is, aerosol systems often persist significantly longer than individual events in them. Biomass burning regions tend to show the largest and fastest subdaily AOD variability and also longest times to decorrelation. Some sites show significant season‐to‐season variations in behavior. These results can be used to inform site‐specific time collocation thresholds for aerosol validation analyses and account for temporal variation when estimating data set uncertainty. They also have implications for comparisons between different satellite products or models, data aggregation, and time series analyses. Results are provided on a site‐by‐site basis to facilitate use by other researchers.

satellite↗

NASA NTRS1981

The validation of LIMS ozone profiles using correlative rocket, ECC, and Dobson data sets

The Limb Infrared Monitor of the Stratosphere (LIMS) experiment is a limb scanning infrared sounder designed to measure vertical temperature profiles and the concentrations of key chemical compounds which are important in the stratospheric ozone-nitrogen photochemistry. Preliminary ozone profiles are being intercompared with correlative rocket and balloonsonde ozone data sets as part of the Nimbus 7 LIMS data validation activity. The LIMS ozone retrievals extend from the lower mesosphere to the tropopause (or cloud-top altitudes). In this paper, preliminary statistics of comparisons of ECC (electrochemical concentration cell) ozonesonde and rocket ozone profiles with LIMS ozone profiles are presented. ECC ozonesonde data taken at times of LIMS overpasses are also used to extend the LIMS retrieval down to ground level. Each combined profile is then integrated to obtain total column ozone. These integrated results are compared to Dobson data obtained at approximately the same time and location.

Remsberg, E. E.↗

NASA NTRS1993

Comparison Between Predicted and Experimentally Measured Flow Fields at the Exit of the SSME HPFTP Impeller

Validation of CFD codes is a critical first step in the process of developing CFD design capability. The MSFC Pump Technology Team has recognized the importance of validation and has thus funded several experimental programs designed to obtain CFD quality validation data. The first data set to become available is for the SSME High Pressure Fuel Turbopump Impeller. LDV Data was taken at the impeller inlet (to obtain a reliable inlet boundary condition) and three radial positions at the impeller discharge. Our CFD code, TASCflow, is used within the Propulsion and Commercial Pump industry as a tool for pump design. The objective of this work, therefore, is to further validate TASCflow for application in pump design. TASCflow was used to predict flow at the impeller discharge for flowrates of 80, 100 and 115 percent of design flow. Comparison to data has been made with encouraging results.

Bache, George↗

NASA NTRSDate not supplied

Aeroheating Testing of the Mars Sample Return Earth Entry System with Surface Roughness

The Mars Sample Return Earth Entry System is a mission concept which would be the first NASA entry vehicle to utilize a woven thermal protection system as well as a 52.5 degree sphere-cone forebody geometry. Due to its novel design, historic experimental data sets were insufficient to validate the models used to characterize the expected aerothermal environment. A wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project in the NASA Langley 20-Inch Mach 6 Air Tunnel in order to obtain validation data. The December 2023 test entry of this campaign sought to obtain thermographic data to capture the impact of supersonic flow near woven surface roughness elements on convective heating augmentation, which was the largest remaining uncertainty in aerothermal design of the Earth Entry System. Data obtained were in family with prior results obtained on identical woven patterns without supersonic flow present at roughness elements, and it was found that this presence of supersonic flow did not have a noticeable effect on surface convective heating augmentation. Data were directly leveraged to support the NASA Mars Sample Return flight program and this data set is valuable for validating computational solutions on roughness-resolved grids.

Mars Sample Return↗

NASA NTRSDate not supplied

Aeroheating Testing of the Mars Sample Return Earth Entry System with Surface Roughness

The Mars Sample Return Earth Entry System is a mission concept which would be the first NASA entry vehicle to utilize a woven thermal protection system as well as a 52.5 degree sphere-cone forebody geometry. Due to its novel design, historic experimental data sets were insufficient to validate the models used to characterize the expected aerothermal environment. A wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project in the NASA Langley 20-Inch Mach 6 Air Tunnel in order to obtain validation data. The December 2023 test entry of this campaign sought to obtain thermographic data to capture the impact of supersonic flow near woven surface roughness elements on convective heating augmentation, which was the largest remaining uncertainty in aerothermal design of the Earth Entry System. Data obtained were in family with prior results obtained on identical woven patterns without supersonic flow present at roughness elements, and it was found that this presence of supersonic flow did not have a noticeable effect on surface convective heating augmentation. Data were directly leveraged to support the NASA Mars Sample Return flight program and this data set is valuable for validating computational solutions on roughness-resolved grids.

Mars Sample Return↗

NASA NTRS2000

A Status Report on the SHADOZ (Southern Hemisphere Additional Ozonesondes) Project and Some Issues Affecting Ozone Climatology

SHADOZ aims to support the study of local and global patterns in stratospheric and tropospheric ozone and to provide a data set for the validation for satellite products and model calculations of ozone. Southern hemispheric tropical ozone is of particular interest because this region appears to have complex interplay among photochemical ozone formation (from biomass burning and lightning), stratospheric dynamics, convection and possibly cross-hemispheric transport. Balloon-borne ozone instrumentation (ozonesondes), joined with standard radiosondes for measurement of pressure, temperature and relative humidity, is used to collect profiles throughout the troposphere and lower- to mid-stratosphere. A network of 10 southern hemisphere tropical and subtropical stations, called the Southern Hemisphere ADditional OZonesondes (SHADOZ) project, has been established from operational sites to assemble sonde data for 1998-2000. A status report on the archive, with station operating characteristics, will be given, along with some operational issues that may affect data analysis and interpretation.

Thompson, Anne M.↗

NASA NTRS1999

Validation of the Land-Surface Energy Budget and Planetary Boundary Layer for Several Intensive field Experiments

Land-surface processes in a data assimilation system influence the lower troposphere and must be properly represented. With the recent incorporation of the Mosaic Land-surface Model (LSM) into the GEOS Data Assimilation System (DAS), the detailed land-surface processes require strict validation. While global data sources can identify large-scale systematic biases at the monthly timescale, the diurnal cycle is difficult to validate. Moreover, global data sets rarely include variables such as evaporation, sensible heat and soil water. Intensive field experiments, on the other hand, can provide high temporal resolution energy budget and vertical profile data for sufficiently long periods, without global coverage. Here, we evaluate the GEOS DAS against several intensive field experiments. The field experiments are First ISLSCP Field Experiment (FIFE, Kansas, summer 1987), Cabauw (as used in PILPS, Netherlands, summer 1987), Atmospheric Radiation Measurement (ARM, Southern Great Plains, winter and summer 1998) and the Surface Heat Budget of the Arctic Ocean (SHEBA, Arctic ice sheet, winter and summer 1998). The sites provide complete surface energy budget data for periods of at least one year, and some periods of vertical profiles. This comparison provides a detailed validation of the Mosaic LSM within the GEOS DAS for a variety of climatologic and geographic conditions.

Bosilovich, Michael G.↗

NASA NTRS1995

The use of LinkWinds for the validation and analysis of 14 years of Microwave Sounder Unit daily global temperature anomaly data

Temperature data derived from the Microwave Sounder Unit (MSU) provides an opportunity for investigating atmospheric temperatures on a global scale since 1979. Fourteen years of global data sets of daily temperature anomalies within the lower stratosphere and lower troposphere are being generated at NASA Marshall Space Flight Center. LinkWinds, a visualization/analysis package under development at NASA Jet Propulsion Laboratory, has been extremely useful for validating and analyzing these data sets. LinkWinds provides the ability to interactively scroll and animate through the 10,220 images of temporal data, to selectively slice and view the data along latitude, longitude, or temporal axes, to interactively analyze spatial and temporal variability within the data, and to perform correlative analysis between various elements of the data. These capabilities have been invaluable in allowing the recognition of processing artifacts, as well as the effects that physical phenomena, such as the El Ninos effects and the Mt. Pinatubo eruption, have had on atmospheric temperatures.

Botts, Michael E.↗

NASA NTRS1983

Three-dimensional viscous design methodology for advanced technology aircraft supersonic inlet systems

A broad program to develop advanced, reliable, and user oriented three-dimensional viscous design techniques for supersonic inlet systems, and encourage their transfer into the general user community is discussed. Features of the program include: (1) develop effective methods of computing three-dimensional flows within a zonal modeling methodology; (2) ensure reasonable agreement between said analysis and selective sets of benchmark validation data; (3) develop user orientation into said analysis; and (4) explore and develop advanced numerical methodology.

Anderson, B. H.↗

NASA NTRS1984

Three-dimensional viscous design methodology for advanced technology aircraft supersonic inlet systems

A broad program to develop advanced, reliable, and user oriented three-dimensional viscous design techniques for supersonic inlet systems, and encourage their transfer into the general user community is discussed. Features of the program include: (1) develop effective methods of computing three-dimensional flows within a zonal modeling methodology; (2) ensure reasonable agreement between said analysis and selective sets of benchmark validation data; (3) develop user orientation into said analysis; and (4) explore and develop advanced numerical methodology. Previously announced in STAR as N84-13190

Anderson, B. H.↗

NASA NTRS1989

Quantitative characterization of a nonreacting, supersonic combustor flowfield using unified, laser-induced iodine fluorescence

A calibrated, nonintrusive optical technique, laser-induced iodine fluorescence (LIIF) was used to quantify the steady, compressible flowfield of a nonreacting, supersonic combustor. The combustor was configured with single and staged, transverse-air injection into a supersonic-air freestream behind a rearward-facing step. Pressure, temperature, two-velocity components, and injectant mole fraction were measured with high spatial resolution in the three-dimensional flowfields. These experimental results provide a benchmark set of data for validation of computational fluid dynamic (CFD) codes being developed to model supersonic combustor flowfields.

Fletcher, D. G.↗

NASA NTRS1990

Injectant mole fraction measurements of transverse injection in constant area supersonic ducts

Planar measurements of the injectant mole fraction distribution in a nonreacting model SCRAMJET combustor have been made using a nonintrusive optical technique, laser-induced iodine fluorescence. The combustor geometry investigated in this work was staged, transverse sonic injection of air into Mach 2 and Mach 2.9 freestreams. Accurate three-dimensional surveys of the injectant mole fraction distribution for both freestream Mach numbers have been generated. These experimental measurements provide valuable insight into the fluid mechanics of the mixing process. The existence of streamwise vortices is shown to dominate the mixing in the injector nearfield while shock wave interactions with the injectant plume are seen to significantly enhance mixing downstream of the injectors. The effect of combustor Mach number on injectant mixing is found to be small for this geometry. These measurements provide an accurate data set for the validation of computational fluid dynamics codes being developed for the calculation of highly three-dimensional nonreacting supersonic combustor flow fields.

Hollo, Steven D.↗

NASA NTRS1991

The application of neural networks to the SSME startup transient

Feedforward neural networks were used to model three parameters during the Space Shuttle Main Engine startup transient. The three parameters were the main combustion chamber pressure, a controlled parameter, the high pressure oxidizer turbine discharge temperature, a redlined parameter, and the high pressure fuel pump discharge pressure, a failure-indicating performance parameter. Network inputs consisted of time windows of data from engine measurements that correlated highly to the modeled parameter. A standard backpropagation algorithm was used to train the feedforward networks on two nominal firings. Each trained network was validated with four additional nominal firings. For all three parameters, the neural networks were able to accurately predict the data in the validation sets as well as the training set.

Meyer, Claudia M.↗

NASA NTRS1991

The application of neural networks to the SSME startup transient

Feedforward neural networks were used to model three parameters during the Space Shuttle Main Engine startup transient. The three parameters were the main combustion chamber pressure, a controlled parameter, the high pressure oxidizer turbine discharge temperature, a redlined parameter, and the high pressure fuel pump discharge pressure, a failure-indicating performance parameter. Network inputs consisted of time windows of data from engine measurements that correlated highly to the modeled parameter. A standard backpropagation algorithm was used to train the feedforward networks on two nominal firings. Each trained network was validated with four additional nominal firings. For all three parameters, the neural networks were able to accurately predict the data in the validation sets as well as the training set.

Meyer, Claudia M.↗

NASA NTRS1992

A classification procedure for the effective management of changes during the maintenance process

During software operation, maintainers are often faced with numerous change requests. Given available resources such as effort and calendar time, changes, if approved, have to be planned to fit within budget and schedule constraints. In this paper, we address the issue of assessing the difficulty of a change based on known or predictable data. This paper should be considered as a first step towards the construction of customized economic models for maintainers. In it, we propose a modeling approach, based on regular statistical techniques, that can be used in a variety of software maintenance environments. The approach can be easily automated, and is simple for people with limited statistical experience to use. Moreover, it deals effectively with the uncertainty usually associated with both model inputs and outputs. The modeling approach is validated on a data set provided by NASA/GSFC which shows it was effective in classifying changes with respect to the effort involved in implementing them. Other advantages of the approach are discussed along with additional steps to improve the results.

Briand, Lionel C.↗

NASA NTRS2002

Coastal Atmosphere and Sea Time Series (CoASTS)

In this document, the first three years of a time series of bio-optical marine and atmospheric measurements are presented and analyzed. These measurements were performed from an oceanographic tower in the northern Adriatic Sea within the framework of the Coastal Atmosphere and Sea Time Series (CoASTS) project, an ocean color calibration and validation activity. The data set collected includes spectral measurements of the in-water apparent (diffuse attenuation coefficient, reflectance, Q-factor, etc.) and inherent (absorption and scattering coefficients) optical properties, as well as the concentrations of the main optical components (pigment and suspended matter concentrations). Clear seasonal patterns are exhibited by the marine quantities on which an appreciable short-term variability (on the order of a half day to one day) is superimposed. This short-term variability is well correlated with the changes in salinity at the surface resulting from the southward transport of freshwater coming from the northern rivers. Concentrations of chlorophyll alpha and total suspended matter span more than two orders of magnitude. The bio-optical characteristics of the measurement site pertain to both Case-I (about 64%) and Case-II (about 36%) waters, based on a relationship between the beam attenuation coefficient at 660nm and the chlorophyll alpha concentration. Empirical algorithms relating in-water remote sensing reflectance ratios and optical components or properties of interest (chlorophyll alpha, total suspended matter, and the diffuse attenuation coefficient) are presented.

Hooker, Stanford B.↗