Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Benchmark Shock Tube Experiments for Radiative Heating Relevant to Earth Re-Entry

Detailed spectrally and spatially resolved radiance has been measured in the Electric Arc Shock Tube (EAST) facility for conditions relevant to high speed entry into a variety of atmospheres, including Earth, Venus, Titan, Mars and the Outer Planets. The tests that measured radiation relevant for Earth re-entry are the focus of this work and are taken from campaigns 47, 50, 52 and 57. These tests covered conditions from 8 km/s to 15.5 km/s at initial pressures ranging from 0.05 Torr to 1 Torr, of which shots at 0.1 and 0.2 Torr are analyzed in this paper. These conditions cover a range of points of interest for potential fight missions, including return from Low Earth Orbit, the Moon and Mars. The large volume of testing available from EAST is useful for statistical analysis of radiation data, but is problematic for identifying representative experiments for performing detailed analysis. Therefore, the intent of this paper is to select a subset of benchmark test data that can be considered for further detailed study. These benchmark shots are intended to provide more accessible data sets for future code validation studies and facility-to-facility comparisons. The shots that have been selected as benchmark data are the ones in closest agreement to a line of best fit through all of the EAST results, whilst also showing the best experimental characteristics, such as test time and convergence to equilibrium. The EAST data are presented in different formats for analysis. These data include the spectral radiance at equilibrium, the spatial dependence of radiance over defined wavelength ranges and the mean non-equilibrium spectral radiance (so-called 'spectral non-equilibrium metric'). All the information needed to simulate each experimental trace, including free-stream conditions, shock time of arrival (i.e. x-t) relation, and the spectral and spatial resolution functions, are provided.

Shock Tube↗

A new approach for determining fully empirical altimeter wind speed model functions

A statistical technique is developed for determining fully empirical model functions relating altimeter backscatter (sigma(sub 0)) measurements to near-surface neutral stability wind speed. By assuming that sigma(sub 0) varies monotonically and uniquely with wind speed, the method requires knowledge only of the separate, rather than joint distribution functions of sigma(sub 0) and wind speed. Analytic simplifications result from using a Weibull distribution to approximate the global ocean wind speed distribution; several different wind data sets are used to demonstrate the validity of the Weibull approximation. The technique has been applied to 1 year of Geosat data. Validation of the new and historical model functions using an independent buoy data set demonstrates that the present model function not only has small overall bias and root mean square (RMS) errors, but yields smaller systematic error trends with wind speed and pseudowave age than previously published models. The present analysis suggests that generally accuracte altimeter model functions can be derived without the use of colocated measurements, nor is additional significant wave height information measured by the altimeter necessary.

Freilich, M. H.↗

Detecting change as it occurs

Traditionally climate changes have been detected from long series of observations and long after they have happened. Our 'inverse sequential' procedure, for detecting change as soon as it occurs, describes the existing or most recent data by their frequency distribution. Its parameter(s) are estimated both from the existing set of observations and from the same set augmented by 1,2,....j new observations. Individual-value probability products ('likelihoods') are used to form ratios which yield two probabilities for erroneously accepting the existing parameter(s) as valid for the augmented data set, and vice versa. A genuine parameter change is signaled when these probabilities (or a more stable compound probability) show a progressive decrease. New parameter values can then be estimated from the new observations alone using standard statistical techniques. The inverse sequential procedure will be illustrated for global annual mean temperatures (assumed normally distributed), and for annual numbers of North Atlantic hurricanes (assumed to represent Poisson distributions). The procedure was developed, but not yet tested, for linear or exponential trends, and for chi-squared means or degrees of freedom, a special measure of autocorrelation.

Radok, Uwe↗

Land Surface Temperature Product Validation Best Practice Protocol Version 1.0 - October, 2017

The Global Climate Observing System (GCOS) has specified the need to systematically generate andvalidate Land Surface Temperature (LST) products. This document provides recommendations on goodpractices for the validation of LST products. Internationally accepted definitions of LST, emissivity andassociated quantities are provided to ensure the compatibility across products and reference data sets. Asurvey of current validation capabilities indicates that progress is being made in terms of up-scaling and insitu measurement methods, but there is insufficient standardization with respect to performing andreporting statistically robust comparisons.Four LST validation approaches are identified: (1) Ground-based validation, which involvescomparisons with LST obtained from ground-based radiance measurements; (2) Scene-based intercomparisonof current satellite LST products with a heritage LST products; (3) Radiance-based validation,which is based on radiative transfer calculations for known atmospheric profiles and land surface emissivity;(4) Time series comparisons, which are particularly useful for detecting problems that can occur during aninstrument's life, e.g. calibration drift or unrealistic outliers due to undetected clouds. Finally, the need foran open access facility for performing LST product validation as well as accessing reference LST datasets isidentified.

best practice↗

Comparison of DMSP SSM/I and Landsat 7 ETM+ Sea Ice Concentrations During Summer Melt

As part of NASA's EOS Aqua sea ice validation program for the Advanced Microwave Scanning Radiometer (AMSR-E), Landsat 7 Enhanced Thematic Mapper (ETM+) images were acquired to develop a sea ice concentration data set with which to validate AMSR-E sea ice concentration retrievals. The standard AMSR-E Arctic sea ice concentration product will be obtained with the enhanced NASA Team (NT2) algorithm. The goal of this study is to assess the accuracy to which the NT2 algorithm, using DMSP Special Sensor Microwave Imager radiances, retrieves sea ice concentrations under summer melt conditions. Melt ponds are currently the largest source of error in the determination of Arctic sea ice concentrations with satellite passive microwave sensors. To accomplish this goal, Landsat 7 ETM+ images of Baffin Bay were acquired under clear sky conditions on the 26th and 27th of June 2000 and used to generate high-resolution sea ice concentration maps with which to compare the NT2 retrievals. Based on a linear regression analysis of 116 25-km samples, we find that overall the NT2 retrievals agree well with the Landsat concentrations. The regression analysis yields a correlation coefficient of 0.98. In areas of high melt ponding, the NT2 retrievals underestimate the sea ice concentrations by about 12% compared to the Landsat values.

Cavalieri, Donald J.↗

A New Sea Ice Model: Pancakes to Metrics

We are developing, testing, and validating a new sea ice dynamics model that treats the ice cover as an elastic/decohesive material in the permanent pack and includes the correct frazil/pancake behavior in the marginal zone. Two salient features of present ice dynamics models are that they do not: 1) reproduce the oriented fracture patterns of openings and closings in the pack ice, and 2) accurately model the effects of frazil/pancake ice formation in the ice margin. These poorly modeled areas account for a substantial portion of the ice growth, turbulent heat flux to the atmosphere, salt flux to the ocean, and energy dissipation due to slippage, ridging, and rafting, in the Arctic. Existing sea ice models have shown limited success in predicting the degree to which a lead will open for prescribed or observed forcing conditions. An important aspect of the new model we are developing is that the existence of cracks, along with their orientation, opening, and closing, is predicted. To put this effort in perspective a short history of ice dynamics modeling and data collection is presented. The RGPS data set is used to validate the model. As part of the testing and validation of the model, we are working on a new metric for comparing linear features (leads and ridges) in the data and model to be used in data assimilation for this model. The model framework is presented as well as some results showing the creation and development of leads in a simulation of ice dynamics in the Beaufort Sea. Other presentations by the authors will show other results from this effort.

Coon, M.↗

Spectrally and Radiometrically Stable Wide-Band on Board Calibration Source for In-Flight Data Validation in Imaging Spectroscopy Applications

The quality of the quantitative spectral data collected by an imaging spectrometer instrument is critically dependent upon the accuracy of the spectral and radiometric calibration of the system. In order for the collected spectra to be scientifically useful, the calibration of the instrument must be precisely known not only prior to but during data collection. Thus, in addition to a rigorous in-lab calibration procedure, the airborne instruments designed and built by the NASA/JPL Imaging Spectroscopy Group incorporate an on board calibrator (OBC) system with the instrument to provide auxiliary in-use system calibration data. The output of the OBC source illuminates a target panel on the backside of the foreoptics shutter both before and after data collection. The OBC and in-lab calibration data sets are then used to validate and post-process the collected spectral image data. The resulting accuracy of the spectrometer output data is therefore integrally dependent upon the stability of the OBC source. In this paper we describe the design and application of the latest iteration of this novel device developed at NASA/JPL which integrates a halogen-cycle source with a precisely designed fiber coupling system and a fiber-based intensity monitoring feedback loop. The OBC source in this Airborne Testbed Spectrometer was run over a period of 15 hours while both the radiometric and spectral stabilities of the output were measured and demonstrated stability to within 1% of nominal.

visible spectrometers↗

LAPS Lidar Measurements at the ARM Alaska Northslope Site (Support to FIRE Project)

This report consists of data summaries of the results obtained during the May 1998 measurement period at Barrow Alaska. This report does not contain any data interpretation or analysis of the results which will follow this activity. This report is forwarded with a data set on magnetic media which contains the reduced data from the LAPS lidar in 15 minute intervals. The data was obtained during the period 15-30 May 1998. The measurement period overlapped with several aircraft flights conducted by NASA as part of the FIRE project. The report contains a summary list of the data obtained plus figures that have been prepared to help visualize the measurement periods. The order of the presentation is as follows: Section 1. A copy of the Statement of Work for the planned activity of the second measurement period at the ARM Northslope site is provided. Section 2. A list of the data collection periods shows the number of one minute data records stored during each hour of operation and the corresponding size (Mbytes) of the one hour data folders. The folder and file names are composed from the year, month, day, hour and minute. The date/time information is given in UTC for easier comparison with other data sets. Section 3. A set of 4 comparisons between the LAPS lidar results and the sondes released by the ARM scientists from a location nearby the lidar. The lidar results show the +/- 1 sigma statistical error on each of the independent 75 m altitude bins of the data. This set of 4 comparisons was used to set and validate the calibration value which was then used for the complete data set. Section 4. A set of false color figures with up to 10 hours of specific humidity measurements are shown in each graph. Two days of measurements are shown on each page. These plots are crude representations of the data and permit a survey which indicates when the clouds were very low or where interesting events may occur in the results. These plots are prepared using the real time sequence plot program which has no smoothing in either the altitude or time (except that you are allowed to pick the integration time and time step. All of these plots were prepared with 15 minute integration and 5 minute time step. Section 5. A set of time sequence data for all of the extended observation periods are shown with a smoothing algorithm from the Matlab plotting library. Most of these data are integrated for 5 minutes and stepped at I minute intervals but several plots are shown with both 15 minute integration and 5 minute steps. The upper level on these data was selected and converted to the white background where the error in the specific humidity reached 25%. Section 6. The set of one hour integrated plots shown with up to 4 hours per page are provided- from the real time analysis snapshot program. The only difference in these plots and the real time display is that the plots are stopped at an altitude where the error appears to be too large for the data to contain any meaningful information.

Philbrick, C. Russell↗

Invited review: gender issues related to spaceflight: a NASA perspective

This minireview provides an overview of known and potential gender differences in physiological responses to spaceflight. The paper covers cardiovascular and exercise physiology, barophysiology and decompression sickness, renal stone risk, immunology, neurovestibular and sensorimotor function, nutrition, pharmacotherapeutics, and reproduction. Potential health and functional impacts associated with the various physiological changes during spaceflight are discussed, and areas needing additional research are highlighted. Historically, studies of physiological responses to microgravity have not been aimed at examining gender-specific differences in the astronaut population. Insufficient data exist in most of the discipline areas at this time to draw valid conclusions about gender-specific differences in astronauts, in part due to the small ratio of women to men. The only astronaut health issue for which a large enough data set exists to allow valid conclusions to be drawn about gender differences is orthostatic intolerance following shuttle missions, in which women have a significantly higher incidence of presyncope during stand tests than do men. The most common observation across disciplines is that individual differences in physiological responses within genders are usually as large as, or larger than, differences between genders. Individual characteristics usually outweigh gender differences per se.

NASA Discipline General Space Life Sciences↗

Inverse sequential procedures for the monitoring of time series

Climate changes traditionally have been detected from long series of observations and long after they happened. The 'inverse sequential' monitoring procedure is designed to detect changes as soon as they occur. Frequency distribution parameters are estimated both from the most recent existing set of observations and from the same set augmented by 1,2,...j new observations. Individual-value probability products ('likelihoods') are then calculated which yield probabilities for erroneously accepting the existing parameter(s) as valid for the augmented data set and vice versa. A parameter change is signaled when these probabilities (or a more convenient and robust compound 'no change' probability) show a progressive decrease. New parameters are then estimated from the new observations alone to restart the procedure. The detailed algebra is developed and tested for Gaussian means and variances, Poisson and chi-square means, and linear or exponential trends; a comprehensive and interactive Fortran program is provided in the appendix.

Radok, Uwe↗

Improved Algorithms for Accurate Retrieval of UV - Visible Diffuse Attenuation Coefficients in Optically Complex, Inshore Waters

Photochemical processes driven by high-energy ultraviolet radiation (UVR) in inshore, estuarine, and coastal waters play an important role in global bio geochemical cycles and biological systems. A key to modeling photochemical processes in these optically complex waters is an accurate description of the vertical distribution of UVR in the water column which can be obtained using the diffuse attenuation coefficients of down welling irradiance (Kd()). The Sea UV Sea UVc algorithms (Fichot et al., 2008) can accurately retrieve Kd ( 320, 340, 380,412, 443 and 490 nm) in oceanic and coastal waters using multispectral remote sensing reflectances (Rrs(), Sea WiFS bands). However, SeaUVSeaUVc algorithms are currently not optimized for use in optically complex, inshore waters, where they tend to severely underestimate Kd(). Here, a new training data set of optical properties collected in optically complex, inshore waters was used to re-parameterize the published SeaUVSeaUVc algorithms, resulting in improved Kd() retrievals for turbid, estuarine waters. Although the updated SeaUVSeaUVc algorithms perform best in optically complex waters, the published SeaUVSeaUVc models still perform well in most coastal and oceanic waters. Therefore, we propose a composite set of SeaUVSeaUVc algorithms, optimized for Kd() retrieval in almost all marine systems, ranging from oceanic to inshore waters. The composite algorithm set can retrieve Kd from ocean color with good accuracy across this wide range of water types (e.g., within 13 mean relative error for Kd(340)). A validation step using three independent, in situ data sets indicates that the composite SeaUVSeaUVc can generate accurate Kd values from 320 490 nm using satellite imagery on a global scale. Taking advantage of the inherent benefits of our statistical methods, we pooled the validation data with the training set, obtaining an optimized composite model for estimating Kd() in UV wavelengths for almost all marine waters. This optimized composite set of SeaUVSeaUVc algorithms will provide the optical community with improved ability to quantify the role of solar UV radiation in photochemical and photobiological processes in the ocean.

UV↗

SAGE II aerosol data validation - Comparative studies of SAGE II and SAM II data sets

Data from the Stratospheric Aerosol and Gas Experiment (SAGE II) satellite are compared with data from the Stratospheric Aerosol Measurement (SAM II) satellite. Both experiments produce aerosol extinction profiles by measuring the attenuation of solar radiation during each sunrise and sunset observed by the satelltie. The SAGE II obtains profiles at 1.02 microns and three smaller wavelengths, whereas the SAM II measures at only one radiometric channel at 1.0 microns. It is found that the differences between the two sets of data are generally within the error bars associated with each measurement. In addition, the sunrise and sunset data from SAGE II are analyzed.

Yue, G. K.↗

Vertical ozone profile results from the Nimbus-4 BUV data

A seven year data set which consists of both total ozone and ozone vertical profiles has been derived from the Nimbus-4 Backscatter Ultraviolet (BUV) experiment. The BUV experiment measures the earth's backscattered solar radiance at 12 wavelengths in the Hartley-Huggins band. The shortest 8 bands are used to determine the vertical ozone profile. The longest four bands are used to determine the total ozone. The present investigation provides a review of the major characteristics of the instrument performance and ozone results during the seven year period of the data set. Attention is given to the data coverage in time and space, the major areas of nonhomogeneous coverage, adjustments made to the basic instrument radiances, long-term trends in the radiances, rocket and balloon measurements, and problems associated with the validation of the satellite data set.

Fleig, A. J.↗

BOREAS RSS-7 LAI, Gap Fraction, and FPAR Data

The BOREAS RSS-7 team collected various data sets to develop and validate an algorithm to allow the retrieval of the spatial distribution of Leaf Area Index (LAI) from remotely sensed images. Ground measurements of LAI and Fraction of Photosynthetically Active Radiation (FPAR) absorbed by the plant canopy were made using the LAI-2000 and TRAC optical instruments during focused periods from 09-Aug-1993 to 19-Sep-1994. The measurements were intensive at the NSA and SSA tower sites, but were made just once or twice at auxiliary sites. The final processed LAI and FPAR data set is contained in tabular ASCII files. The data files are available on a CD-ROM (see document number 20010000884).

Hall, Forrest G.↗

Computation of diffuse sky irradiance from multidirectional radiance measurements

Accurate determination of the diffuse solar spectral irradiance directly above the land surface is important in characterizing the reflectance properties of these surfaces, especially vegetation canopies. This determination is also needed to infer the net radiation budget of the earth-atmosphere system above these surfaces. An algorithm is developed here for the computation of hemispheric diffuse irradiance using the measurements from an instrument called PARABOLA, which rapidly measures upwelling and downwelling radiances in three selected wavelength bands. The validity of the algorithm is established from simulations. The standard reference data set of diffuse radiances of Dave (1978), obtained by solving the radiative transfer equation numerically for realistic atmospheric models, is used to simulate PARABOLA radiances. Hemispheric diffuse irradiance is estimated from a subset of simulated radiances by using the algorithm described. The algorithm is validated by comparing the estimated diffuse irradiance with the true diffuse irradiance of the standard data set. The validations include sensitivity studies for two wavelength bands (visible, 0.65-0.67 micron; near infrared, 0.81-0.84 micron), different atmospheric conditions, solar elevations, and surface reflectances. In most cases the hemispheric diffuse irradiance computed from simulated PARABOLA radiances and the true irradiance obtained from radiative transfer calculations agree within 1-2 percent. This technique can be applied to other sampling instruments designed to estimate hemispheric diffuse sky irradiance.

Ahmad, Suraiya P.↗

Behavior of Spinning Space Vehicles with Onboard Liquids, 2nd Edition, Technical Report B8030

Although the fundamental principles of spin stabilization are well established, uncertainty regarding the potential for rapid nutation growth caused by onboard liquids is a continuing concern. NASA and other organizations regularly encounter the issue of rapid nutation growth due to energy dissipation by liquids on spinning vehicles. Of concern is the stability of spinning upper stages and of spacecraft that spin for part or all of their missions. Several missions have required last-minute hardware or operational changes to deal with rapid nutation divergences that were identified late in the program. In some instances, major schedule slips were barely averted. In at least two cases, it was determined that a spinning upper stage was not a viable option. Historically, the "slosh" issue has been addressed by each space vehicle project individually, if it has been addressed at all. Due to budgetary and programmatic constraints, individual projects are unable to address the problem globally. Hence, there has been little effort to collect available test and flight data and use that data to make a coherent, unified picture of the "slosh" effect and how to deal with it. To some extent, each project has had to "reinvent the wheel", which can be both costly and risky. This study is a step toward correcting the situation. Specifically, the goal was to identify and collect available flight and test data for spinning vehicles with onboard liquid propellants. A total of 149 flight data points and 1,692 test points were collected as part of this study. This data was analyzed, correlated, and is presented here in a normalized form. In most cases, the normalization involves a dimensionless nutation time constant that can be used to predict performance of other vehicles with the same type of tank. For some configurations, it was also possible to identify conditions that can lead to resonance between nutational motion and liquid modes. Gaps in the knowledge base are identified and approaches to filling those gaps are outlined. The data presented here has two different but related uses. First, it can be applied directly to current and future spacecraft programs. Second, it can provide truth models for testing analytical techniques. Experience has shown that purely analytical models of the liquid "slosh" effect on spinning vehicles are unreliable unless they are validated against flight or test data. To the author's knowledge, this report contains the most extensive and varied data set available. As such, it should be a good resource for anyone seeking to develop and validate improved analytical techniques. All of the original digital data sets have been archived on disk, with copies provided to NASA/KSC. With some restrictions, many of these data sets can be made available to researchers within the United States. Whenever possible, spacecraft are identified by name in this report. However, several organizations provided access to data with the explicit proviso that their programs not be identified and that parameters be presented only in normalized form. These constraints have been respected.

Hubert, Carl↗

AMSR2 Soil Moisture Product Validation

The Advanced Microwave Scanning Radiometer 2 (AMSR2) is part of the Global Change Observation Mission-Water (GCOM-W) mission. AMSR2 fills the void left by the loss of the Advanced Microwave Scanning Radiometer Earth Observing System (AMSR-E) after almost 10 years. Both missions provide brightness temperature observations that are used to retrieve soil moisture. Merging AMSR-E and AMSR2 will help build a consistent long-term dataset. Before tackling the integration of AMSR-E and AMSR2 it is necessary to conduct a thorough validation and assessment of the AMSR2 soil moisture products. This study focuses on validation of the AMSR2 soil moisture products by comparison with in situ reference data from a set of core validation sites. Three products that rely on different algorithms were evaluated; the JAXA Soil Moisture Algorithm (JAXA), the Land Parameter Retrieval Model (LPRM), and the Single Channel Algorithm (SCA). Results indicate that overall the SCA has the best performance based upon the metrics considered.

microwave↗

System diagnostic builder

The System Diagnostic Builder (SDB) is an automated software verification and validation tool using state-of-the-art Artificial Intelligence (AI) technologies. The SDB is used extensively by project BURKE at NASA-JSC as one component of a software re-engineering toolkit. The SDB is applicable to any government or commercial organization which performs verification and validation tasks. The SDB has an X-window interface, which allows the user to 'train' a set of rules for use in a rule-based evaluator. The interface has a window that allows the user to plot up to five data parameters (attributes) at a time. Using these plots and a mouse, the user can identify and classify a particular behavior of the subject software. Once the user has identified the general behavior patterns of the software, he can train a set of rules to represent his knowledge of that behavior. The training process builds rules and fuzzy sets to use in the evaluator. The fuzzy sets classify those data points not clearly identified as a particular classification. Once an initial set of rules is trained, each additional data set given to the SDB will be used by a machine learning mechanism to refine the rules and fuzzy sets. This is a passive process and, therefore, it does not require any additional operator time. The evaluation component of the SDB can be used to validate a single software system using some number of different data sets, such as a simulator. Moreover, it can be used to validate software systems which have been re-engineered from one language and design methodology to a totally new implementation.

Nieten, Joseph L.↗