Search NASA⌕ Search

SEARCH · Search NASA

Results for “quantitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Cassini-Huygens Probe Gas Chromatograph Mass Spectrometer (GCMS) Experiment: First Results

The Huygens Probe of the Cassini Huygens Mission entered the atmosphere of the moon Titan on January 14, 2005. The GCMS was part of the instrument complement on the probe to measure in situ the chemical composition of the atmosphere during the probe descent and to support the Aerosol Collector Pyrolyzer (ACP) experiment by serving as detector for the pyrolization products. The GCMS collected data from an altitude of 146 km to ground impact for a time interval of 2hours and 37minutes. The Probe and the GCMS survived the ground impact and collected data for 1hour and 9 minutes on the surface in the near surface environment until signal loss by the orbiter. The major constituents of the lower atmosphere were found to be N2 and CH4. The methane-mixing ratio was found to increase below the turbopause, about 35 km altitude, monotonically toward the surface to levels near saturation. After surface impact a steep increase of the mixing ratio was observed suggesting evaporation of surface condensed methane due to heating by the GCMS sample inlet heater. Other constituents were found to be in very low concentrations, below ppm levels. The presence of Argon 40 was confirmed. The results for the other noble gases are still being evaluated. Other hydrocarbons and nitriles were also observed and quantitative evaluation is in progress. Preliminary ratios for the major carbon and nitrogen isotopes were computed from methane and molecular nitrogen measurements. The instrument collected 5634 mass spectra during descent and 2692 spectra on the ground over a range of m/z from 2 to 141. Eight gas chromatograph samples were taken during the descent and two on the ground.

Niemann, H.↗

The Gas Chromatograph Mass Spectrometer (GCMS) Experiment on the Cassini-Huygens Probe: First Results

The Huygens Probe of the Cassini Huygens Mission entered the atmosphere of the moon Titan on January 14, 2005. The GCMS was part of the instrument complement on the Probe to measure in situ the chemical composition of the atmosphere during the probe descent and to support the Aerosol Collector Pyrolyzer (ACP) experiment by serving as detector for the pyrolization products. The GCMS collected data from an altitude of 146 km to ground impact for a time interval of 2 hours and 37 minutes. The Probe and the GCMS survived the ground impact and collected data for 1 hour and 9 minutes on the surface in the near surface environment until signal loss by the orbiter. The instrument collected 5634 mass spectra during descent and 2692 spectra on the ground over a range of m/z from 2 to 141. Eight gas chromatograph samples were taken during the descent and two on the ground. This is a report on work in progress. The major constituents of the lower atmosphere were found to be N2 and CH4. The methane-mixing ratio was found to increase below the turbopause, about 35 km altitude, monotonically toward the surface to levels near saturation. After surface impact a steep increase of the mixing ratio was observed suggesting evaporation of surface condensed methane due to heating by the GCMS sample inlet heater. Other constituents were found to be in very low concentrations, below ppm levels. The presence of Argon 40 was confirmed. The results for the other noble gases are still being evaluated. Other hydrocarbons and nitriles were also observed and quantitative evaluation is in progress. Preliminary ratios for the major carbon and nitrogen isotopes were computed from methane and molecular nitrogen measurements.

Niemann, H.↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavordsky, Bradley↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavodsky, Bradley↗

Performance evaluation of fault-tolerant systems with application to the IUS

A new method for quantitatively evaluating the performance of fault-tolerant systems is developed and applied to an example. The method assumes that the random failure and diagnostic decision behavior of the system can be modeled by a finite state Markov process. A performance value must be assigned to each of the states of the model. The method then generates the moments of the probability mass function of the cumulative performance and uses these to generate a maximum entropy approximation to the performance PMF. Some computational considerations are discussed. The method is applied to a typical mission for the Inertial Upper Stage to examine the attitude accuracy performance of the inertial system.

Missana, J.-O.↗

Evaluation of vegetation effects on the generation and modification of mesoscale circulations

The effects of the presence of vegetation cover on modifying sea breeze and thermally induced upslope flows during daytime were investigated, and the possibility of the generation of mesoscale circulations due to nonuniform vegetation cover was evaluated. Scale analysis and numerical model simulations were used to provide quantitative evaluations of the circulations involved in the two vagetation effects, using several illustrative cases. The cases considered demonstrate that the impact of vegetated surfaces is highly dependent on the environmental conditions as well as vegetation characteristics.

Segal, M.↗

Evaluations of Thin Cirrus Contamination and Screening in Ground Aerosol Observations Using Collocated Lidar Systems

Cirrus clouds, particularly sub visual high thin cirrus with low optical thickness, are difficult to be screened in operational aerosol retrieval algorithms. Collocated aerosol and cirrus observations from ground measurements, such as the Aerosol Robotic Network (AERONET) and the Micro-Pulse Lidar Network (MPLNET), provide us with an unprecedented opportunity to examine the susceptibility of operational aerosol products to thin cirrus contamination. Quality assured aerosol optical thickness (AOT) measurements were also tested against the CALIPSO vertical feature mask (VFM) and the MODIS-derived thin cirrus screening parameters for the purpose of evaluating thin cirrus contamination. Key results of this study include: (1) Quantitative evaluations of data uncertainties in AERONET AOT retrievals are conducted. Although AERONET cirrus screening schemes are successful in removing most cirrus contamination, strong residuals displaying strong spatial and seasonal variability still exist, particularly over thin cirrus prevalent regions during cirrus peak seasons, (2) Challenges in matching up different data for analysis are highlighted and corresponding solutions proposed, and (3) Estimation of the relative contributions from cirrus contamination to aerosol retrievals are discussed. The results are valuable for better understanding and further improving ground aerosol measurements that are critical for aerosol-related climate research.

Huang, Jingfeng↗

A new method to evaluate human-robot system performance

One of the key issues in space exploration is that of deciding what space tasks are best done with humans, with robots, or a suitable combination of each. In general, human and robot skills are complementary. Humans provide as yet unmatched capabilities to perceive, think, and act when faced with anomalies and unforeseen events, but there can be huge potential risks to human safety in getting these benefits. Robots provide complementary skills in being able to work in extremely risky environments, but their ability to perceive, think, and act by themselves is currently not error-free, although these capabilities are continually improving with the emergence of new technologies. Substantial past experience validates these generally qualitative notions. However, there is a need for more rigorously systematic evaluation of human and robot roles, in order to optimize the design and performance of human-robot system architectures using well-defined performance evaluation metrics. This article summarizes a new analytical method to conduct such quantitative evaluations. While the article focuses on evaluating human-robot systems, the method is generally applicable to a much broader class of systems whose performance needs to be evaluated.

Space Flight/instrumentation↗

Contamination Control in Our Solar UV Sounding Rocket Projects: CLASP/CLASP2

In the CLASP / CLASP2 experiments, the contamination control was conducted mainly for the purpose of preventing molecular contamination. In particular, the organic contamination was successfully prevented. However, in the CLASP observation, the Lyα intensity decreased due to water molecules. Thus, we obtained the importance to evaluate the influence of molecules that can be easily removed and to quantitatively evaluate the vent path during the flight.

Kano, Ryouhei↗

Preliminary ride-quality evaluation of the HM.2 Hoverferry

The results of a forty-minute exposure of the HM.2 Hoverferry are presented. Quantitative evaluations were made from aft seats on the starboard side for a sea state considered calm and visually estimated at one-half to one foot. Since this type of craft is sensitive to sea state, the conclusions are based on ideal conditions. Some drawings are included.

Mcclurken, E. W., Jr.↗

Evaluation of Oxidation Damage in Thermal Barrier Coating Systems

A method based on the technique of dilatometry has been established to quantitatively evaluate the interfacial damage due to the oxidation in a thermal barrier coating system. Strain isolation and adhesion coefficients have been proposed to characterize the thermal barrier coating (TBC) performance based on its thermal expansion behavior. It has been found that, for a thermal barrier coating system consisting of ZrO2-8%Y2O3/FeCrAlY/4140 steel substrate, the oxidation of the bond coat and substrate significantly reduced the ceramic coating adherence, as inferred from the dilatometry measurements. The in-situ thermal expansion measurements under 30 deg C to 700 deg C thermal cycling in air showed that the adhesion coefficient, A(sub i) decreased by 25% during the first 35 oxidation cycles. Metallography showed that delamination occurred at both the ceramic/bond coat and bond coat/substrate interfaces. In addition, the strain isolation effect has been improved by increasing the FeCrAlY bond coat thickness. The strain isolation coefficient, Si, increased from about 0.04 to 0.25, as the bond coat thickness changed from 0.1 mm to 1.0 mm. It may be possible to design optimum values of strain isolation and interface adhesion coefficients to achieve the best TBC performance.

THERMAL PROPERTIES↗

Measuring the development process: A tool for software design evaluation

The design metrics evaluator (DME), a component of an automated software design analysis system, is described. The DME quantitatively evaluates software design attributes. Its use directs attention to areas of a procedure, module, or complete program having a high potential for error.

Moy, S. S.↗

Approach for service life extension of explosive devices for aircraft escape systems

Service life extension of explosive devices used in aircraft escape systems can achieve considerable savings. An overall approach is needed to challenge the logic of explosive component service extension from design to removal from service for evaluation. The purpose of the effort described in this paper was to develop a service-extension approach on explosive devices used in aircraft systems, supported by actual testing of representative candidate devices, to evaluate quantitatively the effects of service, age, and degradation, and allow responsible, conservative service life determinations. Evaluated were five explosive components: rigid and flexible explosive transfer lines, one-way transfers, flexible linear shaped charges, and initiation handles. The service extension approach generated in this effort is summarized by eight recommendations.

Bement, L. J.↗

Evaluating Global Emission Inventories of Biogenic Bromocarbons

Emissions of halogenated very short-lived substances (VSLS) are poorly constrained. However, their inclusion in global models is required to simulate a realistic inorganic bromine (Bry) loading in both the troposphere, where bromine chemistry perturbs global oxidizing capacity, and in the stratosphere, where it is a major sink for ozone (O3). We have performed simulations using a 3-D chemical transport model (CTM) including three top-down and a single bottom-up derived emission inventory of the major brominated VSLS bromoform (CHBr3) and dibromomethane (CH2Br2). We perform the first concerted evaluation of these inventories, comparing both the magnitude and spatial distribution of emissions. For a quantitative evaluation of each inventory, model output is compared with independent long-term observations at National Oceanic and Atmospheric Administration (NOAA) ground-based stations and with aircraft observations made during the NSF (National Science Foundation) HIAPER Pole-to-Pole Observations (HIPPO) project. For CHBr3, the mean absolute deviation between model and surface observation ranges from 0.22 (38 %) to 0.78 (115 %) parts per trillion (ppt) in the tropics, depending on emission inventory. For CH2Br2, the range is 0.17 (24 %) to 1.25 (167 %) ppt. We also use aircraft observations made during the 2011 Stratospheric Ozone: Halogen Impacts in a Varying Atmosphere (SHIVA) campaign, in the tropical western Pacific. Here, the performance of the various inventories also varies significantly, but overall the CTM is able to reproduce observed CHBr3 well in the free troposphere using an inventory based on observed sea-to-air fluxes. Finally, we identify the range of uncertainty associated with these VSLS emission inventories on stratospheric bromine loading due to VSLS (Br(VSLS/y)). Our simulations show Br(VSLS/y) ranges from approximately 4.0 to 8.0 ppt depending on the inventory. We report an optimized estimate at the lower end of this range (approximately 4 ppt) based on combining the CHBr3 and CH2Br2 inventories which give best agreement with the compilation of observations in the tropics.

bromocarbons↗

Shuttle payload minimum cost vibroacoustic tests

This paper is directed toward the development of the methodology needed to evaluate cost effective vibroacoustic test plans for Shuttle Spacelab payloads. Statistical decision theory is used to quantitatively evaluate seven alternate test plans by deriving optimum test levels and the expected cost for each multiple mission payload considered. The results indicate that minimum costs can vary by as much as $6 million for the various test plans. The lowest cost approach eliminates component testing and maintains flight vibration reliability by performing subassembly tests at a relatively high acoustic level. Test plans using system testing or combinations of component and assembly level testing are attractive alternatives. Component testing alone is shown not to be cost effective.

Stahle, C. V.↗

The use of multidate multichannel radiance data in urban feature analysis

Two images were obtained from thematic mappers on Landsats 4 and 5 over the Washington, DC area during November 1982 and March 1984. Selected training areas containing different types of urban land use were examined,one area consisting entirely of forest. Mean digital radiance values for each bandpass in each image were examined, and variances, standard deviations, and covariances between bandpasses were calculated. It has been found that two bandpasses caused forested areas to stand out from other land use types, especially for the November 1982 image. In order to evaluate quantitatively the possible utility of the principal components analysis in selected feature extraction, the eigenvectors were evaluated for principal axes rotations which rendered each selected land use type most separable from all other land use types. The evaluated eigenvectors were plotted as a function of land use type, whose order was decided by considering anticipated shadow component and by examining the relative loadings indicative of vegetation for each of the principal components for the different features considered. The analysis was performed for each seven-band image separately and for the two combined images. It was found that by combining the two images, more dramatic land use type separation could be obtained.

Duggin, M. J.↗

In-flight demonstration of a Real-Time Flush Airdata Sensing (RT-FADS) system

A prototype real-time flush airdata sensing (RT-FADS) system has been developed and flight tested at the NASA Dryden Flight Research Center. This system uses a matrix of pressure orifices on the vehicle nose to estimate airdata parameters in real time using nonlinear regression. The algorithm is robust to sensor failures and noise in the measured pressures. The RT-FADS system has been calibrated using inertial trajectory measurements that were bootstrapped for atmospheric conditions using meteorological data. Mach numbers as high as 1.6 and angles of attack greater than 45 deg have been tested. The system performance has been evaluated by comparing the RT-FADS to the ship system airdata computer measurements to give a quantitative evaluation relative to an accepted measurement standard. Nominal agreements of approximately 0.003 in Mach number and 0.20 deg in angle of attack and angle of sideslip have been achieved.

Whitmore, Stephen A.↗