Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors total quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Validation of Surface Skin Temperature and Moisture Profiles Using Satellite Data

New validation techniques and metrics using satellite data have been developed to evaluate the quality of model-based estimates of surface skin temperature (Tg) and moisture profiles (q). The satellite data consist of clear sky outgoing long-wave radiation (CLR), broadband radiances from 8 to 12 mu (RadWn), brightness temperature centered around 10.8 mu (Tbb), and total precipitable water (TPW) from microwave radiometry. We show that CLR can be used to diagnose Tg. Furthermore, by using a combination of CLR and RadWn from CERES-TRMM measurements and TPW from SSM/I, we are able to identify errors in the moisture profile. Finally, three-hourly Tbb from the International Satellite Cloud Climatology Project can be used to evaluate the amplitude and diurnal variation of Tg. For purpose of illustration, Tg and q are evaluated from runs with an early version of the Goddard Earth Observing System Data Assimilation System (GEOS-2). It is found that, in general, Tg is too cold in the winter hemisphere and q is too wet in the upper atmosphere. In order to address these deficiencies, several improvements have been implemented into GEOS-2, including a Land-Surface-Model, a Moist Turbulence Scheme, and the assimilation of new TOVS retrievals. Preliminary results indicate positive impacts from each of these implementations.

Wu, Man Li C.↗

A recent Cleanroom success story: The Redwing project

Redwing is the largest completed Cleanroom software engineering project in IBM, both in terms of lines of code and project staffing. The product provides a decision-support facility that utilizes artificial intelligence (AI) technology for predicting and preventing complex operating problems in an MVS environment. The project used the Cleanroom process for development and realized a defect rate of 2.6 errors/KLOC, measured from first execution. This represents the total amount of errors that were found in testing and installation at three field test sites. Development productivity was 486 LOC/PM, which included all development labor expended in design specification through completion of incremental testing. In short, the Redwing team produced a complex systems software product with an extraordinarily low error rate, while maintaining high productivity. All of this was accomplished by a project team using Cleanroom for the first time. An 'introductory implementation' of Cleanroom was defined and used on Redwing. This paper describes the quality and productivity results, the Redwing project, and how Cleanroom was implemented.

Hausler, Philip A.↗

Ozone Profiles in the Baltimore-Washington Region (2006-2011): Satellite Comparisons and DISCOVER-AQ Observations

Much progress has been made in creating satellite products for tracking the pollutants ozone and NO2 in the troposphere. Yet, in mid-latitude regions where meteorological interactions with pollutants are complex, accuracy can be difficult to achieve, largely due to persistent layering of some constituents. We characterize the layering of ozone soundings and related species measured from aircraft over two ground sites in suburban Washington, DC (Beltsville, MD, 39.05N; 76.9W) and Baltimore (Edgewood, MD, 39.4N; 76.3W) during the July 2011 DISCOVER-AQ (Deriving Information on Surface Conditions from Column and Vertically Resolved Observations Relevant to Air Quality) experiment. First, we compare column-ozone amounts from the Beltsville and Edgewood sondes with data from overpassing satellites. Second, processes influencing ozone profile structure are analyzed using Laminar Identification and tracers: sonde water vapor, aircraft CO and NOy. Third, Beltsville ozone profiles and meteorological influences in July 2011 are compared to those from the summers of 2006-2010. Sonde-satellite offsets in total ozone during July 2011 at Edgewood and Beltsville, compared to the Ozone Monitoring Instrument (OMI), were 3 percent mean absolute error, not statistically significant. The disagreement between an OMIMicrowave Limb Sounder-based tropospheric ozone column and the sonde averaged 10 percent at both sites, with the sonde usually greater than the satellite. Laminar Identification (LID), that distinguishes ozone segments influenced by convective and advective transport, reveals that on days when both stations launched ozonesondes, vertical mixing was stronger at Edgewood. Approximately half the lower free troposphere sonde profiles have very dry laminae, with coincident aircraft spirals displaying low CO (80-110 ppbv), suggesting stratospheric influence. Ozone budgets at Beltsville in July 2011, determined with LID, as well as standard meteorological indicators, resemble those of 4 of the previous 5 summers. The penetration of stratospheric air throughout the troposphere appears to be typical for summer conditions in the Baltimore-Washington region.

satellite validation↗

ACIX-Aqua: A Global Assessment of Atmospheric Correction Methods for Landsat-8 and Sentinel-2 Over Lakes, Rivers, and Coastal Waters

Atmospheric correction over inland and coastal waters is one of the major remaining challenges in aquatic remote sensing, often hindering the quantitative retrieval of biogeochemical variables and analysis of their spatial and temporal variability within aquatic environments. The Atmospheric Correction Intercomparison Exercise (ACIX-Aqua), a joint NASA – ESA activity, was initiated to enable a thorough evaluation of eight state-of-the-art atmospheric correction (AC) processors available for Landsat-8 and Sentinel-2 data processing. Over 1000 radiometric matchups from both freshwaters (rivers, lakes, reservoirs) and coastal waters were utilized to examine the quality of derived aquatic reflectances (ρ̂w). This dataset originated from two sources: Data gathered from the international scientific community (henceforth called Community Validation Database, CVD), which captured predominantly inland water observations, and the Ocean Color component of AERONET measurements (AERONET-OC), representing primarily coastal ocean environments. This volume of data permitted the evaluation of the AC processors individually (using all the matchups) and comparatively (across seven different Optical Water Types, OWTs) using common matchups. We found that the performance of the AC processors differed for CVD and AERONET-OC matchups, likely reflecting inherent variability in aquatic and atmospheric properties between the two datasets. For the former, the median errors in ρ̂w560 and ρ̂w664 were found to range from 20 to 30% for best-performing processors. Using the AERONET-OC matchups, our performance assessments showed that median errors within the 15–30% range in these spectral bands may be achieved. The largest uncertainties were associated with the blue bands (25 to 60%) for best-performing processors considering both CVD and AERONET-OC assessments. We further assessed uncertainty propagation to the downstream products such as near-surface concentration of chlorophyll-a (Chla) and Total Suspended Solids (TSS). Using satellite matchups from the CVD along with in situ Chla and TSS, we found that 20–30% uncertainties in ρ̂w490≤λ≤743nm yielded 25–70% uncertainties in derived Chla and TSS products for top-performing AC processors. We summarize our results using performance matrices guiding the satellite user community through the OWT-specific relative performance of AC processors. Our analysis stresses the need for better representation of aerosols, particularly absorbing ones, and improvements in corrections for sky- (or sun-) glint and adjacency effects, in order to achieve higher quality downstream products in freshwater and coastal ecosystems.

Nima Pahlevan↗

Pixelation Effects in Weak Lensing

Weak gravitational lensing can be used to investigate both dark matter and dark energy but requires accurate measurements of the shapes of faint, distant galaxies. Such measurements are hindered by the finite resolution and pixel scale of digital cameras. We investigate the optimum choice of pixel scale for a space-based mission, using the engineering model and survey strategy of the proposed Supernova Acceleration Probe as a baseline. We do this by simulating realistic astronomical images containing a known input shear signal and then attempting to recover the signal using the Rhodes, Refregier, and Groth algorithm. We find that the quality of shear measurement is always improved by smaller pixels. However, in practice, telescopes are usually limited to a finite number of pixels and operational life span, so the total area of a survey increases with pixel size. We therefore fix the survey lifetime and the number of pixels in the focal plane while varying the pixel scale, thereby effectively varying the survey size. In a pure trade-off for image resolution versus survey area, we find that measurements of the matter power spectrum would have minimum statistical error with a pixel scale of 0.09' for a 0.14' FWHM point-spread function (PSF). The pixel scale could be increased to ~0.16' if images dithered by exactly half-pixel offsets were always available. Some of our results do depend on our adopted shape measurement method and should be regarded as an upper limit: future pipelines may require smaller pixels to overcome systematic floors not yet accessible, and, in certain circumstances, measuring the shape of the PSF might be more difficult than those of galaxies. However, the relative trends in our analysis are robust, especially those of the surface density of resolved galaxies. Our approach thus provides a snapshot of potential in available technology, and a practical counterpart to analytic studies of pixelation, which necessarily assume an idealized shape measurement method.

gravitational lensing↗

The Marshall Automated Weld System (MAWS)

A fully automated welding system, which can operate totally independent of human intervention, is currently unavailable in the welding industry. Development of the Marshall Automated Weld System (MAWS) has been undertaken to fill this void. The system will enable application of statistical process control practices to assure weld quality prior to post weld nondestructive testing. The Variable Polarity Plasma Arc (VPPA) welding process has been baselined for MAWS because it has eliminated process related defects in the welding of the Space Shuttle External Tank. The few remaining weld defects occurring on the tank can be associated with human error. The system integrates multiple sensors (providing real time information on weld bead geometry, weld joint location, wirefeed entry, and inert gas quality) with a weld model (describing weld geometry in relation to critical parameters) and computer-controlled VPPA weld equipment. This system is designed to provide real-time, closed-loop control of the weld as it is being made.

Russell, Carolyn K.↗

The Marshall Automated Weld System (MAWS)

A fully automated welding system, which can operate totally independent of human intervention, is currently unavailable in the welding industry. Development of the Marshall Automated Weld System (MAWS) has been undertaken to fill this void. The system will enable application of statistical process control practices to assure weld quality prior to post weld nondestructive testing. The Variable Polarity Plasma Arc (VPPA) welding process has been baselined for MAWS because it has eliminated process related defects in the welding of the Space Shuttle External Tank. The few remaining weld defects occurring on the tank can be associated with human error. The system integrates multiple sensors (providing real time information on weld bead geometry, weld joint location, wirefeed entry, and inert gas quality) with a weld model (describing weld geometry in relation to critical parameters) and computer controlled VPPA weld equipment. This system is designed to provide real-time, closed-loop control of the weld as it is being made.

Russell, Carolyn K.↗

First Reprocessing of Southern Hemisphere ADditional OZonesondes (SHADOZ) Profile Records (1998-2015): 1. Methodology and Evaluation

Electrochemical concentration cell ozonesonde measurements are an important source of highly resolved vertical profiles of ozone with long-term data records for deriving ozone trends, model development, satellite validation, and air quality studies. Ozonesonde stations employ a range of operational and data processing procedures, metadata reporting, and instrument changes that have resulted in inhomogeneities within individual station data records. A major milestone is the first reprocessing of seven Southern Hemisphere ADditional OZonesondes (SHADOZ) station ozonesonde records to account for errors and biases in operating/processing procedures. Ascension Island, Hanoi, Irene, Kuala Lumpur, La Reunion, Natal, and Watukosek station records all show an overall increase in ozone after reprocessing. Watukosek shows the largest increase of 9.0 plus or minus 2.1 Dobson Units (DU) in total column ozone; Irene and Hanoi show a 5.5 plus or minus 2.5 DU increase, while remaining sites show statistically insignificant enhancements. Negligible to modest ozone enhancements are observed after reprocessing in the troposphere (up to 8%) and stratosphere (up to 6%), except at La Reunion for which the application of background currents reduces tropospheric ozone (2.1 plus or minus1.3 DU). Inhomogeneities due to ozonesonde/solution-type changes at Ascension, Natal, and La Reunion are resolved with the application of transfer functions. Comparisons with EP-TOMS, Aura's Ozone Monitoring Instrument and Microwave Limb Sounder (MLS) satellite ozone overpasses show an overall improvement in agreement after reprocessing. Most reprocessed data sets show a significant reduction in biases with MLS at the ozone maximum region (50-10 hPa). Changes in radiosonde/ozonesonde system and nonstandard solution types can account for remaining discrepancies observed at several sites when compared to satellites.

Electrochemical concentration cell ozonesonde meas↗

Tropical Pacific moisture variability

The objectives are to describe synoptic scale variability of moisture over the tropical Pacific Ocean and the systems leading to this variability; implement satellite analysis procedures in support of this effort, and to incorporate additional satellite information into operational analysis forecast systems at the National Meteorological Center (NMC). Composite satellite radiance patterns describe features detectable well before the development of synoptic scale tropical plumes. These typical features were extracted from historical files of Tiros Operational Vertical Sounder (TOVS) radiance observations for a pair of tropical plumes which developed during January 1989. Signals were inserted into the NMC operational medium range forecast model and a suite of model integrations were conducted. Many of the 48 h model errors of the historical forecasts were eliminated by the inclusion of more complete satellite observations. Three studies in satellite radiance analysis progressed. An analysis which blended TOVS moisture channels, OLR observations and European Center for Medium Weather Forecasts (ECMWF) model analysis to generate fields of total precipitable water comparable to those estimated from Scanning Multichannel Microwave Radiometer (SMMR) mu-wave observations. This study demonstrated that a 10 y climatology of precipitable water over the oceans is feasible, using available infrared observations (OLR and TOVS) and model analysis (ECMWF, NMC or similar quality). The estimates are sensitive to model quality and the estimating model must be updated with operational model changes. Coe developed a set of tropical plume and ITCZ composites from TOVS observations, and from NMC and ECMWF analyses which had been passed through a radiative transfer model to simulate TOVS radiances. The composites have been completed as well as many statistical diagnostics of individual TOVS channels. Analysis of the computations is commencing. Chung has initiated a study of the differences between TOVS observed vapor structure during El Nino Southern Oscillation (ENSO) (1983) and non-ENSO (1984) years. Preliminary diagnosis demonstrates gross moisture changes between warm and cold sea surface temperature episodes.

Mcguirk, James P.↗

Monitoring and Assimilation of MLS Measurements in the DAO Ozone Data Assimilation System

Since 1999 the DAO (Data Assimilation Office) at NASA Goddard has operationally assimilated ozone measurements in near real time. Currently, the assimilation system analyzes SBUV profile and total column measurements using an off line CTM with parameterized chemistry within the 3D-PSAS algorithm. During the last year the assimilation system was modified to either monitor or actively assimilate MLS (Microwave Limb Sounder) measurements in conjunction with the active assimilation of TOMS total column and SBUV profiles. It is expected that the active assimilation of MLS profiles will improve analysis results in two ways. First, there should be an improvement in the vertical resolution. Second, there should be an improvement in regions where SBUV measurements do not exist (such as in the polar night). A series of experiments using UARS (Upper Atmospheric Research Satellite) MLS data from December 1991 to March 1992 were run. In these experiments MLS data was either monitored in conjunction with active assimilation of the SBUV profile and TOMS total column measurements, or some combination of MLS, TOMS, and SBUV observations was actively assimilated. Monitoring of MLS data indicated that the MLS observations contain verifiable information that should improve the vertical structure of the analysis results, especially below the ozone peak and above the tropopause. The monitoring also substantiated the potential to improve the assimilation in the polar night. Active assimilation of MLS data does indeed improve the analysis results in these two ways, although the quality of the improvements is not uniform. This suggests that refinement of the specification of the error covariances might be needed to optimize the system. In addition it may be necessary to account for biases between the different sources of ozone information.

Atlas, Robert↗

Mission operations and command assurance: Instilling quality into flight operations

Mission Operations and Command Assurance (MO&CA) is a Total Quality Management (TQM) task on JPL projects to instill quality in flight mission operations. From a system engineering view, MO&CA facilitates communication and problem-solving among flight teams and provides continuous process improvement to reduce the probability of radiating incorrect commands to a spacecraft. The MO&CA task has evolved from participating as a member of the spacecraft team to an independent team reporting directly to flight project management and providing system level assurance. JPL flight projects have benefited significantly from MO&CA's effort to contain risk and prevent rather than rework errors. MO&CA's ability to provide direct transfer of knowledge allows new projects to benefit from previous and ongoing flight experience.

Welz, Linda L.↗

Mission operations and command assurance: Flight operations quality improvements

Mission Operations and Command Assurance (MO&CA) is a Total Quality Management (TQM) task on JPL projects to instill quality in flight mission operations. From a system engineering view, MO&CA facilitates communication and problem-solving among flight teams and provides continuous solving among flight teams and provides continuous process improvement to reduce risk in mission operations by addressing human factors. The MO&CA task has evolved from participating as a member of the spacecraft team, to an independent team reporting directly to flight project management and providing system level assurance. JPL flight projects have benefited significantly from MO&CA's effort to contain risk and prevent rather than rework errors. MO&CA's ability to provide direct transfer of knowledge allows new projects to benefit from previous and ongoing flight experience.

Welz, Linda L.↗

Development of Three-Dimensional DRAGON Grid Technology

For a typical three dimensional flow in a practical engineering device, the time spent in grid generation can take 70 percent of the total analysis effort, resulting in a serious bottleneck in the design/analysis cycle. The present research attempts to develop a procedure that can considerably reduce the grid generation effort. The DRAGON grid, as a hybrid grid, is created by means of a Direct Replacement of Arbitrary Grid Overlapping by Nonstructured grid. The DRAGON grid scheme is an adaptation to the Chimera thinking. The Chimera grid is a composite structured grid, composing a set of overlapped structured grids, which are independently generated and body-fitted. The grid is of high quality and amenable for efficient solution schemes. However, the interpolation used in the overlapped region between grids introduces error, especially when a sharp-gradient region is encountered. The DRAGON grid scheme is capable of completely eliminating the interpolation and preserving the conservation property. It maximizes the advantages of the Chimera scheme and adapts the strengths of the unstructured and while at the same time keeping its weaknesses minimal. In the present paper, we describe the progress towards extending the DRAGON grid technology into three dimensions. Essential and programming aspects of the extension, and new challenges for the three-dimensional cases, are addressed.

Zheng, Yao↗

An Efficient Objective Analysis System for Parallel Computers

A new objective analysis system designed for parallel computers will be described. The system can produce a global analysis (on a 2 x 2.5 lat-lon grid with 20 levels of heights and winds and 10 levels of moisture) using 120,000 observations in less than 3 minutes on 32 CPUs (SGI Origin 2000). No special parallel code is needed (e.g. MPI or multitasking) and the 32 CPUs do not have to be on the same platform. The system Ls totally portable and can run on -several different architectures at once. In addition, the system can easily scale up to 100 or more CPUS. This will allow for much higher resolution and significant increases in input data. The system scales linearly as the number of observations and the number of grid points. The cost overhead in going from I to 32 CPus is 18%. in addition, the analysis results are identical regardless of the number of processors used. T'his system has all the characteristics of optimal interpolation, combining detailed instrument and first guess error statistics to produce the best estimate of the atmospheric state. It also includes a new quality control (buddy check) system. Static tests with the system showed it's analysis increments are comparable to the latest NASA operational system including maintenance of mass-wind balance. Results from a 2-month cycling test in the Goddard EOS Data Assimilation System (GEOS DAS) show this new analysis retains the same level of agreement between the first guess and observations (0-F statistics) throughout the entire two months.

Stobie, James G.↗

An empirically derived figure of merit for the quality of overall task performance

The need to develop an operationally relevant figure of merit for the quality of performance of a complex system such as an aircraft cockpit stems from a hypothesized dissociation between measures of performance and those of workload. Performance can be measured in terms of time, errors, or a combination of these. In most tasks performed by expert operators, errors are relatively rare and often corrected in time to avoid consequences. Moreover, perfect performance is seldom necessary to accomplish a particular task. Moreover, how well an expert performs a complex task consisting of a series of discrete cognitive tasks superimposed on a continuous task, such as flying an aircraft, does not depend on how well each discrete task is performed, but on their smooth sequencing. This makes the amount of time spent on each subtask of paramount importance in measuring overall performance, since smooth sequencing requires a minimum amount of time spent on each task. Quality consists in getting tasks done within a crucial time interval while maintaining acceptable continuous task performance. Thus, a figure of merit for overall quality of performance should be primarily a measure of time to perform discrete subtasks combined with a measure of basic vehicle control. Thus, the proposed figure of merit requires doing a task analysis on a series of performance, or runs, of a particular task, listing each discrete task and its associated time, and calculating the mean and standard deviation of these times, along with the mean and standard deviation of tracking error for the whole task. A set of simulator data on 30 runs of a landing task was obtained and a figure of merit will be calculated for each run. The figure of merit will be compared for voice and data link, so that the impact of this technology on total crew performance (not just communication performance) can be assessed. The effect of data link communication on other cockpit tasks will also be considered.

Lemay, Moira↗

Observing System Simulation Experiments Exploring Potential Spaceborne Deployment Options for a Differential Absorption Radar Measuring Marine Surface Pressures

A new technology for remote measurements of marine surface pressure has been proposed, employing a V-band differential absorption radar and a radiometric temperature sounder to calculate the total column atmospheric mass. Observing System Simulation Experiments (OSSEs) are performed to evaluate the potential impact of Spaceborne Marine Surface Pressure (SMSP) on Numerical Weather Prediction. These experiments build on prior efforts (Privé, McLinden, et al., 2023, https://doi.org/10.16993/tellusa.3254), but with an updated version of the OSSE framework and with more sophisticated simulation of the SMSP observations and a longer experiment period. Several different instrument configurations are compared, including both scanning and non-scanning orbits. SMSP impacts are calculated for analysis quality and forecast skill, and a forecast sensitivity observation impact tool is employed to place SMSP observations in context with the global observing network. The effects of rain contamination on observation quality are explored. Different magnitudes of simulated SMSP observation error are tested in the context of data assimilation to show the range of potential behaviors. Overall, SMSP observations are found to be most beneficial in the southern hemisphere extratropics, with statistically significant forecast improvements for the first 72 hr of the forecast. A constellation of four non-scanning SMSP satellites is found to outperform a single scanning instrument with a 250 km wide swath.

N C Prive↗

Assessing Satellite-Based Fire Data for use in the National Emissions Inventory

Biomass burning is significant to emission estimates because: (1) it can be a major contributor of particulate matter and other pollutants; (2) it is one of the most poorly documented of all sources; (3) it can adversely affect human health; and (4) it has been identified as a significant contributor to climate change through feedbacks with the radiation budget. Additionally, biomass burning can be a significant contributor to a regions inability to achieve the National Ambient Air Quality Standards for PM 2.5 and ozone, particularly on the top 20% worst air quality days. The United States does not have a standard methodology to track fire occurrence or area burned, which are essential components to estimating fire emissions. Satellite imagery is available almost instantaneously and has great potential to enhance emission estimates and their timeliness. This investigation compares satellite-derived fire data to ground-based data to assign statistical error and helps provide confidence in these data. The largest fires are identified by all satellites and their spatial domain is accurately sensed. MODIS provides enhanced spatial and temporal information, and GOES ABBA data are able to capture more small agricultural fires. A methodology is presented that combines these satellite data in Near-Real-Time to produce a product that captures 81 to 92% of the total area burned by wildfire, prescribed, agricultural and rangeland burning. Each satellite possesses distinct temporal and spatial capabilities that permit the detection of unique fires that could be omitted if using data from only one satellite.

Soja, Amber J.↗

Quantitative Estimation of Some Possible Errors Associated With TRMM GV Monthly Rain Maps and a Scheme for Spatial Averaging of Radar Accumulations

The Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) rain products are generated from ground-based radar observations using a bulk adjusted FACE radar reflectivity (Ze) - rain rate (R) relationship. Monthly Ze-R relationships are obtained by extracting the Ze data with a horizontal resolution of 2 km from an altitude of 1.5 km (from Constant Altitude PPIS, CAPPIS) over the locations of the gauges. The gauge and radar data are merged, and a quality control procedure is applied that eliminates poorly correlated gauge-radar data. Bulk adjusted Ze-R relations are then derived from this quality-controlled merged data base. These Z-R relations are applied to the base scan reflectivity to produce rain maps. The present study examines the effect of these different planes on the total accumulations from the radar and the associated effect on the bulk adjustment coefficient. In order to evaluate the credibility of these GV products, the effect of the different planes involved in the bulk adjustment method will be discussed, The gauge data will also be used to assess the impact of missing radar data (i.e., data gaps) upon the monthly radar-derived rainfall estimates. Experiments were also performed varying both the area of the radar data extracted over the gauges and the use of different weighting coefficients. Preliminary results from these sensitivity tests indicate improved agreement and consistency between the gauge and radar data.

Datta, Saswati↗