Search NASA⌕ Search

SEARCH · Search NASA

Results for “Quality models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

A measurement system for large, complex software programs

This paper describes measurement systems required to forecast, measure, and control activities for large, complex software development and support programs. Initial software cost and quality analysis provides the foundation for meaningful management decisions as a project evolves. In modeling the cost and quality of software systems, the relationship between the functionality, quality, cost, and schedule of the product must be considered. This explicit relationship is dictated by the criticality of the software being developed. This balance between cost and quality is a viable software engineering trade-off throughout the life cycle. Therefore, the ability to accurately estimate the cost and quality of software systems is essential to providing reliable software on time and within budget. Software cost models relate the product error rate to the percent of the project labor that is required for independent verification and validation. The criticality of the software determines which cost model is used to estimate the labor required to develop the software. Software quality models yield an expected error discovery rate based on the software size, criticality, software development environment, and the level of competence of the project and developers with respect to the processes being employed.

Rone, Kyle Y.↗

Human Thermal Model Evaluation Using the JSC Human Thermal Database

Human thermal modeling has considerable long term utility to human space flight. Such models provide a tool to predict crew survivability in support of vehicle design and to evaluate crew response in untested space environments. It is to the benefit of any such model not only to collect relevant experimental data to correlate it against, but also to maintain an experimental standard or benchmark for future development in a readily and rapidly searchable and software accessible format. The Human thermal database project is intended to do just so; to collect relevant data from literature and experimentation and to store the data in a database structure for immediate and future use as a benchmark to judge human thermal models against, in identifying model strengths and weakness, to support model development and improve correlation, and to statistically quantify a model s predictive quality. The human thermal database developed at the Johnson Space Center (JSC) is intended to evaluate a set of widely used human thermal models. This set includes the Wissler human thermal model, a model that has been widely used to predict the human thermoregulatory response to a variety of cold and hot environments. These models are statistically compared to the current database, which contains experiments of human subjects primarily in air from a literature survey ranging between 1953 and 2004 and from a suited experiment recently performed by the authors, for a quantitative study of relative strength and predictive quality of the models.

Bue, Grant↗

Synthesis Analysis of Mulit-Dimensional Ozone Lidar Measurements in Coastal Environments Toward Improving Ozone Simulation

Large surface ozone variations are frequently observed in coastal regions which makes the modeling of air quality in these regions challenging. The ability to properly model coastal regions relies heavily on the proper detailed observations. There have been three air quality studies (over Chesapeake Bay and the Long Island Sound) that focused on thorough measurements in these complex coastal regions; OWLETS 1 & 2 and LISTOS. Over the course of the campaigns, there were surface ozone observations taken from LIDAR (LIght Detection And Ranging) instruments for a total of 89 days at a high temporal rate. We developed a clustering method that characterizes the multiple timestamps of measurements into a range of ozone events that are specific to these coastal regions. We simulated coastal ozone for these cluster groups using WRF-GC and WRF-Chem to identify gaps within the model. Using the characterized ozone clusters, we were able to identify multiple coastal mechanisms that led to incorrect model simulations.

Claudia Bernier↗

Reaction Wheel Disturbance Model Extraction Software - RWDMES

The RWDMES is a tool for modeling the disturbances imparted on spacecraft by spinning reaction wheels. Reaction wheels are usually the largest disturbance source on a precision pointing spacecraft, and can be the dominating source of pointing error. Accurate knowledge of the disturbance environment is critical to accurate prediction of the pointing performance. In the past, it has been difficult to extract an accurate wheel disturbance model since the forcing mechanisms are difficult to model physically, and the forcing amplitudes are filtered by the dynamics of the reaction wheel. RWDMES captures the wheel-induced disturbances using a hybrid physical/empirical model that is extracted directly from measured forcing data. The empirical models capture the tonal forces that occur at harmonics of the spin rate, and the broadband forces that arise from random effects. The empirical forcing functions are filtered by a physical model of the wheel structure that includes spin-rate-dependent moments (gyroscopic terms). The resulting hybrid model creates a highly accurate prediction of wheel-induced forces. It accounts for variation in disturbance frequency, as well as the shifts in structural amplification by the whirl modes, as the spin rate changes. This software provides a point-and-click environment for producing accurate models with minimal user effort. Where conventional approaches may take weeks to produce a model of variable quality, RWDMES can create a demonstrably high accuracy model in two hours. The software consists of a graphical user interface (GUI) that enables the user to specify all analysis parameters, to evaluate analysis results and to iteratively refine the model. Underlying algorithms automatically extract disturbance harmonics, initialize and tune harmonic models, and initialize and tune broadband noise models. The component steps are described in the RWDMES user s guide and include: converting time domain data to waterfall PSDs (power spectral densities); converting PSDs to order analysis data; extracting harmonics; initializing and simultaneously tuning a harmonic model and a wheel structural model; initializing and tuning a broadband model; and verifying the harmonic/broadband/structural model against the measurement data. Functional operation is through a MATLAB GUI that loads test data, performs the various analyses, plots evaluation data for assessment and refinement of analysis parameters, and exports the data to documentation or downstream analysis code. The harmonic models are defined as specified functions of frequency, typically speed-squared. The reaction wheel structural model is realized as mass, damping, and stiffness matrices (typically from a finite element analysis package) with the addition of a gyroscopic forcing matrix. The broadband noise model is realized as a set of speed-dependent filters. The tuning of the combined model is performed using nonlinear least squares techniques. RWDMES is implemented as a MATLAB toolbox comprising the Fit Manager for performing the model extraction, Data Manager for managing input data and output models, the Gyro Manager for modifying wheel structural models, and the Harmonic Editor for evaluating and tuning harmonic models. This software was validated using data from Goodrich E wheels, and from GSFC Lunar Reconnaissance Orbiter (LRO) wheels. The validation testing proved that RWDMES has the capability to extract accurate disturbance models from flight reaction wheels with minimal user effort.

Blaurock, Carl↗

Modelling above-ground biomass stock over Norway using national forest inventory data with ArcticDEM and Sentinel-2 data

Boreal forests constitute a large portion of the global forest area, yet they are undersampled through field surveys, and only a few remotely sensed data sources provide structural information wall-to-wall throughout the boreal domain. ArcticDEM is a collection of high-resolution (2 m) space-borne stereogrammetric digital surface models (DSM) covering the entire land area north of 60° of latitude. The free-availability of ArcticDEM data offers new possibilities for aboveground biomass mapping (AGB) across boreal forests, and thus it is necessary to evaluate the potential for these data to map AGB over alternative open-data sources (i.e., Sentinel-2). This study was performed over the entire land area of Norway north of 60° of latitude, and the Norwegian national forest inventory (NFI) was used as a source of field data composed of accurately geolocated field plots (n=7710) systematically distributed across the study area. Separate random forest models were fitted using NFI data, and corresponding remotely sensed data consisting of either: i) a canopy height model (ArcticCHM) obtained by subtracting a high-quality digital terrain model (DTM) from the ArcticDEM DSM height values, ii) Sentinel-2 (S2), or iii) a combination of the two (ArcticCHM+S2). Furthermore, we assessed the effect of the forest- and terrain-specific factors on the models’ predictive accuracy. The best model (,i.e., ArcticCHM+S2) explained nearly 60% of the variance of the training set, which translated in the largest accuracy in terms of root mean square error (RMSE=41.4 t/ha). This result highlights the synergy between 3D and multispectral data in AGB modelling. Furthermore, this study showed that despite the importance of ArcticCHM variables, the S2 model performed slightly better than ArcticCHM model. This finding highlights some of the limitations of ArcticDEM, which, despite the unprecedented spatial resolution, is highly heterogeneous due to the blending of multiple acquisitions across different years and seasons. We found that both forest- and terrain-specific characteristics affected the uncertainty of the ArcticCHM+S2 model and concluded that the combined use of ArcticCHM and Sentinel-2 represents a viable solution for AGB mapping across boreal forests. The synergy between the two data sources allowed for a reduction of the saturation effects typical of multispectral data while ensuring the spatial consistency in the output predictions due to the removal of artifacts and data voids present in ArcticCHM data. While the main contribution of this study is to provide the first evidence of the best-case-scenario (i.e., availability of accurate terrain models) that ArcticDEM data can provide for large-scale AGB modelling, it remains critically important for other studies to investigate how ArcticDEM may be used in areas where no DTMs are available as is the case for large portions of the boreal zone.

space-borne imagery↗

Incorporating Handling Qualities Analysis into Rotorcraft Conceptual Design

This paper describes the initial development of a framework to incorporate handling qualities analyses into a rotorcraft conceptual design process. In particular, the paper describes how rotorcraft conceptual design level data can be used to generate flight dynamics models for handling qualities analyses. Also, methods are described that couple a basic stability augmentation system to the rotorcraft flight dynamics model to extend analysis to beyond that of the bare airframe. A methodology for calculating the handling qualities characteristics of the flight dynamics models and for comparing the results to ADS-33E criteria is described. Preliminary results from the application of the handling qualities analysis for variations in key rotorcraft design parameters of main rotor radius, blade chord, hub stiffness and flap moment of inertia are shown. Varying relationships, with counteracting trends for different handling qualities criteria and different flight speeds are exhibited, with the action of the control system playing a complex part in the outcomes. Overall, the paper demonstrates how a broad array of technical issues across flight dynamics stability and control, simulation and modeling, control law design and handling qualities testing and evaluation had to be confronted to implement even a moderately comprehensive handling qualities analysis of relatively low fidelity models. A key outstanding issue is to how to 'close the loop' with an overall design process, and options for the exploration of how to feedback handling qualities results to a conceptual design process are proposed for future work.

Analysis into Rotorcraft↗

Human Thermal Model Evaluation Using the JSC Human Thermal Database

The human thermal database developed at the Johnson Space Center (JSC) is used to evaluate a set of widely used human thermal models. This database will facilitate a more accurate evaluation of human thermoregulatory response using in a variety of situations, including those situations that might otherwise prove too dangerous for actual testing--such as extreme hot or cold splashdown conditions. This set includes the Wissler human thermal model, a model that has been widely used to predict the human thermoregulatory response to a variety of cold and hot environments. These models are statistically compared to the current database, which contains experiments of human subjects primarily in air from a literature survey ranging between 1953 and 2004 and from a suited experiment recently performed by the authors, for a quantitative study of relative strength and predictive quality of the models. Human thermal modeling has considerable long term utility to human space flight. Such models provide a tool to predict crew survivability in support of vehicle design and to evaluate crew response in untested environments. It is to the benefit of any such model not only to collect relevant experimental data to correlate it against, but also to maintain an experimental standard or benchmark for future development in a readily and rapidly searchable and software accessible format. The Human thermal database project is intended to do just so; to collect relevant data from literature and experimentation and to store the data in a database structure for immediate and future use as a benchmark to judge human thermal models against, in identifying model strengths and weakness, to support model development and improve correlation, and to statistically quantify a model s predictive quality.

Cognata, T.↗

Analysis of A Severe Dust Storm and Its Impact on Air Quality Conditions Using Wrf-Chem Modeling, Satellite Imagery, and Ground Observations

This study presents a comprehensive analysis of an extreme dust event recorded in the Arabian Peninsula and the United Arab Emirates (UAE) between 31 March and 3 April 2015. Simulations of the dust event with the Weather Research and Forecasting model coupled with the Chemistry module (WRF-Chem) were analyzed and verified using MSG-SEVIRI imagery and aerosol optical depth (AOD) from the recent 1-km Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm for MODIS Terra/Aqua. Data from the National Centers for Atmospheric Prediction/National Center for Atmospheric Research (NCEP/NCAR) and the upper-air radiosonde observations were used to understand the synoptic of the event. In addition, the impact of the event on atmospheric and air quality conditions is investigated. The Air Quality Index (AQI) was calculated prior, during, and after the event to assess the degradation of air quality conditions. Simulated temperature, relative humidity, wind speed, and surface radiation were compared to observations at six monitoring stations in the UAE giving R2 values of 0.84, 0.63, 0.60, and 0.84, respectively. From 1 to 2 April 2015, both observations and simulations showed an average drop in temperature from 33 to 26 °C and radiance reduction from about 950 to 520 Wm−2. The AOD modeled by WRF-Chem showed a good correlation with Aerosol Robotic Network (AERONET) measurements in the UAE with R2 of 0.83. The AQI over the UAE reached hazardous levels during the peak of the dust event before rapidly decreasing to moderate–good air quality levels. This work is the first attempt to demonstrate the potential of using WRF-Chem to estimate AQI over the UAE along with two satellite products (MODIS-MAIAC and MSG-SEVIRI) for dust detection and tracking.

dust storm↗

TPSAS-NF1676L-33873-DND

NOAA's National Air Quality Forecasting Capability (NAQFC) model provides 48-hour forecast of surface ozone and other atmospheric constituents serving as the nation's key tool actively used by regulatory professionals in assessing air quality events and the issuance of public air quality alerts. NAQFC incorporates input meteorology from North American Mesoscale Model (NAM) at 12 km horizontal resolution that is coupled to the Community Multi-scale Air Quality Model (CMAQ) to predict emissions, tropospheric gas and aerosol chemistry, and related deposition and removal processes. The NAQFC forecast simulations contain 35 steps in altitude, with about one third of these in a typical afternoon daytime boundary layer (0-1.5 km). While several studies have been conducted comparing NAQFC predictions to surface observations, investigations comparing the vertical distribution to observations remain limited. Vertical comparisons are needed in order to fully assess forecast model behavior and atmospheric mixing conditions leading to the formation of ozone at the surface. The Tropospheric Ozone Lidar Network (TOLNet) instruments provide a unique observational capability in this regard, as ozone vertical measurements can be directly compared to models, such as NAQFC, and provide additional insight into atmospheric processes and enhance forecast capabilities. In this study, we utilize multiple TOLNet lidar observations obtained during the Ozone Water Land Environmental Transition Studies (OWLETS-2017 & OWLETS-2018) and the Long Island Sound Tropospheric Ozone Study (LISTOS-2018) to compare with NAQFC vertical predictions of ozone. These campaigns took place at different coastal locations along the US East coast with each campaign having multiple TOLNet lidars present, providing a unique opportunity to examine vertical structure of ozone in regions with complex water-land boundaries. Preliminary comparison results will be presented on ozone temporal and vertical differences between NAQFC and the TOLNet lidars along with example case studies to illustrate insights into boundary layer and surface processes of trace gases.

Timothy Berkoff↗

The Central Role of Air Quality Observations in NASA's GEOS Composition Forecasting Model

The NASA GEOS composition forecast model (GEOS-CF) provides global, high-resolution (25 km) air quality forecasts in near-real time. This system combines the operational GEOS-5 weather forecasting model with the state-of-the-science GEOS-Chem chemistry module to provide detailed chemical analysis of a wide range of air pollutants such as ozone, carbon monoxide, nitrogen oxides, and fine particulate matter (PM2.5). The resolution of the forecasts is the highest compared to current, publicly-available global composition forecasts.Air quality observations are an indispensable tool to evaluate the model's ability to capture the strong temporal and spatial gradients of air pollutants across the globe. We show how comparisons against near-real time observations available through OpenAQ (www.openaq.org) demonstrate the model's overall success in reproducing surface concentrations of ozone, nitrogen dioxide, and PM2.5. This analysis also helps identifying current limitations of the model, for example over South America. The model-observation mismatches are most likely caused by uncertainties in the emissions data. Using the example of Rio de Janeiro, we show how the model skill can be improved by using local, high-resolution emission inventories in combination with air quality data.

Keller, Christoph A.↗

Towards A Flexible Data Fusion Tool Incorporating Model, Satellite, Regulatory Monitor and Low-Cost Sensor Data for Air Quality Estimation and Forecasting

Air quality managers, researchers, and concerned community scientists around the world have a variety of sources for air quality information, ranging from traditional regulatory monitoring networks and atmospheric chemistry models to remote sensing data products and low-cost sensor networks. However, the ability to incorporate data from these disparate sources and synthesize a comprehensive overview of the local air quality situation remains a considerable barrier for many end-users. This presentation will outline a tool, currently in development, which will address this need using a flexible data fusion approach. The tool will make use of air quality forecast model outputs (primarily from the NASA GEOS-CF composition forecast modeling system), satellite remote sensing data (from instruments including MODIS, VIIRS, TROPOMI, plus TEMPO for the US when available), and in-situ data from official regulatory and/or low-cost networks where these are available. The ability to incorporate data from low-cost sensor networks will be a key feature of the tool; it will make use of other available data sources to calibrate the low-cost sensor data on a regional scale, then use these calibrated low-cost sensor data for localized updating to resolve finer-scale air quality patterns. Development of this tool is taking place with the help of national and international partners and end-user groups, coordinated through the US EPA and the United Nations Environment Programme (UNEP). The tool is being developed on the Google Earth Engine cloud computing platform to facilitate integration of diverse data sources and free access by a broad community of end-users. Stewardship of the tool will be passed to US EPA and UNEP to support future activities with end-users in the US and around the world, and the tool itself will remain freely accessible. We hope that this tool will lower the barrier to entry for various user groups worldwide, including community scientists, who struggle to integrate disparate data sources to gain insight into their local air quality situations. This presentation will cover the early stages of the development of the tool, including the underlying methods and some pilot case studies in integrating low-cost sensor data.

global models↗

The North American Multi-Model Ensemble (NMME): Phase-1 Seasonal to Interannual Prediction, Phase-2 Toward Developing Intra-Seasonal Prediction

The recent US National Academies report "Assessment of Intraseasonal to Interannual Climate Prediction and Predictability" was unequivocal in recommending the need for the development of a North American Multi-Model Ensemble (NMME) operational predictive capability. Indeed, this effort is required to meet the specific tailored regional prediction and decision support needs of a large community of climate information users. The multi-model ensemble approach has proven extremely effective at quantifying prediction uncertainty due to uncertainty in model formulation, and has proven to produce better prediction quality (on average) then any single model ensemble. This multi-model approach is the basis for several international collaborative prediction research efforts, an operational European system and there are numerous examples of how this multi-model ensemble approach yields superior forecasts compared to any single model. Based on two NOAA Climate Test Bed (CTB) NMME workshops (February 18, and April 8, 2011) a collaborative and coordinated implementation strategy for a NMME prediction system has been developed and is currently delivering real-time seasonal-to-interannual predictions on the NOAA Climate Prediction Center (CPC) operational schedule. The hindcast and real-time prediction data is readily available (e.g., http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) and in graphical format from CPC (http://origin.cpc.ncep.noaa.gov/products/people/wd51yf/NMME/index.html). Moreover, the NMME forecast are already currently being used as guidance for operational forecasters. This paper describes the new NMME effort, presents an overview of the multi-model forecast quality, and the complementary skill associated with individual models.

NOAA CPC↗

Investigating the Effect of Damage Progression Model Choice on Prognostics Performance

The success of model-based approaches to systems health management depends largely on the quality of the underlying models. In model-based prognostics, it is especially the quality of the damage progression models, i.e., the models describing how damage evolves as the system operates, that determines the accuracy and precision of remaining useful life predictions. Several common forms of these models are generally assumed in the literature, but are often not supported by physical evidence or physics-based analysis. In this paper, using a centrifugal pump as a case study, we develop different damage progression models. In simulation, we investigate how model changes influence prognostics performance. Results demonstrate that, in some cases, simple damage progression models are sufficient. But, in general, the results show a clear need for damage progression models that are accurate over long time horizons under varied loading conditions.

Daigle, Matthew↗

CCSDS Advanced Orbiting Systems Virtual Channel Access Service for QoS MACHETE Model

To support various communications requirements imposed by different missions, interplanetary communication protocols need to be designed, validated, and evaluated carefully. Multimission Advanced Communications Hybrid Environment for Test and Evaluation (MACHETE), described in "Simulator of Space Communication Networks" (NPO-41373), NASA Tech Briefs, Vol. 29, No. 8 (August 2005), p. 44, combines various tools for simulation and performance analysis of space networks. The MACHETE environment supports orbital analysis, link budget analysis, communications network simulations, and hardware-in-the-loop testing. By building abstract behavioral models of network protocols, one can validate performance after identifying the appropriate metrics of interest. The innovators have extended the MACHETE model library to include a generic link-layer Virtual Channel (VC) model supporting quality-of-service (QoS) controls based on IP streams. The main purpose of this generic Virtual Channel model addition was to interface fine-grain flow-based QoS (quality of service) between the network and MAC layers of the QualNet simulator, a commercial component of MACHETE. This software model adds the capability of mapping IP streams, based on header fields, to virtual channel numbers, allowing extended QoS handling at link layer. This feature further refines the QoS v existing at the network layer. QoS at the network layer (e.g. diffserv) supports few QoS classes, so data from one class will be aggregated together; differentiating between flows internal to a class/priority is not supported. By adding QoS classification capability between network and MAC layers through VC, one maps multiple VCs onto the same physical link. Users then specify different VC weights, and different queuing and scheduling policies at the link layer. This VC model supports system performance analysis of various virtual channel link-layer QoS queuing schemes independent of the network-layer QoS systems.

Jennings, Esther H.↗

A simplified rotor system mathematical model for piloted flight dynamics simulation

The model was developed for real-time pilot-in-the-loop investigation of helicopter flying qualities. The mathematical model included the tip-path plane dynamics and several primary rotor design parameters, such as flapping hinge restraint, flapping hinge offset, blade Lock number, and pitch-flap coupling. The model was used in several exploratory studies of the flying qualities of helicopters with a variety of rotor systems. The basic assumptions used and the major steps involved in the development of the set of equations listed are described. The equations consisted of the tip-path plane dynamic equation, the equations for the main rotor forces and moments, and the equation for control phasing required to achieve decoupling in pitch and roll due to cyclic inputs.

Chen, R. T. N.↗