SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

NASA NTRS1992

Human behavior and human performance: Psychomotor demands

The results of several experiments are presented in abstract form. These studies are critical for the interpretation and acceptance of flight based science to be conducted by the Behavior and Performance project. Some representative titles are as follow: External audio for IBM/PC compatible computers; A comparative assessment of psychomotor performance (target prediction by humans and macaques); Response path (a dependent measure for computer maze solving and other tasks); Behavioral asymmetries of psychomotor performance in Rhesus monkey (a dissociation between hand preference and skill); Testing primates with joystick based automated apparatus; and Environmental enrichment and performance assessment for ground or flight based research with primates;

Source record↗

DOE OSTI2023

A Gradient Based Subgrid-Scale Parameterization for Ocean Mesoscale Eddies

Mesoscale eddies play an important role in transport of heat and biogeochemical tracers in the global ocean circulation. Resolving these energetic eddies, however, is challenging in ocean general circulation models (OGCM) because it requires a horizontal grid spacing of ≲1/8° that is computationally expensive. As a result, we are required to parameterize mesoscale eddy effects on large-scale ocean flows. In this work, we introduce a new subgrid-scale (SGS) model that is developed based on a Taylor series expansion of resolved variables to parameterize subgrid mesoscale eddy transports and momentum fluxes in OGCM. We have performed an a priori study to evaluate the performance of our new gradient model using high-resolution ocean simulations. Our results show that the gradient model well predicts the actual SGS thickness fluxes in the zonal and meridional directions in coarse-resolution simulations with the grid spacing ≳1/4°. The unresolved kinetic energy at the ocean surface is also skillfully estimated. More importantly, unlike current mesoscale eddy parameterizations, which are mainly developed based on an assumption of flat bottom ocean, our new SGS model can capture the structure of unresolved standing meanders at the ocean surface. We have also developed a dynamic procedure for setting in non-dimensional parameters in our new parameterization through a non-ad hoc and tuning-free method. Overall, this work suggests that implementing the gradient model in OGCM can improve the model accuracy with an affordable computational cost in eddy-permitting and non-eddying simulations.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

An Empirical Cumulus Parameterization Scheme for a Global Spectral Model

Realistic vertical heating and drying profiles in a cumulus scheme is important for obtaining accurate weather forecasts. A new empirical cumulus parameterization scheme based on a procedure to improve the vertical distribution of heating and moistening over the tropics is developed. The empirical cumulus parameterization scheme (ECPS) utilizes profiles of Tropical Rainfall Measuring Mission (TRMM) based heating and moistening derived from the European Centre for Medium- Range Weather Forecasts (ECMWF) analysis. A dimension reduction technique through rotated principal component analysis (RPCA) is performed on the vertical profiles of heating (Q1) and drying (Q2) over the convective regions of the tropics, to obtain the dominant modes of variability. Analysis suggests that most of the variance associated with the observed profiles can be explained by retaining the first three modes. The ECPS then applies a statistical approach in which Q1 and Q2 are expressed as a linear combination of the first three dominant principal components which distinctly explain variance in the troposphere as a function of the prevalent large-scale dynamics. The principal component (PC) score which quantifies the contribution of each PC to the corresponding loading profile is estimated through a multiple screening regression method which yields the PC score as a function of the large-scale variables. The profiles of Q1 and Q2 thus obtained are found to match well with the observed profiles. The impact of the ECPS is investigated in a series of short range (1-3 day) prediction experiments using the Florida State University global spectral model (FSUGSM, T126L14). Comparisons between short range ECPS forecasts and those with the modified Kuo scheme show a very marked improvement in the skill in ECPS forecasts. This improvement in the forecast skill with ECPS emphasizes the importance of incorporating realistic vertical distributions of heating and drying in the model cumulus scheme. This also suggests that in the absence of explicit models for convection, the proposed statistical scheme improves the modeling of the vertical distribution of heating and moistening in areas of deep convection.

Rajendran, K.↗

DOE OSTI2020

Evaluating the WFIP2 updates to the HRRR model using scanning Doppler lidar measurements in the complex terrain of the Columbia River Basin

The wind-energy (WE) industry relies on numerical weather prediction (NWP) forecast models as foundational or base models for many purposes, including wind-resource assessment and wind-power forecasting. During the Second Wind Forecast Improvement Project (WFIP2) in the Columbia River Basin of Oregon and Washington, a significant effort was made to improve NWP forecasts through focused model development, to include experimental refinements to the High Resolution Rapid Refresh (HRRR) model physics and horizontal grid spacing. In this study, the performance of an experimental version of HRRR that includes these refinements is tested against a control version, which corresponds to that of the operational HRRR run by National Oceanic and Atmospheric Administration/National Centers for Environmental Protection at the outset of WFIP2. Furthermore, the effects of horizontal grid resolution were also tested by comparing wind forecasts from the HRRR (with 3-km grid spacing) with those from a finer-resolution HRRR nest with 750-m grid spacing. Model forecasts are validated against accurate wind-profile measurements by three scanning, pulsed Doppler lidars at sites separated by a total distance of 71 km. Model skill and improvements in model skill, attributable to physics refinements and improved horizontal grid resolution, varied by season, by site, and during periods of atmospheric phenomena relevant to WE. In general, model errors were the largest below 150 m above ground level (AGL). Experimental HRRR refinements tended to reduce the mean absolute error (MAE) and other error metrics for many conditions, but degradation in skill (increased MAE) was noted below 150 m AGL at the two lowest-elevation sites at night. Finer resolution was found to produce the most significant reductions in the error metrics.

17 WIND ENERGY↗

DOE OSTI2026

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗

DOE OSTI2023

Interactive Quantum Chemistry Enabled by Machine Learning, Graphical Processing Units, and Cloud Computing

Modern quantum chemistry algorithms are increasingly able to accurately predict molecular properties that are useful for chemists in research and education. Despite this progress, performing such calculations is currently unattainable to the wider chemistry community, as they often require domain expertise, computer programming skills, and powerful computer hardware. In this review, we outline methods to eliminate these barriers using cutting-edge technologies. We discuss the ingredients needed to create accessible platforms that can compute quantum chemistry properties in real time, including graphical processing units–accelerated quantum chemistry in the cloud, artificial intelligence–driven natural molecule input methods, and extended reality visualization. We end by highlighting a series of exciting applications that assemble these components to create uniquely interactive platforms for computing and visualizing spectra, 3D structures, molecular orbitals, and many other chemical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Impact of boundary layer simulation on predicting radioactive pollutant dispersion: a case study for HANARO Research Reactor using the WRF-MMIF-CALPUFF modeling system

Wind plays an important role in cases of unexpected radioactive pollutant dispersion, deciding distribution and concentration of the leaked substance. The accurate prediction of wind has been challenging in numerical weather prediction models, especially near the surface because of the complex interaction between turbulent flow and topographic effect. As such, in this study, we investigated the characteristics of atmospheric dispersion of radioactive material (i.e. 137 Cs) according to the simulated boundary layer around the HANARO research nuclear reactor in Korea using the Weather Research and Forecasting (WRF)-Mesoscale Model Interface (MMIF)-California Puff (CALPUFF) model system. We examined the impacts of orographic drag on wind field, stability calculation methods, and planetary boundary layer parameterizations on the dispersion of radioactive material under a radioactive leaking scenario. We found that inclusion of the orographic drag effect in the WRF model improved the wind prediction most significantly over the complex terrain area, leading the model system to estimate the radioactive concentration near the reactor more conservatively. We also emphasized the importance of the stability calculation method and employing the skillful boundary layer parameterization to ensure more accurate low atmospheric conditions, in order to simulate more feasible spatial distribution of the radioactive dispersion in leaking scenarios.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2012

Snow Cover and Precipitation Impacts on Dry Season Streamflow in the Lower Mekong Basin

Climate change impacts on dry season streamflow in the Mekong River are relatively understudied, despite the fact that water availability during this time is critically important for agricultural and ecological systems. Analyses of two gauging stations (Vientiane and Kratie) in the Lower Mekong Basin (LMB) show significant positive correlations between dry season (March through May, MAM) discharge and upper basin snow cover and local precipitation. Using snow cover, precipitation, and upstream discharge as predictors, we develop skillful regression models for MAM streamflow at Vientiane and Kratie, and force these models with output from a suite of general circulation model (GCM) experiments for the twentieth and twenty-first centuries. The GCM simulations predict divergent trends in snow cover (decreasing) and precipitation (increasing) over the twenty-first century, driving overall negligible long-term trends in dry season streamflow. Our study demonstrates how future changes in dry season streamflow in the LMB will depend on changes in snow cover and precipitation, factors that will need to be considered when assessing the full basin response to other climatic and non-climatic drivers.

Cook, Benjamin I.↗

NASA NTRS2005

Predicting Software Suitability Using a Bayesian Belief Network

The ability to reliably predict the end quality of software under development presents a significant advantage for a development team. It provides an opportunity to address high risk components earlier in the development life cycle, when their impact is minimized. This research proposes a model that captures the evolution of the quality of a software product, and provides reliable forecasts of the end quality of the software being developed in terms of product suitability. Development team skill, software process maturity, and software problem complexity are hypothesized as driving factors of software product quality. The cause-effect relationships between these factors and the elements of software suitability are modeled using Bayesian Belief Networks, a machine learning method. This research presents a Bayesian Network for software quality, and the techniques used to quantify the factors that influence and represent software quality. The developed model is found to be effective in predicting the end product quality of small-scale software development efforts.

Beaver, Justin M.↗

NASA NTRS2008

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗

NASA NTRS2019

Assimilation of Satellite-Based Snow Cover and Freeze/Thaw Observations Over the High Mountain Asia

Toward qualifying hydrologic changes in the High Mountain Asia (HMA) region, this study explores the use of a hyper-resolution (1 km) land data assimilation (DA)framework developed within the NASA Land Information System using the Noah Multi-parameterization Land Surface Model (Noah-MP) forced by the meteorological boundary conditions from Modern-Era Retrospective analysis for Research and Applications, Version 2 data. Two different sets of DA experiments are conducted:(1) the assimilation of a satellite-derived snow cover map (MOD10A1) and (2) the assimilation of the NASA MEaSUREs landscape freeze/thaw product from 2007 to 2008. The performance of the snow cover assimilation is evaluated via comparisons with available remote sensing-based snow water equivalent product and ground-based snow depth measurements. For example, in the comparison against ground-based snow depth measurements, the majority of the stations (13 of 14) show slightly improved goodness-of-fit statistics as a result of the snow DA, but only four are statistically significant. In addition, comparisons to the satellite-based land surface temperature products (MOD11A1 and MYD11A1) show that freeze/thaw DA yields improvements (at certain grid cells) of up to 0.58 K in the root-mean-square error (RMSE) and 0.77K in the absolute bias (relative to model-only simulations). In the comparison against three ground-based soil temperature measurements along the Himalayas, the bias and the RMSE in the 0-10 cm soil temperature are reduced (on average) by 10 and 7%,respectively. The improvements in the top layer of soil estimates also propagate through the deeper soil layers, where the bias and the RMSE in the 10-40 cm soil temperature are reduced (on average) by 9 and 6%, respectively. However, no statistically significant skill differences are observed for the freeze/thaw DA system in the comparisons against ground-based surface temperature measurements at mid-to-low altitude. Therefore, the two proposed DA schemes show the potential of improving the predictability of snow mass, surface temperature, and soil temperature states across HMA, but more ground-based measurements are still required, especially at high-altitudes, in order to document a more statistically significant improvement as a result of the two DA schemes.

High Mountain Asia↗

DOE OSTI2023

Commercial Building Sensors and Controls Systems: Barriers and Drivers: Preprint

Building sensors and controls systems, including building automation systems, comprise the sensor-based devices installed in buildings as well as the control and automation of those devices. Optimized sensors and controls systems could lead to 29% annual energy savings in commercial buildings and are integral to the growth of grid-interactive efficient buildings. Only 13% of small commercial buildings, however, have installed sensors and controls systems, largely because of cost barriers. To accelerate adoption, this work seeks to increase the transparency of system costs and identify specific barriers and drivers. To gather industry insights, the team reached out to building owners, vendors, and contractors and conducted 21 interviews with the goal of collecting cost data and market characteristics regarding building sensors and controls. We collected the cost data in the form of invoices and used it to develop a percentage-based cost category breakdown. The interview data were analyzed using grounded theory to identify overarching concepts such as barriers, drivers, and future directions. From this analysis, we found the primary barriers to be complex and confusing systems, lack of user skills, and financial concerns, and the primary drivers to be operational benefits, insight into operations, and remote access to data. The future directions analysis highlighted the potential technological solutions to address gaps and barriers, as well as predicted drivers to increase adoption. This greater understanding of the costs, barriers, and drivers associated with commercial building sensors and controls systems lays the groundwork for increasing system adoption, reducing energy consumption, and transforming the market.

building automation system↗

NASA NTRS2000

The Tropical Rainfall Measuring (TRMM) - What Have We Learned and What Does the Future Hold?

Rainfall is important in the hydrological cycle and to the lives and welfare of humans. In addition to being a life-giving resource, rainfall processes also plays a crucial role in the dynamics of the global atmospheric circulation. Three-fourths of the energy that drives the atmospheric wind circulation comes from the latent heat released by tropical precipitation. It varies greatly in space and time. The rain-producing cloud systems may last several hours or days. Their dimensions range from 10 km to several hundred km. This makes it difficult to incorporate rainfall directly large-scale weather and climate models. Until the end of 1997, precipitation in the global tropics was not known to within a factor of two. Regarding "global warming", the various large-scale models differed among themselves in the predicted magnitude of the warming and in the expected regional effects of these temperature and moisture changes. The Tropical Rainfall Measuring Mission (TRMM) satellite has yielded important interim results related to rainfall observations, data assimilation and model forecast skills when rainfall data is assimilated. This talk will summarize where the TRMM science team is with regards to answering some of these important scientific challenges, as well as discuss the future Global Precipitation Mission which will provide 3 hourly rainfall coverage and offers some unique collaborative potential for NOAA and NASA.

Kummerow, C.↗

DOE OSTI2022

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2023

Robustness of Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to investigate the potential performance of proposed new instruments on numerical weather prediction (NWP). As OSSEs involve a framework in which the atmosphere and observations are all completely simulated, it is necessary to perform validation of the OSSE to ensure that it is sufficiently realistic to provide useful experimental results. A common issue that affects the forecast skill and observation impacts is the tendency of OSSEs to have insufficient model error compared to NWP in the real world. In this work, two versions of the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) NWP OSSE framework are compared, with the newer framework having more simulated forecast model error than the older framework due to changes to the NWP system. The performance of the updated OSSE is validated against corresponding behavior of the same NWP system in the real world in terms of the simulated observations, the analysis increments, forecast error, and observation impacts. OSSE results of analysis and forecast impacts for three proposed new observation systems are also compared between the older and newer frameworks to evaluate the robustness of the OSSE experiments and the role of model error in observation impacts. These three new instruments are the Geostationary eXtended Observations (GeoXO) hyperspectral infrared sounder (GXS), the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds) atmospheric motion vectors, and additional Global Navigation Satellite System Radio Occultations (GNSS-RO).

Observing System Simulation Experiments↗

NASA NTRS1992

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗

NASA NTRS2006

A Study of Rapidly Developing Low Cloud Ceilings in a Stable Atmosphere at the Florida Spaceport

Forecasters at the Space Meteorology Group (SMG) issue 30 to 90 minute forecasts for low cloud ceilings at the Shuttle Landing Facility (KTTS) in Kennedy Space Center, FL for all Space Shuttle missions. Mission verification statistics have shown cloud ceilings to be the biggest forecast challenge. SMG forecasters are especially concerned with rapidly developing cloud ceilings below 8000 ft. in a stable, capped thermodynamic environment because ceilings below 8000 ft restrict Shuttle landing operations and are the most challenging to predict accurately. This project involves the development of a database of these cases over east-central Florida in order to identify the onset, location, and if possible, dissipation times of rapidly-developing low cloud ceilings. Another goal is to document the atmospheric regimes favoring this type of cloud development to improve forecast skill of such events during Space Shuttle launch and landing operations. A 10-year database of stable, rapid low cloud development days during the daylight hours was compiled for the Florida cool-season months by examining the Cape Canaveral Air Force Station sounding data, and identifying days that had high boundary layer relative humidity associated with a thermally-capped environment below 8000 ft. Archived hourly surface observations from KTTS and Melbourne, Orlando, Sanford, and Ocala, FL were then examined for the onset of cloud ceilings below 8000 ft between 1100 and 2000 UTC. Once the database was supplemented with the hourly surface cloud observations, visible satellite imagery was examined in 30-minute intervals to confirm event occurrences. This paper will present results from some of the rapidly developing cloud ceiling cases and the prevailing meteorological conditions associated with these events, focusing on potential pre-curser information that may help improve their prediction.

FROM↗

NASA NTRS2001

A New Ensemble Canonical Correlation Prediction Scheme for Seasonal Precipitation

Department of Mathematical Sciences, University of Alberta, Edmonton, Canada This paper describes the fundamental theory of the ensemble canonical correlation (ECC) algorithm for the seasonal climate forecasting. The algorithm is a statistical regression sch eme based on maximal correlation between the predictor and predictand. The prediction error is estimated by a spectral method using the basis of empirical orthogonal functions. The ECC algorithm treats the predictors and predictands as continuous fields and is an improvement from the traditional canonical correlation prediction. The improvements include the use of area-factor, estimation of prediction error, and the optimal ensemble of multiple forecasts. The ECC is applied to the seasonal forecasting over various parts of the world. The example presented here is for the North America precipitation. The predictor is the sea surface temperature (SST) from different ocean basins. The Climate Prediction Center's reconstructed SST (1951-1999) is used as the predictor's historical data. The optimally interpolated global monthly precipitation is used as the predictand?s historical data. Our forecast experiments show that the ECC algorithm renders very high skill and the optimal ensemble is very important to the high value.

Kim, Kyu-Myong↗