Search NASA⌕ Search

SEARCH · Search NASA

Results for “model skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
NASA NTRS2019

Assessment of Satellite Sea Surface Salinity Products Using a Coupled ENSO Prediction Model

Much work has gone into revising and updating algorithms for converting satellite-measured radiances to useful ocean variables like sea surface salinity (e.g. SMOS - Boutin et al., 2017, SMAP - Fore et al., 2016 and Aquarius - Meissner et al., 2018). As part of our Ocean Salinity Science Team work, we utilize an intermediate-complexity air/sea coupled model as a transfer function to test if more mature satellite SSS model algorithms actually improve ENSO forecast skill. For initialization of the coupled forecast, we demonstrate that the positive impact of SSS assimilation is brought about by surface freshening near the eastern edge of the western Pacific warm pool and density changes that lead to shallower mixed layer between 10S-5N. In addition, salting near the ITCZ leads to a deepening of the mixed layer and thermocline near 8N. These patterns together provide the background state to amplify equatorial Kelvin waves and improve ENSO hindcasts (Hackert et al., 2019). Here we extend this work to compare the impact of various pairs of original and improved satellite SSS algorithms. For instance we compare SMAP V4.1 with the latest, SMAP V4.2, to see what impact algorithm improvements may have on ENSO forecasts. SSS observations are tested on seasonal to interannual variability of tropical Indo-Pacific Ocean dynamics as well as on dynamical ENSO forecasts by initializing twelve-month forecasts for each month of available data. All experiments assimilate satellite sea level (SL), sea surface temperature (SST), and in situ subsurface temperature and salinity observations (Tz, Sz). Additionally various satellite, blended, and in-situ SSS products are assimilated. We find that including satellite SSS significantly improves Niño3.4 sea surface temperature anomaly validation, more mature SSS model algorithms are generally improving ENSO forecasts over time, and more satellite SSS data coverage helps to extend useful forecasts.

Ocean↗
NASA NTRS2015

The GEWEX Process Evaluation Study: GEWEX-PROES

Progress in realistically simulating the energy and water cycles in weather and climate models has been slower than desirable. Climate models submitted to the Coupled Model Intercomparison Project Phase-5 (CMIP-5), while more comprehensive than their predecessors, have shown little to no improvement in their biases in simulating key features of the climate system. As a result, uncertainties in global climate and hydrological sensitivities, and in the simulation of regional climate change, have not been reduced significantly. It is time to make use of these opportunities to significantly advance our understanding of key energy and water cycle processes at a wide range of space and time scales, and to provide a more insightful evaluation of the representation of these processes within models. This will require new ways of both analyzing the observations and diagnosing model behavior. The keys to success will be in skillfully combining different data sets and exploring relationships between them, as well as in the ability of models to reproduce those relationships correctly. In response to this challenge, a new GEWEX-wide activity, the GEWEX Process Evaluation Study, will take advantage of the opportunities that the combination of many of the existing data sets provide.

climate models↗
NASA NTRS1999

Satellite Data Assimilation

Satellite altimetry provides the only routine observation of a dynamic variable of the global ocean. For instance, measurements from the TOPEX/POSEIDON altimeter have provided dramatic basin-wide images of the space-time evolution of sea level associated with the 1997-98 El Nino event. The nature of large-scale ocean circulation is being studied that underlies such sea level changes measured by satellite altimetry. To first approximation, properties of large-scale (order 1000 km and larger) sea level variability is latitudinally dependent. An analysis using a general circulation model shows that sea level changes are largely due to wind-driven baroclinic (depth dependent) circulation in the tropics (within 20 degrees of the equator), but are primarily due to the expansion and contraction of near surface water in temperate latitudes (between 20 deg. and 40 deg.) forced by seasonal heating and cooling. In contrast, wind-driven barotropic (depth independent) circulation dominates sea level variability in high latitudes (40 deg. and higher) characterized by periods that are as short as a few days. The presence of such inhomogeneity and the significance of high-frequency, large-scale sea level changes had not been fully recognized prior to this study, and are summarized in Fukumori et al. Numerical models provide theoretical relationships among properties that can be inverted using observations so as to estimate the entire state of the ocean, including properties that are otherwise difficult to measure remotely. The process is data assimilation. An approximate Kalman filter and smoother have been devised to assimilate three years of TOPEX/POSEIDON sea level data into a global ocean general circulation model. The figure below demonstrates the skill of the assimilation, and shows the altimeter assimilated estimate being in closer agreement than the simulation is with independent in situ measurements of subsur ace temperature and velocity, consistent with formal uncertainty estimates. Results from this study have been summarized and submitted for publication. The study demonstrates the feasibility of global ocean data assimilation and illustrates applications in monitoring and understanding of processes controlling the evolution of the ocean. Additional information is contained in the original.

Fukumori, Ichiro↗
NASA NTRS2009

J-2X, The Engine of the Future

My project was two-fold, with both parts involving the J-2X Upper Stage engine (which will be used on both the Ares I and V). Mainly, I am responsible for using a program called Iris to create visual represen tations of the rocket engine's telemetry data. Also, my project includes the application of my newly acquired Pro Engineer skills in develo ping a 3D model of the engine's nozzle.

Smith, Gail↗
NASA NTRS2014

Impact of Land Surface Initialization Approach on Subseasonal Forecast Skill: a Regional Analysis in the Southern Hemisphere

The authors use a sophisticated coupled land-atmosphere modeling system for a Southern Hemisphere subdomain centered over southeastern Australia to evaluate differences in simulation skill from two different land surface initialization approaches. The first approach uses equilibrated land surface states obtained from offline simulations of the land surface model, and the second uses land surface states obtained from reanalyses. The authors find that land surface initialization using prior offline simulations contribute to relative gains in subseasonal forecast skill. In particular, relative gains in forecast skill for temperature of 10%-20% within the first 30 days of the forecast can be attributed to the land surface initialization method using offline states. For precipitation there is no distinct preference for the land surface initialization method, with limited gains in forecast skill irrespective of the lead time. The authors evaluated the asymmetry between maximum and minimum temperatures and found that maximum temperatures had the largest gains in relative forecast skill, exceeding 20% in some regions. These results were statistically significant at the 98% confidence level at up to 60 days into the forecast period. For minimum temperature, using reanalyses to initialize the land surface contributed to relative gains in forecast skill, reaching 40% in parts of the domain that were statistically significant at the 98% confidence level. The contrasting impact of the land surface initialization method between maximum and minimum temperature was associated with different soil moisture coupling mechanisms. Therefore, land surface initialization from prior offline simulations does improve predictability for temperature, particularly maximum temperature, but with less obvious improvements for precipitation and minimum temperature over southeastern Australia.

Precipitation↗
NASA NTRS2013

Modeling Errors in Daily Precipitation Measurements: Additive or Multiplicative?

The definition and quantification of uncertainty depend on the error model used. For uncertainties in precipitation measurements, two types of error models have been widely adopted: the additive error model and the multiplicative error model. This leads to incompatible specifications of uncertainties and impedes intercomparison and application.In this letter, we assess the suitability of both models for satellite-based daily precipitation measurements in an effort to clarify the uncertainty representation. Three criteria were employed to evaluate the applicability of either model: (1) better separation of the systematic and random errors; (2) applicability to the large range of variability in daily precipitation; and (3) better predictive skills. It is found that the multiplicative error model is a much better choice under all three criteria. It extracted the systematic errors more cleanly, was more consistent with the large variability of precipitation measurements, and produced superior predictions of the error characteristics. The additive error model had several weaknesses, such as non constant variance resulting from systematic errors leaking into random errors, and the lack of prediction capability. Therefore, the multiplicative error model is a better choice.

Modeling↗
NASA NTRS2018

Prediction and Predictability of the Madden Julian Oscillation in the NASA GEOS-5 Seasonal-to-Subseasonal System

In this study, we examine the prediction skill and predictability of the Madden Julian Oscillation (MJO) in a recent version of the NASA GEOS-5 atmosphere-ocean coupled model run at at 1/2 degree horizontal resolution. The results are based on a suite of hindcasts produced as part of the NOAA SubX project, consisting of seven ensemble members initialized every 5 days for the period 1999-2015. The atmospheric initial conditions were taken from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), and the ocean and the sea ice were taken from a GMAO ocean analysis. The land states were initialized from the MERRA-2 land output, which is based on observation-corrected precipitation fields. We investigated the MJO prediction skill in terms of the bivariate correlation coefficient for the real-time multivariate MJO (RMM) indices. The correlation coefficient stays at or above 0.5 out to forecast lead times of 26-36 days, with a pronounced increase in skill for forecasts initialized from phase 3, when the MJO convective anomaly is located in the central tropical Indian Ocean. A corresponding estimate of the upper limit of the predictability is calculated by considering a single ensemble member as the truth and verifying the ensemble mean of the remaining members against that. The predictability estimates fall between 35-37 days (taken as forecast lead when the correlation reaches 0.5) and are rather insensitive to the initial MJO phase. The model shows slightly higher skill when the initial conditions contain strong MJO events compared to weak events, although the difference in skill is evident only from lead 1 to 20. Similar to other models, the RMM-index-based skill arises mostly from the circulation components of the index. The skill of the convective component of the index drops to 0.5 by day 20 as opposed to day 30 for circulation fields. The propagation of the MJO anomalies over the Maritime Continent does not appear problematic in the GEOS-5 hindcasts implying that the Maritime Continent predictability barrier may not be a major concern in this model. Finally, the MJO prediction skill in this version of GEOS-5 is superior to that of the current seasonal prediction system at the GMAO; this could be partly attributed to a slightly better representation of the MJO in the free running version of this model and partly to the improved atmospheric initialization from MERRA-2.

Achuthavarier, Deepthi↗
NASA NTRS2015

Simultaneous Radar and Satellite Data Storm-Scale Assimilation Using an Ensemble Kalman Filter Approach for 24 May 2011

Assimilating high-resolution radar reflectivity and radial velocity into convection-permitting numerical weather prediction models has proven to be an important tool for improving forecast skill of convection. The use of satellite data for the application is much less well understood, only recently receiving significant attention. Since both radar and satellite data provide independent information, combing these two sources of data in a robust manner potentially represents the future of high-resolution data assimilation. This research combines Geostationary Operational Environmental Satellite 13 (GOES-13) cloud water path (CWP) retrievals with Weather Surveillance Radar-1988 Doppler (WSR-88D) reflectivity and radial velocity to examine the impacts of assimilating each for a severe weather event occurring in Oklahoma on 24 May 2011. Data are assimilated into a 3-km model using an ensemble adjustment Kalman filter approach with 36 members over a 2-h assimilation window between 1800 and 2000 UTC. Forecasts are then generated for 90 min at 5-min intervals starting at 1930 and 2000 UTC. Results show that both satellite and radar data are able to initiate convection, but that assimilating both spins up a storm much faster. Assimilating CWP also performs well at suppressing spurious precipitation and cloud cover in the model as well as capturing the anvil characteristics of developed storms. Radar data are most effective at resolving the 3D characteristics of the core convection. Assimilating both satellite and radar data generally resulted in the best model analysis and most skillful forecast for this event.

Jones, Thomas A.↗
NASA NTRS2009

Simulating the Effects of Irrigation over the U.S. in a Land Surface Model Based on Satellite Derived Agricultural Data

A novel method is introduced for integrating satellite derived irrigation data and high-resolution crop type information into a land surface model (LSM). The objective is to improve the simulation of land surface states and fluxes through better representation of agricultural land use. Ultimately, this scheme could enable numerical weather prediction (NWP) models to capture land-atmosphere feedbacks in managed lands more accurately and thus improve forecast skill. Here we show that application of the new irrigation scheme over the continental US significantly influences the surface water and energy balances by modulating the partitioning of water between the surface and the atmosphere. In our experiment, irrigation caused a 12% increase in evapotranspiration (QLE) and an equivalent reduction in the sensible heat flux (QH) averaged over all irrigated areas in the continental US during the 2003 growing season. Local effects were more extreme: irrigation shifted more than 100 W/m from QH to QLE in many locations in California, eastern Idaho, southern Washington, and southern Colorado during peak crop growth. In these cases, the changes in ground heat flux (QG), net radiation (RNET), evapotranspiration (ET), runoff (R), and soil moisture (SM) were more than 3 W/m(sup 2), 20 W/m(sup 2), 5 mm/day, 0.3 mm/day, and 100 mm, respectively. These results are highly relevant to continental- to global-scale water and energy cycle studies that, to date, have struggled to quantify the effects of agricultural management practices such as irrigation. Based on the results presented here, we expect that better representation of managed lands will lead to improved weather and climate forecasting skill when the new irrigation scheme is incorporated into NWP models such as NOAA's Global Forecast System (GFS).

Ozdogan, Mutlu↗
NASA NTRS2003

Diabatic Initialization of Mesoscale Models in the Southeastern United States: Can 0 to 12h Warm Season QPF be Improved?

It is well known that numerical warm season quantitative precipitation forecasts lack significant skill for numerous reasons. Some are related to the model--it may lack physical processes required to realistically simulate convection or the numerical algorithms and dynamics employed may not be adequate. Others are related to initialization-mesoscale features play an important role in convective initialization and atmospheric observation systems are incapable of properly depicting the three-dimensional stability structure at the mesoscale. The purpose of this study is to determine if a mesoscale model initialized with a diabatic initialization scheme can improve short-term (0 to 12h) warm season quantitative precipitation forecasts in the Southeastern United States. The Local Analysis and Prediction System (LAPS) developed at the Forecast System Laboratory is used to diabatically initialize the Pennsylvania State University/National center for Atmospheric Research (PSUNCAR) Mesoscale Model version 5 (MM5). The SPORT Center runs LAPS operationally on an hourly cycle to produce analyses on a 15 km covering the eastern 2/3 of the United States. The 20 km National Centers for Environmental Prediction (NCEP) Rapid Update Cycle analyses are used for the background fields. Standard observational data are acquired from MADIS with GOES/CRAFT Nexrad data acquired from in-house feeds. The MM5 is configured on a 140 x 140 12 km grid centered on Huntsville Alabama. Preliminary results indicate that MM5 runs initialized with LAPS produce improved 6 and 12h QPF threat scores compared with those initialized with the NCEP RUC.

Lapenta, William M.↗
NASA NTRS1993

Computational reacting gas dynamics

In the study of high speed flows at high altitudes, such as that encountered by re-entry spacecrafts, the interaction of chemical reactions and other non-equilibrium processes in the flow field with the gas dynamics is crucial. Generally speaking, problems of this level of complexity must resort to numerical methods for solutions, using sophisticated computational fluid dynamics (CFD) codes. The difficulties introduced by reacting gas dynamics can be classified into three distinct headings: (1) the usually inadequate knowledge of the reaction rate coefficients in the non-equilibrium reaction system; (2) the vastly larger number of unknowns involved in the computation and the expected stiffness of the equations; and (3) the interpretation of the detailed reacting CFD numerical results. The research performed accepts the premise that reacting flows of practical interest in the future will in general be too complex or 'untractable' for traditional analytical developments. The power of modern computers must be exploited. However, instead of focusing solely on the construction of numerical solutions of full-model equations, attention is also directed to the 'derivation' of the simplified model from the given full-model. In other words, the present research aims to utilize computations to do tasks which have traditionally been done by skilled theoreticians: to reduce an originally complex full-model system into an approximate but otherwise equivalent simplified model system. The tacit assumption is that once the appropriate simplified model is derived, the interpretation of the detailed numerical reacting CFD numerical results will become much easier. The approach of the research is called computational singular perturbation (CSP).

Lam, S. H.↗
NASA NTRS1990

Building an intelligent tutoring system for procedural domains

Jobs that require complex skills that are too expensive or dangerous to develop often use simulators in training. The strength of a simulator is its ability to mimic the 'real world', allowing students to explore and experiment. A good simulation helps the student develop a 'mental model' of the real world. The closer the simulation is to 'real life', the less difficulties there are transferring skills and mental models developed on the simulator to the real job. As graphics workstations increase in power and become more affordable they become attractive candidates for developing computer-based simulations for use in training. Computer based simulations can make training more interesting and accessible to the student.

Warinner, Andrew↗
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
NASA NTRS1989

TASKILLAN - A simulation to predict the validity of multiple resource models of aviation workload

The extent to which flight simulation models of increasing complexity are successful in predicting pilot performance was investigated using four models of increasing sophistication addressed by the TASKILLAN (for task skill analysis) computer-generated helicopter simulation. At the simplest level of complexity was the total task model (Model T), followed by the demand model (Model D), the undifferentiated capacity model (Model U), and, ultimately, by the multiple resources model (Model M), which is at the highest level of sophistication addressed by the TASKILLAN project. It was found that the correlations between variables were higher with the two more sophisticated models (U and M), which impose a penalty for increased difficulty in time-sharing. The performance prediction was best with the Model U, while the best predictors of subjective measures were models D and M.

Larish, Inge A.↗
NASA NTRS2011

A Comparison of Methods for a Priori Bias Correction in Soil Moisture Data Assimilation

Data assimilation is being increasingly used to merge remotely sensed land surface variables such as soil moisture, snow and skin temperature with estimates from land models. Its success, however, depends on unbiased model predictions and unbiased observations. Here, a suite of continental-scale, synthetic soil moisture assimilation experiments is used to compare two approaches that address typical biases in soil moisture prior to data assimilation: (i) parameter estimation to calibrate the land model to the climatology of the soil moisture observations, and (ii) scaling of the observations to the model s soil moisture climatology. To enable this research, an optimization infrastructure was added to the NASA Land Information System (LIS) that includes gradient-based optimization methods and global, heuristic search algorithms. The land model calibration eliminates the bias but does not necessarily result in more realistic model parameters. Nevertheless, the experiments confirm that model calibration yields assimilation estimates of surface and root zone soil moisture that are as skillful as those obtained through scaling of the observations to the model s climatology. Analysis of innovation diagnostics underlines the importance of addressing bias in soil moisture assimilation and confirms that both approaches adequately address the issue.

Kumar, Sujay V.↗
NASA NTRSDate not supplied

Improving Regional Air Quality Forecasting Through Chemical Data Assimilation and Dynamic Emissions Adjustment

Poor air quality (AQ) is one of the most important human-health and environmental problems facing the United States (US). In addition to the detrimental impacts on human- and environmental-health, poor AQ has an economic cost of ~5% of the US gross domestic product (~$790 billion). AQ managers use AQ analyses and modeling to better understand, anticipate, and avoid poor AQ events. Our research focuses on improving AQ analysis/forecast skill, predictability, and emission estimates through improved and more efficient: (i) modeling and data assimilation strategies; (ii) dynamic emissions adjustment strategies; and (iii) use of satellite remote-sensing Earth observations (e.g., MOPITT, IASI, MODIS, OMI, TROPOMI, TEMPO, etc.). This seminar will review: (i) regional chemical weather forecasting/data assimilation with dynamic emissions adjustment with WRF-Chem/DART; (ii) strategies for efficiently assimilating satellite retrieval profiles with ‘compact phase space retrievals’ (CPSRs); (iii) results from joint assimilation of multiple satellite retrievals at medium (12 km × 12 km) and high (4 km × 4 km) spatial resolutions; and (iv) results from observing system simulation experiments (OSSEs) to investigate whether we can recover COVID-period anthropogenic emissions by assimilating synthetic TEMPO NO2 tropospheric column retrievals with dynamic emissions adjustment. Biographical Sketch: Dr. Mizzi is a Senior Research Fellow working and Dr. Johnson at the NASA Ames Research Center. He holds BA and MS degrees in Environmental Science from the University of Virginia, MS and PhD degrees in Applied Mathematics from the University of Colorado at Boulder (CUB), and a JD degree (with an emphasis in Environmental Law) from the University of Colorado School of Law. He worked at the National Center for Atmospheric Research for nearly 25 years on global atmospheric modeling, dynamic and physical initialization, regional hybrid data assimilation, and most recently on regional chemical data assimilation. He also worked as an environmental attorney and consultant for nearly 15 years. He is an expert in numerical modeling and is recognized internationally as a leading expert in regional, chemical data assimilation with dynamic emissions adjustment. Dr. Mizzi became affiliated with NASA Ames in March 2020 to work on improving AQ analysis/forecast skill, predictability, and ‘top-down’ emissions adjustment though the assimilation of Earth observations. An emphasis of his current work is developing methods for assimilating synthetic TEMPO retrievals to quantify the expected benefits of TEMPO relative to existing AQ observations.

Arthur P. Mizzi↗