Search NASA⌕ Search

SEARCH · Search NASA

Results for “Skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Multi-decadal variation of ENSO forecast skill since the late 1800s

Diagnosing El Niño-Southern Oscillation (ENSO) predictability within operational forecast models is hindered by computational expense and the need for initialization with three-dimensional fields generated by global data assimilation. We instead examine multi-year ENSO predictability since the late 1800s using the model-analog technique, which has neither limitation. We first draw global coupled model states from pre-industrial control simulations, from the Coupled Model Intercomparison Project Phase 6, that are chosen to initially match observed monthly sea surface temperature and height anomalies in the Tropics. Their subsequent 36-month model evolution are the hindcasts, whose 20th century ENSO skill is comparable to twice-yearly hindcasts generated by a state-of-the-art European operational forecasting system. Despite the so-called spring predictability barrier, present throughout the record, there is substantial second-year ENSO skill, especially after 1960. Overall, ENSO exhibited notably high values of both amplitude and skill towards the end of the 19th century, and again in recent decades.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗
DOE OSTI2023

Safer Foundation Solar Demands Skill Collaborative

The milestones and accomplishments achieved in Safer’s Solar Demands Skill Training program required a collective effort of stakeholders. The ability to achieve the desired results and impact lives of the population we serve works best when collaborating with community stakeholders such as community-based organizations, faith-based organizations, community activists, local law enforcement, community residents, employers, and elected and appointed officials. We are working harder than ever to place clients in-demand careers and high-growth industry sectors. Our employer engagement with high growth sectors continues to increase, we have been able to deepen our relationships in this space by providing in demand stackable credential training. Launched our initiative in the green job space by partnering with organizations like ComEd, the Department of Energy, community-based organizations, faith-based organizations, and manufacturers that helped to train clients in the green jobs and renewable energy space. By the end of the year, we will have completed our tenth cohort of photovoltaic solar installation training. The training has been used as a foundation for solar panel installers to acquire new skills in in the green jobs career pathways, such as sales and customer service. It has also served as a pipeline to union-level trade positions through the skills participants obtained through partnership engagement. Safer Foundation's policy and advocacy team plays a major role in expanding opportunities for people with records to over one hundred occupations, including the trades. This reform has allowed many to secure living wage employment, reducing the high recidivism rate within Illinois. Safer continues to build our social enterprise with Reconstructive Technology Partners (RTP). RTP is introducing people with records to the construction trades such as solar, carpentry and electrical through residential remodeling of homes on smaller construction projects. Understanding the need to have a greater community presence, outreach was extended to a boots on the ground model, including, but not limited to door-to-door engagement, DE-EE0008571 Safer Foundation Page 4 of 29 local radio broadcasting and print ads in local newspapers. We continue to seek innovative ways to increase Safer Foundations' presence in the renewable energy space. Outreach efforts gave us an opportunity to share critical reentry information and opportunities about our PV installer program. Giving us reach with local and national audiences alike. We launched a systematic approach to improving client data and client tracking through an evidence-based practices initiative. That implemented an agency wide cross-functional data management system. The system supported our goal of reviewing, evaluating, and making recommendations to improve operational processes, program delivery, information sharing, and more. Played a significant part in the success of the solar program. Finally, economists around the nation agree that there is a significant labor shortage. The shortage directly threatens our ability to sustain our economic growth; if employers do not have access to the workers they need, it can lead to a shutdown in the economic recovery. The demand for Safer Foundation services is more important and impactful than ever. We will continue to build upon our 50 years of experience to address the challenges ahead and serve more people in a better way. We are confident we will accomplish beautiful things that benefit everyone involved because together, we are powerful.

14 SOLAR ENERGY↗
DOE OSTI2026

Fermilab 2025 Summer Internship Skills Learned from Working with Mu2e Tracker Team

As part of a DOE RENEW Grant, the undergraduate authors interned at Fermilab. They spent nine weeks over summer 2025 working on the tracker team for the Mu2e experiment. They gained practical experience in a multitude of new skills including electronics installation, testing, and repairs. Their work particularly increased productivity by helping repair the high voltage and calibration pre-amplifiers, over 20,000 of which are needed in the tracker. These components are very fragile and often break during the installation process. The experience also taught them several soft skills such as the importance of thoughtful data storage, record- keeping, and problem-solving skills. They learned the demands of a large, international collaboration and how to work in a team. The authors would like to acknowledge their advisor and PI of the grant, Dr. Christopher G. Fasano, and the Mu2e team lead by co- spokesperson Dr. Bob Bernstein and tracker L2 manager Dr. Brendan Kiburg.

de Zwart, Brontë↗
DOE OSTI2023

Evaluating skill in predicting the Interdecadal Pacific Oscillation in initialized decadal climate prediction hindcasts in E3SMv1 and CESM1 using two different initialization methods and a small set of start years

Abstract It is a daunting challenge to conduct initialized hindcasts with enough ensemble members and associated start years to form a drifted climatology from which to compute the anomalies necessary to quantify the skill of the hindcasts when compared to observations. This limits the ability to experiment with case studies and other applications where only a few initial years are needed. Here we run a set of hindcasts with CESM1 and E3SMv1 using two different initialization methods for a limited set of start years and use the respective uninitialized free-running historical simulations to form the model climatologies. Since the drifts from the observed initial states in the hindcasts toward the uninitialized model state are large and rapid, after a few years the drifted initialized models approach the uninitialized model climatological errors. Therefore, hindcasts from the limited start years can use the uninitialized climatology to represent the drifted model states after about lead year 3, providing a means to compute forecast anomalies in the absence of a large hindcast sample. There is comparable skill for predicting spatial patterns of multi-year Pacific sea surface temperature anomalies in the domain of the Interdecadal Pacific Oscillation using this method compared to the conventional methodology with a large hindcast data set, though there is a model dependence to the drifts in the two initialization methods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Volcanic forcing degrades multiyear-to-decadal prediction skill in the tropical Pacific

Volcanic aerosol forcing can affect global climate, but its role in climate prediction remains poorly understood. We isolate the impact of volcanic eruptions on multiyear-to-decadal climate prediction skill by comparing two suites of initialized decadal hindcasts conducted with and without historical volcanic forcing. Unexpectedly, the inclusion of volcanic forcing in the prediction system significantly degrades the forecast skill of detrended multiyear-to-decadal sea surface temperature (SST) variability in the central-eastern tropical Pacific. The ensemble mean hindcasts produce multiyear-to-decadal tropical Pacific SST cooling in response to large tropical volcanic eruptions through thermodynamic and El Niño–Southern Oscillation (ENSO)–like dynamic processes. However, in observations, these eruptions coincided with tropical Pacific warming, which is well predicted by the no-volcano hindcasts and, hence, is likely related to internal climate variability. Improved model representation of volcanic response and its interaction with internal climate variability is required to advance prediction of tropical Pacific decadal variability and associated global impacts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Machine Learning for Daily Forecasts of Arctic Sea Ice Motion: An Attribution Assessment of Model Predictive Skill

Physics-based simulations of Arctic sea ice are highly complex, involving transport between different phases, length scales, and time scales. Resultantly, numerical simulations of sea ice dynamics have a high computational cost and model uncertainty. We employ data-driven machine learning (ML) to make predictions of sea ice motion. The ML models are built to predict present-day sea ice velocity given present-day wind velocity and previous-day sea ice concentration and velocity. Models are trained using reanalysis winds and satellite-derived sea ice properties. We compare the predictions of three different models: persistence (PS), linear regression (LR), and a convolutional neural network (CNN). We quantify the spatiotemporal variability of the correlation between observations and the statistical model predictions. Additionally, we analyze model performance in comparison to variability in properties related to ice motion (wind velocity, ice velocity, ice concentration, distance from coast, bathymetric depth) to understand the processes related to decreases in model performance. Results indicate that a CNN makes skillful predictions of daily sea ice velocity with a correlation up to 0.81 between predicted and observed sea ice velocity, while the LR and PS implementations exhibit correlations of 0.78 and 0.69, respectively. The correlation varies spatially and seasonally: lower values occur in shallow coastal regions and during times of minimum sea ice extent. LR parameter analysis indicates that wind velocity plays the largest role in predicting sea ice velocity on 1-day time scales, particularly in the central Arctic. Regions where wind velocity has the largest LR parameter are regions where the CNN has higher predictive skill than the LR.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The predictive skill of convolutional neural networks models for disease forecasting

In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Predictive Skill of Deep Learning Models Trained on Limited Sequence Data

In this report we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, especially variants of recurrent neural networks (RNNs) have been studied for influenza forecasting, and have achieved higher forecasting skill compared to conventional models such as ARIMA models. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block temporal convolutional networks and simple neural attentive meta-learner for epidemiological forecasting and test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Supporting Growth of a Skilled Workforce in the Building Energy Efficiency Industry (Final Technical Report)

The Interstate Renewable Energy Council (IREC), having worked for well over a decade to develop national networks and best practices focused on attracting and training high quality workers for the clean energy industries, sought to address shortfalls in skilled workers who build, retrofit, operate, and maintain energy efficient buildings. Through this project, IREC created and promoted a Green Buildings Career Map (GBCM)—a career awareness and recruitment tool—that seeks to boost the nationwide growth of workers entering the energy efficiency (EE) industry. Working with a team of subject matter experts and our partner organizations—Building Performance Association (BPA), Building Performance Institute (BPI), Community Action Partnership (CAP), and the National Institute of Building Sciences (NIBS)—IREC produced an interactive, engaging career map to attract and motivate individuals into pursuing careers in energy efficiency, and in support of the Weatherization Assistance Program. The GBCM was designed for a broad audience including educators, career advisors, employers, policymakers, workforce professionals, and jobseekers who may otherwise have little or no awareness of the exciting and rewarding opportunities within targeted industry sectors. Most individuals seeking careers do not know about the breadth of careers awaiting them in the built environment and the same is true for most career and guidance counselors, educators, and parents. The GBCM provides this broad audience with a vision of the myriad jobs that could lead to a long-standing career in energy efficiency. The GBCM describes diverse occupations across the EE industry, charts possible progression between those occupations, and identifies the training, skills, and credentials necessary to do them well.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Two Project Concepts on Skills Matching for an Equitable Energy Transition

This is the final scientific/technical report for Two Project Concepts on Skills Matching for an Equitable Energy Transition. The primary objective of this research into skills matching is to aid in the development and implementation of locally tailored policies to support the US energy workforce as it transitions in the years ahead.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

mada-tools: MCP servers, configurations, skills, and examples for MADA

MADA-tools (Multi-Agent Design Assistant tools) is a library for defining MCP (Model Context Protocol) servers that can be used by AI agents in the MADA project. Each MCP server provides a focused set of tools that enhances an LLM's knowledge and capabilities for a specific domain, for example, how to launch jobs with Flux versus Slurm. The library makes it easy to configure and start multiple MCP servers using configuration files or command line options. Once running, these servers are intended to be consumed by one or more agents in the MADA ecosystem. The system is designed to be extensible so that future projects can contribute their own MCP servers, skills, and toolsets.

Gunnarson, BrianS [Lawrence Livermore National Lab↗
DOE OSTI2021

Five-day track forecast skills of WRF model for the western North Pacific tropical cyclones

In this study, the characteristics of simulated tropical cyclones (TCs) over the western North Pacific by a regional model (the WRF Model) are verified. We utilize 12-km horizontal grid spacing, and simulations are integrated for 5 days from model initialization. A total of 125 forecasts are divided into five clusters through the k-means clustering method. The TCs in the cluster 1 and 2 (group 1), which includes many TCs moving northward in the subtropical region, generally have larger track errors than for TCs in cluster 3 and 4 (group 2). The optimal steering vector is used to examine the difference in the track forecast skill between these two groups. The bias in the steering vector between the model and analysis data is found to be more substantial for group 1 TCs than group 2 TCs. The larger steering vector difference for group 1 TCs indicates that environmental fields tend to be poorly simulated in group 1 TC cases. Furthermore, the residual terms, including the storm-scale process, asymmetric convection distribution, or beta-related effect, are also larger for group 1 TCs than group 2 TCs. Therefore, it is probable that the large track forecast error for group 1 TCs is a result of unreasonable simulations of environmental wind fields and residual processes in the midlatitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Developing Metrics to Evaluate the Skill and Credibility of Downscaling

In this project, our overarching goal was to evaluate the skill and credibility of statistical and dynamical downscaling techniques for reconstructing the historical climate record and projecting future climate change. This report summarizes our approach and accomplishments. In the first year of the project, the priority was to generate new data sets. For Year 2, the overall goal was to focus comparisons during the historical period and for a subset of variables, especially temperature and precipitation. In Year 3 and beyond, the focus was mainly on comparisons and metrics for future climate change simulations. To quantify the uncertainty associated with gridded dataset choice, the UCLA group compared eight gridded temperature datasets, examining climatologies, variability, and trends. The Scripps group completed statistical downscaling of NARR with the LOCA method, and UCLA and Scripps collaborated on a comparison of historical and end-of-century temperature and precipitation patterns over California from WRF, LOCA-WRF, and LOCA-Livneh. In addition to downscaling temperature and precipitation, the Scripps group has spent considerable time working on near-surface wind and humidity downscaling. The Santa Clara group assembled the Variable Infiltration Capacity (VIC) for nine snow-dominated river basins draining the western slopes of the Sierra Nevada range and assessed the role of snow albedo feedback in their VIC simulations. The results will help inform future downscaling studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Developing Metrics to Evaluate the Skill and Credibility of Downscaling (Final Report)

In this project, our overarching goal was to evaluate the skill and credibility of statistical and dynamical downscaling techniques for reconstructing the historical climate record and projecting future climate change. This report summarizes our approach and accomplishments. In the first year of the project, the priority was to generate new data sets. For Year 2, the overall goal was to focus comparisons during the historical period and for a subset of variables, especially temperature and precipitation. In Year 3 and beyond, the focus was mainly on comparisons and metrics for future climate change simulations. To quantify the uncertainty associated with gridded dataset choice, the UCLA group compared eight gridded temperature datasets, examining climatologies, variability, and trends. The Scripps group completed statistical downscaling of NARR with the LOCA method, and UCLA and Scripps collaborated on a comparison of historical and end-of-century temperature and precipitation patterns over California from WRF, LOCA-WRF, and LOCA-Livneh. In addition to downscaling temperature and precipitation, the Scripps group has spent considerable time working on near-surface wind and humidity downscaling. The Santa Clara group assembled the Variable Infiltration Capacity (VIC) for nine snow-dominated river basins draining the western slopes of the Sierra Nevada range and assessed the role of snow albedo feedback in their VIC simulations. The results will help inform future downscaling studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Evaluation of Hands-On Cybersecurity Skills Development

Cybersecurity is a relatively new and quickly advancing industry, though there is a deficit in industry professionals throughout the world. This deficit is a result of the inability of education to keep up with the continuously changing cyber-threat landscape. A lack of effective, accessible, hands-on training platforms is a barrier for students and professionals who seek to gain the skills and abilities necessary to enter the workforce. Additionally, the lack of adequate training makes it difficult for industry experts to upskill or stay up to date on new advancements within the field of cybersecurity. The goal of this cohort is to discover what makes an effective or ineffective training platform, what platforms are currently available, and to determine the next steps for hands-on learning. Hands-on experience is necessary to create workforce ready professionals, yet it is underutilized by students and professionals of cybersecurity due to costs, availability, and ease of use. This cohort has uncovered hands-on training solutions, identified many effective training solutions, and explored potential improvement to cybersecurity training. These findings resulted in the cohort moving beyond research to test the resources that currently exist or are in development, and to apply that knowledge to discovering and developing engaging hands-on training.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Skill of Mesoscale Models in Forecasting Springtime Macrophysical Cloud Properties at the Savannah River Site in the Southeastern US

Predicting boundary layer clouds is important for the accurate modeling of pollutant dispersion. Higher resolution mesoscale models would be expected to produce better forecasts of cloud properties that affect dispersion. Using ceilometer observations, we assess the skill of two operational mesoscale models (RAMS and WRF) to forecast cloud base altitude and cloud fraction at the Savannah River Site in the southeastern US during the springtime. Verifications were performed at small spatial and temporal scales necessary for dispersion modeling. Both models were unreliable with a 50% (RAMS) and a 46% (WRF) rate of predicting clouds observed by the ceilometer which led to low cloud fraction predictions. Results indicated that WRF better predicted daytime cloud bases from convection that occurred frequently later in the period and RAMS better predicted nighttime cloud bases. Using root mean squared error (RMSE) to score the forecast periods also highlighted this diurnal dichotomy, with WRF scores better during the day and RAMS scores better at night. Analysis of forecast errors revealed divergent model cloud base biases—WRF low and RAMS high. A hybrid solution which weighs more heavily the RAMS nighttime forecasts and WRF daytime forecasts will likely provide the best prediction of cloud properties for dispersion.

54 ENVIRONMENTAL SCIENCES↗