Search NASA⌕ Search

SEARCH · Search NASA

Results for “Skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Quantifying sources of subseasonal prediction skill in CESM2

Abstract Subseasonal prediction fills the gap between weather forecasts and seasonal outlooks. There is evidence that predictability on subseasonal timescales comes from a combination of atmosphere, land, and ocean initial conditions. Predictability from the land is often attributed to slowly varying changes in soil moisture and snowpack, while predictability from the ocean is attributed to sources such as the El Niño Southern Oscillation. Here we use a set of subseasonal reforecast experiments with CESM2 to quantify the respective roles of atmosphere, land, and ocean initial conditions on subseasonal prediction skill over land. These reveal that the majority of prediction skill for global surface temperature in weeks 3–4 comes from the atmosphere, while ocean initial conditions become important after week 4, especially in the Tropics. In the CESM2 subseasonal prediction system, the land initial state does not contribute to surface temperature prediction skill in weeks 3–6 and climatological land conditions lead to higher skill, disagreeing with our current understanding. However, land-atmosphere coupling is important in week 1. Subseasonal precipitation prediction skill also comes primarily from the atmospheric initial condition, except for the Tropics, where after week 4 the ocean state is more important.

Richter, Jadwiga H. (ORCID:0000000170480781)↗

Seasonal forecasting skill for the High Mountain Asia region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorologically relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks to months is an area of active research and development. NASA's Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1–3-month lead times in the HMA region, including a portion of the Indian subcontinent, during the retrospective forecast period, 1981–2016. To assess forecast skill, we evaluate 2 m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to the similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from an anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system's ability to forecast HMA hydrometeorology.

54 ENVIRONMENTAL SCIENCES↗

An intelligent tutoring system for the investigation of high performance skill acquisition

The issue of training high performance skills is of increasing concern. These skills include tasks such as driving a car, playing the piano, and flying an aircraft. Traditionally, the training of high performance skills has been accomplished through the use of expensive, high-fidelity, 3-D simulators, and/or on-the-job training using the actual equipment. Such an approach to training is quite expensive. The design, implementation, and deployment of an intelligent tutoring system developed for the purpose of studying the effectiveness of skill acquisition using lower-cost, lower-physical-fidelity, 2-D simulation. Preliminary experimental results are quite encouraging, indicating that intelligent tutoring systems are a cost-effective means of training high performance skills.

Fink, Pamela K.↗

Skills, rules and knowledge in aircraft maintenance: errors in context

Automatic or skill-based behaviour is generally considered to be less prone to error than behaviour directed by conscious control. However, researchers who have applied Rasmussen's skill-rule-knowledge human error framework to accidents and incidents have sometimes found that skill-based errors appear in significant numbers. It is proposed that this is largely a reflection of the opportunities for error which workplaces present and does not indicate that skill-based behaviour is intrinsically unreliable. In the current study, 99 errors reported by 72 aircraft mechanics were examined in the light of a task analysis based on observations of the work of 25 aircraft mechanics. The task analysis identified the opportunities for error presented at various stages of maintenance work packages and by the job as a whole. Once the frequency of each error type was normalized in terms of the opportunities for error, it became apparent that skill-based performance is more reliable than rule-based performance, which is in turn more reliable than knowledge-based performance. The results reinforce the belief that industrial safety interventions designed to reduce errors would best be directed at those aspects of jobs that involve rule- and knowledge-based performance.

Aircraft↗

Acquisition of Skill Proficiency Over Multiple Sessions of a Novel Rover Simulation

Following long-duration exploration transits, adaptive changes in sensorimotor function may impair the crew's ability to safely perform manual control tasks such as operating pressurized rovers. Postflight performance will also be influenced by the level of preflight skill proficiency they have attained. The purpose of this study was to characterize the acquisition of skills in a motion-based rover simulation over multiple sessions, and to investigate the effects of varying the simulation scenarios. METHODS: Twenty healthy subjects were tested in 5 sessions, with 1-3 days between sessions. Each session consisted of a serial presentation of 8 discrete tasks to be completed as quickly and accurately as possible. Each task consisted of 1) perspective-taking, using a map that defined a docking target, 2) navigation toward the target around a Martian outpost, and 3) docking a side hatch of the rover to a visually guided target. The simulator utilized a Stewart-type motion base (CKAS, Australia), single-seat cabin with triple scene projection covering 150 deg horizontal by 50 deg vertical, and joystick controller. Subjects were randomly assigned to a control group (tasks identical in the first 4 sessions) or a varied-practice group. The dependent variables for each task included accuracy toward the target and time to completion. RESULTS: The greatest improvements in time to completion occurred during the docking phase. The varied-practice group showed more improvement in perspective-taking accuracy. Perspective-taking accuracy was also affected by the relative orientation of the rover to the docking target. Skill acquisition was correlated with self-ratings of previous gaming experience. DISCUSSION: Varying task selection and difficulty will optimize the preflight acquisition of skills when performing novel operational tasks. Simulation of operational manual control will provide functionally relevant evidence regarding the impact of sensorimotor adaptation on early surface operations and what countermeasures are needed. Learning Objective: The use of a motion-based simulation to investigate decrements in the proficiency to operate pressurized rovers during early surface operations of space exploration missions, along with the acquisition of skill proficiency needed during the preflight phase of the mission.

Dean, S. L.↗

The Effects of Development Team Skill on Software Product Quality

This paper provides an analysis of the effect of the skill/experience of the software development team on the quality of the final software product. A method for the assessment of software development team skill and experience is proposed, and was derived from a workforce management tool currently in use by the National Aeronautics and Space Administration. Using data from 26 smallscale software development projects, the team skill measures are correlated to 5 software product quality metrics from the ISO/IEC 9126 Software Engineering Product Quality standard. in the analysis of the results, development team skill is found to be a significant factor in the adequacy of the design and implementation. In addition, the results imply that inexperienced software developers are tasked with responsibilities ill-suited to their skill level, and thus have a significant adverse effect on the quality of the software product. Keywords: software quality, development skill, software metrics

Beaver, Justin M.↗

Modeling the Skills and Practices of Scientists through an “All-Inclusive” Comparative Planetology Student Research Investigation

To effectively prepare the nation's future Science, Technology, Engineering, and Mathematics (STEM) workforce, students in today's classrooms need opportunities to engage in authentic experiences that model skills and practices used by STEM professionals. Relevant, real-world authentic research experiences allow students to behave as scientists as they model the process of science. This enables students to get a true sense of STEM-related professions and also allows them to develop the requisite knowledge, skills, curiosity, and creativity necessary for success in STEM careers. Providing professional development and opportunities to help teachers infuse research in the classroom is one of the primary goals of the Expedition Earth and Beyond (EEAB) program. EEAB, facilitated by the Astromaterials Research and Exploration Science (ARES) Directorate at the NASA Johnson Space Center, is an Earth and planetary science education program designed to inspire, engage, and educate teachers and students in grades 5-12 by getting them actively involved with exploration, discovery, and the process of science. The program combines the expertise of scientists and educators to ensure the professional development provided to classroom teachers is scientifically valid and also recognizes classroom constraints. For many teachers, facilitating research in the classroom can be challenging. In addition to addressing required academic standards and dealing with time constraints, challenges include structuring a research investigation the entire class can successfully complete. To build educator confidence, foster positive classroom research experiences, and enable teachers to help students model the skills and practices of scientists, EEAB has created an "allinclusive" comparative planetology research investigation activity. This activity addresses academic standards while recognizing students (and teachers) potentially lack experience with scientific practices involved in conducting research. Designed as an entry level research engagement investigation, the activity introduces, illustrates, and teaches the skills involved in each step of the research process. Students use astronaut photos, provided through the ARES Crew Earth Observations (CEO) payload on the International Space Station (ISS) as well as remote sensing imagery of other planetary worlds. By including all the necessary tools to complete the investigation, students can focus on gaining experience in the process of science. Additionally, students are able to extend their experience of modeling the skills and practices of scientists through the opportunity to request new data of Earth from the ISS. Professional development offered through in-person and webinar trainings, along with the resources provided, enable educators to gain first-hand experience implementing a structured research investigation in the classroom. Through data and feedback collected from teachers, this type of "all-inclusive" investigation activity aims to become a model that can be utilized for other research topics and STEM disciplines.

Graff, Paige↗

Global Assimilation of L-Band Brightness Temperature Observations from SMAP and SMOS into the Catchment Land Surface Model and Contribution to the Skill of Soil Moisture Estimates

The Soil Moisture Active Passive (SMAP) and Soil Moisture Ocean Salinity (SMOS) missions provide global observations of L-band (1.4 GHz) passive microwave brightness temperature (Tb) observations at a resolution of ~40 km every 2-3 days. These observations have been available since 2015 from SMAP and since 2010 from SMOS.Soil moisture estimates from the separate assimilation of SMAP and SMOS Tb observations into land surface models were previously shown to improve over model-only estimates, thereby demonstrating the value of assimilating L-band Tb observations for soil moisture estimation. The assimilation experiments documented in the literature do not, however, establish whether the joint assimilation of SMAP and SMOS Tbs improves the skill of the resulting soil moisture estimates beyond what can be achieved with either set of observations alone. Moreover, because the published SMAP and SMOS results used different assimilation systems and configurations and applied different evaluation data and procedures, it is unclear whether the assimilation of SMAP-only or SMOS-only Tbs results in better soil moisture skill. In this presentation, we compare the results of three separate assimilation experiments for the period from April 2015 to present. The experiments utilize the SMAP Level-4 Soil Moisture (L4_SM) algorithm, which assimilates L-band Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. Specifically, the three experiments presented here assimilate (i) SMAP Tbs only, as in the L4_SM product, (ii) SMOS Tbs only, after interpolation of 40° incidence angle, and (iii) both SMAP and SMOS Tbs. In all other respects, the configuration of three experiments is identical, as is the validation of the output. Preliminary results suggest that the joint assimilation of SMAP and SMOS Tbs yields the most skillful soil moisture estimates when compared to independent in situ measurements. Moreover, the skill of the SMAP-only assimilation exceeds that of the SMOS-only assimilation. The presentation provides an in-depth evaluation of the skill of the assimilation estimates vs. independent in situ and satellite measurements and in terms of statistics of the observation-minus-forecast residuals and analysis increments.

Reichle, Rolf↗

Skillful Seasonal Forecasts of Land Carbon Uptake in Northern Mid- and High Latitudes

Here we present a first look at the Gross Primary Production (GPP) forecast skill levels achievable with a state-of-the-art subseasonal-to-seasonal (S2S) forecast system. Using NASA’s retrospective S2S ensemble forecast in conjunction with a terrestrial biosphere model, and using an independent, remote sensing-based dataset for validation, we demonstrate an ability to accurately forecast spring-summer carbon uptake at multi-month leads. Averaged across mid-and high latitudes of the Northern Hemisphere land, the GPP forecast initialized on January 1 produces statistically significant skill through summer. The skill achieved, however, is spatially variable, with some regions appearing to extract skill from accurate forecasts of snowpack removal and others extracting skill from the initialization of carbon and nitrogen states. Our results reveal some heretofore unexplored facets of climate predictability and provide a look at what might be possible with future S2S forecast systems that are fully integrated with biogeochemical cycles.

Eunjee Lee↗

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗

The Death of Airmanship: The Urgent Need to Understand Pilot Skills and Knowledge

Aviation awards a special name—airmanship—for the quality of being highly competent in foundational piloting skills, which seem to comprise primarily judgment, decision making, stick-and-rudder skills, and a bit of intuition. The term, which has a mystical quality, has historically resisted analysis; airmanship is acquired solely through experience. The graying of the Boomers and the extreme turbulence of the last few years in commercial aviation have led to a significant loss of those pilots who started out in simpler, round-dial airplanes and made a tortured transition to glass. Those pilots were comfortable disengaging the autopilot at any time, and more importantly, they continued to stay mentally engaged with flight and systems management even as automation continued to encroach on traditional pilot roles. As an industry, we need to prepare for the loss of these pilots by understanding the elements of airmanship and finding a way to replace the competency. The goal is to eliminate “airmanship” by understanding it...by demystifying it. Human factors/cognitive engineering offers tools and methods to develop a system interface that supports skilled performance from the human/technology team. In this presentation, I will talk about my efforts to understand the elements of skilled performance so that they can be trained, or supported by the interface in a seamless manner Specific topics will include the limits of SOP, monitoring for flight path management, alerting non-normals, and autoflight/mode confusion.

pilot skills↗

Attribution of NAO Predictive Skill Beyond 2 Weeks in Boreal Winter

Weeks 3–6 averaged winter North Atlantic Oscillation (NAO) predictive skill in a state-of-the-art coupled climate prediction system is attributed to two principle sources: upper and lower boundary conditions linked to the stratosphere and El Niño-Southern Oscillation (ENSO), respectively. A 20-member ensemble of 45-day reforecasts over 1999–2015 is utilized, together with uninitialized simulations with the atmospheric component of the prediction system forced with observed radiative forcing and lower boundary conditions. NAO forecast skill for lead times out to 6 weeks is higher following extreme stratospheric polar vortex conditions (weak and strong vortex events) compared to neutral states. Enhanced weeks 3-6 NAO predictive skill for weak vortex events results primarily from stratospheric downward coupling to the troposphere, while enhanced skill for strong vortex events can be partly attributed to lower boundary forcing related to the ENSO phenomenon. Implications for forecast system development and improvement are discussed.

54 ENVIRONMENTAL SCIENCES↗

Quantifying the Effect of Climate Change on Midlatitude Subseasonal Prediction Skill Provided by the Tropics

Abstract Subseasonal timescales (∼2 weeks–2 months) are known for their lack of predictability, however, specific Earth system states known to have a strong influence on these timescales can be harnessed to improve prediction skill (known as “forecasts of opportunity”). As the climate continues warming, it is hypothesized these states may change and consequently, their importance for subseasonal prediction may also be impacted. Here, we examine changes to midlatitude subseasonal prediction skill provided by the tropics under anthropogenic warming using artificial neural networks to quantify skill. The network is tasked to predict the sign of the 500 hPa geopotential height for historical and future time periods in the Community Earth System Model Version 2 ‐ Large Ensemble across the Northern Hemisphere at a 3 week lead using tropical precipitation. We show prediction skill changes substantially in key midlatitude regions and these changes appear linked to changes in seasonal variability with the largest differences in accuracy occurring during forecasts of opportunity.

Mayer, Kirsten J.↗

Skillful multiyear predictions of ocean acidification in the California Current System

The California Current System (CCS) sustains economically valuable fisheries and is particularly vulnerable to ocean acidification, due to its natural upwelling of carbon-enriched waters that generate corrosive conditions for local ecosystems. Here we use a novel suite of retrospective, initialized ensemble forecasts with an Earth system model (ESM) to predict the evolution of surface pH anomalies in the CCS. We show that the forecast system skillfully predicts observed surface pH variations a year in advance over a naive forecasting method, with the potential for skillful prediction up to five years in advance. Skillful predictions of surface pH are mainly derived from the initialization of dissolved inorganic carbon anomalies that are subsequently transported into the CCS. Our results demonstrate the potential for ESMs to provide skillful predictions of ocean acidification on large scales in the CCS. Initialized ESMs could also provide boundary conditions to improve high-resolution regional forecasting systems.

54 ENVIRONMENTAL SCIENCES↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

Delivering Contextual Knowledge and Critical Skills of Disruptive Technologies through Problem-Based Learning in Research Experiences for Undergraduates Setting

The recent development in transportation, such as energy-efficient and autonomous vehicles, defines a condition for the students in transportation engineering. Students in the field of transportation engineering should be ready upon their graduation with new knowledge and skills that are compatible with the need of the industry and sustainable engineering practices.During summers of 2018 and 2019, we developed and implemented an eight-week program to increase the knowledge and skills of students coming from multidisciplinary fields related to autonomous vehicles. Problem of “How much will platooning reduce fuel consumption and emissions per vehicle mile traveled?” was instrumentalized in subsequent activities to introduce the comprehensive knowledge structure of autonomous vehicles.The engineering concept of reducing the cost and sustainability was embedded in the leading research question that helped us to develop and implement activities on an overall knowledge structure in autonomous vehicles. The goal of using problem-based learning activities was not to encourage the students to focus on reaching the solution merely. We aimed to introduce the multidisciplinary knowledge and critical skills aspects of learning about disruptive technologies.In this paper, we will discuss how a multidisciplinary research approach was incorporated into a problem-based learning activity. The students were introduced the subjects related to math, physics, computer science, and biology as the integration of the knowledge structure of autonomous vehicles. We will also present the results on students’ use of critical skills such as machine learning and computer programming.

Comert, Gurcan↗

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Ongoing research investigating perceptual and contextual influences on skilled human performance in dynamic decision making environments is discussed. The research is motivated by two general classes of findings in recent decision making research. First, many studies suggest that the concrete context in which a task is presented has strong influences on the psychological processes used to perform the task and on subsequent performance. Second, studies of skilled behavior in a wide variety of task environments typically implicate the perceptual system as an important contributor to decision-making performance, either in its role as a mediator between the current decision context and stored knowledge, or as a mechanism capable of directly initiating activity through the development of a 'trained eye.' Both contextual and perceptual influences place limits on the ability of traditional utility-theoretic accounts of decision-making to guide display design, as variance in behavior due to contextual factors or the development of a perceptual skill is left unexplained. The author outlines a framework in which to view questions of perceptual and contextual influences on behavior and describe an experimental task and analysis technique which will be used to diagnose the possible role of perception in skilled decision making performance.

Kirlik, Alex↗