Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

The De-Icing Comparison Experiment (D-ICE): a study of broadband radiometric measurements under icing conditions in the Arctic

Abstract. Surface-based measurements of broadband shortwave (solar) and longwave (infrared) radiative fluxes using thermopile radiometers are made regularly around the globe for scientific and operational environmental monitoring. The occurrence of ice on sensor windows in cold environments – whether snow, rime, or frost – is a common problem that is difficult to prevent as well as difficult to correct in post-processing. The Baseline Surface Radiation Network (BSRN) community recognizes radiometer icing as a major outstanding measurement uncertainty. Towards constraining this uncertainty, the De-Icing Comparison Experiment (D-ICE) was carried out at the NOAA Atmospheric Baseline Observatory in Utqiaġvik (formerly Barrow), Alaska, from August 2017 to July 2018. The purpose of D-ICE was to evaluate existing ventilation and heating technologies developed to mitigate radiometer icing. D-ICE consisted of 20 pyranometers and 5 pyrgeometers operating in various ventilator housings alongside operational systems that are part of NOAA's Barrow BSRN station and the US Department of Energy Atmospheric Radiation Measurement (ARM) program North Slope of Alaska and Oliktok Point observatories. To detect icing, radiometers were monitored continuously using cameras, with a total of more than 1 million images of radiometer domes archived. Ventilator and ventilator–heater performance overall was skillful with the average of the systems mitigating ice formation 77 % (many >90 %) of the time during which icing conditions were present. Ventilators without heating elements were also effective and capable of providing heat through roughly equal contributions of waste energy from the ventilator fan and adiabatic heating downstream of the fan. This provided ∼0.6 ∘C of warming, enough to subsaturate the air up to a relative humidity (with respect to ice) of ∼105 %. Because the mitigation technologies performed well, a near complete record of verified ice-free radiometric fluxes was assembled for the duration of the campaign. This well-characterized data set is suitable for model evaluation, in particular for the Year of Polar Prediction (YOPP) first Special Observing Period (SOP1). We used the data set to calculate short- and long-term biases in iced sensors, finding that biases can be up to +60 W m−2 (longwave) and −211 to +188 W m−2 (shortwave). However, because of the frequency of icing, mitigation of ice by ventilators, cloud conditions, and the timing of icing relative to available sunlight, the biases in the monthly means were generally less than the aggregate uncertainty attributed to other conventional sources in both the shortwave and longwave.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Assessing the Impact of SMAP Soil Moisture Data Assimilation on the Simulation and Prediction of Tropical Cyclone Idai

The role of soil moisture in the evolution of tropical cyclones (TCs) approaching land has long been recognized. Dry land surface conditions can lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions can help sustain or even re-intensify a TC. The ability to forecast post-landfall TC evolution and mitigate the associated socio-economic impact thus hinges on accurate knowledge of land surface conditions prior to landfall. The NASA Soil Moisture Active Passive (SMAP) mission provides accurate observations of soil moisture globally and at high revisit times of 2-3 days. It has been shown that the assimilation of SMAPbrightness temperatures (Tb) significantly improves modeled land surface states and thus has the potential to constrain land surface initial conditions in TC forecasts. In this presentation, we investigate this potential through an extensive set of Observing System Experiments that systematically assess the impact of assimilating SMAP Tbs on TC forecast skill in the Goddard Earth Observing System. Focusing on the case of TC Idai, we show that the assimilation of SMAP generally leads to a drier soil moisture analysis for the land surface underneath much of the storm’s circulation. An exception is the direct TC track, where SMAP assimilation increases soil moisture. These changes are reflected in the surface fluxes, which propagate the land surface state changes to the atmosphere. This results a TC that is overall weaker with lower winds, but with a better-defined eye and a slightly smaller track error than a simulation without SMAP DA. The changes in soil moisture resulting from the assimilation of SMAP also impact the total precipitation amounts as well as the precipitation structure associated with TC Idai.

SMAP↗
DOE OSTI2022

Classification of animal sounds in a hyperdiverse rainforest using convolutional neural networks with data augmentation

To protect tropical forest biodiversity, we need to be able to detect it reliably, cheaply, and at scale. Automated detection of sound producing animals from passively recorded soundscapes via machine-learning approaches is a promising technique towards this goal, but it is constrained by the necessity of large training data sets. Using soundscapes from a tropical forest in Borneo and a Convolutional Neural Network model (CNN), we investigate i) the minimum viable training data set size for accurate prediction of call types (‘sonotypes’), and ii) the extent to which data augmentation and transfer learning can overcome the issue of small and imbalanced training data sets. We found that even relatively high sample sizes (>80 per sonotype) lead to mediocre accuracy, which however improved significantly with data augmentation and transfer learning, including at extremely small sample sizes (3 per sonotype), regardless of taxonomic group or call characteristics. Neither transfer learning nor data augmentation alone achieved high accuracy. Our results suggest that transfer learning and data augmentation could make the use of CNNs to classify species’ vocalizations feasible even for small soundscape-based projects with many rare species. Retraining our open-source model requires only basic programming skills which makes it possible for individual conservation initiatives to match their local context, in order to enable more evidence-informed management of biodiversity.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2020

Effects of Long-Duration Space Flight on Training Retention and Transfer

The space environment imposes on the astronaut crew significant physiological, psycho-social, and cognitive loads that can not be replicated on the ground. These loads likely impact crew performance. To date, no systematic data collection has taken place to understand the effects of such loads on crew members ability to retain trained knowledge and skills, and to transfer such knowledge and skills to novel situations. The research described here was originally requested by HRP management to be the first such study to systematically collect data on the effects of long duration space flight on training retention and transfer. Because current theories of retention and transfer are based on results obtained in university laboratories using undergraduate students as research participants, and because crew time in space is very expensive, this study was designed to compare the performance of 4 groups of subjects: crew members in space, crew members on the ground, crew-like subjects, and university undergraduate students. Results from the ground-phase of the study reported here demonstrate that crew members performance under cognitive load can not be predicted from the performance of university undergraduate students. It is still an open question the extent to which crew members cognitive performance in space can be predicted from the performance of crew members on the ground.

Barshi, Immanuel↗
NASA NTRS2020

Effects of Long-Duration Space Flight on Training Retention and Transfer

The space environment imposes on the astronaut crew significant physiological, psycho-social, and cognitive loads that can not be replicated on the ground. These loads likely impact crew performance. To date, no systematic data collection has taken place to understand the effects of such loads on crew members’ ability to retain trained knowledge and skills, and to transfer such knowledge and skills to novel situations. The research described here was originally requested by HRP management to be the first such study to systematically collect data on the effects of long duration space flight on training retention and transfer. Because current theories of retention and transfer are based on results obtained in university laboratories using undergraduate students as research participants, and because crew time in space is very expensive, this study was designed to compare the performance of 4 groups of subjects: crew members in space, crew members on the ground, crew-like subjects, and university undergraduate students. Results from the ground-phase of the study reported here demonstrate that crew members’ performance under cognitive load can not be predicted from the performance of university undergraduate students. It is still an open question the extent to which crew members’ cognitive performance in space can be predicted from the performance of crew members on the ground.

training↗
DOE OSTI2024

Enhancing Extreme Precipitation Predictions With Dynamical Downscaling: A Convection‐Permitting Modeling Study in Texas and Oklahoma

Precipitation in the Southern Plains of the United States is relatively well depicted by the Community Earth System Model (CESM). However, despite its ability to capture seasonal mean precipitation anomalies, CESM consistently underestimates extreme pluvial and drought events, rendering it an insufficient tool for extending simulation lead times for exceptional events, such as the abnormally dry May 2011, which helped drive Texas into its worst period of drought in more than a century, and the abnormally wet May 2015, which led to widespread flooding in that state. Ensemble‐based regional climate experiments are completed for the two extreme years using Weather Research and Forecasting model (WRF) and downscaled from CESM. WRF simulations are at convection‐permitting grid resolution for improved physical representation of simulated precipitation over the Southern Great Plains. By integrating convection‐permitting models (CPMs) into each individual member of a CESM ocean data assimilation ensemble, this study demonstrates that high‐resolution dynamical downscaling can improve model skillfulness at capturing these two events and is thus a potentially useful tool for forecasting extremely high and extremely low precipitation events at subseasonal or even seasonal lead times.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

A preliminary empirical evaluation of virtual reality as an instructional medium for visual-spatial tasks

We explored the training potential of Virtual Reality (VR) technology. Thirty-one adults were trained and tested on spatial skills in a VR. They learned a sequence of button and knob responses on a VR console and performed flawlessly on the same console. Half were trained with a rote strategy; the rest used a meaningful strategy. Response times were equivalent for both groups and decreased significantly over five test trials indicating that learning continued on VR tests. The same subjects practiced navigating through a VR building, which had three floors with four rooms on each floor. The dependent measure was the number of rooms traversed on routes that differed from training routes. Many subjects completed tests in the fewest rooms possible. All subjects learned configurational knowledge according to the criterion of taking paths that were significantly shorter than those predicted by a random walk as determined by a Monte Carlo analysis. The results were discussed as a departure point for empirically testing the training potential of VR technology.

Regian, J. Wesley↗
NASA NTRS2018

An Analysis of the Lightning Jump Algorithm Using Geostationary Lightning Mapper Flashes

Lightning's relation to severe weather has been studied since the 1980's. The invention of the Lightning Mapping Array allowed for total lightning measurements in a 125 km operational range. This brought forth an automated lightning Jump Algorithm (LIA) that predicted severe weather based on two-sigma increases in total lightning. The LIA's biggest downfall is being restrained to the limited field of view (FOV) of LMA's. The launch of the Geostationary Lightning Mapper (GLM) aboard the GOES-16 satellite now gives us hemispheric total lightning measurements. The wide FOV makes the GLM a good candidate to apply the LIA to. However the GLM and LMA have some differences. One being the coarser spatial resolution of GLM. Another being that LMA measures very high frequency (VHF) electromagnetic radiation while GLM measures optical radiation. These differences suggest an extensive study must be done on using the LIA with GLM to understand potential differences in the LIA and to maximize its operational skill. Four deep dive cases are conducted showcasing the differences between the GLM and LMA and their jumps.

Curtis, Nathan↗
NASA NTRS2019

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗
NASA NTRS2021

Australian tidal currents – assessment of a barotropic model (COMPAS v1.3.0 rev6631) with an unstructured grid

While the variations of tidal range are large and fairly well known across Australia (less than 1 m near Perth but more than 14 m in King Sound), the properties of the tidal currents are not. We describe a new regional model of Australian tides and assess it against a validation dataset comprising tidal height and velocity constituents at 615 tide gauge sites and 95 current meter sites. The model is a barotropic implementation of COMPAS, an unstructured-grid primitive-equation model that is forced at the open boundaries by TPXO9v1. The mean absolute error (MAE) of the modelled M2 height amplitude is 8.8 cm, or 12 % of the 73 cm mean observed amplitude. The MAE of phase (10°), however, is significant, so the M2 mean magnitude of vector error (MMVE, 18.2 cm) is significantly greater. The root sum square over the eight major constituents is 26 % of the observed amplitude. We conclude that while the model has skill at height in all regions, there is definitely room for improvement (especially at some specific locations). For the M2 major axis velocity amplitude, the MAE across the 95 current meter sites, where the observed amplitude ranges from 0.1 to 156 cm s −1 , is 6.9 cm s −1 , or 22 % of the 31.7 cm s −1 observed mean. This nationwide average result is encouraging, but it conceals a very large regional variation. Relative errors of the tidal current amplitudes on the narrow shelves of New South Wales (NSW) and Western Australia exceed 100 %, but tidal currents are weak and negligible there compared to non-tidal currents, so the tidal errors are of little practical significance. Looking nationwide, we show that the model has predictive value for much of the 79 % of Australia's shelf seas where tides are a major component of the total velocity variability. In descending order this includes the Bass Strait, the Kimberley to Arnhem Land, and southern Great Barrier Reef regions. There is limited observational evidence to confirm that the model is also valuable for currents in other regions across northern Australia. We plan to commence publishing “unofficial” tidal current predictions for chosen regions in the near future based on both our COMPAS model and the validation dataset we have assembled.

Tidal currents↗
NASA NTRS2011

A Comparison of Methods for a Priori Bias Correction in Soil Moisture Data Assimilation

Data assimilation is being increasingly used to merge remotely sensed land surface variables such as soil moisture, snow and skin temperature with estimates from land models. Its success, however, depends on unbiased model predictions and unbiased observations. Here, a suite of continental-scale, synthetic soil moisture assimilation experiments is used to compare two approaches that address typical biases in soil moisture prior to data assimilation: (i) parameter estimation to calibrate the land model to the climatology of the soil moisture observations, and (ii) scaling of the observations to the model s soil moisture climatology. To enable this research, an optimization infrastructure was added to the NASA Land Information System (LIS) that includes gradient-based optimization methods and global, heuristic search algorithms. The land model calibration eliminates the bias but does not necessarily result in more realistic model parameters. Nevertheless, the experiments confirm that model calibration yields assimilation estimates of surface and root zone soil moisture that are as skillful as those obtained through scaling of the observations to the model s climatology. Analysis of innovation diagnostics underlines the importance of addressing bias in soil moisture assimilation and confirms that both approaches adequately address the issue.

Kumar, Sujay V.↗
NASA NTRSDate not supplied

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗
NASA NTRS1979

Optimal estimator model for human spatial orientation

A model is being developed to predict pilot dynamic spatial orientation in response to multisensory stimuli. Motion stimuli are first processed by dynamic models of the visual, vestibular, tactile, and proprioceptive sensors. Central nervous system function is then modeled as a steady-state Kalman filter which blends information from the various sensors to form an estimate of spatial orientation. Where necessary, this linear central estimator has been augmented with nonlinear elements to reflect more accurately some highly nonlinear human response characteristics. Computer implementation of the model has shown agreement with several important qualitative characteristics of human spatial orientation, and it is felt that with further modification and additional experimental data the model can be improved and extended. Possible means are described for extending the model to better represent the active pilot with varying skill and work load levels.

Borah, J.↗
NASA NTRS2000

A New Eddy Dissipation Rate Formulation for the Terminal Area PBL Prediction System(TAPPS)

The TAPPS employs the MASS model to produce mesoscale atmospheric simulations in support of the Wake Vortex project at Dallas Fort-Worth International Airport (DFW). A post-processing scheme uses the simulated three-dimensional atmospheric characteristics in the planetary boundary layer (PBL) to calculate the turbulence quantities most important to the dissipation of vortices: turbulent kinetic energy and eddy dissipation rate. TAPPS will ultimately be employed to enhance terminal area productivity by providing weather forecasts for the Aircraft Vortex Spacing System (AVOSS). The post-processing scheme utilizes experimental data and similarity theory to determine the turbulence quantities from the simulated horizontal wind field and stability characteristics of the atmosphere. Characteristic PBL quantities important to these calculations are determined based on formulations from the Blackadar PBL parameterization, which is regularly employed in the MASS model to account for PBL processes in mesoscale simulations. The TAPPS forecasts are verified against high-resolution observations of the horizontal winds at DFW. Statistical assessments of the error in the wind forecasts suggest that TAPPS captures the essential features of the horizontal winds with considerable skill. Additionally, the turbulence quantities produced by the post-processor are shown to compare favorably with corresponding tower observations.

Charney, Joseph J.↗
NASA NTRS1980

The performance and efficiency of four motor/controller/battery systems for the simpler electric vehicles

A test and analysis program performed on four complete propulsion systems for an urban electric vehicle (EV) is described and results given. A dc series motor and a permanent magnet (PM) motor were tested, each powered by an EV battery pack and controlled by (1) a series/parallel voltage-switching (V-switch) system; and (2) a system using a pulse width modulation, 400 Hz transistorized chopper. Dynamometer tests were first performed, followed by eV performance predictions and data correlating road tests. During dynamometer tests using chopper control; current, voltage, and power were measured on both the battery and motor sides of the chopper, using three types of instrumentation. Conventional dc instruments provided adequate accuracy for eV power and energy measurements, when used on the battery side of the controller. When using the chopper controller, the addition of a small choke inductor improved system efficiency in the lower duty cycle range (some 8% increase at 50% duty cycle) with both types of motors. Overall system efficiency rankings during road tests were: (1) series motor with V-switch; (2) PM motor with V-switch; (3) series motor with chopper; and (4) PM motor with chopper. Chopper control of the eV was smoother and required less driver skill than V-switch control.

Shipps, P. R.↗
NASA NTRS2003

Transition from Research to Operations: Assessing Value of Experimental Forecast Products within the NWSFO Environment

The NASA Short-term Prediction Research and Transition (SPoRT) Center seeks to accelerate the infusion of NASA Earth Science Enterprise (ESE) observations, data assimilation and modeling research into NWS forecast operations and decision-making. To meet long-term program expectations, it is not sufficient simply to give forecasters sophisticated workstations or new forecast products without fully assessing the ways in which they will be utilized. Close communication must be established between the research and operational communities so that developers have a complete understanding of user needs. In turn, forecasters must obtain a more comprehensive knowledge of the modeling and sensing tools available to them. A major goal of the SPoRT Program is to develop metrics and conduct assessment studies with NWS forecasters to evaluate the impacts and benefits of ESE experimental products on forecast skill. At a glance the task seems relatively straightforward. However, performing assessment of experimental products in an operational environment is demanding. Given the tremendous time constraints placed on NWS forecasters, it is imperative that forecaster input be obtained in a concise unobtrusive manor. Great care must also be taken to ensure that forecasters understand their participation will eventually benefit them and WFO operations in general. Two requirements of the assessment plan developed under the SPoRT activity are that it 1) Can be implemented within the WFO environment; and 2) Provide tangible results for BOTH the research and operational communities. Supplemental numerical quantitative precipitation forecasts (QPF) were chosen as the first experimental SPoRT product to be evaluated during a Pilot Assessment Program conducted 1 May 2003 within the Huntsville AL National Weather Service Forecast Office. Forecast time periods were broken up into six- hour bins ranging from zero to twenty-four hours. Data were made available for display in AWIPS on an operational basis so they could be efficiently incorporated into the forecast process. The methodology used to assess the value of experimental QPFs compared to available operational products is best described as a three-tier approach involving both forecasters and research scientists. Tier-one is a web-based survey completed by duty forecasters on the aviation and public desks. The survey compiles information on how the experimental product was used in the forecast decision making process. Up to 6 responses per twenty-four hours can be compiled during a precipitation event. Tier-two consists of an event post mortem and experimental product assessment performed daily by the NASA/NWS Liaison. Tier-three is a detailed breakdown/analysis of specific events targeted by either the NWS SO0 or SPoRT team members. The task is performed by both NWS and NASA research scientists and may be conducted once every couple of months. The findings from the Pilot Assessment Program will be reported at the meeting.

Lapenta, William M.↗
NASA NTRS2017

Intercomparison of Soil Moisture, Evaporative Stress, and Vegetation Indices for Estimating Corn and Soybean Yields Over the U.S.

This paper presents an intercomparative study of 12 operationally produced large-scale datasets describing soil moisture, evapotranspiration (ET), and or vegetation characteristics within agricultural regions of the contiguous United States (CONUS). These datasets have been developed using a variety of techniques, including, hydrologic modeling, satellite-based retrievals, data assimilation, and survey in-field data collection. The objectives are to assess the relative utility of each dataset for monitoring crop yield variability, to quantitatively assess their capacity for predicting end-of-season corn and soybean yields, and to examine the evolution of the yield-index correlations during the growing season. This analysis is unique both with regards to the number and variety of examined yield predictor datasets and the detailed assessment of the water availability timing on the end-of-season crop production during the growing season. Correlation results indicate that over CONUS, at state-level soil moisture and ET indices can provide better information for forecasting corn and soybean yields than vegetation-based indices such as normalized difference vegetation index. The strength of correlation with corn and soybean yields strongly depends on the interannual variability in yield measured at a given location. In this case study, some of the remotely derived datasets examined provide skill comparable to that of in situ field survey-based data further demonstrating the utility of these remote sensing-based approaches for estimating crop yield.

evapotranspiration↗
DOE OSTI2020

An Applied Strategy for Using Empirical and Hybrid Models in Online Monitoring

The monitoring of plant equipment for failure prediction is one of the key contributors to operation and maintenance (O&M) costs for a nuclear power plant (NPP) because O&M monitoring depends on labor-intensive activities that are required to meet high equipment reliability standards. These activities rely primarily on humans for information gathering, condition diagnosis, and predictive analysis. Online monitoring aims to automate these activities by relying on sensors to replace human information gathering and machine learning to replace human analysis and decision making. To facilitate automated monitoring, a systematic strategy for anomaly detection is needed to optimally use the available sensor data, empirical models, and physics-supported models. This strategy is essential to provide credible reasoning on why and when an empirical (i.e., purely data-driven) versus hybrid (i.e., physics-supported) approach should be used and to determine the ideal mix of these two approaches for a defined anomaly detection scope. The extant methods usually adopt an ad hoc trial-and-error approach that, in addition to being time-consuming and costly, is also highly subjective; it is impacted by the background and the skill set of the personnel making the decisions. Thus, such an approach cannot guarantee an optimum outcome. This represents the motivation of the current research effort, which is focused on devising a scientifically supported strategy for the optimum selection of anomaly detection methods. This report presents a detailed assessment of the main anomaly detection techniques within the empirical or hybrid method streams. Empirical methods include pattern, statistical, and causal inference. Hybrid methods include the use of physics models to train and test data methods, reduce data dimensionality, reduce data-model complexity, augment data, and reduce empirical uncertainty; hybrid methods also include the use of data to tune physics models. The listed techniques within these two streams represent the vast majority of techniques performed for anomaly detection. Using the techniques as outcomes, a strategy was developed to enable a systematic decision-making process to lead to one of these techniques. The strategy is driven by key decision points related to data relevance, simple modeling feasibility, data inference, physics-modeling value, data dimensionality, physics knowledge, method of validation, performance, data availability and suitability for training and testing, cause-effect, entropy inference, and model fitting. Each of these decision points in the strategy is explained in detail in this report with examples, along with the scientific basis behind the decisions and outcomes in common and simplified terminology. The strategy is developed for use by any NPP staff with basic engineering or science knowledge. A user-friendly graphical state flow diagram was also developed as a visual presentation of the strategy. The strategy was tested and demonstrated through two pilot projects for the application of anomaly detection at an NPP. Each pilot had two use cases: an initial case in which certain decisions were made that resulted in one or more empirical techniques and a revised use case where one or more key decisions were modified resulting in using a set of hybrid methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗