Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Online Modelling and Optimization of Nonlinear Integrable Systems

Nonlinear integrable optics was recently proposed as a design approach to increase the limits on beam brightness and intensity imposed by fast collective instabilities. To study these systems experimentally, a new research electron and proton storage ring, the Integrable Optics Test Accelerator, was constructed and recently commissioned at Fermilab. Beam-based diagnostics and online modelling of nonlinear systems presents unique challenges - in this paper, we report on our efforts to develop optimization methods suited for such lattices. We explore the effectiveness of neural networks as fast online surrogate estimators, and integrate them into a beam-based tuning algorithm. We also develop a method of knob dimensionality reduction and subsequent robust multivariate optimization for maximizing key performance metrics under complicated lattice optics constraints.

43 PARTICLE ACCELERATORS↗

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗

Diagnostics of electron-heated solar flare models. III - Effects of tapered loop geometry and preheating

A series of hydrodynamic numerical simulations of nonthermal electron-heated solar flare atmospheres and their corresponding soft X-ray Ca XIX emission-line profiles, under the conditions of tapered flare loop geometry and/or a preheated atmosphere, is presented. The degree of tapering is parameterized by the magnetic mirror ratio, while the preheated atmosphere is parameterized by the initial upper chromospheric pressure. In a tapered flare loop, it is found that the upward motion of evaporated material is faster compared with the case where the flare loop is uniform. This is due to the diverging nozzle seen by the upflowing material. In the case where the flare atmosphere is preheated and the flare geometry is uniform, the response of the atmosphere to the electron collisional heating is slow. The upward velocity of the hydrodynamic gas is reduced due not only to the large coronal column depth, but also to the increased inertia of the overlying material. It is concluded that the only possible electron-heated scenario in which the predicted Ca XIX line profiles agree with the BCS observations is when the impulsive flare starts in a preheated dense corona.

Emslie, A. G.↗

Review of Diagnostics for Water Sources in General Circulation Models (GCMs)

We will describe the uses of passive tracers in GCMs to compute the geographical sources of water for precipitation. We will present a summary of recent research and how this methodology can be applied in climate and climate change studies. We will also discuss the possibility of using passive tracers in conjunction with simulations and observations of stable observations.

Bosilovich, M.↗

Diagnosing added value of convection-permitting regional models using precipitation event identification and tracking

Dynamical downscaling with high-resolution regional climate models may offer the possibility of realistically reproducing precipitation and weather events in climate simulations. As resolutions fall to order kilometers, the use of explicit rather than parametrized convection may offer even greater fidelity. However, these increased resolutions both allow and require increasingly complex diagnostics for evaluating model fidelity. Here we focus on precipitation evaluation and analyze five 2-month-long dynamically downscaled model runs over the continental United States that employ different convective and microphysics parameterizations, including one high-resolution convection-permitting simulation. All model runs use the Weather Research and Forecasting Model driven by National Center for Environmental Prediction reanalysis data. We show that employing a novel rainstorm identification and tracking algorithm that allocates essentially all rainfall to individual precipitation events allows new insights into model biases. Results include that, at least in these runs, model wet bias is driven by excessive areal extent of individual precipitating events, and that the effect is time-dependent, producing excessive diurnal cycle amplitude. This amplified cycle is driven not by new production of events but by excessive daytime enlargement of long-lived precipitation events. Here, we further show that in the domain average, precipitation biases appear best represented as additive offsets. Of all model configurations evaluated, convection-permitting simulations most consistently reduced biases in precipitation event characteristics.

54 ENVIRONMENTAL SCIENCES↗

Diagnosis and Prognosis of Weapon Systems

The Prognostics Framework is a set of software tools with an open architecture that affords a capability to integrate various prognostic software mechanisms and to provide information for operational and battlefield decision-making and logistical planning pertaining to weapon systems. The Prognostics NASA Tech Briefs, February 2005 17 Framework is also a system-level health -management software system that (1) receives data from performance- monitoring and built-in-test sensors and from other prognostic software and (2) processes the received data to derive a diagnosis and a prognosis for a weapon system. This software relates the diagnostic and prognostic information to the overall health of the system, to the ability of the system to perform specific missions, and to needed maintenance actions and maintenance resources. In the development of the Prognostics Framework, effort was focused primarily on extending previously developed model-based diagnostic-reasoning software to add prognostic reasoning capabilities, including capabilities to perform statistical analyses and to utilize information pertaining to deterioration of parts, failure modes, time sensitivity of measured values, mission criticality, historical data, and trends in measurement data. As thus extended, the software offers an overall health-monitoring capability.

Nolan, Mary↗

Reconstructing Subgrid Cloud Variability Guided by CloudSat/CALIPSO Observations

Predicting realistic cloud subgrid variability remains a challenge for Global Climate Models (GCMs) even though it can play an important role for proper representation of processes pertaining to cloud microphysics, precipitation, and radiation, but also for comparisons with satellite observations which are of much higher resolution than model grids. The diagnostic approach of subgrid cloud variability is commonly handled by subcolumn cloud generators. For a specific GCM, one ideally wants the subgrid variability used for comparisons with satellite observations to be created by the same generator and with the same rules as the one used for model integration. With this in mind, we have embarked in an effort to test and improve cloud subcolumn generators appropriate for GCMs. For this purpose, we use cloud (hydrometeor) products from active observations by the CloudSat radar (CPR) and the CALIPSO lidar (CALIOP). Cloud products from active sensors while suffering significant sampling and coverage drawbacks have the advantage of resolving both horizontal and vertical variability. The main question is: given a profile of cloud condensate mean and variance, can we create a subgrid cloud field that is statistically similar to the observed subgrid cloud field? By “statistically”, we suggest that we do not aspire to reproduce “well” each individual subgrid cloud field of a GCM-scale region, but that our generator performs well for a large ensemble of cases. We simulate radar, passive imager, and radiation flux fields from the observed 2D cloud fields and create one-point statistics; we use the profiles of cloud condensate mean and variance as input to the generator to create subgrid cloud fields; we compare the statistics; we adjust the rules of the generator to create the best possible agreement between the radar, imager and radiation field statistics. In this process, the active observations have actually a dual role: they provide the actual subgrid cloud field which can be reduced to a profile of mean and variance used by the subcolumn generator, but they also provide the rules needed by the generator, such as measures (e.g, decorrelation length) of the vertical overlap of cloud fraction and of the condensate horizontal variability. This presentation will show our progress using Cloudsat and CALIPSO products in this dual fashion.

cloud↗

Reconstructing Subgrid Cloud Variability Guided by CloudSat/CALIPSO Observations

Predicting realistic cloud subgrid variability remains a challenge for Global Climate Models (GCMs) even though it can play an important role for proper representation of processes pertaining to cloud microphysics, precipitation, and radiation, but also for comparisons with satellite observations which are of much higher resolution than model grids. The diagnostic approach of subgrid cloud variability is commonly handled by subcolumn cloud generators. For a specific GCM, one ideally wants the subgrid variability used for comparisons with satellite observations to be created by the same generator and with the same rules as the one used for model integration. With this in mind, we have embarked in an effort to test and improve cloud subcolumn generators appropriate for GCMs. For this purpose, we use cloud (hydrometeor) products from active observations by the CloudSat radar (CPR) and the CALIPSO lidar (CALIOP). Cloud products from active sensors while suffering signi􀂦cant sampling and coverage drawbacks have the advantage of resolving both horizontal and vertical variability. The main question is: given a profile of cloud condensate mean and variance, can we create a subgrid cloud field that is statistically similar to the observed subgrid cloud field? By “statistically”, we suggest that we do not aspire to reproduce “well” each individual subgrid cloud field of a GCM-scale region, but that our generator performs well for a large ensemble of cases. We simulate radar, passive imager, and radiation flux fields from the observed 2D cloud fields and create one-point statistics; we use the profiles of cloud condensate mean and variance as input to the generator to create subgrid cloud fields; we compare the statistics; we adjust the rules of the generator to create the best possible agreement between the radar, imager and radiation field statistics. In this process, the active observations have actually a dual role: they provide the actual subgrid cloud field which can be reduced to a profile of mean and variance used by the subcolumn generator, but they also provide the rules needed by the generator, such as measures (e.g, decorrelation length) of the vertical overlap of cloud fraction and of the condensate horizontal variability. This presentation will show our progress using Cloudsat and CALIPSO products in this dual fashion.

clouds↗

Laboratory Calibration of Density-Dependent Lines in the EUV and Soft X-Ray Regions

We analyzed spectral data of Fe XXII and Ar XIV from laboratory sources in which the electron density varies by several orders of magnitude to help benchmark density-sensitive emission lines useful for astrophysics and to test the atomic models underlying the diagnostic line ratios. We found excellent agreement for Fe XXII, but poorer agreement for Ar XIV. A number of astrophysically important emission lines are sensitive to electron density in the EUV and soft X-ray regions. Lines from Fe XXII, for example, have been used in recent years as diagnostics of stellar coronae, such as the active variable AB Dor, Capella, and EX Hya (Sanz-Forcada et al. 2003, Mewe et al. 2001, Mauche et al. 2003). Here we report spectral data of Fe XXII and Ar XIV from laboratory sources in which the electron density is known from either K-shell density diagnostics (for electron beam ion traps) or from non-spectroscopic means (tokamaks), ranging from 5 x 10{sup 10} cm{sup -3} to 5 x 10{sup 14} cm{sup -3}. These measurements were used to test the atomic data underlying the density diagnostic line ratios, complementing earlier work (Chen et al. 2004).

74 ATOMIC AND MOLECULAR PHYSICS↗

Spatial-Temporal Recurrent Graph Neural Networks for Fault Diagnostics in Power Distribution Systems

Fault diagnostics are extremely important to decide proper actions toward fault isolation and system restoration. The growing integration of inverter-based distributed energy resources imposes strong influences on fault detection using traditional overcurrent relays. This paper utilizes emerging graph learning techniques to build new temporal recurrent graph neural network models for fault diagnostics. The temporal recurrent graph neural network structures can extract the spatial-temporal features from data of voltage measurement units installed at the critical buses. From these features, fault event detection, fault type/phase classification, and fault location are performed. Compared with previous works, the proposed temporal recurrent graph neural networks provide a better generalization for fault diagnostics. Moreover, the proposed scheme retrieves the voltage signals instead of current signals so that there is no need to install relays at all lines of the distribution system. Therefore, the proposed scheme is generalizable and not limited by the number of relays installed. The effectiveness of the proposed method is comprehensively evaluated on the Potsdam microgrid and IEEE 123-node system in comparison with other neural network structures.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Laboratory calibration of density-dependent lines in the extreme ultraviolet spectral region

We have been making spectral measurements in the extreme ultraviolet (EUV) from different laboratory sources in order to investigate the electron density dependence of various astrophysically important emission lines and to test the atomic models underlying the diagnostic line ratios. The measurement are being performed at the Livermore EBIT-I electron beam ion trap, the National Spherical Torus Experiment (NSTX) at Princeton, and the Alcator C-Mod tokamak at the Massachusetts Institute of Technology, which together span an electron density of four orders of magnitude and which allow us to test the various models at high and low density limits. Here we present measurements of Fe XXII and Ar XIV, which include new data from an ultra high resolution ({lambda}/{Delta}{lambda} >4000) spectrometer at the EBIT-I facility. We found good agreement between the measurements and modeling calculations for Fe XXII, but poorer agreement for Ar XIV.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

THE DIFFUSE GeV-TeV {gamma}-RAY EMISSION OF THE CYGNUS REGION

Recently the Milagro experiment observed diffuse multi-TeV gamma ray emission in the Cygnus region, which is significantly stronger than what is predicted by the Galactic cosmic ray model. However, the sub-GeV observation by EGRET shows no excess to the prediction based on the same model. This TeV excess implies possible high-energy cosmic rays populated in the region with harder spectrum than that observed on the Earth. In the work we studied this theoretical speculation in detail. We find that, a diffuse proton source with power index {alpha} {sub p} {approx}< 2.3, or a diffuse electron source with power index {alpha} {sub e} {approx}< 2.6 can reproduce the Milagro's observation without conflicting with the EGRET data. Further detections on neutrinos, a diagnostic of the hadronic model, and hard X-ray synchrontron radiation, a diagnostic of the lepton model, help to break this degeneracy. In combination with the gamma ray observations to several hundred GeV by Fermi, we will be able to understand the diffuse emission mechanisms in the Cygnus region better.

99 GENERAL AND MISCELLANEOUS↗

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗

Assessing operating characteristics of CAD algorithms in the absence of a gold standard

Purpose: The authors examine potential bias when using a reference reader panel as ''gold standard'' for estimating operating characteristics of CAD algorithms for detecting lesions. As an alternative, the authors propose latent class analysis (LCA), which does not require an external gold standard to evaluate diagnostic accuracy. Methods: A binomial model for multiple reader detections using different diagnostic protocols was constructed, assuming conditional independence of readings given true lesion status. Operating characteristics of all protocols were estimated by maximum likelihood LCA. Reader panel and LCA based estimates were compared using data simulated from the binomial model for a range of operating characteristics. LCA was applied to 36 thin section thoracic computed tomography data sets from the Lung Image Database Consortium (LIDC): Free search markings of four radiologists were compared to markings from four different CAD assisted radiologists. For real data, bootstrap-based resampling methods, which accommodate dependence in reader detections, are proposed to test of hypotheses of differences between detection protocols. Results: In simulation studies, reader panel based sensitivity estimates had an average relative bias (ARB) of -23% to -27%, significantly higher (p-value <0.0001) than LCA (ARB -2% to -6%). Specificity was well estimated by both reader panel (ARB -0.6% to -0.5%) and LCA (ARB 1.4%-0.5%). Among 1145 lesion candidates LIDC considered, LCA estimated sensitivity of reference readers (55%) was significantly lower (p-value 0.006) than CAD assisted readers' (68%). Average false positives per patient for reference readers (0.95) was not significantly lower (p-value 0.28) than CAD assisted readers' (1.27). Conclusions: Whereas a gold standard based on a consensus of readers may substantially bias sensitivity estimates, LCA may be a significantly more accurate and consistent means for evaluating diagnostic accuracy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Sixth NASA Glenn Research Center Propulsion Control and Diagnostics (PCD) Workshop

The Intelligent Control and Autonomy Branch at NASA Glenn Research Center hosted the Sixth Propulsion Control and Diagnostics Workshop on August 22-24, 2017. The objectives of this workshop were to disseminate information about research being performed in support of NASA Aeronautics programs; get feedback from peers on the research; and identify opportunities for collaboration. There were presentations and posters by NASA researchers, Department of Defense representatives, and engine manufacturers on aspects of turbine engine modeling, control, and diagnostics.

Collaboration↗

Probabilistic machine learning for battery health diagnostics and prognostics—review and perspectives

Abstract Diagnosing lithium-ion battery health and predicting future degradation is essential for driving design improvements in the laboratory and ensuring safe and reliable operation over a product’s expected lifetime. However, accurate battery health diagnostics and prognostics is challenging due to the unavoidable influence of cell-to-cell manufacturing variability and time-varying operating circumstances experienced in the field. Machine learning approaches informed by simulation, experiment, and field data show enormous promise to predict the evolution of battery health with use; however, until recently, the research community has focused on deterministic modeling methods, largely ignoring the cell-to-cell performance and aging variability inherent to all batteries. To truly make informed decisions regarding battery design in the lab or control strategies for the field, it is critical to characterize the uncertainty in a model’s predictions. After providing an overview of lithium-ion battery degradation, this paper reviews the current state-of-the-art probabilistic machine learning models for health diagnostics and prognostics. Details of the various methods, their advantages, and limitations are discussed in detail with a primary focus on probabilistic machine learning and uncertainty quantification. Last, future trends and opportunities for research and development are discussed.

25 ENERGY STORAGE↗

Water Mass Transformation Budgets in Finite‐Volume Generalized Vertical Coordinate Ocean Models

Water Mass Transformation (WMT) theory provides conceptual tools that in principle enable innovative analyses of numerical ocean models; in practice, however, these methods can be challenging to implement and interpret, and therefore remain under-utilized. Our aim is to demonstrate the feasibility of diagnosing all terms in the water mass budget and to exemplify their usefulness for scientific inquiry and model development by quantitatively relating water mass changes, overturning circulations, boundary fluxes, and interior mixing. We begin with a pedagogical derivation of key results of classical WMT theory. We then describe best practices for diagnosing each of the water mass budget terms from the output of Finite-Volume Generalized Vertical Coordinate (FV-GVC) ocean models, including the identification of a non-negligible remainder term as the spurious numerical mixing due to advection scheme discretization errors. We illustrate key aspects of the methodology through the analysis of a polygonal region of the Greater Baltic Sea in a regional demonstration simulation using the Modular Ocean Model v6 (MOM6). We verify the convergence of our WMT diagnostics by brute-force, comparing time-averaged (“offline”) diagnostics on various vertical grids to timestep-averaged (“online”) diagnostics on the native model grid. Finally, we briefly describe a stack of xarray-enabled Python packages for evaluating WMT budgets in FV-GVC models (culminating in the new xwmb package), which is intended to be model-agnostic and available for community use and development.

54 ENVIRONMENTAL SCIENCES↗