Search NASA⌕ Search

SEARCH · Search NASA

Results for “integral probability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Stability and Convergence of Solutions to Stochastic Inverse Problems Using Approximate Probability Densities

Data-consistent inversion is designed to solve a class of stochastic inverse problems where the solution is a pullback of a probability measure specified on the outputs of a quantities of interest (QoI) map. Here, this work presents stability and convergence results for the case where finite QoI data result in an approximation of the solution as a density. Given their popularity in the literature, separate results are proven for three different approaches to measuring discrepancies between probability measures: f-divergences, integral probability metrics, and L p metrics. In the context of integral probability metrics, we also introduce a pullback probability metric that is well-suited for data-consistent inversion. This fills a theoretical gap in the convergence and stability results for data-consistent inversion that have mostly focused on convergence of solutions associated with approximate maps. Numerical results are included to illustrate key theoretical results with intuitive and reproducible test problems that include a demonstration of convergence in the measure-theoretic "almost" sense.

97 MATHEMATICS AND COMPUTING↗

Continuum shock mixture models for Ni+Al multilayers: Inert mesoscale simulations

Mesoscale modeling of shock waves in Ni+Al multilayers poses significant challenges that are due, in part, to shock-induced chemical reactions. Current modeling approaches utilize reactive molecular dynamics (MD), but they are limited to resolving domains of only a few hundred nanometers. In contrast, actual multilayer superlattices can be tens of micrometers thick, and they exhibit non-ideal (i.e., wavy) interfaces. The second part of our research builds upon previous work developing physically based, thermodynamically complete equations of state for various Ni and Al intermetallic compositions. Here, we introduce a novel workflow for high-fidelity mesoscale simulations of Ni+Al multilayers using a continuum hydrocode. By increasing the simulation domain size beyond MD limitations (e.g., 2 × 6 μm 2 ) and incorporating explicit interfacial roughness, we investigate the shock response of Ni+Al multilayers at previously unexplored scales. Our experimental design encompasses nine multilayer geometries with varying roughness amplitudes and tilt angles (θ = 15°, 30°, and 45°), alongside 19 flyer impact velocities ranging from 0.3 to 3.0 km/s, resulting in a total of 171 high-fidelity simulations. The bulk shock state from inert 2D mesoscale simulations aligns with the law of mixtures, while temperature and pressure fluctuations strongly correlate with multilayer geometry types. A new metric dubbed the “hot spot probability integral” shows a greater dependence on a tilt angle than interfacial roughness.

Kittell, David E. [Sandia National Laboratories (S↗

A Resilient Integrated Resource Planning Framework for Transmission Systems: Analysis and Optimization

This article presents a resilient Integrated Resource Planning (IRP) framework designed for transmission systems, with a specific focus on analyzing and optimizing responses to High-Impact Low-Probability (HILP) events. The framework aims to improve the resilience of transmission networks in the face of extreme events by prioritizing the assessment of events with significant consequences. Unlike traditional reliability-based planning methods that average the impact of various outage durations, this work adopts a metric based on the proximity of outage lines to generators to select HILP events. The system’s baseline resilience is evaluated by calculating load curtailment in different parts of the network resulting from HILP outage events. The transmission network is represented as an undirected graph. Graph-theoretic techniques are used to identify islands with or without generators, potentially forming segmented grids or microgrids. This article introduces Expected Load Curtailment (ELC) as a metric to quantify the system’s resilience. The framework allows for the re-evaluation of system resilience by integrating additional generating resources to achieve desired resilience levels. Optimization is performed in the re-evaluation stage to determine the optimal placement of distributed energy resources (DERs) for enhancing resilience, i.e., minimizing ELC. Case studies on the IEEE 24-bus system illustrate the effectiveness of the proposed framework. In the broader context, this resilient IRP framework aligns with energy sustainability goals by promoting robust and resilient transmission networks, as the optimal placement of DERs for resilience enhancement not only strengthens the system’s ability to withstand and recover from disruptions but also contributes to efficient resource utilization, advancing the overarching goal of energy sustainability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A spatial evaluation of Arctic sea ice and regional limitations in CMIP6 historical simulations

The Arctic sea ice response to a warming climate is assessed in a subset of models participating in Phase 6 of the Coupled Model Intercomparison Project (CMIP6), using several metrics in comparison with satellite observations and results from the Pan-Arctic Ice Ocean Modeling and Assimilation System and the Regional Arctic System Model. Our study examines the historical representation of sea ice extent, volume, and thickness using spatial analysis metrics, such as the integrated ice-edge error, Brier score, and Spatial Probability Score. We find that the CMIP6 multi-model mean captures the mean annual cycle and 1979-2014 sea ice trends remarkably well. However, individual models experience a wide range of uncertainty in the spatial distribution of sea ice when compared against satellite measurements and reanalysis data. Our metrics expose common and individual regional model biases, which sea ice temporal analyses alone do not capture. We identify large ice edge and ice thickness errors in Arctic sub-regions, implying possible model specific limitations in or lack of representation of some key physical processes. We postulate that many of them could be related to the oceanic forcing, especially in the marginal and shelf seas, where seasonal sea ice changes are not adequately simulated. We therefore conclude that an individual model’s ability to represent the observed/reanalysis spatial distribution still remains a challenge. We propose the spatial analysis metrics as useful tools to diagnose model limitations, narrow down possible processes affecting them, and guide future model improvements critical to the representation and projections of Arctic climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Risk-Driven Probabilistic Approach to Quantify Resilience in Power Distribution Systems

It is of growing concern to ensure resilience in power distribution systems to extreme weather events. However, there are no clear methodologies or metrics available for resilience assessment that allows system planners to assess the impact of appropriate planning measures and new operational procedures for resilience enhancement. In this paper, we propose a resilience metric using parameters that define system attributes and performance. To represent extreme events (tail probability), the conditional value-at-risk of each of the parameters are combined using Choquet Integral to evaluate the overall resilience. The effectiveness of the proposed resilience metric is studied within the simulation-based framework under extreme weather scenarios with the help of a modified IEEE 123-bus system. With the proposed framework, system operators will have additional flexibility to prioritize one investment over the others to enhance the resilience of the grid.

Poudyal, Abodh↗

Control Effectiveness: Metric Development and Application to Resilient Lunar Habitat Design

System safety engineering in its bare essence involves identifying, assessing, and mitigating, or controlling, hazards. Appropriate safety controls are selected using hazard reduction precedence principles, prior experience, or by assessing their impact on residual risk (together with other factors like cost). We propose a control effectiveness metric as one way to systematically and consistently evaluate potential safety controls individually and thereby facilitate selecting a shortlist of potential controls for subsequent integrated evaluation. The control effectiveness metric considers a safety control’s availability when needed, the probability that its design is adequate in addressing the targeted hazard, the probability that the design will be implemented as intended, and the relationship between the time it takes for the safety control to address its target hazard and the time before the hazard propagates. We demonstrated the use of our metric on a lunar habitat design using a physics-based habitat simulator. High control effectiveness and safety controls result in a habitat with high resilience, while low control effectiveness results in lower resilience.

Rashi Jain↗

Recent Advances in Model-Assisted Probability of Detection

The increased role played by probability of detection (POD) in structural integrity programs, combined with the significant time and cost associated with the purely empirical determination of POD, provides motivation for alternate means to estimate this important metric of NDE techniques. One approach to make the process of POD estimation more efficient is to complement limited empirical experiments with information from physics-based models of the inspection process or controlled laboratory experiments. The Model-Assisted Probability of Detection (MAPOD) Working Group was formed by the Air Force Research Laboratory, the FAA Technical Center, and NASA to explore these possibilities. Since the 2004 inception of the MAPOD Working Group, 11 meetings have been held in conjunction with major NDE conferences. This paper will review the accomplishments of this group, which includes over 90 members from around the world. Included will be a discussion of strategies developed to combine physics-based and empirical understanding, draft protocols that have been developed to guide application of the strategies, and demonstrations that have been or are being carried out in a number of countries. The talk will conclude with a discussion of future directions, which will include documentation of benefits via case studies, development of formal protocols for engineering practice, as well as a number of specific technical issues.

Thompson, R. Bruce↗

Microgrid Resilience: A Holistic and Context-Aware Resilience Metric

Microgrids present an effective solution for the coordinated deployment of various distributed energy resources and furthermore provide myriad additional benefits such as resilience, decreased carbon footprint, and reliability to energy consumers and the energy system as a whole. Boosting the resilience of distribution systems is another major benefit of microgrids. This is because they can also serve as a backup power source when the utility grid's operations are interrupted due to either high-probability low-impact events like a component failure or low-probability high-impact events - be it a natural disaster or a planned cyberattack. However, the degree to which any particular system can defend, adapt, and restore normal operation depends on various factors including the type and severity of events to which a microgrid is subjected. These factors, in turn, are dependent on the geographical location of the deployed microgrid as well as the cyber risk profile of the site where the microgrid is operating. Therefore, in this work, we attempt to capture this multi-dimensional interplay of various factors in quantifying the ability of the microgrid to be resilient in these varying aspects. This paper, thus, proposes a customized site-specific quantification of the resilience strength for the individual microgrid's capability to absorb, restore, and adapt to the changing circumstances for sustaining the critical load when a low-probability high-impact event occurs - termed as - context-aware resilience metric. We also present a case study to illustrate the key elements of our integrated analytical approach.

microgrid↗

Rapid Response Risk Assessment in New Project Development

A capability for rapidly performing quantitative risk assessments has been developed by JSC Safety and Mission Assurance for use on project design trade studies early in the project life cycle, i.e., concept development through preliminary design phases. A risk assessment tool set has been developed consisting of interactive and integrated software modules that allow a user/project designer to assess the impact of alternative design or programmatic options on the probability of mission success or other risk metrics. The risk and design trade space includes interactive options for selecting parameters and/or metrics for numerous design characteristics including component reliability characteristics, functional redundancy levels, item or system technology readiness levels, and mission event characteristics. This capability is intended for use on any project or system development with a defined mission, and an example project will used for demonstration and descriptive purposes, e.g., landing a robot on the moon. The effects of various alternative design considerations and their impact of these decisions on mission success (or failure) can be measured in real time on a personal computer. This capability provides a high degree of efficiency for quickly providing information in NASA s evolving risk-based decision environment

Graber, Robert R.↗

Detecting defects that reduce breakdown voltage using machine learning and optical profilometry

Abstract Semiconductor wafer manufacturing relies on the precise control of various performance metrics to ensure the quality and reliability of integrated circuits. In particular, GaN has properties that are advantageous for high voltage and high frequency power devices; however, defects in the substrate growth and manufacturing are preventing vertical devices from performing optimally. This paper explores the application of machine learning techniques utilizing data obtained from optical profilometry as input variables to predict the probability of a wafer meeting performance metrics, specifically the breakdown voltage (V bk ). By incorporating machine learning techniques, it is possible to reliably predict performance metrics that cause devices to fail at low voltage. For diodes that fail at a higher (but still below theoretical) breakdown voltage, alternative inspection methods or a combination of several experimental techniques may be necessary.

42 ENGINEERING↗

Probabilistic Evaluation of Geomechanical Risks in CO2 Storage: An Exploration of Caprock Integrity Metrics Using a Multilaminate Model

The probabilistic uncertainty assessment of geomechanical risk—specifically, caprock failure—attributable to CO2 injection, as presented in a simplified hypothetical geological model, was the focus of this study. Our approach amalgamates the implementation of a multilaminate model, the creation of a response surface model in conjunction with the Box–Behnken sampling design, the execution of associated numerical modeling experiments, and the utilization of Monte Carlo simulations. Probability distributions to encapsulate the inherent variability (elastic and mechanical properties of the caprock and reservoir) and uncertainty in prediction estimates (vertical displacement, total strain, and F value) were employed. Our findings reveal that the Young modulus of the caprock is a key factor controlling equivalent total strain but is insufficient as a stand-alone indicator of caprock integrity. It is confirmed that the caprock can accommodate significant deformation without failure, if it possesses a low Young’s modulus and high mechanical strength properties, such as the friction angle and uniaxial compressive strength. Similarly, vertical displacement was found to be an unreliable indicator for caprock integrity, as caprock failure can occur across a broad spectrum of vertical displacements, particularly when both the Young modulus and mechanical strength properties have wide ranges. This study introduces the F value as the most dependable indicator for caprock failure, although it is a theoretical attribute (the shortest distance between the Mohr circle and the nearest failure envelope used to measure the sensitivity to failure) and not physically measurable in the field. Deviatoric stress levels were found to vary based on stress regimes, with the maximum levels observed under extensive and compressive stress regimes. In conjunction with the use of the response surface method, this study demonstrates the efficacy of the multilaminate framework and the Mohr–Coulomb constitutive model in providing a simplified, yet effective, probabilistic model of the mechanical behavior of caprock failure, reducing mathematical and computational complexities.

Energy & Fuels↗

Surveillance and Datalink Communication Performance Analysis for Distributed Separation Assurance System Architectures

This study investigates the effects of two technical enablers: Automatic Dependent Surveillance - Broadcast (ADS-B) and digital datalink communication, of the Federal Aviation Administration s Next Generation Air Transportation System (NextGen) under two separation assurance (SA) system architectures: ground-based SA and airborne SA, on overall separation assurance performance. Datalink performance such as successful reception probability in both surveillance and communication messages, and surveillance accuracy are examined in various operational conditions. Required SA performance is evaluated as a function of subsystem performance, using availability, continuity, and integrity metrics to establish overall required separation assurance performance, under normal and off-nominal conditions.

Chung, William W.↗

JGI-Trichoderma v1.0

There is a series of Python and bash scripts to parse genomics datasets used to evaluate the coevolution of gene families and the feature importance of gene families using an SVM classifier. - Cover analysis: takes a list of single-copy genes in a set of genomes, aligns and builds the gene trees to determine if two gene families have a signature of covariation with one another. It parses the files to run phykit cover script described here: https://jlsteenwyk.com/PhyKIT/usage/index.html - SVM-classifier: This Python script is an SVM-based genomic classifier designed for biological data analysis. It combines machine learning with feature selection to identify important genomic markers and classify biological samples. Core Functionality: The script uses Support Vector Machines from scikit-learn to classify genomic data, incorporating SelectKBest for automated feature selection and leave-one-out cross-validation for performance assessment. It operates in multiple modes: feature ranking, optimal combination discovery, and sample prediction. Primary Applications: Genomic sample classification and biomarker discovery Feature importance analysis in high-dimensional biological datasets Prediction of sample categories based on genomic profiles Research applications requiring robust classification of biological data Key Advantages: High-dimensional handling: SVMs excel with genomic data's typical high feature-to-sample ratios Integrated feature selection: Reduces noise and computational overhead while identifying key markers Probability estimation: Provides confidence scores essential for biological interpretation Validation robustness: Leave-one-out cross-validation ensures reliable performance metrics Operational flexibility: Multiple analysis modes support different research phases from exploration to prediction

Stecca Steindorff, Andrei [Lawrence Berkeley Natio↗

Trade can buffer climate-induced risks and volatilities in crop supply

Climate change is intensifying the frequency and severity of extreme events, posing challenges to food security. Corn, a staple crop for billions, is particularly vulnerable to heat stress, a primary driver of yield variability. While many studies have examined climate impact on average corn yields, little attention has been given to the climate impact on production volatility. This study investigates the future volatility and risks associated with global corn supply under climate change, evaluating the potential benefits of two key adaptation strategies: irrigation and market integration. A statistical model is employed to estimate corn yield response to heat stress and utilize NEX-GDDP-CMIP6 climate data to project future production volatility and risks of substantial yield losses. Three metrics are introduced to quantify these risks: Sigma (σ), the standard deviation of year-on-year yield change, which reflects overall yield volatility; Rho (ρ), the risk of substantial loss, defined as the probability of yield falling below a critical threshold; and Beta (β), a relative risk coefficient that captures the volatility of a region's corn production compared to the globally integrated market. The analysis reveals a concerning trend of increasing year-on-year yield volatility (σ) across most regions and climate models. This volatility increase is significant for key corn-producing regions like Brazil and the United States. While irrigated corn production exhibits a smaller rise in volatility, suggesting irrigation as a potential buffer against climate change impacts, it is not a sustainable option as it can cause groundwater depletion. On the other hand, global market integration reduces overall volatility and market risks significantly with less sustainability concerns. Furthermore, these findings highlight the importance of a multidimensional approach to adaptation in the food sector. While irrigation can benefit individual farmers, promoting global market integration offers a broader solution for fostering resilience and sustainability across the entire food system.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Protocol Sensing Across Multiple Space Missions

In this work, we present sensing performance using an architecture for a reconfigurable protocol chip for spacebased applications. Toward utilizing the IP packet architecture, utilizing data link layer framing structures for multiplexed data on a channel are the targeted application considered for demonstration purposes. Specifically, we examine three common framing standards and present the sensing performance of these standards and their relative de-correlation metrics. Some analysis is performed to investigate the impact of lossy links and on the number of packets required to perform a decision with some probability. Finally, we present results on a demonstration platform that integrated reconfigurable sensing technology into the Ground Station Interface Device (GRID) for End-to-End IP demonstrations in space.

Ground Station Interface Device (GRID)↗

Integrated Medical Model Project - Overview and Summary of Historical Application

Introduction: The Integrated Medical Model (IMM) Project represents one aspect of NASA's Human Research Program (HRP) to quantitatively assess medical risks to astronauts for existing operational missions as well as missions associated with future exploration and commercial space flight ventures. The IMM takes a probabilistic approach to assessing the likelihood and specific outcomes of one hundred medical conditions within the envelope of accepted space flight standards of care over a selectable range of mission capabilities. A specially developed Integrated Medical Evidence Database (iMED) maintains evidence-based, organizational knowledge across a variety of data sources. Since becoming operational in 2011, version 3.0 of the IMM, the supporting iMED, and the expertise of the IMM project team have contributed to a wide range of decision and informational processes for the space medical and human research community. This presentation provides an overview of the IMM conceptual architecture and range of application through examples of actual space flight community questions posed to the IMM project. Methods: Figure 1 [see document] illustrates the IMM modeling system and scenario process. As illustrated, the IMM computational architecture is based on Probabilistic Risk Assessment techniques. Nineteen assumptions and limitations define the IMM application domain. Scenario definitions include crew medical attributes and mission specific details. The IMM forecasts probabilities of loss of crew life (LOCL), evacuation (EVAC), quality time lost during the mission, number of medical resources utilized and the number and type of medical events by combining scenario information with in-flight, analog, and terrestrial medical information stored in the iMED. In addition, the metrics provide the integrated information necessary to estimate optimized in-flight medical kit contents under constraints of mass and volume or acceptable level of mission risk. Results and Conclusions: Historically, IMM simulations support Science and Technology planning, Exploration mission planning, and ISS program operations by supplying simulation support, iMED data information, and subject matter expertise to Crew Health and Safety and the HRP. Upcoming release of IMM version 4.0 seeks to provide enhanced functionality to increase the quality of risk decisions made using the IMM through a more accurate representation of the real world system.

Myers, J.↗

Reliability-Based Control Design for Uncertain Systems

This paper presents a robust control design methodology for systems with probabilistic parametric uncertainty. Control design is carried out by solving a reliability-based multi-objective optimization problem where the probability of violating design requirements is minimized. Simultaneously, failure domains are optimally enlarged to enable global improvements in the closed-loop performance. To enable an efficient numerical implementation, a hybrid approach for estimating reliability metrics is developed. This approach, which integrates deterministic sampling and asymptotic approximations, greatly reduces the numerical burden associated with complex probabilistic computations without compromising the accuracy of the results. Examples using output-feedback and full-state feedback with state estimation are used to demonstrate the ideas proposed.

Crespo, Luis G.↗

Integrating data types to estimate spatial patterns of avian migration across the Western Hemisphere

For many avian species, spatial migration patterns remain largely undescribed, especially across hemispheric extents. Recent advancements in tracking technologies and high-resolution species distribution models (i.e., eBird Status and Trends products) provide new insights into migratory bird movements and offer a promising opportunity for integrating independent data sources to describe avian migration. Here, we present a three-stage modeling framework for estimating spatial patterns of avian migration. First, we integrate tracking and band re-encounter data to quantify migratory connectivity, defined as the relative proportions of individuals migrating between breeding and nonbreeding regions. Next, we use estimated connectivity proportions along with eBird occurrence probabilities to produce probabilistic least-cost path (LCP) indices. In a final step, we use generalized additive mixed models (GAMMs) both to evaluate the ability of LCP indices to accurately predict (i.e., as a covariate) observed locations derived from tracking and band re-encounter data sets versus pseudo-absence locations during migratory periods and to create a fully integrated (i.e., eBird occurrence, LCP, and tracking/band re-encounter data) spatial prediction index for mapping species-specific seasonal migrations. To illustrate this approach, we apply this framework to describe seasonal migrations of 12 bird species across the Western Hemisphere during pre- and postbreeding migratory periods (i.e., spring and fall, respectively). We found that including LCP indices with eBird occurrence in GAMMs generally improved the ability to accurately predict observed migratory locations compared to models with eBird occurrence alone. Using three performance metrics, the eBird + LCP model demonstrated equivalent or superior fit relative to the eBird-only model for 22 of 24 species–season GAMMs. In particular, the integrated index filled in spatial gaps for species with over-water movements and those that migrated over land where there were few eBird sightings and, thus, low predictive ability of eBird occurrence probabilities (e.g., Amazonian rainforest in South America). This methodology of combining individual-based seasonal movement data with temporally dynamic species distribution models provides a comprehensive approach to integrating multiple data types to describe broad-scale spatial patterns of animal movement. Further development and customization of this approach will continue to advance knowledge about the full annual cycle and conservation of migratory birds.

59 BASIC BIOLOGICAL SCIENCES↗