Search NASA⌕ Search

SEARCH · Search NASA

Results for “community metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

The Event Horizon General Relativistic Magnetohydrodynamic Code Comparison Project

Recent developments in compact object astrophysics, especially the discovery of merging neutron stars by LIGO, the imaging of the black hole in M87 by the Event Horizon Telescope, and high- precision astrometry of the Galactic Center at close to the event horizon scale by the GRAVITY experiment motivate the development of numerical source models that solve the equations of general relativistic magnetohydrodynamics (GRMHD). Here we compare GRMHD solutions for the evolution of a magnetized accretion flow where turbulence is promoted by the magnetorotational instability from a set of nine GRMHD codes: Athena++, BHAC, Cosmos++, ECHO, H-AMR, iharm3D, HARM-Noble, IllinoisGRMHD, and KORAL. Agreement among the codes improves as resolution increases, as measured by a consistently applied, specially developed set of code performance metrics. We conclude that the community of GRMHD codes is mature, capable, and consistent on these test problems.

relativistic processes↗
NASA NTRSDate not supplied

Limitations to Biomass Estimation for FAV Using NDVI Analysis of Satellite Acquisitions

The distribution and standing biomass (mass per unit area) of Floating Aquatic Vegetation (FAV)provide assessment metrics for productivity of vegetative communities. Remote sensing acquisition data has been used to estimate standing biomass in various ecosystems using vegetation indices, particularly the normalized difference vegetation index (NDVI), comparing the relative strength of radiation absorbance and reflectance of vegetation in specific wavebands. Obstacles to estimating vegetation biomass using NDVI reported are related to diversity of the vegetation community and high-density saturation. We evaluate the potential for using NDVI derived estimates for FAV biomass in the California Delta by focusing on patches of predominantly single species and compare biomass estimates for specific patches with measurement of total biomass and partitioning within the vegetation canopy. Using Landsat satellite acquisitions, biomass estimates are made for individual pixels and vegetation samples were collected from those same pixels. Focus on patches of predominantly single FAV species resulted in successful estimation of standing biomass beyond that previously reported in other ecosystems. A saturation response for the estimations was observed, however, with a much higher threshold high than previously reported for diverse population aquatic ecosystems. We discuss the likely cause for the saturation phenomenon and potential improvement utilizing altered spectral indices possible with higher spectral resolution from satellites carrying higher waveband multispectral and hyperspectral instruments.

Biomass↗
DOE OSTI2020

Adapting Existing Energy Planning, Simulation, and Operational Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result, research communities have proposed a plethora of candidate indicators and metrics for resilience, most of which remain immature at different scales and segments within the energy system. Given the complexity of resilience analyses and mitigation strategies, there is limited value in attempting to identify a single resilience metric, as no one metric can quantify resilience or its associated value for all stakeholders. Instead, a necessary focus of the research community should lie in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing that implementing, testing, and validating resilience metrics are challenges that need to be addressed, the National Renewable Energy Laboratory (NREL) dedicated staff and time to researching how to effectively integrate resilience considerations into energy sector models and tools, as part of the Laboratory Directed Research and Development (LDRD) program. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

The Evolution of the Peridynamics Co-Authorship Network

We report peridynamics is a relatively new field in continuum mechanics that has developed over the past 20 years. This paper studies the evolution of collaborations in the field of peridynamics since its inception using social network analysis. For this purpose, we construct a network for each year from 2000 to 2019 describing co-authorship between scientists in peridynamics. In these networks, each node represents a scientist and each link connects two co-authoring scientists with a link weight representing the frequency and strength of their collaboration; each network as a whole can be thought of as a graph representation of the peridynamics community for the given year. By constructing a network for each year, we are able to analyze the evolution of the network in time and discuss the implications of this evolution for the peridynamics community. Our study demonstrates that the peridynamics community has been growing exponentially in size in recent years. Centrality metrics are also used to identify the most collaborative scientists in the community. Moreover, we compute link recommendations based on both elevating a scientist’s position in the network with respect to certain centrality metrics or closing structural holes in the network identified with persistent homology. We further extend the analysis to higher-order networks whose nodes represent groups of scientists in the community and whose links connect collaborating groups. In some sense, our work studies the past, present, and future of the peridynamics community.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Model Validation and its Crucial Roles in Connecting Space Weather Research, Operations, and End-User Needs

Model validation is indispensable to transitioning a model from research to operations. In this presentation, we focus on the performance of models for specific operational purposes/user needs, which include careful selection of the corresponding specific Essential Space Environment Quantity (ESEQ) and a proper set of metrics. Initial results of our community-wide validation efforts under the COSPAR ISWAT Initiative with relevance to surface charging and internal charging will be shown. We will highlight processes involved in performing such tasks, such as setting up unified guidelines, data preparation, assessment using different metrics, etc. We will also present setbacks and challenges associated with such efforts so further progress can be made.

Yihua Zheng↗
DOE OSTI2025

Accelerating Resilience of the Community through Holistic Engagement and use of Renewables (ARCHER) Planning Framework

The primary objective of the Accelerating Resilience of the Community through Holistic Engagement and Use of Renewables (ARCHER) initiative was to identify and incorporate the unique variations in energy burden, social vulnerability, living conditions, and access to essential services that differ across communities. By accounting for these localized factors—down to the neighborhood level—the project supports more targeted and effective investments in community resilience. The framework seeks to establish practical planning guidance, methods, and performance measures for community energy resilience, integrate community-level and electric utility system resilience planning, and assess its effectiveness through comparison with conventional and operational planning approaches. A key component of the project was its data exchange platform, which is used to evaluate and demonstrate the tools, methodologies, and planning approaches developed through ARCHER. This open-source platform enables developers and vendors of distribution and outage management systems to build upon the research by incorporating its concepts into their own tools and workflows. This capability is enabled by the transparent availability of data, functional requirements, and the underlying information model. The project yielded several important insights. First, meaningful engagement with communities is essential to achieving comprehensive resilience outcomes. Second, resilience planning is most effective when electric grid considerations and broader community needs are addressed in a coordinated manner. Third, the use of platforms that allow for real-time input from communities can enhance utility responsiveness during restoration activities. Fourth, a structured and systematic planning approach can successfully translate ARCHER concepts into practice. Fifth, the development of an integrated metric that reflects both grid performance and community impacts provides a more holistic basis for evaluating resilience. Finally, incorporating community engagement and equity considerations into grid operations is critical, particularly during severe weather events that result in extended outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗
DOE OSTI2022

Inferring the Contribution of Microbial Taxa and Organic Matter Molecular Formulas to Ecological Assembly

Understanding the mechanisms underlying the assembly of communities has long been the goal of many ecological studies. While several studies have evaluated community wide ecological assembly, fewer have focused on investigating the impacts of individual members within a community or assemblage on ecological assembly. Here, we adapted a previous null model β-nearest taxon index (βNTI) to measure the contribution of individual features within an ecological community to overall assembly. This new metric, called feature-level βNTI (βNTI feat ), enables researchers to determine whether ecological features (e.g., individual microbial taxa) contribute to divergence, convergence, or have insignificant impacts across spatiotemporally resolved metacommunities or meta-assemblages. Using βNTI feat , we revealed that unclassified microbial lineages often contributed to community divergence while diverse groups (e.g., Crenarchaeota, Alphaproteobacteria, and Gammaproteobacteria) contributed to convergence. We also demonstrate that βNTI feat can be extended to other ecological assemblages such as organic molecules comprising organic matter (OM) pools. OM had more inconsistent trends compared to the microbial community though CHO-containing molecular formulas often contributed to convergence, while nitrogen and phosphorus-containing formulas contributed to both convergence and divergence. A network analysis was used to relate βNTI feat values from the putatively active microbial community and the OM assemblage and examine potentially common contributions to ecological assembly across different communities/assemblages. This analysis revealed that P-containing formulas often contributed to convergence/divergence separately from other ecological features and N-containing formulas often contributed to assembly in coordination with microorganisms. Additionally, members of Family Geobacteraceae were often observed to contribute to convergence/divergence in conjunction with both N- and P-containing formulas, suggesting a coordinated ecological role for family members and the nitrogen/phosphorus cycle. Overall, we show that βNTI feat offers opportunities to investigate the community or assemblage members, which shape the phylogenetic or functional landscape, and demonstrate the potential to evaluate potential points of coordination across various community types.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) (Final Technical Report)

The Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) project advances resilience science and engineering by addressing challenges in rural Kansas communities where aging infrastructure, extreme weather, and socioeconomic disparities heighten vulnerability to energy disruptions. Traditional approaches often focus on technical performance while overlooking community concerns and priorities. SAFER responds by integrating community perspectives with advanced analytical frameworks to create a holistic model for measuring and improving resilience. Project objectives included developing novel resilience metrics, advancing modeling frameworks that capture interdependencies across infrastructures, and embedding community-centric indicators directly into planning processes for distributed energy resources. The key technical innovations included the creation of self-organizing map (SOM)-based indices for objective resilience quantification, hetero-functional graph theory (HFGT) models linking power, water, transportation, and community assets, and graph neural network (GNN) tools for identifying critical nodes in complex systems. Community-centric energy planning was demonstrated through optimal siting and sizing of (photovoltaic) PV and battery storage, ensuring resilience enhancements also addressed energy burden and energy insecurity. SAFER engaged community partners in Dodge City and Ford County through surveys, focus groups, and workshops, generating more than 600 responses that established baseline measures of energy burden, financial insecurity, and willingness-to-pay to avoid outages. This data, organized in terms of a community capitals framework, informed the development of weighted reliability indices that better reflect community costs than traditional utility metrics. SAFER’s GNN-based critical node identification framework identified expert-labelled critical nodes with over 99% accuracy, while also uncovering additional functionalities essential for proactive resilience planning. The project’s models demonstrated that optimal PV and storage deployment could improve resilience indices by over 11 percent, with dispatch strategies further enhancing outcomes, confirming both the technical effectiveness and economic feasibility of these approaches. Through its combined emphasis on rigorous modeling, community-focused planning, and community engagement, SAFER advances the state of resilience research while delivering direct benefits to rural communities. The project provides tools, guidelines, and resilience heatmaps that help utilities, local governments, and residents better anticipate disruptions, prioritize investments, and strengthen the capacity to withstand and recover from energy-related hazards. Furthermore, the developed HFG and GNN frameworks are designed for transferability, allowing them to be adapted for resilience planning in other communities with minimal retraining. This inductive learning capability provides a scalable pathway to extend the SAFER project’s impact. Thus, creating a foundation for a nationally applicable model of infrastructure resilience. Additionally, the HFG can also be extended to include other FEMA community lifelines.

14 SOLAR ENERGY↗
DOE OSTI2021

Adapting Existing Energy Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes—including consequences and/or changes in investment or operational decisions due to avoided consequences—based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Selecting and Implementing Resilience Metrics in Existing Energy Sector Models [Slides]

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2019

Collecting and Processing Earth Science Data Metrics at NASA ESDIS

Since the launch of Terra satellite in 1999, the number of Earth Science remote sensing data products created and distributed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS) has increased from a few hundred to nearly ten thousand. NASA's Earth Science Data and Information System (ESDIS) Metrics System (EMS) collects metrics on data ingest, archive, and distribution by its Distributed Active Archive Centers (DAACs) and the Science Investigator-led Systems (SIPS), known as Data Providers. These metrics are critical in helping NASA management as well as data producers in resource planning and gaining a wide range of knowledge of data users and data usage.EMS receives flat files, or log files of data archive, ingest, and distribution either in their raw format, such as Apache web logs, or text files of log records formatted by the Data Providers. Tens of millions of records are processed each day to extract metrics on data products, user information, distribution protocols and services, and so on. The metrics are then made available to designated parties.This presentation provides an overview of the EMS processing workflow and improvement efforts made in recent years to handle ever-increasing number of data records and new metrics requirements, discusses several key steps including mapping log records to data products and identifying user communities along with geo-distribution, and demonstrates typical metrics capabilities produced by the EMS system. Challenges and potential approaches to improve the system are also discussed.

Pan, Jianfu↗
DOE OSTI2024

Large-scale Hydrogen Storage Risk Assessment

This project investigated risks involved in deploying a large-scale hydrogen storage system at the Port of Seattle (hereafter, the Port) for its on-terminal and maritime applications in an urban industrial setting. Alongside, the project attempted to address some of the barriers to risk assessment such as need for an exact system design for a systematic investigation, direct access to surrounding communities to gauge their perceptions, and an integrated software required to undertake a full-fledged risk assessment. These barriers were overcome using illustrative reference station designs, engaging with community-facing agencies through Port support, and pooling national laboratory capabilities available for risk assessments. The project identified relevant public safety risk metrics, compared various hydrogen carriers, engaged with community-facing agencies, and explored potential gaps in existing safety codes and standards. The primary impacts of this project include the development of risk assessment guidance for ports and utilities, informing them of the trade-offs in the choice of hydrogen carriers, and the ability to increase public capacity for dialog and engagement. This paves the way toward decarbonization of the Port activities, bringing about awareness around jobs in the market for risk assessments, and the need to ramp up community engagement long before any hydrogen system deployment is undertaken.

08 HYDROGEN↗
DOE OSTI2020

Energy Master Planning for Resilient Public Communities—Best Practices from U.S. Military Installations

Until recently, most planners at military installations addressed energy systems for new facilities on an individual facility basis without consideration of community-wide goals relevant to energy sources, renewables, storage, or future energy generation needs. Building retrofits of public buildings typically do not address energy needs beyond the minimum code requirements making it difficult, if not impossible, to achieve community-level targets on a building-by-building basis. Planning on the basis of cost and general reliability may also fail to deliver community-level resilience. For example, many building code requirements focus on hardening to specific threats, but in a multi-building community, only a few of these buildings may be mission-critical. Over the past two decades, the frequency and duration of regional power outages and water utility disruptions from weather, man-made events, and aging infrastructure have increased. Major disruptions of electric and thermal energy have degraded critical mission capabilities and caused significant economic impacts. In 2016, the U.S. Department of Defense issued guidance that each Service (Army, Navy, Air Force, Marines) complete comprehensive energy plans for the installations that consumed 75% of total building energy. Guidance was updated in 2017 to include metrics for energy resilience, and in some cases, water. This paper describes how community level quantitative and qualitative resilience analysis and metrics have been incorporated into community energy and water planning best practices for military installations in three geographically diverse locations. It is based on research performed under the International Energy Agency’s “Energy in Buildings and Communities Program Annex 73,” focusing on development of guidelines and tools that support the planning of Net Zero Energy Resilient Public Communities as well as research performed under the Department of Defense Environmental Security Technology Certification Program project EW18-D1- 5281, “Technologies Integration to Achieve Resilient, Low- Energy Military Installations.” The first case study reviews progress made on an energy and water planning study conducted at Fort Bliss, Texas. The second and third describes planning conducted at Fort Bragg, North Carolina and the Joint Region Marianas, Guam, respectively, under the updated guidance from 2017 regarding energy and water resilience. Analysis methods, key metrics, and key infrastructure and operational constraints are described, as well as technical, economic and business concepts used during the planning process.

Urban, Angela B.↗
DOE OSTI2020

Replicating Machine Learning Experiments in Materials Science

Transparency and reproducibility are important aspects of validation for Machine Learning (ML) models that are not fully understood and applies independently of the application domain.We offer a case study of reproducibility that highlights the challenges encountered when attempting to reproduce analyzes obtained with Machine Learning methods in materials informatics. Our study explores prediction results obtained with ML models and issues in training data serving as input. We discuss challenges related to theory-driven and numerical errors in training data, lack of reproducibility across platforms and versions, and effects of randomness when varying hyperparameters. In addition to model accuracy, a main metric of interest in the ML community, our results show that model sensitivity may be equally important for applying ML in domain applications such a materials science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

An Interpretable Index of Social Vulnerability to Environmental Hazards

Index-based measures of social vulnerability to environmental hazards are commonly modeled from composites of population-level risk factors. These models overlook individual context in communities' experiences of environmental hazards, producing metrics that may hinder spatial decision support for mitigating and responding to hazards. This paper introduces an interpretable, high-resolution model for generating an individual-oriented social vulnerability index (IOSVI) for the United States built on synthetic populations that couples individual and social determinants of vulnerability. The IOSVI combines an individual vulnerability index (IVI) that ranks individuals in an area’s synthetic population based on intersecting risk factors, with a social vulnerability index (SVI) based on the population’s cumulative distribution of IVI scores. Interpretability of the IOSVI procedure is demonstrated through examples of national, metropolitan, and neighborhood (census tract) level spatial variation in index scores and IVI themes, as well as an exploratory analysis examining risk factors affecting a specific sub-population (military veterans) in areas of high social and environmental vulnerability.

Tuccillo, Joe↗
NASA NTRS2019

Space Radiation and Plasma Effects on Satellites and Aviation: Quantities and Metrics for Tracking Performance of Space Weather Environment Models

The Community Coordinated Modeling Center has been leading communitywide space science and space weather model validation projects for many years. These efforts have been broadened and extended via the newly launched International Forum for Space Weather Modeling Capabilities Assessment (https://ccmc.gsfc.nasa.gov/assessment/). Its objective is to track space weather models' progress and performance over time, a capability that is critically needed in space weather operations and different user communities in general. The Space Radiation and Plasma Effects Working Team of the afore mentioned International Forum works on one of the many focused evaluation topics and deals with five different subtopics (https://ccmc.gsfc.nasa.gov/assessment/topics/radiationall.php) and varieties of particle populations: Surface Charging from tens of eV to 50keV electrons and internal charging due to energetic electrons from hundreds keV to several MeVs. Single event effects from solar energetic particles and galactic cosmic rays (several MeV to TeV), total dose due to accumulation of doses from electrons (>100 keV) and protons (>1 MeV) in a broad energy range, and radiation effects from solar energetic particles and galactic cosmic rays at aviation altitudes. A unique aspect of the Space Radiation and Plasma Effects focus area is that it bridges the space environments, engineering, and user communities. The intent of the paper is to provide an overview of the current status and to suggest a guide for how to best validate space environment models for operational/engineering use, which includes selection of essential space environment and effect quantities and appropriate metrics.

Zheng, Yihua↗