Search NASA⌕ Search

SEARCH · Search NASA

Results for “community metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A Predictive Approach to Eliminating Errors in Software Code

NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.

Source record↗

IRDFF-II: A New Neutron Metrology Library

High quality nuclear data is the most fundamental underpinning for all neutron metrology applications. This paper describes the release of version II of the International Reactor Dosimetry and Fusion File (IRDFF-II) that contains a consistent set of nuclear data for fission and fusion neutron metrology applications up to 60 MeV neutron energy. The library is intended to support: a) applications in research reactors; b) safety and regulatory applications in the nuclear power generation in commercial fission reactors; and c) material damage studies in support of the research and development of advanced fusion concepts. The paper describes the contents of the library, documents the thorough verification process used in its preparation, and provides an extensive set of validation data gathered from a wide range of neutron benchmark fields. The new IRDFF-II library includes 119 metrology reactions, four cover material reactions to support self-shielding corrections, five metrology metrics used by the dosimetry community, and cumulative fission products yields for seven fission products in three different neutron energy regions. In support of characterizing the measurement of the residual nuclei from the dosimetry reactions and the fission product decay modes, the present document lists the recommended decay data, particle emission energies and probabilities for 68 activation products. It also includes neutron spectral characterization data for 29 neutron benchmark fields for the validation of the library contents. Additional six reference fields were assessed (four from plutonium critical assemblies, two measured fields for thermal-neutron induced fission on 233U and 239Pu targets) but not used for validation due to systematic discrepancies in C/E reaction rate values or lack of reaction-rate experimental data. Another ten analytical functions are included that can be useful for calculating average cross sections, average energy, thermal spectrum average cross sections and resonance integrals. The IRDFF-II library and comprehensive documentation is available online at www-nds.iaea.org/IRDFF/. Evaluated cross sections can be compared with experimental data and other evaluations at www-nds.iaea.org/exfor/endf.htm. The new library is expected to become the international reference in neutron metrology for multiple applications.

IAEA IRDFF↗

First Plant Cell Atlas symposium report

The Plant Cell Atlas (PCA) community hosted a virtual symposium on December 9 and 10, 2021 on single cell and spatial omics technologies. The conference gathered almost 500 academic, industry, and government leaders to identify the needs and directions of the PCA community and to explore how establishing a data synthesis center would address these needs and accelerate progress. This report details the presentations and discussions focused on the possibility of a data synthesis center for a PCA and the expected impacts of such a center on advancing science and technology globally. Community discussions focused on topics such as data analysis tools and annotation standards; computational expertise and cyber-infrastructure; modes of community organization and engagement; methods for ensuring a broad reach in the PCA community; recruitment, training, and nurturing of new talent; and the overall impact of the PCA initiative. These targeted discussions facilitated dialogue among the participants to gauge whether PCA might be a vehicle for formulating a data synthesis center. The conversations also explored how online tools can be leveraged to help broaden the reach of the PCA (i.e., online contests, virtual networking, and social media stakeholder engagement) and decrease costs of conducting research (e.g., virtual REU opportunities). Major recommendations for the future of the PCA included establishing standards, creating dashboards for easy and intuitive access to data, and engaging with a broad community of stakeholders. The discussions also identified the following as being essential to the PCA's success: identifying homologous cell-type markers and their biocuration, publishing datasets and computational pipelines, utilizing online tools for communication (such as Slack), and user-friendly data visualization and data sharing. In conclusion, the development of a data synthesis center will help the PCA community achieve these goals by providing a centralized repository for existing and new data, a platform for sharing tools, and new analytical approaches through collaborative, multidisciplinary efforts. A data synthesis center will help the PCA reach milestones, such as community-supported data evaluation metrics, accelerating plant research necessary for human and environmental health.

59 BASIC BIOLOGICAL SCIENCES↗

Equation-based and data-driven modeling: Open-source software current state and future directions

Here, a review of current trends in scientific computing reveals a broad shift to open-source and higher-level programming languages such as Python and growing career opportunities over the next decade. Open-source modeling tools accelerate innovation in equation-based and data-driven applications. Significant resources have been deployed to develop data-driven tools (PyTorch, TensorFlow, Scikit-learn) from tech companies that rely on machine learning services to meet business needs while keeping the foundational tools open. Open-source equation-based tools such as Pyomo, CasADi, Gekko, and JuMP are also gaining momentum according to user community and development pace metrics. Integration of data-driven and principles-based tools is emerging. New compute hardware, productivity software, and training resources have the potential to radically accelerate progress. However, long-term support mechanisms are still necessary to sustain the momentum and maintenance of critical foundational packages.

97 MATHEMATICS AND COMPUTING↗

Virginia Energy Resiliency Study

The Virginia Energy Resilience Study (VERS) was conducted under the U.S. Department of Energy’s Renewables Advancing Community Energy Resilience (RACER) program to strengthen the ability of communities in Virginia to anticipate, withstand, and recover from electric grid disruptions. While the project did not fund construction, it delivered a comprehensive, community-centered framework for assessing energy resilience and produced actionable, site-specific solar-plus-storage designs to support future implementation.

14 SOLAR ENERGY↗

Evaluation of native Earth system model output with ESMValTool v2.6.0

Earth system models (ESMs) are state-of-the-art climate models that allow numerical simulations of the past, present-day, and future climate. To extend our understanding of the Earth system and improve climate change projections, the complexity of ESMs heavily increased over the last decades. As a consequence, the amount and volume of data provided by ESMs has increased considerably. Innovative tools for a comprehensive model evaluation and analysis are required to assess the performance of these increasingly complex ESMs against observations or reanalyses. One of these tools is the Earth System Model Evaluation Tool (ESMValTool), a community diagnostic and performance metrics tool for the evaluation of ESMs. Input data for ESMValTool needs to be formatted according to the CMOR (Climate Model Output Rewriter) standard, a process that is usually referred to as “CMORization”. While this is a quasi-standard for large model intercomparison projects like the Coupled Model Intercomparison Project (CMIP), this complicates the application of ESMValTool to non-CMOR-compliant climate model output. In this paper, we describe an extension of ESMValTool introduced in v2.6.0 that allows seamless reading and processing of “native” climate model output, i.e., operational output produced by running the climate model through the standard workflow of the corresponding modeling institute. This is achieved by an extension of ESMValTool's preprocessing pipeline that performs a CMOR-like reformatting of the native model output during runtime. Thus, the rich collection of diagnostics provided by ESMValTool is now fully available for these models. For models that use unstructured grids, a further preprocessing step required to apply many common diagnostics is regridding to a regular latitude–longitude grid. Extensions to ESMValTool's regridding functions described here allow for more flexible interpolation schemes that can be used on unstructured grids. Currently, ESMValTool supports nearest-neighbor, bilinear, and first-order conservative regridding from unstructured grids to regular grids. Example applications of this new native model support are the evaluation of new model setups against predecessor versions, assessing of the performance of different simulations against observations, CMORization of native model data for contributions to model intercomparison projects, and monitoring of running climate model simulations. For the latter, new general-purpose diagnostics have been added to ESMValTool that are able to plot a wide range of variable types. Currently, five climate models are supported: CESM2 (experimental; at the moment, only surface variables are available), EC-Earth3, EMAC, ICON, and IPSL-CM6. As the framework for the CMOR-like reformatting of native model output described here is implemented in a general way, support for other climate models can be easily added.

58 GEOSCIENCES↗

Supporting Space Weather with the Geospace Dynamics Constellation

The Geospace Dynamics Constellation (GDC) mission, planned to launch at the end of the decade, is a six-satellite constellation that will fly through the ionosphere and thermosphere at around 400 km. While GDC is a science mission, its comprehensive instrumentation will not only contribute to our understanding of space weather phenomena in the ionosphere-thermosphere system, but will also provide valuable, space weather-relevant data. Data from GDC will be made available at low latency via real-time space weather data stream. We are working with operational partners to identify space weather data products and coordinate reception of the space weather beacon data. Alongside preparations for real-time GDC data streams, we are working to identify current model capabilities and needs, to ensure that space weather models that can make use of GDC measurements are moving along the Research-toOperations pipeline. Before GDC launch, Observing System Simulation Experiments (OSSEs) carried out with synthetic GDC data can be used to demonstrate the capabilities of models and to predict the impact of GDC data. Following launch, Observing System Experiments (OSEs) will demonstrate the impact of GDC space weather data. In preparation for GDC, the ITM space weather community should establish baseline metrics for space weather parameters of scientific and operational interest. These metrics, tracked over time before and after the launch of GDC, will allow us to track advancements in forecasting, nowcasting, and hindcasting of the ITM system and to trace the impact of scientific progress from space weather research into operations. By demonstrating the impact of real-time GDC data, specific data needs can be identified and prioritized for long term investment on future observing systems.

Katherine Garcia-Sage↗

Sound Quality Metric Indicators of Rotorcraft Noise Annoyance Using Multilevel Regression Analysis

Although every helicopter in operation has to go through a noise certification process, annoyance due to helicopters still persists within various communities. This implies that certification metrics do not capture the full range of human response and that predicted reactions could be supplemented with other information, which could be acoustic or non-acoustic in nature. The rotorcraft sound quality metric (RoQM) psychoacoustic experiment was designed to determine the relative importance of sound quality metrics (SQMs), such as sharpness, tonality, loudness, fluctuation strength and impulsiveness, on human annoyance to rotorcraft sounds. Starting from a baseline helicopter recording, SQMs were varied synthetically and presented to subjects who responded with an annoyance rating. The RoQM test took place in 2017 at the NASA Langley Research Center in the Exterior Effects Room. A total of 105 sounds were played to 40 subjects. The relationship between helicopter noise sound quality and annoyance is modeled using multilevel regression in this work, which takes into account the variability of responses across subjects. Previous analyses did not consider such a grouping of the data.

Matthew Boucher↗

Feedback Control of Flight Speed to Reduce Unmanned Aerial System Noise

The aim of this initial study is to incorporate an acoustic metric into the flight control system of an unmanned aerial vehicle. This could be used to mitigate the noise impact of unmanned aerial systems operating near residential communities. To incorporate an acoustic metric into a pre-existing flight control system, two things are required: a source noise model, and an acoustic controller. An acoustic model was developed based on Gutin's work to estimate propeller noise. The flight control system was augmented with a controller to reduce propeller noise using feedback control of the commanded flight speed until an acoustic target was met. This control approach focuses on modifying flight speed only, with no perturbation to the trajectory. Multiple flight simulations were performed and the results showed that integrating an acoustic metric into the flight control system of an unmanned aerial system is possible.

Matthew B Galles↗

Application Usability Levels: A Framework for Tracking Project Product Progress

The space physics community continues to grow and become both more interdisciplinary and more intertwined with commercial and government operations. This has created a need for a framework to easily identify what projects can be used for specific applications and how close the tool is to routine autonomous or on-demand implementation and operation. We propose the Application Usability Level (AUL) framework and publicizing AULs to help the community quantify the progress of successful applications, metrics, and validation efforts. This framework will also aid the scientific community by supplying the type of information needed to build off of previously published work and publicizing the applications and requirements needed by the user communities. In this paper, we define the AUL framework, outline the milestones required for progression to higher AULs, and provide example projects utilizing the AUL framework. This work has been completed as part of the activities of the Assessment of Understanding and Quantifying Progress working group which is part of the International Forum for Space Weather Capabilities Assessment.

Alexa J Halford↗

An investigation of fighter aircraft agility

This report attempts to unify in a single document the results of a series of studies on fighter aircraft agility funded by the NASA Ames Research Center, Dryden Flight Research Facility and conducted at the University of Kansas Flight Research Laboratory during the period January 1989 through December 1993. New metrics proposed by pilots and the research community to assess fighter aircraft agility are collected and analyzed. The report develops a framework for understanding the context into which the various proposed fighter agility metrics fit in terms of application and testing. Since new metrics continue to be proposed, this report does not claim to contain every proposed fighter agility metric. Flight test procedures, test constraints, and related criteria are developed. Instrumentation required to quantify agility via flight test is considered, as is the sensitivity of the candidate metrics to deviations from nominal pilot command inputs, which is studied in detail. Instead of supplying specific, detailed conclusions about the relevance or utility of one candidate metric versus another, the authors have attempted to provide sufficient data and analyses for readers to formulate their own conclusions. Readers are therefore ultimately responsible for judging exactly which metrics are 'best' for their particular needs. Additionally, it is not the intent of the authors to suggest combat tactics or other actual operational uses of the results and data in this report. This has been left up to the user community. Twenty of the candidate agility metrics were selected for evaluation with high fidelity, nonlinear, non real-time flight simulation computer programs of the F-5A Freedom Fighter, F-16A Fighting Falcon, F-18A Hornet, and X-29A. The information and data presented on the 20 candidate metrics which were evaluated will assist interested readers in conducting their own extensive investigations. The report provides a definition and analysis of each metric; details of how to test and measure the metric, including any special data reduction requirements; typical values for the metric obtained using one or more aircraft types; and a sensitivity analysis if applicable. The report is organized as follows. The first chapter in the report presents a historical review of air combat trends which demonstrate the need for agility metrics in assessing the combat performance of fighter aircraft in a modern, all-aspect missile environment. The second chapter presents a framework for classifying each candidate metric according to time scale (transient, functional, instantaneous), further subdivided by axis (pitch, lateral, axial). The report is then broadly divided into two parts, with the transient agility metrics (pitch lateral, axial) covered in chapters three, four, and five, and the functional agility metrics covered in chapter six. Conclusions, recommendations, and an extensive reference list and biography are also included. Five appendices contain a comprehensive list of the definitions of all the candidate metrics; a description of the aircraft models and flight simulation programs used for testing the metrics; several relations and concepts which are fundamental to the study of lateral agility; an in-depth analysis of the axial agility metrics; and a derivation of the relations for the instantaneous agility and their approximations.

Valasek, John↗

Resilient Node Cluster Analysis Tool (ReNCAT) v. 2.1

SAND2021-6533 O The Resilient Node Cluster Analysis Tool (ReNCAT) identifies portions of a power distribution network that can be isolated into microgrids in order to supply services to a community during disruptive events. Candidate microgrid configurations are evaluated using a burden metric, a measure of the relative effort community members must expend to acquire services required for their well-being. Results present multiple candidate configurations, each with a different balance of cost and burden. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Melander, Darryl↗

Staying Current: A Community Readiness Framework for Marine Energy Applied to River Current Energy in Alaska

Marine energy-including wave, tidal, and river current energy-can provide a local energy source for rural and remote communities. Marine energy has the potential to bolster self-sufficiency and create economic opportunities while preserving ecological integrity. Communities may be interested in deploying, testing, and advancing these early-stage technologies to meet their needs. However, limited capacity, workforce constraints, and other barriers can challenge development. To better understand a community's interest in and preparedness for marine energy, we developed a suite of 150 'metrics of readiness.' Organized across seven categories-technical, social, environmental, strategic, governance, economic, financial-and 29 subcategories, the metrics provide a holistic perspective beyond the technical aspects of an energy device. We conducted a desktop application of the metrics of readiness for Igiugig, Alaska. The metrics were applied retrospectively for two points in time: before (2009) and after (2018) in-stream testing of a river current energy device. By documenting changes among categories and subcategories of the metrics, our results show the evolving nature of community readiness for river current energy. They also illustrate how our interdisciplinary framework captures the investment in environmental effects research and commitment to strategic planning that occurred in Igiugig. In future applications, we envision the framework could be used to foster public engagement in marine energy, collaborate with communities in project development, shape capacity building activities, prioritize investments, and inform research needs. While our study focuses on enabling river current energy in Alaska, the metrics of readiness have the potential to inform implementation of other renewable technologies with communities in new geographies.

13 HYDRO ENERGY↗

Distributed Wind Brings Value to Communities

Value streams extend beyond traditional quantitative metrics and benefit a variety of stakeholders. When considering a distributed wind system, both the benefits and costs of the potential system need to be well understood. This fact sheet provides an overview of how to value the various benefits of distributed wind systems.

17 WIND ENERGY↗

Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Abstract Dynamic (temporal) graphs are a convenient mathematical abstraction for many practical complex systems including social contacts, business transactions, and computer communications. Community discovery is an extensively used graph analysis kernel with rich literature for static graphs. However, community discovery in a dynamic setting is challenging for two specific reasons. Firstly, the notion of temporal community lacks a widely accepted formalization, and only limited work exists on understanding how communities emerge over time. Secondly, the added temporal dimension along with the sheer size of modern graph data necessitates new scalable algorithms. In this paper, we investigate how communities evolve over time based on several graph metrics under a temporal formalization. We compare six different algorithmic approaches for dynamic community detection for their quality and runtime. We identify that a vertex-centric (local) optimization method works as efficiently as the classical modularity-based methods. To its advantage, such local computation allows for the efficient design of parallel algorithms without incurring a significant parallel overhead. Based on this insight, we design a shared-memory parallel algorithm DyComPar , which demonstrates between 4 and 18 fold speed-up on a multi-core machine with 20 threads, for several real-world and synthetic graphs from different domains.

97 MATHEMATICS AND COMPUTING↗

GEM-CEDAR Challenge: Comparing Ionospheric Models with Poynting Flux from DMSP Observations

As part to the GEM-CEDAR challenge we are extending the model-data comparisons to electrodynamic in-situ measurements in low-Earth orbit. We use DMSP observations of electric and magnetic fields to compute Poynting Flux values along the satellite track in high latitudes including the auroral zones and the polar cap. Models of the ionosphere that include electrodynamic parameters have been run for five events selected for the GEM-CEDAR modeling challenge for which DMSP data are available for comparison. Combined with a magnetic field model we use the modeled electric fields to compute Poynting Flux and Joule Dissipation values from outputs of CTIPe, TIE-GCM, the ionospheric electrodynamics solvers of the SWMF, LFM and OpenGGCM magnetosphere-ionosphere coupled models, and the Weimer electric field model. The online metrics analysis tool at the Community Coordinated Modeling Center (CCMC) has been updated to handle the analysis of separate short segments of available data (high-latitude sections of the satellite orbit) with model outputs to analyze how well auroral patterns are being reproduced by the models. We present initial results from the new analysis tool in terms of model yields (ratio of the difference between maximum and minimum values of model results to the observation), timing/location errors of local maxima in the inbound and outbound auroral crossings as well as cross-correlations for individual passes. We collect the information for many DMSP passes and present an analysis for model performance during quiet and geomagnetically disturbed time periods using half-orbit integrated values as well.

Rastaetter, Lutz↗

NASA In Situ Data Needs to Support the Operational Calibration and Validation of Ocean Color Satellite Data Products

Calibrating ocean color satellite instruments and validating their data products requires temporal and spatial abundances of high quality in situ oceanographic data. The Consortium for Ocean Leadership Ocean Observing Initiative (OOl) is currently implementing a distributed array of in-water sensors that could provide a significant contribution to future ocean color activities. This workshop will scope the optimal way to use and possibly supplement the planned OOl infrastructure to maximize its utility and relevance for calibration and validation activities that support existing and planned NASA ocean color missions. Here, I present the current state of the art of NASA validation of ocean color data products, with attention to autonomous time-series (e.g., the AERONET -OC network of above-water radiometers), and outline NASA needs for data quality assurance metrics and adherence to community-vetted data collection protocols

Werdel, P. Jeremy↗