Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Literature Review of Cumulative Noise Metrics Relevant to X-59 Supersonic Overflights

Upcoming studies with the X-59 aircraft will collect dose-response data to understand community response to en-route supersonic noise. This data collection effort will inform regulators in their efforts to potentially update the ban on commercial supersonic flight with acceptable noise standards. Part of the dataset will consist of end-of-day responses to the noise from multiple supersonic overflights. This document provides rationale from relevant literature surrounding which cumulative noise metric to pair with end-of-day survey responses for upcoming community studies with the X-59 aircraft. Despite its deficiencies, day-night average sound level (DNL) summation of candidate single-event metrics remains the most likely choice for a cumulative noise metric for multiple supersonic overflights because 1) it is widely used for other transportation noise sources and 2) its relevance for infrequent events is somewhat plausible, unlike some recent alternative metrics.

sonic boom↗

A Three-Dimensional Receiver Operator Characteristic Surface Diagnostic Metric

Receiver Operator Characteristic (ROC) curves are commonly applied as metrics for quantifying the performance of binary fault detection systems. An ROC curve provides a visual representation of a detection system s True Positive Rate versus False Positive Rate sensitivity as the detection threshold is varied. The area under the curve provides a measure of fault detection performance independent of the applied detection threshold. While the standard ROC curve is well suited for quantifying binary fault detection performance, it is not suitable for quantifying the classification performance of multi-fault classification problems. Furthermore, it does not provide a measure of diagnostic latency. To address these shortcomings, a novel three-dimensional receiver operator characteristic (3D ROC) surface metric has been developed. This is done by generating and applying two separate curves: the standard ROC curve reflecting fault detection performance, and a second curve reflecting fault classification performance. A third dimension, diagnostic latency, is added giving rise to 3D ROC surfaces. Applying numerical integration techniques, the volumes under and between the surfaces are calculated to produce metrics of the diagnostic system s detection and classification performance. This paper will describe the 3D ROC surface metric in detail, and present an example of its application for quantifying the performance of aircraft engine gas path diagnostic methods. Metric limitations and potential enhancements are also discussed

Simon, Donald L.↗

Repeal of the Clean Power Plan: Social Cost and Distributional Implications

The Clean Power Plan (CPP) was repealed due to concerns about the “unnecessary, costly burdens” it may impose on electric utilities, thereby delaying efforts to reduce carbon dioxide emissions (CO 2 ) from the electricity sector. This paper examines the greenhouse gas and welfare implications of this repeal while incorporating the presence of the state renewable portfolio standards (RPS) in the US as the status quo. We assess the carbon abatement and welfare costs with the CPP relative to two alternative baselines: a no–policy baseline and a pre–existing policy baseline with the RPS. The CPP is implemented as a regional mass–based standard, a regional rate–based standard, or as a national mass–based standard with trading of emissions across regions over the 2022–2030 period. We find that the incremental discounted welfare costs per metric ton of CO 2 that would have been abated by the CPP relative to the RPS would be substantially lower than the global social cost of CO 2 . However, the overall costs of carbon abatement with the CPP added to the RPS would have become higher than the social cost of carbon when estimated relative to a no–policy baseline, except with a national mass–based CPP. Across all policy combinations and choice of baselines, the aggregate welfare costs were lowest under a national mass–based standard and highest under the regional rate–based standard. Here, we also find that the CPP would have imposed large welfare costs on consumers and fossil fuel producers while benefiting the renewable fuel producers.

, Q42↗

Energy flexibility of residential buildings: A systematic review of characterization and quantification methods and applications

With building electric demand becoming increasingly dynamic, and a growing percentage of intermittent renewable power generation from solar photovoltaics and wind turbines, the power grid is facing increasing challenge to manage the real time balance between the supply and demand. With advancements in smart sensing and metering, smart appliances, electric vehicles, and energy storage technologies, demand side management of residential buildings can help the grid to improve stability by optimizing flexible loads. This paper reviews recent studies on residential building demand side management, with a focus on characterization and quantification of energy flexibility covering various types of flexible loads, metrics, methods, and applications. The reviewed studies showed four levels of applications: building level (45%), district or community level (29%), system level (19%), and building sector level (7%). Shifting loads is the dominant flexibility type in 60% of applications, followed by shedding (19%), generation (16%), and modulating (6%). Depending on the technology and application scope, flexible operations have a wide range of performance, with peak power reductions of 1%~65%, energy savings up to 60%, operational cost reduction of 1%~48%, and greenhouse gas emission reductions of up to29%. More than half (51%) of the studies employed control strategies to achieve flexibility; among those 72% used optimal controls, while 28% used rule-based controls. About 58% of the studies used mathematical formulation to quantify energy flexibility. Most studies were based on simulation, while less than 15% of the studies had measurements from experiments or field tests. The review reveals research opportunities to address significant gaps in the existing literature: (1) establishing a common definition and performance metrics for energy flexibility of buildings that are technology and application agnostic, (2) developing an ontology to standardize representation of flexibility resources for interoperability, (3) integrating occupant impacts into the quantification and optimization of energy flexibility, and (4) developing requirements and credits of energy flexibility in building energy codes and standards. Findings from the review can inform future research and development of energy flexible buildings which are essential to a reliable and resilient power grid.

Li, H↗

Replicating HCCI-like autoignition behavior: What gasoline surrogate fidelity is needed?

This work seeks to characterize the fidelity needed in a gasoline surrogate with the intent to replicate the complex autoignition behavior exhibited within advanced combustion engines, and specifically Homogeneous Charge Compression Ignition (HCCI). A low-temperature gasoline combustion (LGTC) engine operating in HCCI mode and a rapid compression machine (RCM) are utilized to experimentally quantify fuel reactivity, through autoignition and preliminary heat release characteristics. Fuels considered include a research grade E10 U.S. gasoline (RD5-87), three multi-component surrogates (PACE-1, PACE-8, PACE-20), and a binary surrogate (PRF88.4). Each fuel was studied at lean/HCCI-like conditions covering a wide range of temperatures and pressures that are representative of naturally aspirated to high boost engine operation. Detailed chemical kinetic modeling is also undertaken using a recently updated gasoline surrogate kinetic model to simulate the RCM experiments and to provide chemical insight into surrogate-to-surrogate differences. The LGTC engine experiments demonstrate nearly identical reactivity between PACE-20 and RD5-87 across studied conditions, while faster phasing is seen for both PACE-1 and PACE-8 due to their stronger intermediate- and low-temperature heat release (ITHR/LTHR) at naturally aspirated and boosted conditions, respectively. The RCM experiments reveal typical low-temperature, negative temperature coefficient (NTC) and intermediate-temperature autoignition behaviors at all pressure conditions for RD5-87, which are qualitatively reproduced by all surrogates. Quantitative discrepancies in both autoignition and preliminary heat release are observed for all surrogates, while their ability to replicate RD5-87 autoignition behavior follows the order of PACE-20 > PACE-1 > PACE-8 > PRF88.4. Excellent mapping is obtained between the LGTC engine and the RCM, where the engine pressure-time trajectories can be characterized by the regimes represented by the RCM autoignition isopleths. The kinetic model performs commendably when simulating both autoignition and preliminary heat release of PACE-20, while typically overpredicting ignition delay times for PACE-1, PACE-8 and PRF88.4 at high-pressure and low-temperature/NTC conditions. Sensitivity and rate of production (ROP) analyses highlight surrogate-to-surrogate differences in the governing chemical kinetics where n-pentane initiates rapid OH branching at a faster rate and an earlier timing for PACE-20 than iso-pentane does for PACE-1 and PACE-8, making it computationally more reactive than the other surrogates. The current study highlights the need to include non-standardized properties, such as the lean/HCCI-like autoignition characteristics, in addition to ASTM properties (e.g., RON, MON) as metrics of fuel reactivity and targets to be matched when formulating high-fidelity surrogates that fully capture gasoline advanced combustion behavior such as HCCI-like autoignition.

42 ENGINEERING↗

Robust statistical methods for automated outlier detection

The computational challenge of automating outlier, or blunder point, detection in radio metric data requires the use of nonstandard statistical methods because the outliers have a deleterious effect on standard least squares methods. The particular nonstandard methods most applicable to the task are the robust statistical techniques that have undergone intense development since the 1960s. These new methods are by design more resistant to the effects of outliers than standard methods. Because the topic may be unfamiliar, a brief introduction to the philosophy and methods of robust statistics is presented. Then the application of these methods to the automated outlier detection problem is detailed for some specific examples encountered in practice.

Jee, J. R.↗

Development of NASA Technical Standards Program Relative to Enhancing Engineering Capabilities

The enhancement of engineering capabilities is an important aspect of any organization; especially those engaged in aerospace development activities. Technical Standards are one of the key elements of this endeavor. The NASA Technical Standards Program was formed in 1997 in response to the NASA Administrator s directive to develop an Agencywide Technical Standards Program. The Program s principal objective involved the converting Center-unique technical standards into Agency wide standards and the adoption/endorsement of non-Government technical standards in lieu of government standards. In the process of these actions, the potential for further enhancement of the Agency s engineering capabilities was noted relative to value of being able to access Agencywide the necessary full-text technical standards, standards update notifications, and integration of lessons learned with technical standards, all available to the user from one Website. This was accomplished and is now being enhanced based on feedbacks from the Agency's engineering staff and supporting contractors. This paper addresses the development experiences with the NASA Technical Standards Program and the enhancement of the Agency's engineering capabilities provided by the Program s products. Metrics are provided on significant aspects of the Program.

Gill, Paul S.↗

The Multiplatform Precipitation Feature (MPF) Database: Synthesizing Satellite and Ground-Based Precipitation and Lightning Datasets for Convective Studies

NASA’s Lightning Imaging Sensor (LIS) and the Global Precipitation Measurement (GPM) mission have contributed a wealth of data toward global lightning and precipitation studies, respectively. Combining lightning and precipitation datasets leverages their unique insights into deep convective processes that inform about characteristics of convection and its intensity. Recent efforts to synthesize the LIS and GPM datasets prepare the opportunity for unprecedented large-scale, value-added multiplatform analyses of convection. This data synthesis proof-of-concept study elaborates on the creation of a database of reflectivity-based multiplatform precipitation features (MPFs) that capture a combination of information extracted from spatiotemporally coincident lightning and precipitation data within individual storm features. The space-based GPM Dual-frequency Precipitation Radar (DPR) provides a record of precipitation data, while the GPM Validation Network (VN) additionally incorporates ground-based polarimetric Doppler radar data to provide microphysical and kinematic context to DPR data. The LIS instrument onboard the International Space Station has contributed lightning observations since 2017. MPFs encapsulating information from these datasets are created from isolated regions of filtered, smoothed DPR reflectivity data to which ellipses are fit. Each MPF includes feature location, size, and eccentricity information as well as summary reflectivity characteristics. They also include summaries of precipitation microphysics and derived three-dimensional wind available from ground-based radar data. LIS data provides standard lightning characteristics such as flash count and density to each MPF as well as other informative metrics such as flash area and radiance. Each MPF file includes information about the original data from which the MPF and its characteristics were determined, allowing end-user reconstruction of the ellipse and deeper “level I” analysis of captured data. This database of VN-LIS MPFs enables broad statistical analysis of the relationships between the microphysical, kinematic, and electrical properties of convection. Preliminary results from a demonstration of the database will be described as well as ongoing efforts and avenues for future work.

Lightning↗

Comparison of the Performance of Noise Metrics as Predictions of the Annoyance of Stage 2 and Stage 3 Aircraft Overflights

Thirty audiometrically screened test participants judged the relative annoyance of two comparison (variable level) and thirty-four standard (fixed level) signals in an adaptive paired comparison psychoacoustic study. The signal ensemble included both FAR Part 36 Stage 2 and 3 aircraft overflights, as well as synthesized aircraft noise signatures and other non-aircraft signals. All test signals were presented for judgment as heard indoors, in the presence of continuous background noise, under free-field listening conditions in an anechoic chamber. Analyses of the performance of 30 noise metrics as predictors of these annoyance judgments confirmed that the more complex metrics were generally more accurate and precise predictors than the simpler methods. EPNL was somewhat less accurate and precise as a predictor of the annoyance judgments than a duration-adjusted variant of Zwicker's Loudness Level.

Pearsons, Karl S.↗

Drawbar Pull (DP) Procedures for Off-Road Vehicle Testing

As NASA strives to explore the surface of the Moon and Mars, there is a continued need for improved tire and vehicle development. When tires or vehicles are being designed for off-road conditions where significant thrust generation is required, such as climbing out of craters on the Moon, it is important to use a standard test method for evaluating their tractive performance. The drawbar pull (DP) test is a way of measuring the net thrust generated by tires or a vehicle with respect to performance metrics such as travel reduction, sinkage, or power efficiency. DP testing may be done using a single tire on a traction rig, or with a set of tires on a vehicle; this report focuses on vehicle DP tests. Though vehicle DP tests have been used for decades, there are no standard procedures that apply to exploration vehicles. This report summarizes previous methods employed, shows the sensitivity of certain test parameters, and provides a body of knowledge for developing standard testing procedures. The focus of this work is on lunar applications, but these test methods can be applied to terrestrial and planetary conditions as well. Section 1.0 of this report discusses the utility of DP testing for off-road vehicle evaluation and the metrics used. Section 2.0 focuses on test-terrain preparation, using the example case of lunar terrain. There is a review of lunar terrain analogs implemented in the past and a discussion on the lunar terrain conditions created at the NASA Glenn Research Center, including methods of evaluating the terrain strength variation and consistency from test to test. Section 3.0 provides details of the vehicle test procedures. These consist of a review of past methods, a comprehensive study on the sensitivity of test parameters, and a summary of the procedures used for DP testing at Glenn.

wheel↗

ARC-DPA 1-MeV Neutron Fluence Equivalence Model for GaAs

Here, the legacy data used in the production of the American Society for Testing and Materials (ASTM) E722 standard for gallium arsenide (GaAs) were fit with the athermal recombination corrected-displacements per atom (ARC-DPA) model for the development of a novel 1-MeV neutron equivalent fluence metric. Improving on previous work, the coefficients for the ARC-DPA model were optimized using a conjugate gradient method, and the uncertainties in the observed damage in different benchmark neutron fields were sampled to quantify their contribution to the damage metric. The optimized parameters of −0.474 ± 0.03 for b arcdpa and 0.016 ± 0.002 for c arcdpa provided good agreement and indicated that the solution is not sensitive to the corresponding fluence uncertainties. Compared to the current 1-MeV neutron fluence equivalence standard for displacement damage in GaAs, our results indicate that for a thermal reactor neutron environment, displacement damage has been underestimated by around 25% and that the saturation value for the damage efficiency had been higher than previously modeled.

1-MeV equivalent fluence↗

Metrics and Analytical Frameworks for Valuing Energy Efficiency and Distributed Energy Resources in the Built Environment: Preprint

This paper summarizes efforts to develop new—and enhance existing—analytical frameworks and metrics to quantify the value that grid-interactive efficient homes with solar (GEB-solar homes) can provide. Industry is working to characterize and understand these capabilities and benefits, but existing analytical frameworks for evaluating energy efficiency (EE) are often siloed from those that evaluate distributed energy resources (DERs). Five metrics were adapted from an extensive literature review and applied to case studies of a modeled home in Riverside, California: ramp up/down, cover factor demand/supply, and curtailable load. Eight different technology scenarios were analyzed using a more tightly connected suite of building-to-grid models (BEopt, REopt, ReEDS, and PLEXOS). Additionally, an initial version of the Cambium tool was developed, characterizing the marginal prices and emissions from NREL’s 2018 Standard Scenarios. These grid costs were extended to a time-varying proxy retail rate and applied as part of a new grid alignment metric. In the results, a more integrated combination of GEB-solar technologies led to a higher cover factor demand—the percentage of gross home load covered by on-site solar—however, a benchmark was required to determine what range of cover factor was “best” for given grid conditions. To that end, a grid alignment cost metric was applied to the case study scenarios. The average cost to serve the net load of the home decreased from a median of ~$0.24/kWh to ~$0.10/kWh when the most integrated technology scenario was optimized towards the grid pricing proxy versus the time-of-use (TOU) rate.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Fault-tolerant resource comparison of qudit and qubit encodings for diagonal quadratic operators

Finite local Hilbert-space truncations arise naturally in quantum simulations of lattice field theories and motivate qudit encodings, but their fault-tolerant advantage over qubit encodings remains unclear. We compare the non-Clifford cost of implementing quadratic diagonal evolutions, exemplified by 𝑈 = 𝑒$^{−𝑖⁢𝑡⁢𝜙^2_𝑥}$ in a uniform field-amplitude discretization of a real scalar field, using either one logical 𝑑-level qudit or 𝑛 𝑏 = ⌈log 2⁡ 𝑑⌉ logical qubits. We analyze two standard settings: product-formula simulation and linear combination of unitaries (LCU) per block encoding, taking the resource metric to be the number of non-Clifford gates after synthesis into a discrete logical gate set. Because tight synthesis bounds for general single-qudit rotations are not known, we express the qudit constructions in terms of embedded two-level SU⁡(2) rotations and derive explicit finite-𝑑 break-even conditions for their synthesis cost; these serve as compiler targets for when qudit encodings can outperform the qubit baseline. Within the constructive models studied here, product-formula implementations would require an exponentially stronger per-primitive synthesis advantage for qudits to win asymptotically, while in the LCU setting the qubit encoding is asymptotically cheaper in 𝑑. Nevertheless, the finite-𝑑 threshold analysis identifies low-dimensional regions in which qudits can yield meaningful constant-factor savings, particularly for LCU-based implementations. As a secondary analysis of the LCU construction, we use an idealized negligible-overhead qubit-qudit code-switching model to give an absolute 𝑇-count comparison and reinterpret the savings as an allowable per-switch overhead budget.

Godwood, Samuel [Univ. of Liverpool (United Kingdo↗

HumoNet: A Framework for Realistic Modeling and Simulation of Human Mobility Network

Understanding, analyzing, and predicting human mobility and dynamics are valuable to solving pressing problems, developing effective plans, and prescribing timely remedies. As a computational approach, realistic human mobility simulations allow us to understand, analyze, and predict complex systems, including human societies. Accurate simulations rely on (1) the model that captures interactions and behaviors of myriad entities in our society and (2) the mapping of model instances to real-world entities. Taking this into account, this paper introduces the Human Mobility Network simulation framework (HumoNet), an integrated patterns of life (POL) simulation framework that leverages real-world data layers including transportation networks, points of interest, populations, popularity, and human trajectories. HumoNet is a data informed model in which agents are equipped with activities, locomotion, and planning capabilities. To simulate realistic kinematic maneuvers of individuals in transportation networks, HumoNet harnesses a microscopic traffic simulator that provides interaction among vehicles and traffic objects. In this paper, we describe the framework, outline our methodologies, and discuss the data processing and challenges of each data layer. Through experiments, we demonstrate that our simulations capture key features of human mobility by comparing them to the literature and real data using standard measures of human mobility (i.e., the radius of gyration, number of locations visited, level of exploration) and metrics scoring (i.e., Jensen-Shannon divergence). We envision that the synthetic data produced by HumoNet will serve as a benchmark for analyzing epidemics, deploying EV charging networks, and validating AI/ML tasks such as location prediction.

Kim, Joon-Seok↗

Evaluating Symmetry in 3-dimensional Simulation Data

The increasing use of three-dimensional simulations has led to an increased need for effective verification and validation, or V&V. Unfortunately, the high computational cost associated with three-dimensional simulations makes many standard V&V techniques cost-prohibitive. Given these circumstances, we must pay close attention to V&V metrics that can be evaluated using only a single simulation. One of the simplest of these metrics is the evaluation of physical symmetries. This report details a method of computing the deviation from symmetry in a three-dimensional dataset with an arbitrarily distributed mesh. Examples are presented for spherical and axisymmetric systems using the Paraview post-processing analysis workflow.

97 MATHEMATICS AND COMPUTING↗

Multi-Sensor Optimal Motion Planning for Radiological Contamination Surveys by Using Prediction-Difference Maps

Distributed and networked mobile sensor platforms using unmanned aerial and/or ground vehicles to survey areas of interest offer a safer and more efficient method for radiological contamination mapping; however, most applications rely on uniformly sweeping of the area in a raster-type motion without utilizing the information available in a dynamic sense. We have developed a fully autonomous optimal motion planning procedure for networks with two or more mobile sensors. The procedure utilizes well-established concepts of Gaussian processes in combination with control laws based on centroidal Voronoi tessellations to achieve optimal next-iteration sensor movements. A new method of informing optimal motion planning is proposed, whereby the absolute difference between the prior and current full-map prediction, referred to as the prediction-difference map, is used as the spatial density function within each Voronoi cell, providing immediate and iterative feedback for dynamic use of available information. The Gaussian process regression model used to estimate the contamination in unvisited locations also provides prediction uncertainties, and can be used as a quantitative metric to assess the confidence in the calculated contamination map; these estimates and prediction uncertainties are unavailable for standard uniform survey routines as they can only produce maps in the vicinity of observed locations. We present through simulation the achievable performance gains from using this new method by directly comparing to a uniform survey method. Results show that using the prediction-difference maps to inform motion planning procedures offers a faster rate of producing an accurate and convergent map relative to a uniform survey route.

47 OTHER INSTRUMENTATION↗

Out-of-plane properties

This paper summarizes three areas of research which were performed to characterize out-of-plane properties of composite materials. In the first investigation, a series of tests was run to characterize the through-the-thickness tensile strength for a variety of composites that included 2D braids, 2D and 3D weaves, and prepreg tapes. A new test method based on a curved beam was evaluated. Failures were significantly different between the 2D materials and the 3D weaves. The 2D materials delaminated between layers due to out-of-plane tensile stresses while the 3D weaves failed due to the formation of radial cracks between the surface plies caused by high circumferential stresses along the inner radius. The strength of the 2D textile composites did not increase relative to the tapes. Final failure in the 3D weaves was caused by a circumferential crack similar to the 2D materials and occurred at a lower bending moment than in other materials. The early failures in the 3D weaves were caused by radial crack formation rather than a low through-the-thickness strength. The second investigation focused on the development of a standard impact test method to measure impact damage resistance. The only impact tests that currently exist are compression after impact (CAI) tests which incorporate elements of both damage resistance and damage tolerance. A new impact test method is under development which uses a quasi-static indentation (QSI) test to directly measure damage resistance. Damage resistance is quantified in terms of the contact force to produce a unit of damage where a metric for damage may be area in C-scan, depth of residual dent , penetration, damage growth, etc. A final draft of an impact standard that uses a QSI test method will be presented to the ASTM Impact Task Group on impact. In the third investigation, the impact damage resistance behavior of a variety of textile materials was studied using the QSI test method. In this study, the force where large damage initiates was measured and the delamination size as a function of force was determined. The force to initiate large damage was significantly lower in braids and weaves. The delamination diameter - impact forace relationship was quanitfied using a damage resistance parameter, Q(*), which related delamination diameter to imapct force over a range of delamination sizes. Using this Q(*) parameter to rate the materials, the stitched uniweaves, toughened epoxy tapes, and through-the-thickness orthogonal interlock weave were the most damage resistant.

Jackson, Wade C.↗

Assessing tension metrics with dark energy survey and Planck data

ABSTRACT Quantifying tensions – inconsistencies amongst measurements of cosmological parameters by different experiments – has emerged as a crucial part of modern cosmological data analysis. Statistically significant tensions between two experiments or cosmological probes may indicate new physics extending beyond the standard cosmological model and need to be promptly identified. We apply several tension estimators proposed in the literature to the dark energy survey (DES) large-scale structure measurement and Planck cosmic microwave background data. We first evaluate the responsiveness of these metrics to an input tension artificially introduced between the two, using synthetic DES data. We then apply the metrics to the comparison of Planck and actual DES Year 1 data. We find that the parameter differences, Eigentension, and Suspiciousness metrics all yield similar results on both simulated and real data, while the Bayes ratio is inconsistent with the rest due to its dependence on the prior volume. Using these metrics, we calculate the tension between DES Year 1 3 × 2pt and Planck, finding the surveys to be in ∼2.3σ tension under the ΛCDM paradigm. This suite of metrics provides a toolset for robustly testing tensions in the DES Year 3 data and beyond.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗