Search NASA⌕ Search

SEARCH · Search NASA

Results for “scoring system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Learning From User Behavior: A Survey-Assist Algorithm for Longitudinal Mobility Data Collection

GPS-based travel surveys are widely used in mobility studies to gather crucial qualitative data, like purpose, transportation mode and replaced mode. However, survey response still poses a burden to users, especially in long-term mobility studies, leading to response fatigue. We explore a survey-assist strategy to ease this burden by a novel, user-level modeling approach that leverages past responses from each user to predict responses for new trips, without relying on external data sources like GIS data. We investigate three main algorithms for predicting responses: (i) clustering trips and extrapolating responses for similar trips, (ii) using random forest classification, and (iii) clustering that uses a hybrid algorithm to determine spatial structure, which is then fed as input to a classic random forest classifier. The clustering approach can flexibly predict responses for even complex qualitative survey questions; it achieved F-scores of 65%. The random forest pipeline uses architecture that restricts it to predicting three predetermined survey questions: trip purpose, mode, and replaced mode. However, it achieved F-scores of 78%. While the survey-assist approach has been implemented by several proprietary systems, to our knowledge, this is the first exploration in the academic literature. It follows that this is also the first rigorous evaluation of multiple algorithms that can implement the approach. The evaluation uses a large scale, publicly available, longitudinal dataset consisting of ~ 92k trips from 235 users over a period of roughly one and a half years. With this approach, travel surveys can be pre-filled with the predicted responses for each trip, thus streamlining the survey process for users. Combined with an active learning system that requests user input on low-confidence predictions, models can be updated and improved over time to better support the long-term collection of longitudinal qualitative data.

clustering↗
DOE OSTI2023

Spoofing Cross-Entropy Measure in Boson Sampling

Cross-entropy (XE) measure is a widely used benchmark to demonstrate quantum computational advantage from sampling problems, such as random circuit sampling using superconducting qubits and boson sampling (BS). We present a heuristic classical algorithm that attains a better XE than the current BS experiments in a verifiable regime and is likely to attain a better XE score than the near-future BS experiments in a reasonable running time. The key idea behind the algorithm is that there exist distributions that correlate with the ideal BS probability distribution and that can be efficiently computed. The correlation and the computability of the distribution enable us to postselect heavy outcomes of the ideal probability distribution without computing the ideal probability, which essentially leads to a large XE. Our method scores a better XE than the recent Gaussian BS experiments when implemented at intermediate, verifiable system sizes. Much like current state-of-the-art experiments, we cannot verify that our spoofer works for quantum-advantage-size systems. However, we demonstrate that our approach works for much larger system sizes in fermion sampling, where we can efficiently compute output probabilities. Finally, we provide analytic evidence that the classical algorithm is likely to spoof noisy BS efficiently.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

An Integrated Paradigm for the Management of Delivery Risk in Electricity Markets: From Batteries to Insurance and Beyond

This presentation discusses the objectives to quantify flexibility from distributed energy resources (DERs) through DER risk scores, increase the number of hedging options for resources with uncertain output by tapping system-wide resources through a system-wide flexibility auction, and create transparent flexibility prices ahead of time, alleviating the need for forecasting of balancing prices.

27 ARPA - Advanced Research Projects Agency-Energy↗
DOE OSTI2021

Performance Comparison of Clipping Detection Techniques in AC Power Time Series

In this research, a variety of methods were developed to detect clipping periods in AC power time series. AC power data streams associated with 36 unique systems across the United States were collected, and data points representing clipping periods were manually labeled by experts. Using this data set for training and validation, novel logic-based and machine learning (ML) approaches were developed to classify time series values as clipping or non-clipping. These approaches were compared to the RdTools method for detecting clipping periods. The logic-based and ML XGBoost approaches achieved F-scores of 85.0 and 77.6, respectively, when cross-validated against the manually labeled data, as compared to the current RdTools approach (F-score of 56.4), indicating a significant improvement at detecting clipping periods. Additionally, the effects of each clipping filter when evaluating system degradation rates were assessed, using 31 unique systems across the United States. Results indicate that estimated system degradation rate can vary based on the type of clipping filter used, by up to 0.6% degradation rate for some cases.

clipping↗
DOE OSTI2020

MEP: Mobility Energy Productivity Metric

In response to the need to assess fundamental improvements in mobility as technology provides new modes, methods, and opportunities in urban areas to connect people with goods, services, and employment, a mobility-energy productivity score (MEPS) has been developed. The MEPS fundamentally measures the potential of a multi-modal system to connect a person to a variety of services and activities that define a high-quality of life. The MEPS is measured relative to the convenience and energy needed to provide connectivity. Fundamentally derived from accessibility theory, the MEPS advances practice by using readily available travel time data (either from web-based APIs or outputs from an urban transportation model) combined with established parameters that reflect the energy intensity of various travel modes, and relative frequency of activity engagement. The construction of the MEPS allows for aggregation and disaggregation to the appropriate spatial, modal, and trip purpose resolution, as analysis needs dictate. The MEPS could be used to compare alternative futures related to technology, infrastructure investment, or policy, providing a much needed tool for planners, researchers, and analysts. In other words, the metric measures how efficiently connected a place is.

Hou, Yi↗
DOE OSTI2020

Probabilistic Solar Power Forecasting Using Bayesian Model Averaging

There is rising interest in probabilistic forecasting to mitigate risks from solar power uncertainty, but the numerical weather prediction (NWP) ensembles readily available to system operators are often biased and underdispersed. We propose a Bayesian model averaging (BMA) post-processing method suitable for forecasting power from utility-scale photovoltaic (PV) plants at multiple time horizons up to at least the day-ahead timescale. BMA is a kernel dressing technique for NWP ensembles in which the forecast is a weighted sum of member-specific probability density functions. We tailor BMA for utility-scale PV forecasting by modeling power clipping at the AC inverter rating and advance the theory of BMA with a new beta kernel parameterization that accommodates theoretical constraints not previously addressed. BMA is demonstrated for a case study of 11 utility-scale PV plants in Texas, forecasting at hourly resolution for the complete year 2018. BMA's mixture-model approach mitigates underdispersion of the raw ensemble to significantly improve forecast calibration, while consistently outperforming an ensemble model output statistics (EMOS) parametric approach from the literature. At 4-hour lead time, the BMA post-processing achieves continuous ranked probability skill scores of 2--36% over the raw ensemble, with consistent performance at multiple lead times suitable for power system operations.

14 SOLAR ENERGY↗
DOE OSTI2021

Remote Home Energy Score Assessments (Feasibility Study)

The delivery of Home Energy Scores (HES) has been significantly impacted over the last year by the recent pandemic and ongoing limitations to person-to-person interactions. There are also historic challenges in providing HES to more remote geographies where assessor infrastructure is not in place. Alternative approaches to in-person, on-site home energy assessments could help address these current restrictions, while also potentially providing opportunities for the efficient delivery of HES in certain use cases after COVID-related restrictions are lifted. From the program administrator’s perspective, there needs to be confidence that the remote scores closely match what they would have been if the assessment had been performed on-site. The recommendations shown on a report generated from a remote score should closely match those of an onsite assessment. A remote assessment should be an option for all HES Partners and have direction on how to deliver those scores. From the HES partner’s and assessor’s perspective, there needs to be understanding of what level of experience is needed, what system infrastructure is required, the time expenditure of the remote assessment process, and the limitations of a remote assessment. From the homeowner’s perspective, there needs to be an awareness and comfort with the time commitment, the level of knowledge of the home, the equipment needed, and any physical requirements of the remote assessment process. During this study, Earth Advantage assessed methods for delivering Home Energy Score assessments remotely through web-based technology platforms and resident interaction in a diverse array of home types in different geographic locations. Earth Advantage developed remote assessment test protocols and integrated those testing protocols into existing Home Energy Score programs being overseen by USDOE Home Energy Score partners New York State Energy Research & Development Authority (NYSERDA), the Oregon Department of Energy (ODOE), and the City of Portland (PDX). Earth Advantage staff acted as the Remote assessor and gathered HES data remotely during the video sessions with participants. Authorized Home Energy Score assessors performed the onsite assessments that were then used to compare with the remote assessment data. This allowed the research to effectively test the efficacy of various remote assessment approaches in a diverse array of home-types. Earth advantage identified the key components of a remote assessment infrastructure which included Remote Home Energy Score Assessments Page vi processes, tools, services, methods and mechanisms that would better enable remote assessments. This report details methods, results, and findings of the HES remote assessment research. In addition, the report provides recommendations and best practices that could be used as guidance for the Home Energy Score administrator and the HES partners seeking to effectively conduct remote assessments.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Evaluating the Interplay between Trajectory Segmentation and Mode Inference Error

Travel behavior changes are essential to transportation decarbonization. Travel diaries, consisting of sequences of trips between places, are typically used to instrument human travel behavior. However, these diaries are only as accurate as the underlying methods used to construct them. Travel diary algorithms have been a popular research topic since the advent of Global Positioning System tracking surveys. These algorithms have typically been validated using prompted recall of presegmented trips, thus disregarding the continuity of mode inference. Phone operating systems have adopted battery-conserving techniques, but the resulting data collection errors have not been studied extensively. We introduce a framework to evaluate the accuracy of trip length computations and mode inference by analyzing continuous mode-segmented trajectories for groups of trips. We then use the framework to identify the input data quality and the impact of postprocessing. Our primary inputs to this evaluation are MobilityNet, a public dataset containing information from three artificial timelines covering 15 different travel modes, and sample open-source travel diary creation algorithms from the OpenPATH project. Our framework concretely shows that the variance of the distance error drops from (0.217, 0.0848) to (o.011, 0.0407) (Android, iOS) after postprocessing. Similarly, the weighted F-scores for mode inference increase from (0.25, 0.29) to (0.60, 0.74) (iOS, Android) between random forest and geographic information system-based models. We hope that this standardized method will be adapted to evaluate other, potentially proprietary, travel diary algorithms. Finally, the results can be used to understand and improve the state of the art in the travel diary creation field.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging↗
DOE OSTI2023

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Advancing earth system model calibration: a diffusion-based method

Understanding of climate impact on ecosystems globally requires site-specific model calibration. Here we introduce a novel diffusion-based uncertainty quantification (DBUQ) method for efficient model calibration. DBUQ is a score-based diffusion model that leverages Monte Carlo simulation to estimate the score function and evaluates a simple neural network to quickly generate samples for approximating parameter posterior distributions. DBUQ is stable, efficient, and can effectively calibrate the model given diverse observations, thereby enabling rapid and site-specific model calibration on a global scale. This capability significantly advances Earth system modeling and our understanding of climate impacts on Earth systems. We demonstrate DBUQ's capability in E3SM land model calibration at the Missouri Ozark AmeriFlux forest site. Both synthetic and real-data applications indicate that DBUQ produces accurate parameter posterior distributions similar to those generated by Markov Chain Monte Carlo sampling but with 30X less computing time. This efficiency marks a significant stride in model calibration, paving the way for more effective and timely climate impact analyses.

Liu, Yanfang↗
DOE OSTI2021

Dynamics of genetic code evolution: The emergence of universality

We study the dynamics of genetic code evolution. The model of Vetsigian et al. [Proc. Natl. Acad. Sci. USA 103, 10696 (2006)] and Vetsigian [Collective evolution of biological and physical systems, Ph.D. thesis, 2005] uses the mechanism of horizontal gene transfer to demonstrate convergence of the genetic code to a near universal solution. We reproduce and analyze the algorithm as a dynamical system. All the parameters used in the model are varied to assess their impact on convergence and optimality score. We show that by allowing specific parameters to vary with time, the solution exhibits attractor dynamics. Finally, we study automorphisms of the genetic code arising due to this model. We use this to examine the scaling of the solutions to re-examine universality and find that there is a direct link to mutation rate.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Comprehensive Approach to Measure the Mobility Energy Productivity of Freight Transport

Freight travel accounts for a major share of the energy consumed in the transportation sector in any country, and the United States is no exception. Understanding and modeling freight movement are critical, particularly in the context of capturing the impact of emerging technologies on freight travel and its externalities. The domain of freight modeling and forecasting has been gaining pace in recent years, but advancement in comprehensive freight performance metrics is still lagging. Conventional freight performance metrics such as truck-miles, ton-miles, or value-miles are unidimensional and aggregate in nature, making them unsuitable to accurately capture the impact of emerging transportation trends on the performance or productivity of freight systems. Addressing the research need, this paper presents the “Freight Mobility Energy Productivity” metric to quantify freight productivity of current as well as future freight systems, accounting for various costs associated with freight transport. The proposed metric was implemented using data from the Freight Analysis Framework along with other published sources, and shows intuitive results in quantifying freight productivity. Further, a scenario analysis exercise was conducted to test the capability of the metric in tracking improvements in system-level freight productivity as a result of vehicle electrification. The relative differences in Freight Mobility Energy Productivity scores help identify which zones benefit from the vehicle powertrain technology improvement. The results of the scenario analysis reinforce confidence that the proposed metric can be used as a decision support tool in assessing the productivity of existing as well as future freight trends and technologies.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

A Comprehensive Approach to Measure the Mobility Energy Productivity of Freight Transport: Preprint

Freight travel accounts for a major share of the energy consumed in the transportation sector in any country, and the United States is no exception. Understanding and modeling freight movement are critical, particularly in the context of capturing the impact of emerging technologies on freight travel and its externalities. The domain of freight modeling and forecasting is gaining pace in the recent years, but advancement in comprehensive freight performance metrics is still lagging. Conventional freight performance metrics such as truck-miles, ton-miles, or value-miles are unidimensional and aggregate in nature, making them unsuitable to accurately capture the impact of emerging transportation trends on the performance or productivity of freight systems. Addressing the research need, this paper presents the “Freight Mobility Energy Productivity” metric to quantify freight productivity of current as well as future freight systems, accounting for various costs associated with freight transport. The proposed metric was implemented using data from the Freight Analysis Framework along with other published sources, which shows intuitive results in quantifying freight productivity. Further, a scenario analysis exercise was conducted to test the capability of the metric in tracking improvements in system-level freight productivity as a result of vehicle electrification. The relative differences in Freight Mobility Energy Productivity scores help identify which zones benefit from the vehicle powertrain technology improvement. The results of the scenario analysis reinforce confidence that the proposed metric can be used as a decision support tool in assessing the productivity of existing as well as future freight trends and technologies.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Consequence-driven cyber-informed engineering and related systems and methods

Embodiments of the disclosure relate to a computer-implemented consequence-driven cyber-informed engineering tool for performing and reporting consequence-based prioritization, system-of-systems breakdown, consequence-based targeting, and mitigations and protections. Embodiments of a CCE tool may perform one or more steps of defining a target industrial control system (ICS), wherein the target ICS includes operational goals, critical functions, and critical services; determining one or more scored high consequence events (HCE) associated with the defined target ICS; prioritizing the scored HCEs according to an HCE severity index; and updating a dashboard with one or more representations of the prioritized HCEs, wherein the updated dashboard is associated with the CCE tool and presented at a display.

Assante, Michael↗
DOE OSTI2023

Implementation of AI/DEEP learning disruption predictor into a plasma control system

Abstract This paper reports on advances in the state‐of‐the‐art deep learning disruption prediction models based on the Fusion Recurrent Neural Network (FRNN) originally introduced in a 2019 NATURE publication [ https://doi.org/10.1038/s41586‐019‐1116‐4 ]. In particular, the predictor now features not only the “disruption score,” as an indicator of the probability of an imminent disruption, but also a “sensitivity score” in real time to indicate the underlying reasons for the imminent disruption. This adds valuable physics interpretability for the deep learning model and can provide helpful guidance for control actuators now implemented into a modern plasma control system (PCS). The advance is a significant step forward in moving from modern deep learning disruption prediction to real‐time control and brings novel AI‐enabled capabilities relevant for application to the future burning plasma ITER system. Our analyses use large amounts of data from JET and DIII‐D vetted in the earlier NATURE publication. In addition to “when” a shot is predicted to disrupt, this paper addresses reasons “why” by carrying out sensitivity studies. FRNN is accordingly extended to use more channels of information, including measured DIII‐D signals such as (i) the “n1rms” signal that is correlated with the n = 1 modes with finite frequency, including neoclassical tearing mode and sawtooth dynamics; (ii) the bolometer data indicative of plasma impurity control; and (iii) “q‐min”—the minimum value of the safety factor relevant to the key physics of kink modes. The additional channels and interpretability features expand the ability of the deep learning FRNN software to provide information about disruption subcategories as well as more precise and direct guidance for the actuators in a PCS.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Pushing Green: Leveraging Home Energy Score to Promote Deep-Energy Retrofits in Portland, Oregon

In the United States, 39% of total energy is consumed by the building sector, 20% of which is attributed to residential buildings. Older homes, built before 1992 when the U.S. Department of Energy’s (DOE) Building Energy Codes Program was established, represent approximately 68% of residential building stock in the country and often have significant air leakage, inadequate insulation and inefficient heating & cooling systems. These older homes have long been the elephant in the room: how can programs effectively increase efficiency in all of the homes in need? Developed by DOE, the Home Energy Score was established to provide homeowners, buyers, and renters a comparable score measuring a home's energy use. Much like the MPG rating of automobiles, the Home Energy Score provides an overview of a residential building’s energy efficiency. In 2016, the City of Portland passed an ordinance requiring all residential properties to receive a Home Energy Score before being listed for sale, a mandate that was implemented January 1, 2018. Since 2018, more than 22,000 homes throughout the Portland Metro area have received Home Energy Scores (amounting to over 10% of Portland's single-family homes). This paper explores the sample of Home Energy Scores throughout Portland, including at the neighborhood level, identifies trends in efficiency measures, describes how the data has been used to date and proposes ways program administrators can use the Home Energy Score to increase the impact of energy efficiency programs on a city-scale.

Antonopoulos, Chrissi A.↗
DOE OSTI2021

Physics-Informed Machine Learning Models for Predicting the Progress of Reactive-Mixing

This paper presents a physics-informed machine learning (ML) framework to construct reduced-order models (ROMs) for reactive-transport quantities of interest (QoIs) based on high-fidelity numerical simu-lations. QoIs include species decay, product yield, and degree of mixing. The ROMs for QoIs are applied to quantify and understand how the chemical species evolve over time. First, high-resolution datasets for constructing ROMs are generated by solving anisotropic reaction-di?usion equations using a non-negative finite element formulation for di?erent input parameters. The reactive-mixing model input parameters are: time-scale associated with flipping of velocity, spatial-scale controlling small/large vortex structures of velocity, perturbation parameter of the vortex-based velocity, anisotropic dispersion strength/contrast, and molecular diffusion. Second, random forests, F-test, and mutual information criterion are used to evaluate the importance of model inputs/features with respect to QoIs. We observed that anisotropic dispersion strength/contrast is the most important feature and time-scale associated with flipping of velocity is the least important feature. Third, Support Vector Machines (SVM) and Support Vector Regression (SVR) are used to construct ROMs based on the model inputs. The constructed SVR-ROMs are then used to predict scaling of QoIs. We also present estimates and inequalities on the QoIs, which inform that the species decay, mix, and produce in an exponential fashion. These inequalities also inform that a radial basis function is the most suitable kernel for the SVM/SVR models for QoIs. It is observed that R2-score for SVR-ROMs on unseen data is greater than 0.9, implying that the SVR-ROMs are able to predict the reaction-diffusion system state reasonably well. Finally, in terms of the computational cost, the proposed SVM-ROMs are O(107) times faster than running a high-fidelity finite element simulation for evaluating QoIs. This makes the proposed ML-based ROMs attractive for reactive-transport sensing and real-time monitoring applications as they are significantly faster yet reasonably accurate.

Mudunuru, Maruti K.↗