SEARCH · Search NASA

Results for “quantitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2024

MOSAiC-Colorado State University Ice Spectrometer

This data set contains atmospheric ice nucleating particle (INP) measurements, using Colorado State University’s (CSU) Ice Spectrometer (IS), of filter collections taken at the U.S. DOE ARM AMF2 site onboard the R/V Polarstern P-deck during the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) field campaign. Samples were collected from October 27, 2019 to September 24, 2020. A filter sampler was mounted approximately 15 m above ground level on a railing in proximity to (and approximately 3 m below) the Aerosol Observation System (AOS) inlet. Single-use filter units open to the atmosphere were pre-cleaned and pre-loaded with 47-mm diameter Nuclepore polycarbonate (0.2 µm pore-diameter) filters. Filters were typically drawn for a three-day period, with an average volume of air filtered of 87,000 standard liters. Total volumes were calculated through recorded daily flow rates using a mass flow meter (TSI). After collection, filters were stored and transported frozen until analysis using CSU’s IS instrument (McCluskey et al., 2018). Aerosol particles were first re-suspended in 8 mL of 0.1 µm-filtered deionized (DI) water. Aliquots of each suspension, and corresponding 11-fold dilutions, were dispensed into polymerase chain reaction (PCR) trays and placed into the aluminum blocks of the IS. Samples were cooled at approximately 0.33 °C min -1 and freezing detected optically with corresponding temperatures recorded. Cumulative INP concentrations were determined through calculating the number of INPs per mL of suspension (Vali, 1971) and converting to concentration per standard L of air by accounting for the proportion of liquid used and volume of air collected. All samples were corrected for the number of INPs on the average of four field blanks (cleaned, handled, transported, and analyzed in the same way without air flow). Two-tailed, 95% confidence intervals for binomial sampling are provided (Agresti and Coull, 1998). Select samples were also heat treated (95 °C for 20 min) to denature and deactivate biological INPs present and digested in 10% H 2 O 2 at 95 °C under UV-B for 20 min to remove any organic carbon INPs. Agresti, A, and BA Coull. 1998. "Approximate is better than “exact” for interval estimation of binomial proportions." American Statistics 52: 119–126. https://doi.org/10.2307/2685469 McCluskey, CS, J Ovadnevaite, M Rinaldi, J Atkinson, F Belosi, D Ceburnis, … and PJ DeMott. 2018. "Marine and Terrestrial Organic Ice-Nucleating Particles in Pristine Marine to Continentally Influenced Northeast Atlantic Air Masses." Journal of Geophysical Research: Atmospheres 123 (11): 6196–6212, https://doi.org/10.1029/2017JD028033 Vali, G. 1971. "Quantitative Evaluation of Experimental Results and the Heterogeneous Freezing Nucleation of Supercooled Liquids." Journal of the Atmospheric Sciences 28: 402-209. https://doi.org/10.1175/1520-0469(1971)028<0402:QEOERA>2.0.CO;2

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Towards Semantic Search in Building Sensor Data

This paper presents a search engine system for sensor time series data and metadata in the context of building management. It takes natural language queries as input, retrieves sensor time series data, ranks them with respect to their relevance to a given query, and visualizes the time series as search results. In addition, the system allows users to interact with the search results: they can define events of interest in the visualized results and search across sensor data for similar events, i.e., the search by example scheme. Quantitative evaluations and user studies demonstrate the value of this system for managing building sensor data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2021

Offline Arterial Signal Timing Optimization based on Virtual Phase Link Model - A Real-world Case Study

Conventional signal timing for arterial usually takes bottom-up approaches. Engineers optimize each individual intersection first and then coordinate them by adjusting the offsets. This work is based on the Virtual Phase-Link (VPL) model, a street traffic model designed for online traffic model predictive control, to obtain a top-down offline arterial signal timing. We Studied the Shallowford Rd. in Chattanooga, TN and found that the inconsistency in intersection capacities along the arterial could lead to some intersections becoming bottlenecks. Signal timing is a significant factor that affect the intersection capacities. We realized that the VPL-based model can guarantee the consistency in intersections along an arterial. We therefore adopted the VPL-based model and developed an offline signal timing optimization approach. The proposed timing derived from the VPL-based offline signal timing optimization showed very good results in simulation. The Chattanooga Department of Transportation adopted the optimized timing obtained from the proposed approach and gave positive feedbacks to the research team. We also collected field experiment data, which demonstrated overall energy reductions and speed improvements on some sections of the Shallowford Rd. arterial. We will continue the experiment when the COVID-19 pandemic impact subsides to have a more robust quantitative evaluation.

Wang, Qichao↗

DOE OSTI2024

Electromagnetic shower separation in LArTPCs: study of the calorimetric method at LArIAT

This thesis reports a study of the prospects of using calorimetry for separating photon- from electron-initiated electromagnetic (EM) showers in liquid argon time projection chambers (LArTPCs), a prevalent need for neutrino oscillation experiments based on the LArTPC technology as $\gamma$-initiated showers are a significant background to electron neutrino ($\nu_e$) events, whose signature is electron showers. From events simulated in the LArIAT (Liquid Argon In A Testbeam) experiment's detector, we quantitatively evaluated the dependence of the calorimetric separation on the initial momentum and position (along the beamline) of the primary particle. We could conclude that the separation is more efficient if the primary particle is created inside the chamber, whereas the impact of the momentum is not as significant. Furthermore, a first step was taken towards applying the calorimetric method to the showers measured in LArIAT. A convolutional neural network (CNN) trained on simulation was deployed to find EM showers among the events collected by the experiment. The charge deposition at the beginning of the showers found is centered at a plausible value, although the width of the distribution demands further inquiry.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

In situ Detection of Plasma Induced Surface Interaction based on Deep Learning based Visual Diagnostics (Technical Report)

It is characteristic for many plasma devices to undergo plasma-material interaction leading to surface erosion. These processes, often not easily detectable, lead to changes in device performance and lifespan. State-of-the-art lifetime tests and wear experiments require over 1000s hours. A self-consistent model for accurately predicting the erosion's effects is not available. In situ detection of these processes is not a trivial task since the surface variations at the early stages have a micron scale. Such limitations not only restrict testing and prediction capabilities but also slow the development of new thrusters and limit mission duration. To address these challenges, an in-situ diagnostic for real-time erosion assessment has been developed, aiming to expedite lifetime testing and broaden experimental campaigns. Several works were dedicated to real-time and in situ monitoring of material erosion during plasma exposure using laser holography, microscopy, and with telemicroscopes. However, the applicability of these approaches is limited due to complexity, cost and less flexibility as they often require placing diagnostic equipment inside the vacuum chamber. In collaboration with Princeton Collaborative Research Facility (PCRF), Princeton Plasma Physics Laboratory (PPPL), a new diagnostic approach is developed, where geometry modifications to the ceramic channel walls were introduced that would result in accelerated channel erosion. We employed Long-distance microscope (LDM) imagery, combined with Deep-Learning based Shape from focus or depth from focus (DFF or SFF) approach, that provides an accessible and cost-effective solution. LDM employs focus variation techniques to continuously capture multiple images of the target object at distinct focal planes. DFF, an optical focus variation method, generates a 3D topographical surface depth map from a sequence of variably focused images. Combined with the developed diagnostic, this approach offers a controllable means to study erosion under accelerated conditions. In this work, we develop Neural Network-based DFF algorithm applicable for LDM data to quantitatively evaluate plasma induced surface modification from LDM data. Next, we develop Deep Learning-based super-resolution depth map image reconstruction technique to increase the resolution of depth maps obtained from DFF algorithm to improve the accuracy of erosion measurements. Thirdly, we develop several image processing techniques to remove noise and improve the quality of depth map image. Here we report the results of initial tests for this approach. An experimental setup designed and built in PPPL was employed that consists of a 3-cm gridded ion source that produces a neutralized argon beam with energies up to 600 eV. A hexagonal boron nitride (h-BN) ceramic target, designed based on computational predictions, was used. Tests were conducted to reconstruct the complex geometry of the target under the lighting conditions of the operated ion source.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Quantitative metrics for evaluating thermonuclear design codes and physics models applied to the National Ignition Campaign

In this study, physics models and design codes for hot dense plasmas undergoing thermonuclear burn are evaluated objectively using statistical metrics that compare the difference between calculations and data relative to the experimental uncertainties. The analysis is applied to the National Ignition Campaign (NIC) because it is relevant, comprehensive, and well documented. The statistics confirm that a key process afflicting NIC performance is mix driven by hydrodynamic instabilities as approximated here using the KL model [G. Dimonte and R. Tipton, Phys. Fluids 18, 085101 (2006)]. New physics models are also presented for instability-driven magnetic fields [B. Srinivasan et al., Phys. Rev. Lett. 108, 165002 (2012)] and the Coulomb logarithm for electron–ion thermal relaxation [G. Dimonte and J. Daligault, Phys. Rev. Lett. 101, 135001 (2008)]. The plasma-generated magnetic fields improve the agreement between code and data in a statistically significant manner by reducing the electron thermal conduction in the hot-spot via the Hall term. The Coulomb logarithm is presented in a numerically practical form that incorporates recent theoretical advances. However, it does not improve the agreement between the code and data because the thermal relaxation is so fast in non-ignited NIC plasmas that the typical 20% error does not change the tight coupling between electrons and ions. Even with these improved physics models, the one-dimensional simulations presented here are not able to describe the high-convergence NIC implosions in a statistically acceptable manner. Of the heroic multi-dimensional simulations of Clark et al. [Phys. Plasmas 23, 056302 (2016)], only those in three-dimensions satisfy the statistical acceptance criterion.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Quantitative Method for Evaluating Parameter Distribution Changes on Waste Isolation Pilot Plant Performance Assessment-25209

Explore the source record for details and available documents.

Weiksnar, Kate Diane↗

DOE OSTI2023

Evaluating a Semi-Quantitative, Spectrophotometric Method for the Rapid Determination of Total Rare Earth Element Concentrations in Citrate Leaching Solutions

Quick, reliable methods to measure the rare earth elements (REEs) in process streams are needed to support real-time parameterization and monitoring for a burgeoning number of REE extraction schemes. Such methods would ideally be fast, reproducible, and field-deployable. This study evaluates the feasibility of using a chromogenic indicator, arsenazo(III) (hereafter abbreviated as Arsz(III)) to detect the concentration of REEs in complex citrate leaching solutions using a spectrophotometer. Arsz(III) forms a chromogenic complex with the lanthanide elements that produces a blue/purple color detectable in the visible light range. Matrices of solutions containing varied concentrations of calcium, iron, and lanthanum were scanned in the presence of an Arsz(III) indicator to generate a modeled relationship that could be used to back calculate REE concentrations. While relatively quick (scan times on the order of seconds), the results indicated that the calcium and iron concentrations of typical mining solutions overwhelm the signal of the REEs, to the extent that sensitivity of the method is no less than 50 µM REEs. These results demonstrate the difficulties of accurately measuring trace metals in complex solutions, although the method may still hold utility for processes with significantly lower calcium and iron concentrations or REE concentrations much greater than 50 µM.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Quantitative XPS of plutonium: Evaluation of the Pu4f peak shape, relative sensitivity factors and estimated detection limits

We report that high-resolution X-ray photoelectron spectra have been acquired from sputter cleaned and in situ oxidized samples of α-plutonium and a face-centred cubic δ-plutonium–gallium alloy. The differences in the Pu4f peak shape in these two materials have been investigated, and the poorly screened satellite peaks have been quantified. Curve fitting parameters for the Pu4p 3/2 , Pu4d 5/2 , Pu4f and Pu6p 3/2 photoelectron peaks are reported, and relative sensitivity factors have been determined. The Pu4f curve fit model has been applied to data acquired using different spectrometers and alloys. Examples of quantification of the plutonium spectra are provided and minimum detection limits are calculated for common impurities in plutonium metal.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗

DOE OSTI2025

Online collection of LC effluent as droplets for automatic injection into ICP-MS

A sample introduction technique was developed to allow for online, dropwise injection of effluent into a mass spectrometer (MS). This allowed for the coupling of chromatography systems that were not driven by pumps without altering the set-up or separation performance. This capability combined the benefits of coupling separation and measurement while also enabling accurate chromatographic evaluation that would generally be performed offline. The incorporation of a flowing rinse into the system made dropwise resolution possible for any liquid capable of forming drops under ambient conditions. The technique was demonstrated utilizing gas pressurized extraction chromatography (GPEC) and inductively coupled plasma-time-of-flight mass spectrometry (ICP-TOFMS) to illustrate the qualitative applications for rapid separation development and procedure evaluation. This method's quantitative applications were evaluated using single and double isotope dilution mass spectrometry (IDMS) with an external mass bias correction to measure analytes across entire elutions including volumes as small as single drops. In conclusion, the total neodymium values afforded by both single and double IDMS were within the uncertainty of the calculated value for evaluation of full elution peaks and for most of the single drops analyzed that reached above 10k cps Nd-144.

GPEC↗

DOE OSTI2022

Quantitative Metrics for Grid Resilience Evaluation and Optimization

Power system resilience has become a critical topic in recent years because of the increasing trend of extreme events and the growing integration of intermittent renewable energy sources. To enhance grid resilience against high-impact, low-frequency events, two questions should be answered: how to quantify the resilience of a given grid and how to incorporate the quantification into power system planning, operation, and restoration. Here this paper develops a new set of quantitative metrics with clear physical interpretation to comprehensively evaluate power system resilience. Using microgrids as an example, an event-based corrective scheduling (ECS) model and an online model predictive control (OMPC) model are developed to integrate the proposed quantitative resilience metrics into power system optimization models for resilience enhancement. The ECS model employs extreme event data to investigate the optimal restoration solution and to help microgrid operators prepare to respond to similar events. The OMPC model provides online decision-making support for operators to handle ongoing outages in the most resilient fashion. The effectiveness and superiority of the proposed quantitative resilience metrics and the resilience enhancement models are demonstrated through simulations and comparative studies on an IEEE test feeder and a real distribution feeder in Southern California.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Benchmarking machine learning strategies for phase-field problems

Abstract We present a comprehensive benchmarking framework for evaluating machine-learning approaches applied to phase-field problems. This framework focuses on four key analysis areas crucial for assessing the performance of such approaches in a systematic and structured way. Firstly, interpolation tasks are examined to identify trends in prediction accuracy and accumulation of error over simulation time. Secondly, extrapolation tasks are also evaluated according to the same metrics. Thirdly, the relationship between model performance and data requirements is investigated to understand the impact on predictions and robustness of these approaches. Finally, systematic errors are analyzed to identify specific events or inadvertent rare events triggering high errors. Quantitative metrics evaluating the local and global description of the microstructure evolution, along with other scalar metrics representative of phase-field problems, are used across these four analysis areas. This benchmarking framework provides a path to evaluate the effectiveness and limitations of machine-learning strategies applied to phase-field problems, ultimately facilitating their practical application.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Quantitative Power System Resilience Metrics and Evaluation Approach: Preprint

Power system resilience is an emerging topic and plays an essential role in helping power industry understand and respond to the increasing threats of extreme weather events. The first step of power system resilience analysis is to introduce metrics to quantify the resilience reasonably. Existing resilience metrics are typically restrained by the limited data for extreme event modeling and fall short in terms of physical interpretation and comparability. This paper develops novel quantitative metrics to evaluate power system resilience in pre- and post-event contexts. The developed metrics illustrate clear physical meanings and can be effectively used to compare resilience across different systems under different extreme events. Moreover, the developed metrics can be applied to both transmission and distribution systems. Simulation on a distribution system is employed to validate the effectiveness of the proposed resilience metrics and resilience evaluation approach.

power system resilience↗

DOE OSTI2024

Harvest Initiated Volatile Organic Compound Emissions from In-Field Tall Wheatgrass

While crop and grassland usage continues to increase, the full diversity of plant-specific volatile organic compounds (VOCs) emitted from these ecosystems, including their implications for atmospheric chemistry and carbon cycling, remains poorly understood. It is particularly important to investigate VOCs in the context of potential biofuels: aside from the implications of largescale land use, harvest may shift both the flux and speciation of emitted VOCs. To this point, we evaluate the diversity of VOCs emitted both pre and postharvest from “Alkar” tall wheatgrass (Thinopyrum ponticum), a candidate biofuel that exhibits greater tolerance to frost and saline land compared to other grass varieties. Mature plants grown under field conditions (n = 6) were sampled for VOCs both pre- and postharvest (October 2022). Via hierarchical clustering of emitted VOCs from each plant, we observe distinct “volatilomes” (diversity of VOCs) specific to the pre- and postharvest conditions despite plant-to-plant variability. In total, 50 VOCs were found to be unique to the postharvest tall wheatgrass volatilome, and these unique VOCs constituted a significant portion (26%) of total postharvest signal. While green leaf volatiles (GLVs) dominate the speciation of postharvest emissions (e.g., 54% of unique postharvest VOC signal was due to 1-penten-3-ol), we demonstrate novel postharvest VOCs from tall wheatgrass that are under characterized in the context of carbon cycling and atmospheric chemistry (e.g., 3-octanone). Continuing evaluations will quantitatively investigate tall wheatgrass VOC fluxes, better informing the feasibility and environmental impact of tall wheatgrass as a biofuel.

09 BIOMASS FUELS↗

DOE OSTI2023

The reactive flow evolution of the polymer-bonded explosive PBX 9502: Experiments and model validation in extreme pressure regimes

The shock-to-detonation transition properties of the triaminotrinitrobenzene based PBX 9502 high explosive (HE) are experimentally and computationally explored in extremely high input pressure conditions. These include both slightly sub-Chapman–Jouguet and overdriven input pressure conditions, namely, ∼25 and ∼31 GPa, respectively. Our experiments capture the transient buildup of a shock-induced reaction via measurement of HE and polymethyl methacrylate window interface particle velocity profiles for a variety of sample thicknesses for this insensitive HE. These observations necessitate extremely thin explosive samples, and the high rates of reaction provide a considerable challenge to optical diagnostics. Samples at these thicknesses also provide an opportunity for evaluation of potential micro-structure effects on the resulting shock-to-detonation-transition measurements. To address this, the thin samples are also characterized via x-ray micro-computed tomography. Finally, a pair of previously established continuum-level detonation performance modeling approaches for PBX 9502 were used to analyze the experiments. The employed model variants crucially differ in their definition of each model’s empirical reaction rate functional form, utilization of shock state quantities, and local flow variable dependencies. As a result, the present experiments provide a novel platform to evaluate the quantitative and qualitative consequences stemming from these modeling choices in a challenging initiation scenario, largely beyond the chosen calibration range of either model. This new experimental information will provide a platform for both improved physics and model parameterizations for this well-studied explosive.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Integrating Transactive Energy into Reliability Evaluation for a Self-healing Distribution System with Microgrid

Non-utility owned distributed energy resources (DERs) are mostly untapped currently, but they can provide many grid services such as voltage regulation and service restoration, if properly controlled, and can improve the distribution systems reliability when coordinated with utility-owned assets such as self-healing control and microgrids. This paper integrates transactive energy control into the distribution system reliability evaluation to quantitatively assess the impact of non-utility owned DERs on reliability improvement. Here, a transactive reactive power control strategy is designed to incentivize the DERs to provide reactive power support for improving voltage profiles thus enabling additional customer load restoration during an outage. Also, an operational sequence to coordinate the non-utility owned DERs with the utility owned self-healing control and utility owned microgrids is designed and integrated into the service restoration process with the operational constraints guaranteed by checking the three-phase unbalanced power flow for post-fault network reconfiguration. The reliability indices are then calculated through a Monte Carlo simulation. The transactive reactive power control strategy is tested on a four-feeder distribution system operated by Duke Energy in the U.S. Results demonstrate that the non-utility owned DERs with the transactive control improve the reliability of both the system and critical loads by more than 30%.

24 POWER TRANSMISSION AND DISTRIBUTION↗