Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Hardware-in-the-Loop Test Bed and Test Methodology for Microgrid Controller Evaluation

Increasing penetration levels of distributed energy resources are making the deployment of microgrids more feasible. Controllers that operate such microgrids are key to realizing the objectives of the microgrid owner or operator and there is a need to evaluate microgrid controller performance prior to field deployment. This paper describes a controller hardware-in-the-loop and power hardware-in-the-loop microgrid controller test bed that was designed and constructed to evaluate the capabilities of a microgrid controller for a proposed campus microgrid. This paper also presents a test methodology to evaluate microgrid controller functionality, and it describes how the controller was assessed through the application of different test scenarios. Results from the testing are presented to provide insight into the capabilities of the test bed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Quantitative Power System Resilience Metrics and Evaluation Approach

Power system resilience is an emerging topic and plays an essential role in helping the power industry understand and respond to the increasing threats of extreme weather events. The first step of power system resilience analysis is to introduce metrics to quantify the resilience reasonably. Existing resilience metrics are typically restrained by the limited data for extreme event modeling and fall short in terms of physical interpretation and comparability. This paper develops novel quantitative metrics to evaluate power system resilience in pre- and post-event contexts. The developed metrics illustrate clear physical meanings and can be effectively used to compare resilience across different systems under different extreme events. Moreover, the developed metrics can be applied to both transmission and distribution systems. Simulation on a distribution system is employed to validate the effectiveness of the proposed resilience metrics and resilience evaluation approach.

power system resilience↗
DOE OSTI2022

Performance Evaluation of an Advanced Distributed Energy Resource Management Algorithm

This paper presents performance evaluation of a new distributed energy resource management system (DERMS) algorithm via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of sub-transmission and distribution networks, the DERMS software controller, and 84 power hardware solar photovoltaic (PV) inverters, standard communication protocols, and a capacitor bank controller. The DERMS algorithm is also called, Grid-Optimization of Solar (GO-Solar) platform which includes predictive state estimation (PSE) and online multiple objective optimization (OMOO) to dispatch the legacy devices and distributed energy resources (e.g., PV). The voltage regulation performance is evaluated under three scenarios, volt-var smart inverter (baseline), and DERMS control for 100% and 30% of PV. The results show that controlling 30% of PV systems with the GO-Solar platform may provide the best balance of control performance and implementation cost.

distributed energy resource management system (DER↗
DOE OSTI2023

Advanced Modeling and Simulation Methods for Evaluation of Thermal Neutron Scattering Materials

With the rise of interest in thermal neutron scattering data for advanced reactor, criticality safety, and shielding applications, new experimental data are required for evaluation of new materials or for re-evaluation (or validations) of previously evaluated materials. New experimental data are evaluated in a three-step process: (1) computing the phonon characteristics, (2) computing the dynamic structure factor (DSF) from the data, and (3) using the experimental setup to simulate the experimental data. All three steps have challenges, ranging from the need for a sufficiently general material simulation code—a processing code that can compute the corresponding DSF—to having a detailed layout of the instrument/beamline/facility where the data were measured. Whereas phonon characteristics of materials can be computed using various methods (molecular dynamics, density functional theory, etc.), a high-fidelity computation of the DSF and the simulation of the experiment based on the DSF is vital to the accuracy of the evaluation. The latter two steps can be achieved by using the two corresponding code systems developed by instrument scientists at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory: (1) OCLIMAX, a program that calculates the dynamic structure factor from DFT and MD simulation results, and (2) MCViNE, a Monte Carlo neutron ray-tracing program designed to simulate neutron scattering experiments. Recently, polyethylene and yttrium hydride were measured at the Wide Angular-Range Chopper (ARCS) and SEQUOIA instrument stations of the SNS. These experiments are simulated using the density functional theory code, the Cambridge Serial Total Energy Package (CASTEP), to compute its phonon characteristics (eigenvalues/vectors and PDOS), which is then processed using OCLIMAX to yield the DSF, and finally the data at each instrument station are simulated by the MCViNE for comparison to the measured data for evaluation. For comparison to conventional evaluation methods, the scattering data processed from OCLIMAX are compared against those processed from the LEAPR module of NJOY, and the results from MCViNE simulations are compared against previously used simplified beamline models implemented in the Monte Carlo N-Particle (MCNP) code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Automated Resonance Fitting for Nuclear Data Evaluation

Global and national efforts to deliver high-quality nuclear data to users have a wide-ranging impact, affecting applications in national security, reactor operations, basic science, medicine, and more. Cross section evaluation is a major part of this effort, combining theory and experimentation to produce recommended values and uncertainties for reaction probabilities. Resonance region evaluation is a specialized type of nuclear data evaluation that can require significant manual effort and months of time from expert scientists. In this article, non-convex non-linear optimization methods are combined with concepts of inferential statistics to infer a resonance model from experimental data in an automated manner that is not dependent on prior evaluation(s). This methodology aims to enhance the workflow of a resonance evaluator by minimizing time, effort, and the potential for bias from prior assumptions, while enhancing reproducibility and documentation, thereby addressing well-known challenges in the field.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Bayesian Monte Carlo Evaluation of Imperfect (n, 233 U) Data and Model

Conventional nuclear data evaluation methods using generalized linear least squares make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate to minimize the cost function (even for nonlinear models); the model (e.g., of neutron cross section) and experimental data (including covariance data) are without defect and prior PDFs of parameters and measured data are known perfectly. Neglect of covariance between model parameters and measured data in conventional evaluations contributes to imperfections. These assumptions are inherent to the generalized linear least squares minimization method commonly used for resolved resonance region neutron cross section evaluations but are often not justified due to the presence of non-normal PDFs, nonlinear models (e.g., R-matrix formalism), and inherent imperfections in data and models (e.g., imperfect covariance data). Here, these assumptions are removed in a mathematical framework of Bayes’ theorem, which is implemented using the Metropolis-Hastings Monte Carlo method. Most importantly, new parameters are introduced to parameterize discrepancies between the theoretical model and measured data to quantify judgement about discrepancies or imperfections in a reproducible manner. An evaluation of 233U in the eV region using the ENDF-B/VIII.0 library and transmission data (Guber et al.) is presented, and posterior parameters are compared to those obtained by conventional evaluation methods. This example illustrates the effects of removing the most harmful assumption: that of model-data perfection.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2018

Comparative Performance Evaluation of High-performance Data Transfer Tools

Data transfer in wide-area networks has been long studied in different contexts, from data sharing among data centers to online access to scientific data. Many software tools and platforms have been developed to facilitate easy, reliable, fast, and secure data transfer over wide area networks, such as GridFTP, FDT, bbcp, mdtmFTP, and XDD. However, few studies have shown the full capabilities of existing data transfer tools from the perspective of whether such tools have fully adopted state-of-the-art techniques through meticulous comparative evaluations. In this paper, we evaluate the performance of the four highperformance data transfer tools (GridFTP, FDT, mdtmFTP, and XDD) in various environments. Our evaluation suggests that each tool has strengths and weaknesses. FDT and GridFTP perform consistently in diverse environments. XDD and mdtmFTP show improved performance in limited environments and datasets during our evaluation. Unlike other studies on data transfer tools, we also evaluate the predictability of the tools' performance, an important factor for scheduling different stages of science workflows. Performance predictability also helps in (auto)tuning the configurable parameters of the data transfer tool. We apply statistical learning techniques such as linear/polynomial regression, and k-nearest neighbors (kNN), to assess the performance predictability of each tool using its control parameters. Our results show that we can achieve good prediction performance for GridFTP and mdtmFTP using linear regression and kNN, respectively.

Nadig, Deepak↗
DOE OSTI2025

An Observational Evaluation of RKW Theory over the U.S. Southern Great Plains

The theory of Rotunno et al. (“RKW” theory) addresses the behavior of squall-line cold pools in vertically sheared flows. It predicts that, within a given thermodynamic environment, a balance between baroclinic vorticity generation by the cold pool and low-level environmental vertical wind shear induces an upright updraft along the gust front that maximizes the initiation of new convective cells. Although this theory has been evaluated numerically, its applicability to observed systems remains unclear and is limited by a lack of critical measurements, including high-frequency thermodynamic and wind profiles across the gust front. Herein, observations from the Atmospheric Radiation Measurement Southern Great Plains (ARM-SGP) observatory near Lamont, Oklahoma, are used to evaluate RKW theory for 10 well-observed squall lines over a 11-yr period. For this evaluation, RKW parameters including cold-pool intensity (c), low-level ambient, line-normal vertical shear (ΔV n ), subcloud and cloud-layer updraft tilts, and multiple measures of system intensity are estimated. Furthermore, the c estimates rely on thermodynamic retrievals from the Atmosphere Emitted Radiance Interferometer (AERI), which are uncertain but verify reasonably well against independent observations. As predicted by the theory, for c/ΔV n ≥ 1, c/ΔV n correlates positively with updraft tilt and negatively with system intensity, but these results are not always statistically significant and are also sensitive to the method by which ΔV n is evaluated. Specifically, ΔV n evaluations that extend above the cold-pool top yield greater consistency with RKW predictions. Also, some measures of intensity correlate more strongly with standard moist instability metrics than with RKW parameters.

Cold pools↗
NASA NTRS1986

Configuration evaluation and criteria plan. Volume 2: Evaluation critera plan (preliminary). Space Transportation Main Engine (STME) configuration study

The unbiased selection of the Space Transportation Main Engine (STME) configuration requires that the candidate engines be evaluated against a predetermined set of criteria which must be properly weighted to emphasize critical requirements defined prior to the actual evaluation. The evaluation and selection process involves the following functions: (1) determining if a configuration can satisfy basic STME requirements (yes/no); (2) defining the evaluation criteria; (3) selecting the criteria relative importance or weighting; (4) determining the weighting sensitivities; and (5) establishing a baseline for engine evaluation. The criteria weighting and sensitivities are cost related and are based on mission models and vehicle requirements. The evaluation process is used as a coarse screen to determine the candidate engines for the parametric studies and as a fine screen to determine concept(s) for conceptual design. The criteria used for the coarse and fine screen evaluation process is shown. The coarse screen process involves verifying that the candidate engines can meet the yes/no screening requirements and a semi-subjective quantitative evaluation. The fine screen engines have to meet all of the yes/no screening gates and are then subjected to a detailed evaluation or assessment using the quantitative cost evaluation processes. The option exists for re-cycling a concept through the quantitative portion of the screening and allows for some degree of optimization. The basic vehicle is a two stage LOX/HC, LOX/LH2 parallel burn vehicle capable of placing 150,000 lbs in low Earth orbit (LEO).

Bair, E. K.↗
DOE OSTI2024

Resolved resonance region evaluations of n+ 206,207,208 Pb for fast spectrum applications

Resolved resonance region evaluations of the major isotopes of natural lead, 206 Pb, 207 Pb, 208 Pb, have been per formed to support the development of Generation IV reactors. In this study, validation of nuclear data for lead fast reactors was performed with simulations of shielding benchmarks, integral critical benchmarks, and quasi-differential scattering measurements. Sensitivity analyses of these systems showed that elastic scattering reactions above 100 keV were the dominant reactions driving system performance. The resolved resonance regions (RRRs) of the lead isotopes extend past 100 keV, making the RRR an ideal starting point to evaluate lead cross sections. Since the R-matrix requires knowledge of bound, distant, and observed resonances, it was necessary to evaluate from 10 -5 eV up to the respective limit of the RRR. The 208 Pb RRR evaluation was extended to 1.5 MeV in order to obtain resonance parameters used to calculate new elastic scattering angular distributions up to 1.5 MeV. Resonance parameter uncertainties and covariance were generated using the R-matrix code SAMMY. The new RRR parameters show a direct improvement to the scattering kernel below 1.5 MeV which in turn greatly improves fast critical experiments over ENDF/B-VIII.0.

206Pb↗
DOE OSTI2025

Field Evaluation of the High Efficiency Dehumidification System (HEDS) at the Timken Museum of Art - Measurement and Verification (M&V) Results from Summer, Winter and Spring Evaluation Periods

The High Efficiency Dehumidification System (HEDS) technology from Conservant Systems Inc., installed at the Timken Museum of Art in San Diego, California, was evaluated to determine its performance relative to appropriate baseline operation. Data was collected for measurement and verification for several weeks during three evaluation periods: Summer (Aug-Sep 2023), Winter (Dec 2023-Feb 2024) and Spring (May-Jun 2024). The evaluation included operating the heating, ventilation and air conditioning (HVAC) system in both constant air volume (CAV) and variable air volume (VAV) modes, with and without the HEDS energy recovery and HVAC system optimization technology enabled. The electricity consumption of the chiller and the gas-supplied reheat energy were measured to characterize savings achieved by the HEDS operation. Based on these measurements, the HEDS was responsible for chiller electrical load savings during the summer evaluation period of 39% and 42% for the CAV and VAV operating modes, respectively; 97% and 100% chiller electrical load reductions were observed during the winter evaluation for the CAV and VAV operating modes, respectively; and the corresponding reductions during the spring evaluation were 42% and 52% for CAV and VAV operation, respectively. The measured reheat energy reductions, which are typically provided by natural gas, due to the HEDS during summer were 64% and 97% in CAV and VAV operating modes, respectively, while the corresponding values were 99% and 78% during the winter evaluation, and 59% and 56% during the spring evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

140,142 Ce Neutron Cross Section Resolved Resonance Region Evaluation

A resolved resonance region evaluation of 140,142 Ce was conducted by Oak Ridge National Laboratory. Requested by the US Nuclear Criticality Safety Program, this evaluation is based on recent high-resolution transmission and capture high-resolution measurements of nat Ce and 142 Ce conducted at JRC-Geel at the Geel Linear Accelerator facility. It is also based on recently measured thermal constants available from the EX FOR database. Starting from the resonance parameters from the ENDF/B-VIII.0 library and following a preliminary R-matrix analysis, an updated set of resonance parameters and corresponding covariance in formation was derived by the fit of these experimental datasets using the Reich–Moore approximation of the R-matrix theory, as implemented in the SAMMY code system. The resolved resonance region upper energy limit for 140 Ce was kept at 200 keV, whereas the 142 Ce resonance region was extended from 13 to 26 keV. This new evaluation was found to be in good agreement not only with several integral quantities of interest to the reactor physics community, but also with the stellar Maxwellian-averaged cross section.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Evaluation of Light-Element Reactions in the Resolved Resonance Region

Light-element reactions at low energies in the resolved resonance region are important for a range of applications in basic and applied sciences including nuclear reactors, nonproliferation, cultural heritage, forensics and environmental control, rare event investigations and nuclear astrophysics. In this paper, we report on an effort to evaluate charged-particle cross sections in the resolved resonance region and produce evaluated nuclear data files for further processing and inclusion in evaluated data libraries. We discuss the open issues in R-matrix calculations as we extend to higher energies, such as dealing with the rapidly growing number of open channels and merging with the regime of smooth cross sections described by the statistical model, and present attempts to address these issues in neutron-induced reactions relevant to nuclear reactor applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Towards Off-policy Evaluation as a Prerequisite for Real-world Reinforcement Learning in Building Control

We present an initial study of off-policy evaluation (OPE), a problem prerequisite to real-world reinforcement learning (RL), in the context of building control. OPE is the problem of estimating a policy's performance without running it on the actual system, using historical data from the existing controller. It enables the control engineers to ensure a new, pretrained policy satisfies the performance requirements and safety constraints of a real-world system, prior to interacting with it. While many methods have been developed for OPE, no study has evaluated which ones are suitable for building operational data, which are generated by deterministic policies and have limited coverage of the state-action space. After reviewing existing works and their assumptions, we adopted the approximate model (AM) method. Furthermore, we used bootstrapping to quantify uncertainty and correct for bias. In a simulation study, we evaluated the proposed approach on 10 policies pretrained with imitation learning. On average, the AM method estimated the energy and comfort costs with 1.84% and 14.1% error, respectively.

Chen, B↗
NASA NTRS1975

Evaluation program for secondary spacecraft cells: Initial evaluation tests of Eagle-Picher Industries, Incorporated 6.0 ampere-hour, nickel-cadmium spacecraft cells for separator material evaluation

Several groups of nickel cadmium cells were tested for the durability of their separator materials. The cells were rated at 6.0 ampere-hours, and contained double ceramic seals. Two cells in each group were fitted with pressure gauge assemblies. Results are presented for various brands of separator materials.

Harkness, J. D.↗
DOE OSTI2019

Aftertreatment protocols for catalyst characterization and performance evaluation: low-temperature oxidation, storage, three-way, and NH3-SCR catalyst test protocols

A set of standardized and realistic aftertreatment catalyst test protocols have been developed by the Advanced Combustion and Emission Control Technical Team in support of the U.S.DRIVE Partnership. The protocols are intended to accelerate the pace of aftertreatment catalyst innovation by enabling the accurate evaluation and comparison of aftertreatment catalyst performance data from various testing and research facilities to maximize the impact of discovery-phase research occurring across the nation. The protocols address a need identified by the Partnership’s industry partners for consistent and accurate metrics for aftertreatment catalyst evaluation and comparison. The protocols consist of a set of standardized requirements and test procedures that sufficiently capture the performance capability of a catalyst technology in a manner that is adaptable in various laboratories. The protocols provide a detailed description of the necessary reactor system, the steps for achieving a desired aged state of the catalyst, all necessary sample pretreatment to be performed prior to testing, and realistic test conditions for evaluating performance. This article details four low-temperature catalyst test protocols applicable to (1) oxidation catalysts, (2) passive storage (and release) catalysts, (3) three-way catalysts, and (4) NH3-SCR catalysts. The catalyst test protocol descriptions are presented in five (5) sections: protocol general guidelines and the four individual catalyst test protocol descriptions. The general guidelines plus the individual protocol description forms the complete low-temperature catalyst test protocol for the application.

Emission control, Three-way catalyst, oxidation, S↗