Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Experimental Evaluation of Advanced Archimedes Hydrodynamic Screw Geometries

There is increasing interest in the application of Archimedes Hydrodynamic Screws (AHS) to generate hydroelectric power. While numerous theoretical and experimental investigations have been published on this application of AHS over the past decade, there have been no experimental evaluations in the literature of blade shapes other than the helicoid. This paper provides the results of bench-scale testing of 3D-printed models to evaluate the performance of various shapes and parameters for AHS.

Straalsund, Jerry L.↗
DOE OSTI2018

Evaluation of regression and neural network models for solar forecasting over different short-term horizons

Forecasting solar irradiation has acquired immense importance in view of the exponential increase in the number of solar pho- tovoltaic (PV) system installations. In this article, analyses results involving statistical and machine-learning techniques to predict solar irradiation for di?erent forecasting horizons are reported. Yearlong typical meteorological year 3 (TMY3) datasets from three cities in the United States with di?erent climatic conditions have been used in this analysis. A simple forecast approach that assumes consecutive days to be identical serves as a baseline model to compare forecasting alternatives. To account for seasonal variability and to capture short-term ?uctuations, di?erent variants of the lagged moving average (LMX) model with cloud cover as the input variable are evaluated. Finally, the proposed LMX model is evaluated against an arti?cial neural network (ANN) model. How the one-hour and 24-hour models can be used in conjunction to predict di?erent short-term rolling horizons is discussed, and this joint application is illustrated for a four-hour rolling horizon forecast scheme. Finally, the e?ect of using predicted cloud cover values, instead of measured ones, on the accuracy of the models is assessed. Results show that LMX models do not degrade in forecast accuracy if models are trained with the forecast cloud cover data.

Inanlouganji, Alireza↗
DOE OSTI2019

An Automated Vehicle Fuel Economy Benefits Evaluation Framework Using Real-World Travel and Traffic Data

Increasing automation is a consistent development trend in the automobile industry. However, real-world evaluation of the operational and energy consumption differences between automated vehicles and comparable manually driven vehicles has been limited. This study helps fill the information gap by comparing the operation and fuel economy of vehicles in adaptive cruise control (ACC) and non-ACC modes based on large-scale field test data collected by Volvo Car Corporation (Volvo Cars) from vehicles traveling on the designated 'Drive Me' project road network in Gothenburg, Sweden. The test vehicles' travel data are classified by driving mode (ACC vs. non-ACC) and driving conditions, which refer to traffic speed and road grade in this study. The results from the data logging fleet are used to estimate the aggregate fuel consumption differences at the Drive Me road-network level for vehicles traveling in ACC vs. non-ACC mode based on appropriately weighting the total amount of travel that took place on the network under different driving conditions. At the ACC penetration levels observed in the field test data, vehicles tended to drive more smoothly in ACC mode than in non-ACC mode. The corresponding travel-weighted fuel consumption rate for vehicles in ACC mode was about 5%-7% lower than for vehicles in non-ACC mode when traveling at similar conditions. Sensitivity analyses impart confidence in this result, and in the future, the established evaluation framework could be used to objectively quantify potential on-road fuel consumption impacts from vehicles with even higher levels of automated driving capability.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

A Multi-Site Networked Hardware-in-Loop Platform for Evaluation of Interoperability and Distributed Intelligence at Grid-Edge

Electric power systems have experienced large increases in the number of intelligent, connected and controllable devices being deployed, leading to a high degree of distributed intelligence at the grid-edge. These devices, both utility-owned and consumer-owned, include but are not limited to: renewable generation sources, energy storage, remote switches, voltage regulators, and smart controllable loads such as electric vehicles. These new devices provide significant potential for increased operational flexibility that can be leveraged to achieve system reconfiguration, resiliency improvements, power quality improvements, and distribution system automation. However, there are two significant challenges that must be addressed before these assets can be leveraged for operations: interoperability and system level validation prior to deployment. Because of the complexity of distributed control systems, and their interactions with legacy centralized controls, a purely simulations-based approach for pre-deployment validation is not sufficient. It requires hardware-in-loop testing to emulate the operational hardware devices and evaluate their performance. Additionally, securely integrating multiple test facilities at utility operators and vendors might enable rapid scale-up of evaluation platforms, and remove the need for multiple expensive standalone installations. Presented in this paper, is the development of a multi-site evaluation platform that employs Advanced Distribution Management Systems (ADMS), distributed control devices, real-time hardware-in-loop assets, secure communication links, and protocol adapters. This platform uses standards-based approaches and open-source tools, and hence can serve as a template for other researchers and institutions to implement their multi-site evaluation frameworks for pre-deployment testing.

Essakiappan, Somasundaram↗
DOE OSTI2026

Evaluating isoprenol production using the IPP-bypass pathway in the oleaginous yeast Rhodosporidium toruloides

Background To strengthen the national energy supply, there is an increasing demand for domestically generated aviation fuels. Bio-derived advanced aviation fuels offer the opportunity to meet this domestic need while presenting a unique opportunity to investigate the production of novel aviation fuels. Isoprenol, a chemical precursor to such novel fuels, has been shown to be a biologically producible compound in model organisms, but its bio-producibility needs to be further explored in organisms more compatible with industrial bioproduction. Results In this work, we evaluate isoprenol production using the promising bioproduction yeast, Rhodosporidium toruloides. First, we show successful isoprenol production using the IPP-bypass pathways most successful in laboratory strains of E. coli and S. cerevisiae. Next, we demonstrate that increased flux through the mevalonate pathway only modestly increases isoprenol titers. Using proteomics, we identified a potential bottleneck in production at the final step in the IPP-bypass pathway and explored alternative enzymes for this step. Finally, the top three strains of R. toruloides were evaluated in sorghum hydrolysates generated using cholinium lysinate. Through this work, 93.1 mg/L of isoprenol was produced in mock medium and 27.3 mg/L in sorghum hydrolysates. Conclusion Together these results lay the foundation for future work for the production of isoprenol from bioproduction crops.

Advanced aviation fuel↗
DOE OSTI2019

Evaluating the Uncertainty of Terrestrial Water Budget Components Over High Mountain Asia

This study explores the uncertainties in terrestrial water budget estimation over High Mountain Asia (HMA) using a suite of uncoupled land surface model (LSM) simulations. The uncertainty in the water balance components of precipitation (P), evapotranspiration (ET), runoff (R), and terrestrial water storage (TWS) is significantly impacted by the uncertainty in the driving meteorology, with precipitation being the most important boundary condition. Ten gridded precipitation datasets along with a mix of model-, satellite-, and gauge-based products, are evaluated first to assess their suitability for LSM simulations over HMA. The datasets are evaluated by quantifying the systematic and random errors of these products as well as the temporal consistency of their trends. Though the broader spatial patterns of precipitation are generally well captured by the datasets, they differ significantly in their means and trends. In general, precipitation datasets that incorporate information from gauges are found to have higher accuracy with low Root Mean Square Errors and high correlation coefficient values. An ensemble of LSM simulations with selected subset of precipitation products is then used to produce the mean annual fluxes and their uncertainty over HMA in P, ET, and R to be 2.11 ± 0.45, 1.26 ± 0.11, and 0.85 ± 0.36 mm per day, respectively. The mean annual estimates of the surface mass (water) balance components from this model ensemble are comparable to global estimates from prior studies. However, the uncertainty/spread of P, ET, and R is significantly larger than the corresponding estimates from global studies. A comparison of ET, snow cover fraction, and changes in TWS estimates against remote sensing-based references confirms the significant role of the input meteorology in influencing the water budget characterization over HMA and points to the need for improving meteorological inputs.

Yoon, Yeosang↗
NASA NTRS2003

The case for applying an early-lifecycle technology evaluation methodology to comparative evaluation of requirements engineering research

The premise of this paper is taht there is a useful analogy between evaluation of proposed problem solutions and evaluation of requirements engineering research itself. Both of these application areas face the challenges of evaluation early in the lifecycle, of the need to consider a wide variety of factors, and of the need to combine inputs from multiple stakeholders in making thse evaluation and subsequent decisions.

technology transfer↗
DOE OSTI2021

Simulation-based Performance Evaluation of Model Predictive Control for Building Energy Systems

The performance of model predictive control (MPC) can be significantly affected by different choices of controller parameters such as the time intervals for model discretization and control sampling. Due to the lack of a systematic understanding on how these parameters affect control performance, they are usually selected arbitrarily in practice.In this paper, the combined impacts of selected time intervals for model discretization and control sampling on the performance of MPC are comprehensively investigated for the first time through detailed simulations. Specifically, a typical MPC strategy is first designed to improve building operations based on a reduced-order model of building dynamics. Then, the performance of the designed MPC is evaluated against different choices of time intervals for model discretization and control sampling on a simulated office building. The detailed simulation results reveal that the time interval for model discretization has a much greater influence on the performance of MPC than the time interval for control sampling. Although the time interval for control sampling usually receives more attentions in practice, it turns out that the time interval for model discretization affects the prediction performance, cost saving, and computation time simultaneously and more significantly. Therefore, the simulation-based performance evaluation presented here sheds light on the impacts of different time intervals and facilitates their selection for practical applications of MPC to building operations

Huang, Sen↗
DOE OSTI2021

The AME 2020 atomic mass evaluation (I). Evaluation of input data, and adjustment procedures*

Abstract This is the first of two articles (Part I and Part II) that presents the results of the new atomic mass evaluation, AME2020. It includes complete information on the experimental input data that were used to derive the tables of recommended values which are given in Part II. This article describes the evaluation philosophy and procedures that were implemented in the selection of specific nuclear reaction, decay and mass-spectrometric data which were used in a least-squares fit adjustment in order to determine the recommended mass values and their uncertainties. All input data, including both the accepted and rejected ones, are tabulated and compared with the adjusted values obtained from the least-squares fit analysis. Differences with the previous AME2016 evaluation are discussed and specific examples are presented for several nuclides that may be of interest to AME users.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2018

Evaluation of Alternative Designs for a High Temperature Particle-to-SCO2 Heat Exchanger

This paper presents an evaluation of alternative particle heat-exchanger designs, including moving packed-bed and fluidized-bed designs, for high-temperature heating of a solar-driven supercritical CO2 (sCO2) Brayton power cycle. The design requirements for high pressure (= 20 MPa) and high temperature (= 700 degrees C) operation associated with sCO2 posed several challenges requiring high-strength materials for piping and/or diffusion bonding for plates. Designs from several vendors for a 100 kW-thermal particle-to-sCO2 heat exchanger were evaluated as part of this project. Cost, heat-transfer coefficient, structural reliability, manufacturability, parasitics and heat losses, scalability, compatibility, erosion and corrosion, transient operation, and inspection ease were considered in the evaluation. An analytical hierarchy process was used to weight and compare the criteria for the different design options. The fluidized-bed design fared the best on heat transfer coefficient, structural reliability, scalability and inspection ease, while the moving packed-bed designs fared the best on cost, parasitics and heat losses, manufacturability, compatibility, erosion and corrosion, and transient operation. A 100 kWt shell-and-plate design was ultimately selected for construction and integration with Sandia's falling particle receiver system.

14 SOLAR ENERGY↗
DOE OSTI2020

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options against the Arms Control Evaluation Criteria

In this FY19 study, a range of possible measurement systems for confirming a U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for further evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended measurement system for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2020

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options Against the Arms Control Evaluation Criteria

In this study, eleven possible radiation and other non-destructive measurement systems for confirming U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for futher evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended UMAS for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN↗
DOE OSTI2024

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗
NASA NTRS1981

A review and evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of phase 5. Design and evaluation of STI systems: A selected, annotated bibliography

A selected, annotated bibliography of literature citations related to the design and evaluation of STI systems is presented. The use of manual and machine-readable literature searches; the review of numerous books, periodicals reports, and papers; and the selection and annotation of literature citations were required. The bibliography was produced because the information was needed to develop the methodology for the review and evaluation project, and a survey of the literature did not reveal the existence of a single published source of information pertinent to the subject. Approximately 200 citations are classified in four subject areas. The areas include information - general; information systems - design and evaluation, including information products and services; information - use and need; and information - economics.

Pinelli, T. E.↗
NASA NTRS1987

Configuration evaluation and criteria plan. Volume 2: Evaluation criteria plan (update). Space Transportation Main Engine (STME) configuration study

Candidate main engine configurations which enhance vehicle performance, operation and cost are identified. These candidate configurations are evaluated and the configurations which provide significant advantages over existing systems are selected for consideration for the next generation of launch vehicles. The unbiased selection of the Space Transportation Main Engine (STME) configuration requires that the candidate engines be evaluated against a predetermined set of criteria which must be properly weighted to emphasize critical requirements defined prior to the actual evaluation. During a prior study of the STME a Gas Generator Cycle engine was selected for conceptual design, with emphasis on reusability, reliability and low cost while achieving good performance. In this study emphasis is on expendable application of the STME while maintaining low cost and high reliability.

Bair, E. K.↗
NASA NTRS1991

Fuel Systems Architecture (FSA) evaluation criteria and concept evaluation methodology

Consideration is given to two methods developed for the evaluation, screening, and ranking of concepts for Space Exploration Initiative vehicle propellant management systems. The methods selected for handling this multicriteria decision problem are based on the utility theory which transforms both qualitative and quantitative criteria into a nondimensional utility scale for comparison of dissimilar figures of merit. The development of the resultant FSA evaluation criteria and concept evaluation methodology is summarized.

Hendershot, J. E.↗