Search NASASearch

SEARCH · Search NASA

Results for “Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Automated Resonance Fitting for Nuclear Data Evaluation

Global and national efforts to deliver high-quality nuclear data to users have a wide-ranging impact, affecting applications in national security, reactor operations, basic science, medicine, and more. Cross section evaluation is a major part of this effort, combining theory and experimentation to produce recommended values and uncertainties for reaction probabilities. Resonance region evaluation is a specialized type of nuclear data evaluation that can require significant manual effort and months of time from expert scientists. In this article, non-convex non-linear optimization methods are combined with concepts of inferential statistics to infer a resonance model from experimental data in an automated manner that is not dependent on prior evaluation(s). This methodology aims to enhance the workflow of a resonance evaluator by minimizing time, effort, and the potential for bias from prior assumptions, while enhancing reproducibility and documentation, thereby addressing well-known challenges in the field.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

An Observational Evaluation of RKW Theory over the U.S. Southern Great Plains

The theory of Rotunno et al. (“RKW” theory) addresses the behavior of squall-line cold pools in vertically sheared flows. It predicts that, within a given thermodynamic environment, a balance between baroclinic vorticity generation by the cold pool and low-level environmental vertical wind shear induces an upright updraft along the gust front that maximizes the initiation of new convective cells. Although this theory has been evaluated numerically, its applicability to observed systems remains unclear and is limited by a lack of critical measurements, including high-frequency thermodynamic and wind profiles across the gust front. Herein, observations from the Atmospheric Radiation Measurement Southern Great Plains (ARM-SGP) observatory near Lamont, Oklahoma, are used to evaluate RKW theory for 10 well-observed squall lines over a 11-yr period. For this evaluation, RKW parameters including cold-pool intensity (c), low-level ambient, line-normal vertical shear (ΔV n ), subcloud and cloud-layer updraft tilts, and multiple measures of system intensity are estimated. Furthermore, the c estimates rely on thermodynamic retrievals from the Atmosphere Emitted Radiance Interferometer (AERI), which are uncertain but verify reasonably well against independent observations. As predicted by the theory, for c/ΔV n ≥ 1, c/ΔV n correlates positively with updraft tilt and negatively with system intensity, but these results are not always statistically significant and are also sensitive to the method by which ΔV n is evaluated. Specifically, ΔV n evaluations that extend above the cold-pool top yield greater consistency with RKW predictions. Also, some measures of intensity correlate more strongly with standard moist instability metrics than with RKW parameters.

Cold pools

Field Evaluation of the High Efficiency Dehumidification System (HEDS) at the Timken Museum of Art - Measurement and Verification (M&V) Results from Summer, Winter and Spring Evaluation Periods

The High Efficiency Dehumidification System (HEDS) technology from Conservant Systems Inc., installed at the Timken Museum of Art in San Diego, California, was evaluated to determine its performance relative to appropriate baseline operation. Data was collected for measurement and verification for several weeks during three evaluation periods: Summer (Aug-Sep 2023), Winter (Dec 2023-Feb 2024) and Spring (May-Jun 2024). The evaluation included operating the heating, ventilation and air conditioning (HVAC) system in both constant air volume (CAV) and variable air volume (VAV) modes, with and without the HEDS energy recovery and HVAC system optimization technology enabled. The electricity consumption of the chiller and the gas-supplied reheat energy were measured to characterize savings achieved by the HEDS operation. Based on these measurements, the HEDS was responsible for chiller electrical load savings during the summer evaluation period of 39% and 42% for the CAV and VAV operating modes, respectively; 97% and 100% chiller electrical load reductions were observed during the winter evaluation for the CAV and VAV operating modes, respectively; and the corresponding reductions during the spring evaluation were 42% and 52% for CAV and VAV operation, respectively. The measured reheat energy reductions, which are typically provided by natural gas, due to the HEDS during summer were 64% and 97% in CAV and VAV operating modes, respectively, while the corresponding values were 99% and 78% during the winter evaluation, and 59% and 56% during the spring evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Evaluation program for secondary spacecraft cells: Initial evaluation tests of Eagle-Picher Industries, Incorporated 6.0 ampere-hour, nickel-cadmium spacecraft cells for separator material evaluation

Several groups of nickel cadmium cells were tested for the durability of their separator materials. The cells were rated at 6.0 ampere-hours, and contained double ceramic seals. Two cells in each group were fitted with pressure gauge assemblies. Results are presented for various brands of separator materials.

Harkness, J. D.

Upcycling of post-consumer mixed polyolefin feedstock: An economic and technical evaluation

Here, this study reports techno-economic and life cycle analyses to evaluate the economic and environmental impacts of mechanically recycled PE/PP blends in the presence of rheology modifiers. Additionally, fiber-reinforced composites derived from the compatibilized blends were prepared and evaluated for their performance compared with virgin plastics. Results suggest that compatibilized PE/PP blends exhibit a 70% lower selling price compared to virgin PE. Furthermore, these blends achieved a 74% reduction in greenhouse gas emissions or climate change impact compared to the virgin counterpart. Fiber-reinforced composites from compatibilized PE/PP blends demonstrated improved or comparable mechanical properties relative to composites made from virgin PE/PP blends. Based on their favorable cost and environmental impact, along with performance comparable to virgin composites, compatibilized PP/PE composites made from post-consumer plastics can find applications in large-scale composite manufacturing.

Fiber reinforced plastics (FRP)

Evaluating isoprenol production using the IPP-bypass pathway in the oleaginous yeast Rhodosporidium toruloides

Background To strengthen the national energy supply, there is an increasing demand for domestically generated aviation fuels. Bio-derived advanced aviation fuels offer the opportunity to meet this domestic need while presenting a unique opportunity to investigate the production of novel aviation fuels. Isoprenol, a chemical precursor to such novel fuels, has been shown to be a biologically producible compound in model organisms, but its bio-producibility needs to be further explored in organisms more compatible with industrial bioproduction. Results In this work, we evaluate isoprenol production using the promising bioproduction yeast, Rhodosporidium toruloides. First, we show successful isoprenol production using the IPP-bypass pathways most successful in laboratory strains of E. coli and S. cerevisiae. Next, we demonstrate that increased flux through the mevalonate pathway only modestly increases isoprenol titers. Using proteomics, we identified a potential bottleneck in production at the final step in the IPP-bypass pathway and explored alternative enzymes for this step. Finally, the top three strains of R. toruloides were evaluated in sorghum hydrolysates generated using cholinium lysinate. Through this work, 93.1 mg/L of isoprenol was produced in mock medium and 27.3 mg/L in sorghum hydrolysates. Conclusion Together these results lay the foundation for future work for the production of isoprenol from bioproduction crops.

Advanced aviation fuel

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN

A review and evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of phase 5. Design and evaluation of STI systems: A selected, annotated bibliography

A selected, annotated bibliography of literature citations related to the design and evaluation of STI systems is presented. The use of manual and machine-readable literature searches; the review of numerous books, periodicals reports, and papers; and the selection and annotation of literature citations were required. The bibliography was produced because the information was needed to develop the methodology for the review and evaluation project, and a survey of the literature did not reveal the existence of a single published source of information pertinent to the subject. Approximately 200 citations are classified in four subject areas. The areas include information - general; information systems - design and evaluation, including information products and services; information - use and need; and information - economics.

Pinelli, T. E.

GPM IMERG V07B and V06B: Evaluation Using Ground-Based Radar Observations and Application in Global Mesoscale Convective System Tracking

This study evaluates the latest Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG V07B) against its predecessor V06B, for studying mesoscale convective systems (MCSs). Both versions are compared using ground-based radar and rain gauge data from five meteorologically diverse regions: the contiguous United States (including eastern coastlines), Amazon rainforest, central Argentina mountains, equatorial Indian Ocean, and northern Australia across multiple temporal (0.5–6 hours) and spatial scales (0.1°–0.25°). An updated global MCS tracking dataset is developed by integrating satellite-observed infrared brightness temperature with IMERG V07B. Comparation of IMERG against radar observations reveals that IMERG demonstrates better performance in capturing the probability distribution and quantitative contributions of rainfall (from no-rain to intense-rain conditions) over tropical oceans than over land, with marked improvements in IMERG V07B for heavy-to-intense rain (> 10 mm h-1). Over land, systematic biases persist: IMERG tends to overestimate light-to-moderate rain (1–10 mm h-1) while underestimating heavy-to-intense rain. Additionally, aggregating IMERG to coarser resolutions (3-hourly or 0.25°) improves consistency with radar observations, outperforming the 1-hourly/0.1° resolution. The new IMERG V07B-based global MCS dataset exhibits consistent statistical characteristics with the V06B-based dataset, despite lower mean rain rates and reduced heavy precipitation contributions. These findings offer valuable insights for utilizing IMERG V07B in global precipitation studies, MCS characterization, and model evaluation.

Zhang, Sihan

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats

Data for Multisite Field Evaluation of Oil Accumulation and Agronomic Performance in Grain and Sweet Sorghums Engineered for Lipid Hyperaccumulation

Oil sorghum (OS) has been developed by engineering grain (TX430) and sweet (Ramada) genetic backgrounds to accumulate triacylglycerols (TAG) in vegetative tissues as an energy-dense feedstock for sustainable aviation fuel (SAF) and other biofuels. This study evaluated two TX430 OS lines (TxHO-2, TxHO-3) and two Ramada OS lines (RmHO-1, RmHO-2) alongside wild-type (WT) lines in NE and IL over 2 years (2023–2024) to quantify genotype × environment effects on agronomic performance and TAG accumulation. Across four environments, TX430 OS lines showed average TAG concentrations of 15.0 g kg−1 in leaves and 12.8 g kg−1 in stems, approximately 19-fold higher than WT. Ramada OS lines accumulated 26.1 g kg−1 in leaves and 12.3 g kg−1 in stems, approximately 25-fold and 13-fold increases over WT, respectively. OS lines in TX430 exhibited an 18% reduction in biomass (8.4 vs. 9.9 Mg ha−1 for WT), while Ramada OS lines had similar WT biomass (18.3 vs. 19.9 Mg ha−1 for WT). Among TX430 OS lines, TxHO-2 achieved the highest TAG yield (190 kg ha−1), while RmHO-1 led the Ramada lines (335 kg ha−1) due to higher biomass and similar TAG concentration. Enhanced TAG accumulation increased N, P, and K removal in TX430 lines but not in Ramada lines. Structural carbohydrate and ash concentration were unaffected. Overall, results confirm vegetative lipid accumulation as a viable strategy for high-biomass sorghum, supporting its potential as a dual-purpose feedstock for SAF. Future work should focus on minimizing biomass yield penalties and improving nutrient use efficiency in oil sorghum systems.

Agronomy

Data for Clumping Index Estimation With 30°-tilted Cameras in Row Crops: Evaluation of Methods and Segment Size Effects

The clumping index (CI) quantifies the spatial distribution of foliage elements and is essential for accurately estimating the plant area index (PAI), canopy radiative transfer, and photosynthesis. Traditionally, the finite-length averaging method (LX), the gap size distribution method (CC), and a combined approach of CC and LX (CLX) have been applied to instruments like TRAC and digital hemispherical photography to estimate CI. However, a comprehensive evaluation of these methods in row crops remains limited, especially regarding the influence of segment size on CI. Meanwhile, digital cameras offer a cost-effective and user-friendly solution for canopy measurements in row crops, yet their application in this context remains underexplored. In this study, we employed a new approach using a 30°-tilted digital camera to estimate CI in corn and soybean fields, applying the LX, CC, and CLX methods. We systematically assessed the performance of these three methods by combining field measurements in real-world fields with simulations using the LESS 3D radiative transfer model. Our results showed that CLX applied to the whole image and 45° segment offered accurate estimation of CI (bias within ±0.1, RMSE < 0.2) and PAI (bias within ±0.4, RMSE < 1) in real-world fields and LESS simulations. The accuracy of the LX method was highly sensitive to segment size, with the best performance observed at the 15° segment (PAI bias within ±0.4). In contrast, the CC method remained stable across different segment sizes, and its performance was generally comparable to that of LX, except at the 15° segment. Across view zenith angles, CI derived from CC generally showed a continuous increase, while those from LX and CLX followed a rising trend at small zenith angles but began to decline at 68°, likely due to an increasing proportion of no-gap segments. Seasonally, LX tended to show decreasing CI during early growth stages but increased as the canopy matured, whereas CC and CLX showed gradually increasing CI before plateauing at peak PAI. The 30°-tilted camera effectively captured CI variations across different angles and growth stages, making it a practical and robust instrument for row crop canopy structure analysis. Applying these CI methods to digital cameras offers a low-cost and accessible CI estimation alternative, improving canopy structure monitoring accuracy in row crops.

Modeling

Evaluation of accuracy and resolution of the electron beam profile scanner at the Fermilab Main Injector

The objective of this work is to assess the accuracy of measurements made by the Electron Beam Profile Scanner (EBPS), which captures the trajectory of an electron beam with and without a proton beam present. The proton beam induces deflection in the electron beam, which is influenced by proton charges.For high-resolution images, the probe beam needs to be of high intensity, small diameter, and small divergence, evaluated using a YAG screen and an optical transition radiation (OTR) screen. Additionally, the point spread function (PSF) will be calculated to characterize the optical system's properties using ZEMAX software. The capabilities of the Hamamatsu Charge-Injection Device (CID) camera and Kimball Physics electron gun (e-gun) will be considered for accuracy.

Mwaniki, Matilda [IIT, Chicago; Fermilab]

Evaluate data lake design for the accelerator control system

Increasing precision in automation for modern particle accelerators not only creates a requirement to gather data from all devices but also demands scalable and high-performance data infrastructure with the capability of handling vast incoming device data. A well architected data lake is suitable for such a system which integrates real-time data acquisition, transient data caching, and long-term storage. This paper evaluates data lake architecture for an Accelerator Control System (ACS), focusing on two critical components of a data lake, data cache and long-term storage.

Jaikar, Amol [Fermilab]

Pyrotechnic hazards classification and evaluation program. Phase 3, segments 1-4: Investigation of sensitivity test methods and procedures for pyrotechnic hazards evaluation and classification, part A

The findings, conclusions, and recommendations relative to the investigations conducted to evaluate tests for classifying pyrotechnic materials and end items as to their hazard potential are presented. Information required to establish an applicable means of determining the potential hazards of pyrotechnics is described. Hazard evaluations are based on the peak overpressure or impulse resulting from the explosion as a function of distance from the source. Other hazard classification tests include dust ignition sensitivity, impact ignition sensitivity, spark ignition sensitivity, and differential thermal analysis.

Source record

Evaluation of coated columbium alloy heat shields for space shuttle thermal protection system application. Volume 2, phase 2: Subsize heat shield and small size TPS evaluation

Initially a trade study was conducted of seven heat shield configurations. These were evaluated for structural reliability, fabricability, weight, inspectability, and refurbishability. Two concepts, a tee-stiffened and an open corrugation, were selected as offering the most potential for system success. Fourteen subsize heat shields of a full scale section were fabricated from C-129Y and Cb-752 and silicide coated with R-512E. These subsize panels were subjected to a simulated flight profile representing temperature, local surface pressures, and applied pressure differential loads. All corrugated panels of both alloys sustained 100 cycles without structural or coating failure. All Cb-752/R-512E panels performed well with one panel being successfully repaired after 66 cycles and completing 100 cycles. As a result of this evaluating the Cb-752/R-512E system was selected for hardware application during the subsequent phases. In addition, the tee-stiffened configuration was selected for further development and application in Phase III. This selection was based on an overall assessment of relative weight, cost, and structural performance of the tee-stiffened and open corrugation TPS.

Black, W. E.