Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

ISRU Evaluation of Artemis Campaign Sites: Considerations and Methodology

The Artemis campaign has stated goals of ‘sustainable exploration’ [1] which includes In-Situ Resource Utilization (ISRU). The selection of the lunar polar region for Artemis was in part due to the identification of water in permanently shadowed regions (PSRs) which is of both scientific and exploration interest. The potential use of this water (as is, or as oxygen/hydrogen) for NASA and commercial applications, such as refueling vehicles, for power systems, or supplying life support consumables, is reflected in NASA’s Moon to Mars objectives (LI-7) [2]. These objectives also specify the need to locate and characterize the lunar water such that a water ‘reserve’ can be identified (AS-3). While infusion of ISRU capabilities is not planned for Artemis III, it is an opportunity to collect information to identify water reserves for later Artemis and commercial use. Selection of an Artemis III site with ISRU consideration will help advance the infusion of ISRU into later missions.

In situ resource utilization↗

Assessing Aircraft Susceptibility to Nonlinear Aircraft-Pilot Coupling/Pilot-Induced Oscillations

A unified approach for assessing aircraft susceptibility to aircraft-pilot coupling (or pilot-induced oscillations) which was previously reported in the literature and applied to linear systems is extended to nonlinear systems, with emphasis upon vehicles with actuator rate saturation. The linear methodology provided a tool for predicting: (1) handling qualities levels, (2) pilot-induced oscillation rating levels and (3) a frequency range in which pilot-induced oscillations are likely to occur. The extension to nonlinear systems provides a methodology for predicting the latter two quantities. Eight examples are presented to illustrate the use of the technique. The dearth of experimental flight-test data involving systematic variation and assessment of the effects of actuator rate limits presently prevents a more thorough evaluation of the methodology.

Hess, R.A.↗

Validation of Gamma Dose Rate Calculation Methodology using the Morris and Turkey Point Measurements

The ability to accurately predict the dose rates from the spent nuclear fuel assembly is very important for determining whether the used nuclear fuel is self-guarded and self-protected. Studies have shown that the direct numerical calculations of the dose rates gave a much lower value than a typical reference. This report summarizes the benchmark studies performed to evaluate the numerical methodologies used in calculating the gamma dose rates of the spent nuclear fuel assemblies. The Morris and Turkey Point experimental data for dose rates measured through air were used in the analyses. Numerical simulations of the gamma dose rate measurements included the fuel depletion analysis of the fuel assembly as well as its structural materials irradiated inside the reactor core, the radioisotopes decay, and photon transport simulations to calculate the gamma dose rates. The different factors which affect the calculated gamma dose rates were addressed. The calculated results were compared with the measured gamma dose rates. Good agreement was obtained when the detectors were placed at the middle of the fuel assembly region. The deviations of the calculated dose rates became larger when the measurements were performed at the top or bottom fuel assemblies. In these benchmark studies, the spent nuclear fuel assemblies were all PWR assemblies and had fuel burnup around 25 MWd/kg to 40 MWd/kg. Its cooling time before the measurements was around 1.8 years to 7 years. The used nuclear fuel assembly is usually self-protected while discharged from the core. Its radioactivity decreases and after a few tens of years it may fall down below the current threshold of 100 r/h. Future validation work is necessary in order to better evaluate the numerically calculated gamma dose rates with experiments performed for other types of fuel assemblies and for fuel assemblies with higher burnup and/or longer cooling times.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Synthetic data generators for the evaluation of biosurveillance outbreak detection algorithms

The research and development of new algorithmic and statistical methods of outbreak detection is an ongoing research priority in the field of biosurveillance. The early detection of emergent disease outbreaks is crucial for effective treatment and mitigation. New detection methods must be compared to established approaches for proper evaluation. This comparison requires biosurveillance test data that accurately reflects the complexity of the real-world data it will be applied to. While the test and evaluation of new detection methods is best performed on real data, it is often impractical to obtain such data as it is either proprietary or limited in scope. Thus, scientists must turn to synthetic data generation to provide enough data to properly eval- uate new detection methodologies. This paper evaluates three such synthetic data sources: The WSARE dataset, the Noufilay equation-based approach, and the Project Mimic data generator.

47 OTHER INSTRUMENTATION↗

A New Real - Time Fault Detection Methodology for Systems Under Test

The purpose of this research is focussed on the identification/demonstration of critical technology innovations that will be applied to various applications viz. Detection of automated machine Health Monitoring (BM, real-time data analysis and control of Systems Under Test (SUT). This new innovation using a High Fidelity Dynamic Model-based Simulation (BFDMS) approach will be used to implement a real-time monitoring, Test and Evaluation (T&E) methodology including the transient behavior of the system under test. The unique element of this process control technique is the use of high fidelity, computer generated dynamic models to replicate the behavior of actual Systems Under Test (SUT). It will provide a dynamic simulation capability that becomes the reference truth model, from which comparisons are made with the actual raw/conditioned data from the test elements.

Johnson, Roger W.↗

Utilization of municipal wastewater for cooling in thermoelectric power plants: Evaluation of the combined cost of makeup water treatment and increased condenser fouling

A methodology is presented to calculate the total combined cost (TCC) of water sourcing, water treatment and condenser fouling in the recirculating cooling systems of thermoelectric power plants. The methodology is employed to evaluate the economic viability of using treated municipal wastewater (MWW) to replace the use of freshwater as makeup water to power plant cooling systems. Cost analyses are presented for a reference power plant and five different tertiary treatment scenarios to reduce the scaling tendencies of MWW. Results indicate that a 550 MW sub-critical coal fired power plant with a makeup water requirement of 29.3 ML/day has a TCC of $3.0 - 3.2 million/yr associated with the use of treated MWW for cooling. (All costs USD 2009). This translates to a freshwater conservation cost of $0.29/kL, which is considerably lower than that of dry air cooling technology, $1.5/kL, as well as the 2020 conservation cost target set by the U.S. Department of Energy, $0.74/kL. Results also show that if the available price of freshwater exceeds that of secondary-treated MWW by more than $0.13-0.14/kL, it can be economically advantageous to purchase secondary MWW and treat it for utilization in the recirculating cooling system of a thermoelectric power plant.

20 FOSSIL-FUELED POWER PLANTS↗

Methodology for Stress-Controlled Fatigue Test Under In-Air and Pressurized Water Reactor Coolant Water Condition and to Evaluate the Effect of Pressurized Water Reactor Water and Loading Rate on Ratcheting [Methodology for Stress-Controlled Fatigue Test Under In-Air and PWR Coolant Water Condition and to Evaluate the Effect of PWR Water and Loading Rate on Ratcheting]

Here, this work investigates the behavior of 316 stainless steel (SS) under stress-controlled low cycle fatigue loading. Several fatigue experiments are conducted under different environment such as in air at 300°C and primary loop water conditions for a pressurized water reactor (PWR). Two different loading conditions are also employed to examine the effect of stress rate on material hardening and ratcheting. During PWR water test, actuator position measurements are used to determine the strain of the specimen. Under PWR environment, 316 SS is found to ratchet to a significantly greater degree compared with in air. At slow stress rate, higher amount of cyclic hardening is observed in 316 SS, and slow stress rate increases the rate of ratcheting. Results also indicate that 316 SS exhibits asymptotic strain response at higher stress loading which can cause material to behave very differently under same stress cyclic loading.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An Expert Elicitation Based Study of the Proliferation Resistance of a Suite of Nuclear Power Plants

In 2008, a multi-laboratory research team completed a study evaluating the proliferation resistance (PR) characteristics of a diverse suite of four advanced nuclear reactor designs. The systems evaluated included: • a light water reactor (a pressurized-water reactor), • a heavy water reactor, • a high temperature gas reactor (with a prismatic-block reactor core), • a sodium-cooled fast reactor. The team used an expert elicitation assessment approach based on the Generation IV International Forum (GIF) Proliferation Resistance and Physical Protection (PR&PP) methodology. The team evaluated three general types of proliferation threats: 1) concealed diversion of material, 2) concealed misuse of the reactor to produce material, and 3) breakout. The evaluations took into account the intrinsic PR characteristics of each reactor and the extrinsic PR characteristics provided by generic safeguards the team considered appropriate for each reactor, based on the team’s experience and available conceptual design information.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Data-driven key performance indicators and datasets for building energy flexibility: A review and perspectives

Energy flexibility, through short-term demand-side management (DSM) and energy storage technologies, is now seen as a major key to balancing the fluctuating supply in different energy grids with the energy demand of buildings. This is especially important when considering the intermittent nature of ever-growing renewable energy production, as well as the increasing dynamics of electricity demand in buildings. This paper provides a holistic review of (1) data-driven energy flexibility key performance indicators (KPIs) for buildings in the operational phase and (2) open datasets that can be used for testing energy flexibility KPIs. The review identifies a total of 48 data-driven energy flexibility KPIs from 87 recent and relevant publications. These KPIs were categorized and analyzed according to their type, complexity, scope, key stakeholders, data requirement, baseline requirement, resolution, and popularity. Moreover, 330 building datasets were collected and evaluated. Of those, 16 were deemed adequate to feature building performing demand response or building-to-grid (B2G) services. The DSM strategy, building scope, grid type, control strategy, needed data features, and usability of these selected 16 datasets were analyzed. This review reveals future opportunities to address limitations in the existing literature: (1) developing new data-driven methodologies to specifically evaluate different energy flexibility strategies and B2G services of existing buildings; (2) developing baseline-free KPIs that could be calculated from easily accessible building sensors and meter data; (3) devoting non-engineering efforts to promote building energy flexibility, standardizing data-driven energy flexibility quantification and verification processes; and (4) curating and analyzing datasets with proper description for energy flexibility assessm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development of electrostatic precipitator (ESP) technology to remove elemental mercury vapor, HG(0)

The presence of mercury vapor or other forms of mercury presents issues with worker safety, decommissioning facilities, and environmental impacts. As such, it is desired to develop a strategy to either remove or reduce mercury levels in Oak Ridge’s Y-12 Complex facilities. A testing methodology was developed to evaluate electrostatic precipitator technology for removal of mercury vapor. This methodology involved supplying mercury vapor-containing air to the ESP device by flowing air through a column containing alternating layers of sand and liquid mercury droplets. Initial attempts at quantifying the efficacy of the ESP device in removing mercury vapor were plagued with difficulties in controlling the flow of mercury into the ESP device due to poor performance of the generator column and the contamination of these experiments with mercury from an unknown source. These issues were resolved by creating a new generator column with slower air velocity and higher surface area of liquid mercury, along with moving the air intake for the ESP device to outside of the chemical hood in which testing took place. This resulted in a steady, quantified flow of mercury vapor from the generator column and no observation of unintended mercury sources. A final test of the ESP device under these controlled conditions showed that for a certain amount of time (on the order of 20-30 minutes) mercury concentrations were reduced by approximately 33 - 67% of the inlet concentration. However, episodic releases or pulses of mercury observed only at the outlet indicated that the mercury accumulated in the ESP device is periodically expelled. As a result, it was not deemed to be an efficient strategy for the removal of elemental mercury vapor.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Automated Programmable Logic Controller Memory Forensics Using RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and Internet-based technologies has enhanced industrial control system operations but have inadvertently increased their vulnerabilities to cyber attacks. When an industrial control system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies. Memory forensics is critical in the incident analysis process to ascertain what occurred. Approaches for analyzing the persistent memory in industrial control devices are limited and almost nonexistent for volatile memory. This chapter proposes an automated methodology for programmable logic controller memory dump analysis using computer vision and deep learning techniques. The methodology converts the sequences of bytes in a programmable logic controller memory dump to red-green-blue pixels and employs a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. The trained model is employed to automatically segment new memory images and identify forensic artifacts. Evaluation of the methodology on a Schneider Electric Modicon M221 programmable logic controller under code injection and code modification attacks demonstrates its ability to detect attack artifacts in memory dumps.

Asmar Awad, Rima [ORNL] (ORCID:0000000233407742)↗

Computational methods based on density functional theory for reactions and processes involving electronic spin (Final Technical Report)

This award supports one post-doctoral researcher for 1.5 years. Publications that acknowledge this grant: Refs. 1–14. Refs. 3,10,12 assess current methodology for the evaluation of magnetic exchange couplings in transition metal complexes. In particular, Ref. 10 validates the use of an approximate (non-iterative) Green’s function approach for the calculation of magnetic exchange couplings and will be the foundation for Thrust 2 in this proposal. Refs. 3 and 12 focus on widely used density functional approaches based on the standard energy differences methodology for the particular case of oxo-bridged Fe(III) complexes. Refs. 2,4–7,11 apply current methodologies to problems of practical interest in molecular magnetism. Ref. 13 presents a methodology to explicitly simulate the dynamics of open quantum systems within density functional theory (DFT) calculations based on the Liouville-von Neumann equation of motion for quantum systems driven out-of-equilibrium. Ref. 8 uses non-collinear spin DFT to explain the mechanical behavior of magnetic mono-atomic Pt wires produced in break-junction experiments in the presence of a magnetic field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design and Installation of a Disposal Cell Cover Field Test

The U.S. Department of Energy’s Office of Legacy Management (LM) initiated a cover assessment project in September 2007 to evaluate an inexpensive approach to enhancing the hydrological performance of final covers for disposal cells. The objective is to accelerate and enhance natural processes that are transforming existing conventional covers, which rely on low-conductivity earthen barriers, into water balance covers, that store water in soil and release it as soil evaporation and plant transpiration. A low conductivity cover could be modified by deliberately blending the upper layers of the cover profile and planting native shrubs. A test facility was constructed at the Grand Junction, Colorado, Disposal Site to evaluate the proposed methodology. The test cover was constructed in two identical sections, each including a large drainage lysimeter. The test cover was constructed with the same design and using the same materials as the existing disposal cell in order to allow for a direct comparison of performance. One test section will be renovated using the proposed method; the other is a control. LM is using the lysimeters to evaluate the effectiveness of the renovation treatment by monitoring hydrologic conditions within the cover profile as well as all water entering and leaving the system. This paper describes the historical experience of final covers employing earthen barrier layers, the design and operation of the lysimeter test facility, testing conducted to characterize the as-built engineering and edaphic properties of the lysimeter soils, the calibration of instruments installed at the test facility, and monitoring data collected since the lysimeters were constructed.

disposal cells, Grand Junction, Colorado, Disposal↗

An Eddy Current Case Study using NASA’s Transfer Function and Limited-Sample Probability of Detection Guidebooks

Probability of detection (POD) requirements for NASA fracture-critical human-rated systems can be met by (1) claiming ‘similarity’ to NASA Standard Nondestructive Evaluation (NDE) flaw sizes or (2) by inspector-specific POD demonstration, known as NASA Special NDE. Standard NDE flaw sizes are intended to represent the detection capability of most qualified inspectors, and were primarily based on POD studies in the development of the Space Shuttle Program Orbiter fracture control plan. However, these Standard NDE flaw sizes were based on fatigue cracks in flat panels of one material alloy over a limited range of panel thicknesses. While the POD study was comprehensive, the inspection conditions are relatively narrow. An evaluation of similarity between the Standard NDE POD study and flight component conditions is required to apply Standard NDE to specific flight component inspections. A similarity evaluation may include differences in materials, surface finish, component geometry (e.g., curvature, corners, welds), and inspection access. Similarity is typically based on a qualitative engineering evaluation. Recently, NASA published a quantitative methodology to assess similarity. If similarity is not supported by test and analysis, then the methodology provides a transfer function of flaw size for Special NDE POD demonstration. NASA recommends that Special POD demonstrations use flaws that are flight-like or more difficult to detect than flight component flaws, which are commonly induced fatigue cracks. Often, it is not feasible to induce fatigue cracks in flight component geometry, and therefore, a simpler representative geometry is used, commonly a flat panel, for POD demonstration. Inducing cracks in simple geometry specimens can be time-consuming and expensive, and thus, minimizing the number of flawed specimens is desired. Traditionally, NASA Special NDE demonstration was limited to MIL-HDBK-1823A methods or the binomial point-estimate method (PEM), commonly known as 29/29. Recently, NASA published a limited-sample POD (LS-POD) methodology for signal-response NDE techniques (e.g., eddy current) that provides POD demonstration with fewer specimens than previous approaches. LS-POD suggests a minimum of 10 flawed specimens, compared to 29 in the PEM and the suggested minimum of 40 from MIL-HDBK-1823A. The methodology also includes new guidance on evaluating the probability of false calls. In this presentation, these new transfer function and LS-POD methodologies are described and illustrated through an eddy current detection capability of far-side flaws on thin welded panels. A geometry-based transfer function is developed using electro-discharge machined (EDM) notches in flight component and simple geometry to estimate the Special NDE flaw size that is representative of the critical initial flaw size required by the fracture analysis. Then, fatigue cracks are induced in simple flat panels of the transferred flaw size, and the LS-POD methodology is used for Special NDE demonstration.

P. A. Parker↗

Evaluation of Landscape Structure Using AVIRIS Quicklooks and Ancillary Data

Currently the best tool for examining landscape structure is remote sensing, because remotely sensed data provide complete and repeatable coverage over landscapes in many climatic regimes. Many sensors, with a variety of spatial scales and temporal repeat cycles, are available. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) has imaged over 4000 scenes from over 100 different sites throughout North America. For each of these scenes, one-band "quicklook" images have been produced for review by AVIRIS investigators. These quicklooks are free, publicly available over the Internet, and provide the most complete set of landscape structure data yet produced. This paper describes the methodologies used to evaluate the landscape structure of quicklooks and generate corresponding datasets for climate, topography and land use. A brief discussion of preliminary results is included at the end. Since quicklooks correspond exactly to their parent AVIRIS scenes, the methods used to derive climate, topography and land use data should be applicable to any AVIRIS analysis.

Sanderson, Eric W.↗

Solar Thermal Concept Evaluation

Concentrated solar thermal energy can be utilized in a variety of high temperature applications for both terrestrial and space environments. In each application, knowledge of the collector and absorber's heat exchange interaction is required. To understand this coupled mechanism, various concentrator types and geometries, as well as, their relationship to the physical absorber mechanics were investigated. To conduct experimental tests various parts of a 5,000 watt, thermal concentrator, facility were made and evaluated. This was in anticipation at a larger NASA facility proposed for construction. Although much of the work centered on solar thermal propulsion for an upper stage (less than one pound thrust range), the information generated and the facility's capabilities are applicable to material processing, power generation and similar uses. The numerical calculations used to design the laboratory mirror and the procedure for evaluating other solar collectors are presented here. The mirror design is based on a hexagonal faceted system, which uses a spherical approximation to the parabolic surface. The work began with a few two dimensional estimates and continued with a full, three dimensional, numerical algorithm written in FORTRAN code. This was compared to a full geometry, ray trace program, BEAM 4, which optimizes the curvatures, based on purely optical considerations. Founded on numerical results, the characteristics of a faceted concentrator were construed. The numerical methodologies themselves were evaluated and categorized. As a result, the three-dimensional FORTRAN code was the method chosen to construct the mirrors, due to its overall accuracy and superior results to the ray trace program. This information is being used to fabricate and subsequently, laser map the actual mirror surfaces. Evaluation of concentrator mirrors, thermal applications and scaling the results of the 10 foot diameter mirror to a much larger concentrator, were studied. Evaluations, recommendations and pit falls regarding the structure, materials and facility design are presented.

Hawk, Clark W.↗

"Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date"

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.

Ameli, Mostafa↗