Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Soil Moisture Drought Monitoring and Forecasting Using Satellite and Climate Model Data over Southwestern China

In this paper, an experimental soil moisture drought monitoring and seasonal forecasting framework based on the Variable Infiltration Capacity model (VIC) over southwestern China (SW) is presented. Satellite precipitation data are used to force VIC for a near-real-time estimate of land surface hydrologic conditions. Initialized with satellite-aided monitoring (MONIT), the climate model (CFSv2)-based forecast (MONIT+CFSv2) and ensemble streamflow prediction (ESP)-based forecast (MONIT+ESP) are both performed. One dry season drought and one wet season drought are employed to test the ability of this framework in terms of real-time tracking and predicting the evolution of soil moisture (SM) drought, respectively. The results show that the skillful CFSv2 climate forecasts (CFs) are only found at the first month. The satellite-aided monitoring is able to provide a reasonable estimate of forecast initial conditions (ICs) in real-time mode. In the presented cases, MONIT+CFSv2 forecast exhibits comparable performance against the observation-based estimates for the first month, whereas the predictive skill largely drops beyond 1 month. Compared to MONIT+ESP, MONIT+CFSv2 ensembles give more skillful SM drought forecast during the dry season, as indicated by a smaller ensemble range, while the added value of MONIT+CFSv2 is marginal during the wet season. Furthermore, a quantitative attribution analysis of SM forecast uncertainty demonstrates that SM forecast skill is mostly controlled by ICs at the first month and that uncertainties in CFs have the largest contribution to SM forecast errors at longer lead times. This study highlights a value of this framework in generating near-real-time ICs and providing a reliable SM drought prediction with 1 month ahead, which may greatly benefit drought diagnosis, assessment, and early warning.

54 ENVIRONMENTAL SCIENCES↗

Lightning Jump Algorithm Development for the GOES·R Geostationary Lightning Mapper

Current work on the lightning jump algorithm to be used in GOES‐R Geostationary Lightning Mapper (GLM)'s data stream is multifaceted due to the intricate interplay between the storm tracking, GLM proxy data, and the performance of the lightning jump itself. This work outlines the progress of the last year, where analysis and performance of the lightning jump algorithm with automated storm tracking and GLM proxy data were assessed using over 700 storms from North Alabama. The cases analyzed coincide with previous semi‐objective work performed using total lightning mapping array (LMA) measurements in Schultz et al. (2011). Analysis shows that key components of the algorithm (flash rate and sigma thresholds) have the greatest influence on the performance of the algorithm when validating using severe storm reports. Automated objective analysis using the GLM proxy data has shown probability of detection (POD) values around 60% with false alarm rates (FAR) around 73% using similar methodology to Schultz et al. (2011). However, when applying verification methods similar to those employed by the National Weather Service, POD values increase slightly (69%) and FAR values decrease (63%). The relationship between storm tracking and lightning jump has also been tested in a real‐time framework at NSSL. This system includes fully automated tracking by radar alone, real‐time LMA and radar observations and the lightning jump. Results indicate that the POD is strong at 65%. However, the FAR is significantly higher than in Schultz et al. (2011) (50‐80% depending on various tracking/lightning jump parameters) when using storm reports for verification. Given known issues with Storm Data, the performance of the real‐time jump algorithm is also being tested with high density radar and surface observations from the NSSL Severe Hazards Analysis & Verification Experiment (SHAVE).

Schultz. E.↗

SPOKES: An end-to-end simulation facility for spectroscopic cosmological surveys

The nature of dark matter, dark energy and large-scale gravity pose some of the most pressing questions in cosmology today. These fundamental questions require highly precise measurements, and a number of wide-field spectroscopic survey instruments are being designed to meet this requirement. A key component in these experiments is the development of a simulation tool to forecast science performance, define requirement flow-downs, optimize implementation, demonstrate feasibility, and prepare for exploitation. We present SPOKES (SPectrOscopic KEn Simulation), an end-to-end simulation facility for spectroscopic cosmological surveys designed to address this challenge. SPOKES is based on an integrated infrastructure, modular function organization, coherent data handling and fast data access. These key features allow reproducibility of pipeline runs, enable ease of use and provide flexibility to update functions within the pipeline. The cyclic nature of the pipeline offers the possibility to make the science output an efficient measure for design optimization and feasibility testing. We present the architecture, first science, and computational performance results of the simulation pipeline. The framework is general, but for the benchmark tests, we use the Dark Energy Spectrometer (DESpec), one of the early concepts for the upcoming project, the Dark Energy Spectroscopic Instrument (DESI). As a result, we discuss how the SPOKES framework enables a rigorous process to optimize and exploit spectroscopic survey experiments in order to derive high-precision cosmological measurements optimally.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Reassembly and Test of High-Field Nb3Sn Dipole Demonstrator MDPCT1

In the framework of the U.S. Magnet Development Program (MDP), Fermilab has developed and tested a high-field Nb$_3$Sn dipole demonstrator MDPCT1 for a post-LHC Hadron Collider. The magnet was first assembled with a lower coil pre-load to minimize the risk of coil damage during assembly and test. In the first test the magnet reached its test goal producing a world record field of 14.1 T at 4.5 K. Next the magnet was reassembled with nominal pre-load to achieve its design field limit of 15 T. This paper describes the details of MDPCT1 inspection, design modifications and reassembly. The magnet quench performance, including training, ramp rate and temperature dependences in the temperature range of 1.9-4.5 K, is presented and discussed.

43 PARTICLE ACCELERATORS↗

National Security Programs - Cyber: MMAREJBLIGE – Modular Multi Agent Grid Emulation for Joined Breakdowns in Linked Generative Emulations - 23-0644

Modular Multi Agent Grid Emulations for Joined Breakdowns in Linked Generative Emulations (MMAREJBLIGE) introduces an agent-based modeling framework into real-time cyber-physical emulation to achieve a context-aware environment that introduces operator/attacker/external-condition variability to improve emulation fidelity and testing rigor. We detail our agent framework design, internal communication via message passing, and time synchronization, as well as the individual components of the system. We include a brief analysis of several scenarios run on a real-time, hardware-in-the-loop, Industrial Control Systems (ICS) test-bed which include normal operation, physical disruption, disruption with mitigation, and disruption with mitigation during a cyber denial-of-service (DOS) attack.

42 ENGINEERING↗

Performance Assessment of Prediction In Dynamic Environments (PRIDE) in Manufacturing Environments

This paper describes PRIDE (Prediction in Dynamic Environments), a multi-resolution and hierarchical framework. PRIDE was developed as a test bed to assess the performance of autonomous vehicles in the presence of moving objects in a simulated environment. By simulating scenarios in which moving objects are prevalent, a designer of an autonomous vehicle can test the performance of their path planning and collision avoidance algorithms without having to immerse the vehicle in the physical world. This framework supports the prediction of the future location of moving objects at various levels of resolution, thus providing prediction information at the frequency and level of abstraction necessary for planners at different levels within the hierarchy. Previous works have demonstrated the reliability of PRIDE to simulate on-road traffic situations with multiple vehicles. To provide realistic scenarios, PRIDE integrates a level of situation awareness of how other vehicles in the environment are expected to behave considering the situation in which the vehicles find themselves in. In recent efforts, the PRIDE framework has been extended to consider production logistics in dynamic manufacturing environment while focusing on the scheduling of material transportation system. To demonstrate the characteristics of the PRIDE framework, this paper illustrates real-time navigation of Automated Guided Vehicles (AGVs) at different locations in a dynamic manufacturing environment. Moreover, using the high-fidelity physics?based framework for the Unified System for Automation and Robot Simulation (USARSim), this paper analyzes the performance of the PRIDE framework on a set of realistic scenarios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Framework for a space shuttle main engine health monitoring system

A framework developed for a health management system (HMS) which is directed at improving the safety of operation of the Space Shuttle Main Engine (SSME) is summarized. An emphasis was placed on near term technology through requirements to use existing SSME instrumentation and to demonstrate the HMS during SSME ground tests within five years. The HMS framework was developed through an analysis of SSME failure modes, fault detection algorithms, sensor technologies, and hardware architectures. A key feature of the HMS framework design is that a clear path from the ground test system to a flight HMS was maintained. Fault detection techniques based on time series, nonlinear regression, and clustering algorithms were developed and demonstrated on data from SSME ground test failures. The fault detection algorithms exhibited 100 percent detection of faults, had an extremely low false alarm rate, and were robust to sensor loss. These algorithms were incorporated into a hierarchical decision making strategy for overall assessment of SSME health. A preliminary design for a hardware architecture capable of supporting real time operation of the HMS functions was developed. Utilizing modular, commercial off-the-shelf components produced a reliable low cost design with the flexibility to incorporate advances in algorithm and sensor technology as they become available.

Hawman, Michael W.↗

Development of a Test-Bed for Testing and Refining EarthEn’s Supercritical CO 2 Based Energy Storage System

EarthEn’s energy storage concept leverages supercritical carbon dioxide (sCO 2 ) as a working fluid and relies on compact, high-performance components operating at elevated pressures and temperatures. To accelerate component development and reduce technical risk prior to larger-scale demonstrations, Oak Ridge National Laboratory (ORNL) developed a 100 kW-scale sCO 2 test-bed under a Cooperative Research and Development Agreement with EarthEn (CRADA NO. NFE-24-10050). The objective of the work was to design and construct a flexible experimental facility capable of reproducing key thermodynamic state points and heat-transfer conditions relevant to EarthEn’s thermal energy storage (TES) cycle, with particular emphasis on enabling development and evaluation of next-generation heat exchangers and TES concepts. The test-bed consists of a closed-loop sCO 2 circulation system housed within an open-topped enclosure. In its as-installed configuration, dense-phase sCO 2 is recirculated through a printed circuit recuperator, an electrically heated section, a throttling device used to simulate turbine expansion, and a water-cooled printed circuit heat exchanger that rejects heat to the building chilled-water system before returning to the pump. The pump is driven by a variable frequency drive, enabling controlled adjustment of flow and operating point. A comprehensive instrumentation suite was integrated to support both safe operation and high-quality data collection. Installed sensors include Coriolis flow meters for sCO 2 flow rate and density, resistance temperature detectors and thermocouples distributed throughout the loop (including the heated section and key heat exchanger ports), and pressure transducers for absolute and differential pressure measurements. The facility was designed to support high-pressure (19 MPa nominal) and high-temperature (575°C nominal) operation with credited overpressure protection provided by a rupture disk. Nominal operating conditions were selected to support 100 kW-class testing while maintaining flexibility for non-heated and heated shakedown, control development, and future integration of advanced TES test sections. In parallel with facility development, a system-level thermal-hydraulic model was created using Modelica-based tools to support component sizing, anticipate performance over targeted test conditions, and establish a framework for future model calibration against experimental data. At the conclusion of the project performance period, the facility was in final assembly, and the pressure boundary was nearly completed. However, several practical challenges associated with high-pressure/high-temperature systems and specialized component procurement impacted schedule and prevented initial pump-driven operation and full commissioning within the available resources. This report documents the as-built design, operating capabilities, and instrumentation, and it summarizes key lessons learned related to heater fabrication and testing, first-of-a-kind assembly factors, specialty flange supply constraints, and fill pump corrective actions. Finally, it outlines a phased plan for future commissioning and experimental campaigns, including control and instrumentation shakedown, heater characterization, model calibration, and testing at state points representative of EarthEn’s TES cycle.

25 ENERGY STORAGE↗

Application of Rank-Weight Methods to Blockchain Cybersecurity Vulnerability Assessment Framework

Cybersecurity vulnerability assessment tools, frameworks, and methodologies are used to understand the cybersecurity maturity of a system or a facility. However, these tools are strictly developed based on standards defined by organizations such as the National Institute of Standards and Technology (NIST) and the U.S. Department of Energy; the majority of these tools and frameworks do not provide a platform to prioritize the requirements to reach a desired cybersecurity maturity. To address that challenge, we have been developing a framework and software application called cybersecurity vulnerability mitigation framework through empirical paradigm (CyFEr). CyFEr treats the problem at hand as a multi-criteria decision analysis (MCDA) problem, which requires that various criteria be weighed relatively. Defining those weights is non-trivial and often leads to subjective decisions leading to undesired complications. To facilitate such a weighting system in CyFEr, we evaluated the application of various rank-weight methods (such as rank sum, reciprocal rank, rank exponent, and rank order centroid). The efficacy of those rank-weight methods was evaluated by applying them and testing against the blockchain cybersecurity framework (BC2F). BC2F was developed using the NIST cybersecurity framework to evaluate the cybersecurity posture of the blockchain nodes and networks in a given blockchain application or use-case. This paper provides 1) technical insights on the application of rank-weight methods to cybersecurity vulnerability assessments, 2) an overview of BC2F, 3) the application of rank-weight methods to BC2F, and 4) a depiction of the integration of the discussed rank-weight methods in CyFEr.

Gourisetti, Sri Nikhil G.↗

A Multi-Site Networked Hardware-in-Loop Platform for Evaluation of Interoperability and Distributed Intelligence at Grid-Edge

Electric power systems have experienced large increases in the number of intelligent, connected and controllable devices being deployed, leading to a high degree of distributed intelligence at the grid-edge. These devices, both utility-owned and consumer-owned, include but are not limited to: renewable generation sources, energy storage, remote switches, voltage regulators, and smart controllable loads such as electric vehicles. These new devices provide significant potential for increased operational flexibility that can be leveraged to achieve system reconfiguration, resiliency improvements, power quality improvements, and distribution system automation. However, there are two significant challenges that must be addressed before these assets can be leveraged for operations: interoperability and system level validation prior to deployment. Because of the complexity of distributed control systems, and their interactions with legacy centralized controls, a purely simulations-based approach for pre-deployment validation is not sufficient. It requires hardware-in-loop testing to emulate the operational hardware devices and evaluate their performance. Additionally, securely integrating multiple test facilities at utility operators and vendors might enable rapid scale-up of evaluation platforms, and remove the need for multiple expensive standalone installations. Presented in this paper, is the development of a multi-site evaluation platform that employs Advanced Distribution Management Systems (ADMS), distributed control devices, real-time hardware-in-loop assets, secure communication links, and protocol adapters. This platform uses standards-based approaches and open-source tools, and hence can serve as a template for other researchers and institutions to implement their multi-site evaluation frameworks for pre-deployment testing.

Essakiappan, Somasundaram↗

An accelerated framework for predicting creep rupture lifetimes in engineering alloys

Confidently predicting high-temperature deformation, including creep and creep rupture, is paramount for the design and commercialization of candidate materials for advanced nuclear energy systems. To accelerate creep quantification, we introduce a framework that enables rapid, cost-effective, and reliable prediction of creep rupture lifetimes, minimizing reliance on time-intensive bulk creep testing. Unlike conventional creep analysis, which requires extensive time and resources, our method leverages a maximum of four short-term bulk creep tests as training data for prediction. This framework combines high-throughput nanoindentation up to 700 °C with these targeted bulk tests to inform our creep rupture model in order to predict rupture lifetimes. The strong agreement between our predictions and conventional experimental data demonstrates the effectiveness of our approach for accelerated creep analysis and lifetime prediction of structural components in high-temperature applications. Our multi-pronged approach motivates further integration of computational tools and advanced instrumentation to establish a universal framework for understanding high-temperature material responses.

36 MATERIALS SCIENCE↗

Adaptive Waveform Correlation Detectors for Arrays: Algorithms for Autonomous Calibration

Waveform correlation detectors compare a signal template with successive windows of a continuous data stream and report a detection when the correlation coefficient, or some comparable detection statistic, exceeds a specified threshold. Since correlation detectors exploit the fine structure of the full waveform, they are exquisitely sensitive when compared to power (STA/LTA) detectors. The drawback of correlation detectors is that they require complete knowledge of the signal to be detected, which limits such methods to instances of seismicity in which a very similar signal has already been observed by every station used. Such instances include earthquake swarms, aftershock sequences, repeating industrial seismicity, and many other forms of controlled explosions. The reduction in the detection threshold is even greater when the techniques are applied to arrays since stacking can be performed on the individual channel correlation traces to achieve significant array gain. In previous years we have characterized the decrease in detection threshold afforded by correlation detection across an array or network when observations of a previous event provide an adequate template for signals from subsequent events located near the calibration event. Last year we examined two related issues: (1) the size of the source region calibration footprint afforded by a master event, and (2) the use of temporally incoherent detectors designed to detect the gross envelope structure of the signal to extend the footprint. In Case 1, results from the PETROBAR-1 marine refraction profile indicated that array correlation gain was usable at inter-source separations out to one or two wavelengths. In Case 2, we found that incoherent detectors developed from a magnitude 6 event near Svalbard were successful at detecting aftershocks where correlation detectors derived from individual aftershocks were not. Incoherent detectors might provide 'seed' events for correlation detectors that then could extend detection to lower magnitudes. This year we addressed a problem long known to limit the acceptance of correlation detectors in practice: the labor intensive development of templates. For example, existing design methods cannot keep pace with rapidly unfolding aftershock sequences. We successfully built and tested an object-oriented framework (as described in our 2005 proposal) for autonomous calibration of waveform correlation detectors for an array. The framework contains a dynamic list of detectors of several types operating on a continuous array data stream. The list has permanent detectors: beam forming power (STA/LTA) detectors which serve the purpose of detecting signals not yet characterized with a waveform template. The framework also contains an arbitrary number of subspace detectors which are launched automatically using the waveforms from validated power detections as templates. The implementation is very efficient such that the computational cost of adding subspace detectors was low. The framework contains a supervisor that oversees the validation of power detections, and periodically halts the processing to revise the portfolio of detectors. The process of revision consists of collecting the waveforms from all detections, performing cross-correlations pairwise among all waveforms, clustering the detections using correlations as a distance measure, then creating a new subspace detector from each cluster. The collection of new subspace detectors replaces the existing portfolio and processing of the data stream resumes. This elaborate scheme was implemented to prevent proliferation of closely-related subspace detectors. The method performed very well on several simple sequences: 2005 'drumbeat' events observed locally at Mt. St. Helens, and the 2003 Orinda, CA aftershock sequence. Our principal test entailed detection of the aftershocks of the San Simeon earthquake using the NVAR array; in this case, the system automatically detected and categorized approximately 2/3 of the events above magnitude 2.8.

58 GEOSCIENCES↗

A global database of nitrogen and phosphorus excretion rates of aquatic animals

Though their importance varies greatly among species and ecosystems, animals can be important in modulating ecosystem-level nutrient cycling. Nutrient cycling rates of individual animals represent valuable data for testing the predictions of important frameworks such as the Metabolic Theory of Ecology (MTE) and ecological stoichiometry (ES). They also represent an important set of functional traits that may reflect both environmental and phylogenetic influences. Over the past two decades, studies of animal-mediated nutrient cycling have increased dramatically, especially in aquatic ecosystems. Here we present a global compilation of aquatic animal nutrient excretion rates. The dataset includes 10,534 observations from freshwater and marine animals of N and/or P excretion rates. Furthermore, these observations represent 491 species, including most aquatic phyla. Coverage varies greatly among phyla and other taxonomic levels. The dataset includes information on animal body size, ambient temperature, taxonomic affiliations, and animal body N:P. We used this data set to test predictions of MTE and ES, as described in Vanni and McIntyre (2016; Ecology DOI: 10.1002/ecy.1582).

54 ENVIRONMENTAL SCIENCES↗

U.S. Nuclear Regulatory Commission Extremely Low Probability of Rupture pilot study : xLPR framework model user's guide.

For the U.S. Nuclear Regulatory Commission (NRC) Extremely Low Probability of Rupture (xLPR) pilot study, Sandia National Laboratories (SNL) was tasked to develop and evaluate a probabilistic framework using a commercial software package for Version 1.0 of the xLPR Code. Version 1.0 of the xLPR code is focused assessing the probability of rupture due to primary water stress corrosion cracking in dissimilar metal welds in pressurizer surge nozzles. Future versions of this framework will expand the capabilities to other cracking mechanisms, and other piping systems for both pressurized water reactors and boiling water reactors. The goal of the pilot study project is to plan the xLPR framework transition from Version 1.0 to Version 2.0; hence the initial Version 1.0 framework and code development will be used to define the requirements for Version 2.0. The software documented in this report has been developed and tested solely for this purpose. This framework and demonstration problem will be used to evaluate the commercial software's capabilities and applicability for use in creating the final version of the xLPR framework. This report details the design, system requirements, and the steps necessary to use the commercial-code based xLPR framework developed by SNL.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of a High Accuracy Angular Measurement System for Langley Research Center Hypersonic Wind Tunnel Facilities

Modern experimental and test activities demand innovative and adaptable procedures to maximize data content and quality while working within severely constrained budgetary and facility resource environments. This report describes development of a high accuracy angular measurement capability for NASA Langley Research Center hypersonic wind tunnel facilities to overcome these deficiencies. Specifically, utilization of micro-electro-mechanical sensors including accelerometers and gyros, coupled with software driven data acquisition hardware, integrated within a prototype measurement system, is considered. Development methodology addresses basic design requirements formulated from wind tunnel facility constraints and current operating procedures, as well as engineering and scientific test objectives. Description of the analytical framework governing relationships between time dependent multi-axis acceleration and angular rate sensor data and the desired three dimensional Eulerian angular state of the test model is given. Calibration procedures for identifying and estimating critical parameters in the sensor hardware is also addressed.

Newman, Brett↗

Determination of acoustic nonlinearity parameters using thermal modulation of ultrasonic waves

This study presents a test method and its theoretical framework to determine the acoustic nonlinearity parameters (α, β, δ) of material using thermal modulation of ultrasonic waves. Temperature change-induced thermal strain excites the nonlinear response of the material and modulates the ultrasonic wave propagating in it. Experimental results showed a strong correlation between the relative wave velocity change and the temperature change. With a quadratic polynomial model, the acoustic nonlinearity parameters were obtained from the polynomial coefficients by curve fitting the experimental data. Their effects on thermal-induced velocity change were discussed. The parameters α, β, and δ govern the hysteretic gap, average slope, and curvature of the correlation curve, respectively. The proposed theory was validated on aluminum, steel, intact and damaged concrete samples. The obtained nonlinear parameters show reasonable agreement with values reported in the literature. Compared to other nonlinear acoustic methods using vibration or acoustic excitation, the thermal modulation method generates more uniform, slow changing, and larger strain field in the test sample. Employing the thermal effect as the driving force for nonlinearity instead of an undesired influencing factor, this method can measure the absolute values of α, β, and δ with good accuracy using a simple ultrasonic test setup.

Physics↗