Search NASA⌕ Search

SEARCH · Search NASA

Results for “automated test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Statistical Tests for Diagnosing Fission Source Convergence and Undersampling in Monte Carlo Criticality Calculations [Slides]

There is a very strong need for statistical testing to determine fission source convergence in Monte Carlo criticality calculations. Automation of such tests will greatly streamline and support the work carried out by NCS practitioners. Recent R&D work has shown that no single statistical test for convergence is sufficiently reliable, robust, and “guaranteed.” However, a combination of several standard statistical tests for the similarity of distributions, coupled with a high-fidelity estimate of the fission-matrix source is sufficiently robust, reliable, and repeatable that convergence can be “guaranteed.” During the course of the EG-AMCT studies, a number of statistical metrics and tests were proposed for diagnosing clustering and undersampling. None of these was robust and reliable enough for practical use in production codes. However, the expert group efforts came close. Some recent R&D work stemming from those past efforts has been very successful and promising. This Sub-Group will provide international input and collaboration on the development and implementation of statistical tests for convergence, with the primary goal of having the MC codes automatically detect convergence (or lack thereof). Newly proposed statistical tests to detect undersampling (after convergence) will also be reviewed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Evaluation of Damage in Medium Voltage Cable Using Machine Learning

Developments in cable test instrumentation coupled with artificial intelligence and machine learning (ML) to aid in interpretation of cable test signals supports the feasibility for automated analysis of reflectometry tests for low voltage power cables. This work seeks to leverage prior ML work and success for low voltage cables to evaluate potential application to medium voltage (2kV to 10kV) installations. The Accelerated and Real-Time Environmental Nodal Assessment (ARENA) Cable Motor Test Bed at Pacific Northwest National Laboratory (PNNL) was used to test a medium voltage cable with several types of damage including thermal aging and low resistance conductor-to-shield faults. The cable was tested using an inductive clamshell coupler to protect the test instruments from the energized cable voltages that would damage the test instruments if coupled directly to the energized conductor.

42 ENGINEERING↗

Modernization efforts for the R -Matrix code SAMMY [Abstract]

The R-Matrix code SAMMY is a widely used nuclear data evaluation code focused on the resolved range, which includes corrections for experimental effects. The code is still mostly written in Fortran 77, and uses a memory management system suitable for the time of its initial writing (1984). A modernization effort is under way to bring the code in-line with modern software development practices. A continuous-integration testing framework was added, automating the large existing set of test cases. It is run on every commit. The memory management was updated to current standard practices suitable for modern software analysis tools. The code can be obtained from https://code.ornl.gov/RNSD/SAMMY. The resonance parameters and covariance information are now stored in C++ objects shared by SAMMY and AMPX, the processing code that generates nuclear data libraries for SCALE. This allows for easier maintenance and access to the resonance parameters inside and outside of SAMMY. This feature is already used by accessing and changing parameters in memory in the Bayesian Monte Carlo Evaluation Framework for Cross Sections Nuclear Data and Integral Benchmark Experiments project, Further plans include the switch to the ENDF reading and writing routines in AMPX, as these routines are more robust, easier to maintain, and support more features. Of note here is support for the new GNDS format. Previously it wasn’t easy to share the full covariance matrix for evaluations containing more than one isotope due to limitations on the ENDF format; this is now supported in GNDS. The data are currently available in a binary SAMMY format and can be exported to GNDS to make them more widely available and sharable. The next step will be to use the same resonance processing code at 0K in AMPX and SAMMY as one of the available Reich-Moore R-Matrix formalism. The first step toward this goal is to isolate the reconstruction into a module that takes resonance parameters as its input and does not depend on SAMMY global parameters. This goal has been achieved and it should now be possible to more easily change the resonance formalism and add enhancements as the Phenomenological R-Matrix parameterization of direct, doorway, and compound nuclear reactions discussed elsewhere on this conference. This concerted modernization and enhancement effort provides multiple advantages to the nuclear data community. It will allow parameter optimization using enhanced formalisms, including experimental effects, that better match complex experimental data. Then those evaluated parameters can immediately be passed off to AMPX to be reconstructed with the exact same cross section model and be put into a data library for subsequent testing using SCALE and the Valid Benchmark suite or other suitable benchmark suites.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Advanced control sequences and FDD technology. Just shiny objects, or ready for scale?

Innovations in commercial building control sequences (ASHRAE guideline 36) and fault detection and diagnostics (FDD) technology have the potential to transform existing building operational efficiency by realizing whole-building level savings on the order of 15% and higher. However, several technical and market barriers related to up-front estimation of achievable savings, verifying implementation, and ensuring persistence are slowing down their adoption as a core offering through diverse owner-funded initiatives and rate-payer funded programs. This paper describes a suite of solutions to overcome these barriers to program delivery of advanced HVAC controls integrated with FDD energy management and information system (EMIS) technology. First, the Guideline 36 conformance test offers an automated method to confirm correct sequence implementation by the manufacturer, before field deployment. A successful test of a controller was conducted using a new manufacturer-independent hardware-in-the-loop testbed demonstrating the viability and scalability of this approach. Second, the Guideline 36 energy savings calculator uses modeling paired with high-level user inputs to estimate building-specific savings potential, target cost effective implementation and minimize uncertainty. Initial results indicate the baseline control sequences significantly impact energy savings, however, as much as 50% savings may be possible for the worst-case baseline scenario. Third, a functional specification provides minimum recommended EMIS-FDD capabilities, and best practices to integrate the technology into organizational practice and ensure that advanced control sequences provide persistent savings.

Pritoni, Marco↗

An Overview of Gemma FY20 Verification Activities

Gemma verification activities for FY20 can be divided into three categories: the development of specialized quadrature rules, initial progress towards the development of manufactured solutions for code verification, and automated code-verification testing. In the method-of-moments implementation of the electric-field integral equation, the presence of a Green’s function in the four-dimensional integrals yields singularities in the integrand when two elements are nearby. To address these challenges, we have developed quadrature rules to integrate the functions through which the singularities can be characterized. Code verification is necessary to develop confidence in the implementation of the numerical methods in Gemma. Therefore, we have begun investigating the use of manufactured solutions to more thoroughly verify Gemma. Manufactured solutions provide greater flexibility for testing aspects of the code; however, the aforementioned singularities provide challenges, and existing work is limited in rigor and quantity. Finally, we have implemented automated code-verification testing using the VVTest framework to automate the mesh refinement and execution of a Gemma simulation to generate mesh convergence data. This infrastructure computes the observed order of accuracy from these data and compares it with the theoretical order of accuracy to either develop confidence in the implementation of the numerical methods or detect coding errors.

97 MATHEMATICS AND COMPUTING↗

Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation

This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

kiloAMPS (Final Report)

This project aims to reduce the testing time of various electrochemical techniques for neural interface electrodes by developing an automated PCB design which would be capable of testing multiple interface electrodes in parallel. The system should be able to perform the full battery of electrochemical tests, though electrochemical impedance spectroscopy (EIS) will be of primary interest. Previous versions of this project have already improved upon traditional interface testing by automating many parts of the process, reducing the test time to around a day and requiring the technician to check up on the process once every six hours. A key bottleneck is that the electrode testing is still done sequentially. Testing time could be heavily reduced if electrodes could be tested in parallel.

42 ENGINEERING↗

Microreactor Automated Control System - Digital Twin Models and Advanced Control Systems Updates

Automation of control systems is expected to be important in the economic and safe operation of microreactors. Therefore, there is a need to develop and demonstrate automated control for microreactors, along with the development of testbeds for this purpose. This report provides updates on the status of a nonnuclear microreactor automated control system (MACS)—a real-time, hardware-in-the-loop testbed for non-nuclear testing of microreactor control system automation. A real-time hardware-in-the-loop testbed incorporates the realistic dynamics of physical systems into control system development and testing. The collaborative effort between Oak Ridge National Laboratory (ORNL) and Idaho National Laboratory (INL) resulted in the development of a prototypic microreactor plant-level digital twin that includes the reactor and a balance of plant system. Advanced control strategies were incorporated to demonstrate testing of control automation solutions. The gRPC communication protocol, which was implemented in the hardware-in-the-loop testbed by INL, was coupled to a digital twin model developed using the TRANsient Simulation Framework of Reconfigurable Models (TRANSFORM) library in Modelica. This digital twin simulation was tested with the ViBRANT hardware for realistic feedback and visual representation of control action in real time. A modular Python client structure was developed to manage functional mock-up unit-based simulation and real-time gRPC communication. Hardware-in-the-loop testing indicated that the modeled reactor—a natural-convection, molten-salt coolant loop configuration—responds well to control of drum positioning for modulation of reactor core power, as well as system-level control and downstream demand changes. Ongoing research is focused on integrating additional control algorithms that utilize data from newly included sensors within the MACS hardware testbed, as well as demonstrating and assessing the performance of the different automated control algorithms on multiple additional operational scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bio-fuel effects and seasonal fuel property variations related to abnormal combustion occurrences observed in the field

Since 2015, the automotive industry has regularly observed sharp increases in customer complaints of poor driveability and increased warranty claims during the months of September and October. These persistent seasonal complaint increases have been tracked to occur from increased abnormal combustion events that coincide with the seasonal transition from summer to winter fuel volatility, beginning on September 15th annually. The Reid Vapor Pressure (RVP) of gasoline during this seasonal transition has been found to be the primary property attributed to this annual issue. It’s hypothesized that an increase in volatile butanes and pentanes from advanced petroleum recovery techniques and hydrofracking production has hastened the transition from summer to winter fuel volatility in the marketplace, rather than the gradual increase of the RVP over time as historically intended. At worst, mid-winter fuel, with an RVP ranging from 12 to 16 psi, depending on location in the U.S., enters the market while ambient temperatures can still be above average for the winter season. This combination of high volatility fuel with unseasonably warm weather will increase fuel system flash boiling, injector spray cavitation, and spray collapse inside the engine’s combustion chamber, ultimately linking fuel property variations to abnormal engine combustion processes. This CRADA program will investigate these known knowledge gaps by coupling with two national laboratories, Oak Ridge National Laboratory, and the National Renewable Energy Laboratory to employ both unique tools and expertise throughout the industry to provide the insight, knowledge, and data critical to understand the observed interactions. Overall findings of this work are that fuel wall retention increased SPI proportionally, and fuels with an increased distillation (i.e. energy fraction) above the wall temperature increased fuel retention. Likewise fuels with increased enthalpy of vaporization (HoV) increased fuel retention proportional to the temperature reduction from the HoV (~13K reduction in this work). Thus, fuel with increased HoV and increased fuel distillation above the linear temperature also exhibited increased SPI rates. Fuel with high RVP did exhibit increased fuel spray collapse form spray imaging measurements, but in SPI testing the high volatility of these fuels at the tested conditions did not necessarily increase SPI rates despite exhibiting increased spray collapse in injector imaging and increased spray-wall impingement measured in fired engine testing. It was also found that spray imaging showed collapse was possible at throttled conditions, but this was not relevant to high boost pressures relevant to SPI conditions, however, under transient load and or speed encountered in real-world operation fuel spray collapse could affect fuel retention and real-world SPI that were not probed in the automated high load test sequence of this work.

09 BIOMASS FUELS↗

Unified architecture for data-driven metadata tagging of building automation systems

This article presents a Unified Architecture (UA) for automated point tagging of Building Automation System (BAS) data, based on a combination of data-driven approaches. Advanced energy analytics applications—including fault detection and diagnostics and supervisory control—have emerged as a significant opportunity for improving the performance of our built environment. Effective application of these analytics depends on harnessing structured data from the various building control and monitoring systems, but typical BAS implementations do not employ any standardized metadata schema. While standards such as Project Haystack and Brick Schema have been developed to address this issue, the process of structuring the data, i.e., tagging the points to apply a standard metadata schema, has, to date, been a manual process. This process is typically costly, labor-intensive, and error-prone. In this work we address this gap by proposing a UA that automates the process of point tagging by leveraging the data accessible through connection to the BAS, including time-series data and the raw point names. The UA intertwines supervised classification and unsupervised clustering techniques from machine learning and leverages both their deterministic and probabilistic outputs to inform the point tagging process. Furthermore, we extend the UA to embed additional input and output data-processing modules that are designed to address the challenges associated with the real-time deployment of this automation solution. We test the UA on two datasets for real-life buildings: (i) commercial retail buildings and (ii) office buildings from the National Renewable Energy Laboratory (NREL) campus. We report the proposed methodology correctly applied 85–90% and 70–75% of the tags in each of these test scenarios, respectively for two significantly different building types used for testing UA's fully-functional prototype. The proposed UA, therefore, offers promising approach for automatically tagging BAS data as it reaches close to 90% accuracy. Further building upon this framework to algorithmically identify the equipment type and their relationships is an apt future research direction to pursue.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Concrete Structure Health Monitoring Using Vibro-acoustic Testing and Machine Learning

Assessment and management of aging concrete structures in nuclear power plants require a more systematic approach than simple reliance on margins of safety in existing codes. Research is required to deploy online monitoring capability to assess the health of concrete structures in nuclear power plants and perform predictive analytics based on heterogeneous measurements, in order to reduce the operation and maintenance costs. The research effort described in this report focuses on the health monitoring of concrete slabs containing reactive aggregates using the vibro-acoustic modulation (VAM) technique and predictive modeling. The research is developing an approach to enable detection, localization, and estimation of the extent of degradation in concrete slabs due to alkali-silica reaction (ASR). The project outcomes are generic and extendable to other degradation modes in concrete. A concrete slab without reinforcements was cast at Vanderbilt University and cured in aggressive conditions to accelerate ASR degradation. In this report, we develop a methodology for the automation of VAM testing, and the construction of machine learning models to facilitate damage localization in concrete structures. We investigate how machine learning models based on physics simulation data can be effectively utilized for damage localization (damage location and depth) and estimation in a concrete slab specimen. Our study indicates that these models could potentially support damage localization and estimation for NPP structures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Adrastea: An Efficient FPGA Design Environment for Heterogeneous Scientific Computing and Machine Learning

We present Adrastea, an efficient FPGA design environment for developing scientific machine learning applications. FPGA development is challenging, from deployment, proper toolchain setup, programming methods, interfacing FPGA kernels, and more importantly, the need to explore design space choices to get the best performance and area usage from the FPGA kernel design. Adrastea provides an automated and scalable design flow to parameterize, implement, and optimize complex FPGA kernels and associated interfaces. We show how virtualization of the development environment via virtual machines is leveraged to simplify the setup of the FPGA toolchain while deploying the FPGA boards and while scaling up the automated design space exploration to leverage multiple machines concurrently. Adrastea provides an automated build and test environment of FPGA kernels. By exposing design space hyper-parameters, Adrastea can automatically search the design space in parallel to optimize the FPGA design for a given metric, usually performance or area. Adrastea simplifies the task of interfacing with the FPGA kernels with a simplified interface API. To demonstrate the capabilities of Adrastea, we implement a complex random forest machine learning kernel with 10,000 input features while achieving extremely low computing latency without loss of prediction accuracy, which is required by a scientific edge application at SNS. We also demonstrate Adrastea using an FFT kernel and show that for both applications Adrastea is able to systematically and efficiently evaluate different design options, which reduced the time and effort required to develop the kernel from months of manual work to days of automatic builds.

Young, Aaron↗

Development and testing of a continuous maritime monitor for radionuclide aerosols

Monitoring airborne concentrations of radionuclide activity may provide a timely warning to sea-based assets to avoid contamination from a radioactive plume. The development and testing of an automated aerosol monitoring system that can capture and detect radioactive particulate from marine air is presented. A custom electrostatic precipitator (ESP) was designed to capture particulate onto a reusable collection media. The collection efficiency of the ESP system for radon progeny was determined to be ~23%. A conservative calculation of the minimum detectable concentration of 214 Bi was estimated as 0.3-8 Bq/m 3 . The system was demonstrated in continuous operation, without consumables and limited maintenance, in a marine environment at the PNNL campus in Sequim, Washington. In conclusion, a successful 2-month deployment indicates the feasibility of the approach for continuous maritime monitoring for radionuclide aerosols.

Moore, Michael E. [Pacific Northwest National Labo↗

Continuous Integration, In-Code Documentation, and Automation for Nuclear Quality Assurance Conformance

The Multiphysics Object Oriented Simulation Environment (MOOSE) is an open-source, finite element framework for solving highly coupled sets of nonlinear equations. The development of the framework and applications occurs concurrently using an agile, continuous-integration software package. Included in the framework is an in-code, extensible documentation system. Using these two tools in union with the repository management tools GitHub and GitLab, a software quality plan was created and followed such that MOOSE and a MOOSE-based application (BISON) have been shown to meet the American Society of Mechanical Engineers’ Nuclear Quality Assurance-1 standard. The approach relies heavily on automation for both testing and documentation. The resulting effort demonstrates that a rigorous software quality plan may be implemented that incurs a minimal impact on day-to-day development of the software, satisfying the stringent guidelines necessary to operate the software in a safety function within a nuclear facility.

97 MATHEMATICS AND COMPUTING↗

Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm

Abstract We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a material’s composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm—namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10 4 or greater data points. We encourage evaluating materials ML algorithms on the Matbench benchmark and comparing them against the latest version of Automatminer.

36 MATERIALS SCIENCE↗

Automated Redox Titrations via Interdigitated Electrode Arrays: Application to the Mediated Electron Transfer Interrogation of Charge and Rate on Electrodeposited Polymers

Mediated electron transfer (MET) plays a crucial role in energy storage and conversion technologies such as redox targeting flow batteries (RTFBs), yet its experimental investigation often requires labor-intensive and low-throughput setups. To address this, we developed a microfabricated interdigitated electrode array (IDA) platform that enables automated, high-throughput electrochemical redox titration measurement to be performed to study the MET process. Our redox titration method enables simultaneous measurement of the charge capacity and rate of MET processes on a material or surface. Automated redox titration (ART) facilitates systematic investigation of the MET process across a broad parameter space, exemplified through the study of polypyrrole (PPy) and a pyrene-4,5,9,10-tetrone azo group-based polymer (PTAP), both redox-active polymers relevant to various energy storage applications. Using PPy as a model material, 500 redox titration measurements were conducted within 50 h, varying the electrode gap widths, polymer charging potentials, voltammetric scan rates, and electrolyte concentrations. Finite-element simulations confirmed the electrochemical responses and elucidated the kinetics of the MET reactions. Our automated methodology was further tested with PTAP, revealing a surprising charging potential dependence on the rate of MET. The automation, flexibility, and scalability of our redox titration platform pave the way not only for advanced studies of MET processes relevant to RTFBs, but also with implications in the understanding of next-generation energy storage materials, molecular electrocatalysis, and biosensing.

electrochemical analysis↗