Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Test case selection procedure for simulation-assisted automation testing - 321

Simulation-assisted automation testing is an efficient tool for validating the automation systems for nuclear power plants. This paper presented a systematic procedure for selecting test cases for simulation-assisted automation testing. The procedure is relies on the plant's licensing framework and allows associating the test cases to the functional requirements in order to produce traceable test set for validation. The procedure is demonstrated with a case study concerning the automation tests of Loviisa NPP's automation renewal project. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Activate/Inhibit KGCS Gateway via Master Console EIC Pad-B Display

My internship consisted of two major projects for the Launch Control System.The purpose of the first project was to implement the Application Control Language (ACL) to Activate Data Acquisition (ADA) and to Inhibit Data Acquisition (IDA) the Kennedy Ground Control Sub-Systems (KGCS) Gateway, to update existing Pad-B End Item Control (EIC) Display to program the ADA and IDA buttons with new ACL, and to test and release the ACL Display.The second project consisted of unit testing all of the Application Services Framework (ASF) by March 21st. The XmlFileReader was unit tested and reached 100 coverage. The XmlFileReader class is used to grab information from XML files and use them to initialize elements in the other framework elements by using the Xerces C++ XML Parser; which is open source commercial off the shelf software. The ScriptThread was also tested. ScriptThread manages the creation and activation of script threads. A large amount of the time was used in initializing the environment and learning how to set up unit tests and getting familiar with the specific segments of the project that were assigned to us.

Computer Programming↗

Xenon Recovery at Room Temperature using Metal-Organic Frameworks

Xenon is known to be a very efficient anesthetic gas but its cost prohibits the wider use in medical industry and other potential applications. It has been shown that Xe recovery and recycle from anesthetic gas mixture can significantly reduce its cost as anesthetic. The current technology uses series of adsorbent columns followed by low temperature distillation to recover Xe, which is expensive to use in medical facilities. Herein, we propose much efficient and simpler system to recover and recycle Xe from simulant exhale anesthetic gas mixture at room temperature using metal organic frameworks. Among the MOFs tested, PCN-12 exhibits unprecedented performance with high Xe capacity, Xe/N2 and Xe/O2 selectivity at room temperature. The in-situ synchrotron measurements suggest the Xe is occupied in the small pockets of PCN-12 compared to unsaturated metal centers (UMCs). Computational modeling of adsorption further supports our experimental observation of Xe binding sites in PCN-12.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Practical water production from desert air

Energy-efficient production of water from desert air has not been developed. A proof-of-concept device for harvesting water at low relative humidity was reported; however, it used external cooling and was not desert-tested. We report a laboratory-to-desert experiment where a prototype using up to 1.2 kg of metal-organic framework (MOF)–801 was tested in the laboratory and later in the desert of Arizona, USA. It produced 100 g of water per kilogram of MOF-801 per day-and-night cycle, using only natural cooling and ambient sunlight as a source of energy. We also report an aluminum-based MOF-303, which delivers more than twice the amount of water. The desert experiment uncovered key parameters pertaining to the energy, material, and air requirements for efficient production of water from desert air, even at a subzero dew point.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fortran Compiler Test Suite v0.1.0

There is no currently available, open-source, easily adapted test suite for checking a compiler's conformance to the Fortran Standard. The main innovation of this software is in the framework to make the test suite apply to a new compiler. Making it open-source will enable community contributions of the test cases. Single organization construction of a comprehensive test suite is something that would be financially infeasible.

Richardson, Bradley↗

Selecting representative geological realizations to model subsurface CO 2 storage under uncertainty

Carbon capture and storage (CCS) is one of the quickest and most effective solutions for reducing carbon emissions. The majority of subsurface storage occurs in saline aquifers, for which geological information is lacking which in turn results in geological uncertainty. To evaluate uncertainty in CO 2 injection projections, the use of multiple geological realizations (GRs) has been practiced very commonly. In this approach, hundreds or thousands of high-resolution GRs is used that quickly becomes computationally expensive. This issue can be addressed with representative geological realizations (RGRs) that preserve the uncertainty domain of the ensemble GRs. Here, in this study, we propose the use of unsupervised machine learning (UML) frameworks, including dissimilarity measurement, dimensionality reduction, clustering and sampling algorithms ta select a predetermined number of RGRs. We compare the simulation outputs of the RGR sets and the ensemble using the Kolmogorov–Smirnov (KS) test to select the best UML. The UML frameworks and their associated selection processes are evaluated using a saline aquifer with a single CO 2 injection well and 200 GRs with varying uncertain petrophysical characteristics. The best UML framework is selected to use only 5% of the GRs while maintaining the uncertainty domain of the ensemble GRs. In addition, the best UML framework is tested using a saline aquifer with three CO 2 injection wells and varied GRs. The results show that our proposed UML framework can be used to choose RGRs, capturing the whole uncertainty domain. Our approach leads to a significant reduction in the computational cost associated with scenario testing, decision-making, and development planning for CO 2 storage sites under geological uncertainty.

58 GEOSCIENCES↗

Disturbance triggers non-linear microbe–environment feedbacks

Abstract. Conceptual frameworks linking microbial community membership, properties, and processes with the environment and emergent function have been proposed but remain untested. Here we refine and test a recent conceptual framework using hyporheic zone sediments exposed to wetting–drying transitions. Our refined framework includes relationships between cumulative properties of a microbial community (e.g., microbial membership, community assembly properties, and biogeochemical rates), environmental features (e.g., organic matter thermodynamics), and emergent ecosystem function. Our primary aim was to evaluate the hypothesized relationships that comprise the conceptual framework and contrast outcomes from the whole and putatively active bacterial and archaeal communities. Throughout the system we found threshold-like responses to the duration of desiccation. Membership of the putatively active community – but not the whole bacterial and archaeal community – responded due to enhanced deterministic selection (an emergent community property). Concurrently, the thermodynamic properties of organic matter (OM) became less favorable for oxidation (an environmental component), and respiration decreased (a microbial process). While these responses were step functions of desiccation, we found that in deterministically assembled active communities, respiration was lower and thermodynamic properties of OM were less favorable. Placing the results in context of our conceptual framework points to previously unrecognized internal feedbacks that are initiated by disturbance and mediated by thermodynamics and that cause the impacts of disturbance to be dependent on the history of disturbance.

59 BASIC BIOLOGICAL SCIENCES↗

A note on minimizing time assurance tests for repairable systems

We consider assurance testing for repairable systems when supplementary information is available in addition to the data collected in the assurance test. Here, the supplementary information is incorporated using a Bayesian inferential framework. Here we consider assurance testing for a homogeneous Poisson process. In this note we consider an alternative criterion that minimizes the test time while ensuring that the requirements on the producer's and consumer's risks are met. We illustrate the use of this alternative criterion with an example.

42 ENGINEERING↗

Inexpensive Multirotor Platform for Advanced Controls Testing (IMPACT): Development, Integration, and Experimentation

A comprehensive framework was explored and validated for rapid deployment and testing of custom flight control logic using the Inexpensive Multirotor Platform for Advanced Controls Testing (IMPACT). This vehicle facilitated the efficient validation and refinement of a custom flight control algorithm, which was designed using Simulink and deployed onto a Pixhawk flight computer running PX4 firmware through the utilization of the MathWorks UAV Toolbox. The robust and cost-effective design of IMPACT provides the groundwork for future flight testing of flight controls and model development research for electric vertical takeoff and landing (eVTOL) aircraft.

flight testing↗

Benchmarking and performance analysis of the CM-2

A suite of benchmarking routines testing communication, basic arithmetic operations, and selected kernel algorithms written in LISP and PARIS was developed for the CM-2. Experiment runs are automated via a software framework that sequences individual tests, allowing for unattended overnight operation. Multiple measurements are made and treated statistically to generate well-characterized results from the noisy values given by cm:time. The results obtained provide a comparison with similar, but less extensive, testing done on a CM-1. Tests were chosen to aid the algorithmist in constructing fast, efficient, and correct code on the CM-2, as well as gain insight into what performance criteria are needed when evaluating parallel processing machines.

Myers, David W.↗

The Modern Design of Experiments: A Technical and Marketing Framework

A new wind tunnel testing process under development at NASA Langley Research Center, called Modern Design of Experiments (MDOE), differs from conventional wind tunnel testing techniques on a number of levels. Chief among these is that MDOE focuses on the generation of adequate prediction models rather than high-volume data collection. Some cultural issues attached to this and other distinctions between MDOE and conventional wind tunnel testing are addressed in this paper.

DeLoach, R.↗

DEReliction: A Cybersecurity Vulnerability Assessment Methodology for Distributed Energy Resources

With the increasing integration of Distributed Energy Resources (DER) into the electric grid, maintaining grid reliability and resilience requires that these devices remain secure. This paper discusses a cybersecurity vulnerability assessment methodology that incorporates best practices from Sandia National Laboratories, SANS Institute, OWASP Foundation, and other web and Internet of Things (IoT) penetration testing (“pen testing”) programs, courses, and frameworks for assessing the security posture of devices. The methodology involves five sequential steps: (1) Collect Public Information, (2) Extract Hardware Details, (3) Inventory Software Components, (4) Identify Vulnerabilities, and (5) Test Vulnerabilities. Each step uncovers potential weaknesses in both hardware and software components of DER devices, considering adversary tactics, techniques, and procedures (TTPs), and potential attack vectors along the way. The results from the execution of this method on multiple residential- and small commercial-scale photovoltaic (PV) inverters reveled hardware and software vulnerabilities, which highlight the benefit of taking a methodical approach to discover vulnerabilities. While the specific vulnerability details are not shared here, a generalized overview of findings underscore the importance of robust security assessments for DER devices. Adoption of an assessment framework of this kind will identify and mitigate cybersecurity threats and bolster the resilience of DER-integrated electric grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

RAVEN regression tests' description

Regression tests for the Python RAVEN framework are found in raven/tests/framework. There is a hierarchy of folders with tests collected by similar testing. Every test is described in a special XML node (< TestInfo >) within the < Simulation > block.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

EPICS Deployment at Fermilab

Fermilab has traditionally not been an EPICS house, as such expertise in EPICS is limited and scattered. However, PIP-II will be using EPICS for its control system. Furthermore, when PIP-II is operating, it must to interface with the existing, though modernized (see ACORN) legacy control system. We have developed and deployed a software pipeline that addresses these needs and presents to developers a tested and robust software framework, including template IOCs from which new developers can quickly gain experience. In this presentation, we will discuss the motivation for this work, the implementation of a continuous integration/continuous deployment pipeline, testing, template IOCs, and the deployment of user applications. We will also discuss how this is used with the current PIP-II teststand and lessons learned.

43 PARTICLE ACCELERATORS↗

Development of Parallel Computing Framework to Enhance Radiation Transport Code Capabilities for Rare Isotope Beam Facility Design

A parallel computing framework has been developed to use with general-purpose radiation transport codes. The framework was implemented as a C++ module that uses MPI for message passing. It is intended to be used with older radiation transport codes implemented in Fortran77, Fortran 90 or C. The module is significantly independent of radiation transport codes it can be used with, and is connected to the codes by means of a number of interface functions. The framework was developed and tested in conjunction with the MARS15 code. It is possible to use it with other codes such as PHITS, FLUKA and MCNP after certain adjustments. Besides the parallel computing functionality, the framework offers a checkpoint facility that allows restarting calculations with a saved checkpoint file. The checkpoint facility can be used in single process calculations as well as in the parallel regime. The framework corrects some of the known problems with the scheduling and load balancing found in the original implementations of the parallel computing functionality in MARS15 and PHITS. The framework can be used efficiently on homogeneous systems and networks of workstations, where the interference from the other users is possible.

43 PARTICLE ACCELERATORS↗

Benchmarking Microscale Ductility Measurements (Final Report of the Project DE-NE0008799)

Conventional macroscale experimentation is generally considered to be straightforward with few limitations. Conversely, micro/nanoscale experimentation presents numerous challenges in loading device design, sample preparation and handling, as well as accurate understanding of grain size and local texture effects on recorded measurements. Despite these challenges, nanopillar compression, MEMs based micro-tension, and nanoindentation approaches have been able to provide fundamental contributions to the understanding of material behavior at small lengthscales. However, the overarching shortcoming of these micro/nanoscale experimentation approaches, is the inability to directly translate measurements evaluated at the nm and µm length scales (e.g., hardness) to macroscale tensile material behavior (i.e., elastic modulus, yield strength, and ductility). The objectives of the proposed study are, 1) to establish best practices for obtaining tensile microscale ductility measurements, and 2) to validate methodologies to for comparing microscale ductility measurements to macroscale ductility measurements. In order to achieve these objectives, a multi-lengthscale, multi-temperature testing protocol and simulation framework are executed first on copper as a model material to validate the following approach, and second on reactor grade Zircaloy-2. Experiments are conducted on specimens extracted from the same test piece to ensure nominally identical grain size and texture from specimens to specimen. Motivated by the need to isolate the contribution of size-effects on obtained mechanical property measurements, specimens are manufactured with thicknesses at the micro- (1-10 µm), meso- (10-100's µm), and macroscales (sub-sized ASTM E8). In-situ full-field deformation techniques (scanning electron microscopy (SEM) grid methods and optical DIC) are incorporated into testing at each specimen length-scale to capture plasticity localization and evolution. Experimental testing for all specimens is conducted at both room temperature and elevated temperatures to probe the role of thermal activation on plastic deformation accommodation processes. Simulation efforts focus on examining the mechanical behavior of microscale specimens using a finite element approach with explicitly resolved grain morphologies, and an embedded crystal plasticity model. The cost-efficient implementation method allows for the modeling of a statistically significant number of both real (i.e., digital twin) and generated microstructures to obtain an understanding of the interrelationships between specimen microstructure and geometric variables (grain size, texture, specimen geometry, etc.) on microscale mechanical behavior.

36 MATERIALS SCIENCE↗

Model-based, in-situ, non-destructive qualification and certification of parts made by autonomous additive manufacturing

To address the significant productivity challenges associated with the qualification and certification (Q&C) tasks of additively manufactured (AM) parts, which have traditionally relied on rigorous post‐build inspection and testing, we propose an integrated framework that combines model‐based qualification and certification (MBQ&C) with autonomous additive manufacturing (AAM). MBQ&C employs high‐fidelity predictive models, developed within the Integrated Computational Materials Engineering (ICME) paradigm, to simulate process–structure–property–performance relationships for assessing a part’s fitness for use. Since predictive models are commonly machine learning (ML)-based or reduced-order surrogates of validated physics models, they run efficiently, enabling timely inference. In parallel, the self-driving AAM utilises ML-based adaptive, closed‐loop control strategies to avoid, mitigate, or repair defects and anomalies during fabrication, thereby increasing the likelihood of producing acceptable parts. A key feature of the combined AAM-MBQ&C framework is that predictive models explicitly incorporate defects or anomalies that persist after the build, using instance-specific data captured via in-situ sensing. This customisation enables a build‐specific assessment of fitness for use, rather than relying on nominal or generic parameters. Such individualised evaluation provides a robust basis for Q&C-related acceptance decisions relating to each build. Additionally, the rapid solution capabilities of ML or reduced-order models enable the determination of a part’s suitability for service shortly after build completion. As the framework matures, it has the potential to substantially reduce reliance on conventional point‐design approaches—such as time‐consuming post‐build computed tomography scanning and costly destructive testing. Thus, the AAM-MBQ&C framework represents a transformative, scalable strategy for quality assurance of AM components, as parts produced within a stable, validated, and certified envelope can be certified with reduced testing. Key benefits include: (1) significant gains in Q&C productivity through efficient, model-centric assessment; (2) performance-based classification of defects into critical and non-critical categories; (3) the ability to predict potential deviations in the performance of parts affected by real-time, adaptive process control interventions relative to those produced under a certified process, and (4) the enabling of virtual Q&C for service environments that are difficult, hazardous, or impractical to access or reproduce experimentally. Collectively, these capabilities strengthen the business case for AM, particularly for high‐consequence and mission‐critical applications. Finally, although this work focuses on powder-based AM, the proposed techniques could be extended to AM processes employing alternative feedstock forms.

Gunasegaram, Dayalan↗

Cyber threat assessment of machine learning driven autonomous control systems of nuclear power plants

We report advanced cyber-attacks against critical infrastructure and the energy sector are becoming more common. With the invention of autonomous control systems (ACS) within advanced nuclear reactor designs, system designers, reactor operators, and regulators must consider cybersecurity during the design and operational phases. This article provides a cyber threat assessment of machine learning (ML)-based digital twinning (DT) technologies in the context of advanced reactor ACS. A cyber–physical testbed was created to emulate nuclear reactor digital instrumentation and controls (I&C) and act as a basis for the ACS. The ACS was designed as two plant-level DTs predicting reactor malfunctions and determining control actions and two component-level DTs responsible for classifying component states and forecasting component inputs and outputs (I/O). Two duplicate ACS designs– one using a traditional ML framework and one using an automated ML (AutoML) framework– were created and tested against cyber-attacks on training data, real-time process data, and ML model architectures to determine their respective qualitative cyber-risk in terms of likelihood and impact. Both frameworks showed similar cyber-resilience against training, real-time, and ML architecture attacks, proving that neither is inherently more secure. Recommended safeguard and security measures are posed to system designers, reactor operators, and regulators to maintain the cybersecurity of ML-based DT technologies such as ACS, prompting a holistic view of shared responsibility for maintaining cyber-secure ML-based systems.

99 GENERAL AND MISCELLANEOUS↗