Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

LISA Framework for Enhancing Gravitational Wave Signal Extraction Techniques

This paper describes the development of a Framework for benchmarking and comparing signal-extraction and noise-interference-removal methods that are applicable to interferometric Gravitational Wave detector systems. The primary use is towards comparing signal and noise extraction techniques at LISA frequencies from multiple (possibly confused) ,gravitational wave sources. The Framework includes extensive hybrid learning/classification algorithms, as well as post-processing regularization methods, and is based on a unique plug-and-play (component) architecture. Published methods for signal extraction and interference removal at LISA Frequencies are being encoded, as well as multiple source noise models, so that the stiffness of GW Sensitivity Space can be explored under each combination of methods. Furthermore, synthetic datasets and source models can be created and imported into the Framework, and specific degraded numerical experiments can be run to test the flexibility of the analysis methods. The Framework also supports use of full current LISA Testbeds, Synthetic data systems, and Simulators already in existence through plug-ins and wrappers, thus preserving those legacy codes and systems in tact. Because of the component-based architecture, all selected procedures can be registered or de-registered at run-time, and are completely reusable, reconfigurable, and modular.

Thompson, David E.↗

Data Curation for Machine Learning Applied to Geothermal Power Plant Operational Data for GOOML: Geothermal Operational Optimization with Machine Learning: Preprint

Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach to physics-guided, data-centric machine learning. This framework has been used to develop digital twins that provide steamfield operators with operational environments to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management in real world applications. To create, test, and apply the GOOML framework, diverse time-series datasets spanning multiple years were sourced from various geothermal power plant components within several complex real-world geothermal operations. These operations are based in the United States and New Zealand and include a variety of technologies, end-uses and configurations, collectively covering nearly all relevant operating conditions for modern geothermal fields. Datasets were acquired from multiple sources to ensure that machine learning experiments generalized properly to various operating conditions. It was found that the data varied in quality, format, and completeness. To ensure consistency between the various datasets, a standardized data curation process was developed to reliably streamline data preparation. This paper will discuss best practices as learned from the GOOML data curation process which takes the following steps: 1) acquisition of large quantities of data from power plant operators, 2) digestion of data to gain an initial understanding of what is included, 3) data transformation, which includes converting the data into a standardized machine-readable format so that they can be visualized, quality checked, and cleaned, 4) quality assurance and quality control, involving identification of significant data gaps and apparent anomalies through mapping of data features to real world componentry via the GOOML historical model, followed by discussion with modelers and power plant operators to identify additional data needs and to resolve issues, 5) use in machine learning algorithms, and 6) repetition of steps one through five until all data needs are met and data are deemed suitable for producing trustworthy modeling results which may be disseminated, ideally along with the curated dataset. This iterative process is focused on improving the quality of the data rather than tuning machine learning model parameters and supports a shift towards data-centric AI as a means to improving real-world applicability of geothermal machine learning projects.

access↗

Improved Verification and Validation Testing and Tools [Slides]

All MCNP team supported V&V test suites are now developed in a separate repository from the MCNP source code within a Python-based framework. This entire framework will be distributed with the upcoming MCNP6.3 release. Most V&V test suites distributed with MCNP6.2 will be distributed in new framework. New V&V test suites are done or being worked on for the MCNP6.3 release.

97 MATHEMATICS AND COMPUTING↗

Towards automated and real-time multi-object detection of anguilliform fishes from sonar data using YOLOv8 deep learning algorithm

Eels (Anguilla spp.), including American eels (Anguilla rostrata), European eels (Anguilla anguilla), and Japanese eels (Anguilla japonica), are species of critical management and regulatory concern due to their vulnerability to various stressors during downstream migrations. Accurate and efficient detection of migrating eels can improve our understanding of fish behaviors and fish-hydraulic structure interactions, thereby facilitating the design, operation, and optimization of more effective downstream passage facilities from both biological and economic perspectives. However, a real-time, automated framework for detecting migrating eels in real-world applications is currently lacking. Leveraging imaging sonar as a reliable technology for fish passage monitoring, field data are acquired using imaging sonar and then converted to single sonar frames/images for subsequent analysis. In this study, a framework based on the You Only Look Once Version 8 (YOLOv8)-based convolutional neural network is proposed for multi-object detection of eels and non-eel fish using the sonar images after image subtraction and additional wavelet denoising. The results from both training and testing phases demonstrate that the framework's ability can successfully detect both eels and non-eel fish in preprocessed sonar images, achieving F1-scores and mAP@0.50 exceeding 0.84. Additionally, the incorporation of wavelet denoising during preprocessing slightly improve detection performance. Furthermore, the transferability of this framework from eel to lamprey detection is demonstrated to be feasible given the similar morphological characteristics of these two species. Overall, the proposed framework achieves accurate and efficient detection of migrating eels, providing reliable and real-time information that can help conserve vulnerable eel and eel-like populations.

Deep learning↗

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗

A Framework to Debug Diagnostic Matrices

Diagnostics is an important concept in system health and monitoring of space operations. Many of the existing diagnostic algorithms utilize system knowledge in the form of diagnostic matrix (D-matrix, also popularly known as diagnostic dictionary, fault signature matrix or reachability matrix) gleaned from physical models. But, sometimes, this may not be coherent to obtain high diagnostic performance. In such a case, it is important to modify this D-matrix based on knowledge obtained from other sources such as time-series data stream (simulated or maintenance data) within the context of a framework that includes the diagnostic/inference algorithm. A systematic and sequential update procedure, diagnostic modeling evaluator (DME) is proposed to modify D-matrix and wrapper logic considering least expensive solution first. This iterative procedure includes conditions ranging from modifying 0s and 1s in the matrix, or adding/removing the rows (failure sources) columns (tests). We will experiment this framework on datasets from DX challenge 2009.

Model-based↗

Development of the CELSS emulator at NASA. Johnson Space Center

The Closed Ecological Life Support System (CELSS) Emulator is under development. It will be used to investigate computer simulations of integrated CELSS operations involving humans, plants, and process machinery. Described here is Version 1.0 of the CELSS Emulator that was initiated in 1988 on the Johnson Space Center (JSC) Multi Purpose Applications Console Test Bed as the simulation framework. The run model of the simulation system now contains a CELSS model called BLSS. The CELSS simulator empowers us to generate model data sets, store libraries of results for further analysis, and also display plots of model variables as a function of time. The progress of the project is presented with sample test runs and simulation display pages.

Cullingford, Hatice S.↗

Development of the CELSS Emulator at NASA JSC

The Controlled Ecological Life Support System (CELSS) Emulator is under development at the NASA Johnson Space Center (JSC) with the purpose to investigate computer simulations of integrated CELSS operations involving humans, plants, and process machinery. This paper describes Version 1.0 of the CELSS Emulator that was initiated in 1988 on the JSC Multi Purpose Applications Console Test Bed as the simulation framework. The run module of the simulation system now contains a CELSS model called BLSS. The CELSS Emulator makes it possible to generate model data sets, store libraries of results for further analysis, and also display plots of model variables as a function of time. The progress of the project is presented with sample test runs and simulation display pages.

Cullingford, Hatice S.↗

Characterizing the Electromagnetic Response of the NOvA Detectors

The NOvA Test Beam Program was commissioned to complement the full-scale NOvA experiment in its goal of measuring neutrino oscillations. The NOvA Experiment consists of a 300-ton Near Detector and a 14-kton Far Detector, both exposed to the same beam, which can be operated in neutrino or antineutrino mode from Fermilab at an off-axis angle of 14.6~mrad. These detectors can discriminate between $\nu_\mu$-CC and $\nu_e$-CC neutrino (or corresponding antineutrino) events, enabling appearance and disappearance measurements of these flavors across the \SI{810}{\kilo\meter} near-to-far detector baseline. From these measurements, the underlying parameters of the three-flavor PMNS oscillations framework are measured. The NOvA Test Beam uses identical technology to the full-scale detectors, but scaled down to 30~tons. It is exposed to a beam of charged particles closely matched to the daughter products of NOvA (anti)neutrino interactions in both energy and species. An instrumented beamline determines both particle momentum and species upstream of the NOvA detector, allowing for a crisp measurement of the NOvA detector response to these known inputs. This dissertation presents an analysis of the electromagnetic response of the NOvA hardware and establishes a framework for incorporating these results to enhance the physics reach of the experiment. Prior to this work, the electromagnetic energy response of the NOvA detector relied primarily on simulation-driven calibration together with a globally applied energy scale uncertainty. The measurements presented here provide direct test beam constraints on the detector response, enabling particle-dependent and potentially energy-dependent uncertainty models derived from controlled electromagnetic inputs.

Myers, Dalton Grant [U. Texas, Austin (main)] (ORC↗

Range‐separated density functional theory using multiresolution analysis and quantum computing

Quantum computers are expected to outperform classical computers for specific problems in quantum chemistry. Such calculations remain expensive, but costs can be lowered through the partition of the molecular system. In the present study, partition was achieved with range-separated density functional theory (RS-DFT). The use of RS-DFT reduces both the basis set size and the active space size dependence of the ground state energy in comparison with the use of wave function theory (WFT) alone. The utilization of pair natural orbitals (PNOs) in place of canonical molecular orbitals (MOs) results in more compact qubit Hamiltonians. To test this strategy, a basis-set independent framework, known as multiresolution analysis (MRA), was employed to generate PNOs. Tests were conducted with the variational quantum eigensolver for a number of molecules. The results show that the proposed approach reduces the number of qubits needed to reach a target energy accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Parallel beamlet dose calculation via beamlet contexts in a distributed multi‐GPU framework

Purpose Dose calculation is one of the most computationally intensive, yet essential tasks in the treatment planning process. With the recent interest in automatic beam orientation and arc trajectory optimization techniques, there is a great need for more efficient model‐based dose calculation algorithms that can accommodate hundreds to thousands of beam candidates at once. Foundational work has shown the translation of dose calculation algorithms to graphical processing units ( GPU s), lending to remarkable gains in processing efficiency. But these methods provide parallelization of dose for only a single beamlet, serializing the calculation of multiple beamlets and under‐utilizing the potential of modern GPU s. In this paper, the authors propose a framework enabling parallel computation of many beamlet doses using a novel beamlet context transformation and further embed this approach in a scalable network of multi‐ GPU computational nodes. Methods The proposed context‐based transformation separates beamlet‐local density and TERMA into distinct beamlet contexts that independently provide sufficient data for beamlet dose calculation. Beamlet contexts are arranged in a composite context array with dosimetric isolation, and the context array is subjected to a GPU collapsed‐cone convolution superposition procedure, producing the set of beamlet‐specific dose distributions in a single pass. Dose from each context is converted to a sparse representation for efficient storage and retrieval during treatment plan optimization. The context radius is a new parameter permitting flexibility between the speed and fidelity of the dose calculation process. A distributed manager‐worker architecture is constructed around the context‐based GPU dose calculation approach supporting an arbitrary number of worker nodes and resident GPU s. Phantom experiments were executed to verify the accuracy of the context‐based approach compared to Monte Carlo and a reference CPU ‐ CCCS implementation for single beamlets and broad beams composed by addition of beamlets. Dose for representative 4 π beam sets was calculated in lung and prostate cases to compare its efficiency with that of an existing beamlet‐sequential GPU ‐ CCCS implementation. Code profiling was also performed to evaluate the scalability of the framework across many networked GPU s. Results The dosimetric accuracy of the context‐based method displays <1.35% and 2.35% average error from the existing serialized CPU ‐ CCCS algorithm and Monte Carlo simulation for beamlet‐specific PDD s in water and slab phantoms, respectively. The context‐based method demonstrates substantial speedup of up to two orders of magnitude over the beamlet‐sequential GPU ‐ CCCS method in the tested configurations. The context‐based framework demonstrates near linear scaling in the number of distributed compute nodes and GPU s employed, indicating that it is flexible enough to meet the performance requirements of most users by simply increasing the hardware utilization. Conclusions The context‐based approach demonstrates a new expectation of performance for beamlet‐based dose calculation methods. This approach has been successful in accelerating the dose calculation process for very large‐scale treatment planning problems ‐ such as automatic 4 π IMRT beam orientation and VMAT arc trajectory selection, with hundreds of thousands of beamlets ‐ in clinically feasible timeframes. The flexibility of this framework makes it as a strong candidate for use in a variety of other very large‐scale treatment planning tasks and clinical workflows.

Neph, Ryan↗

What can simulation test beds teach us about social science? Results of the ground truth program

The ground truth program used simulations as test beds for social science research methods. The simulations had known ground truth and were capable of producing large amounts of data. This allowed research teams to run experiments and ask questions of these simulations similar to social scientists studying real-world systems, and enabled robust evaluation of their causal inference, prediction, and prescription capabilities. We tested three hypotheses about research effectiveness using data from the ground truth program, specifically looking at the influence of complexity, causal understanding, and data collection on performance. We found some evidence that system complexity and causal understanding influenced research performance, but no evidence that data availability contributed. The ground truth program may be the first robust coupling of simulation test beds with an experimental framework capable of teasing out factors that determine the success of social science research.

97 MATHEMATICS AND COMPUTING↗

Secondary Payload Opportunities on NASA's Space Launch System (SLS) Enable Science and Deep Space Exploration

For the first time in almost 40 years, a NASA human-rated launch vehicle has completed its Critical Design Review (CDR). With this milestone, NASA's Space Launch System (SLS) and Orion spacecraft are on the path to launch a new era of deep space exploration. This first launch of SLS and the Orion Spacecraft is planned no later than November 2018 and will fly along a trans-lunar trajectory, testing the performance of the SLS and Orion systems for future missions. NASA is making investments to expand the science and exploration capability of the SLS by developing the capability to deploy small satellites during the trans-lunar phase of the mission trajectory. Exploration Mission 1 (EM-1) will include thirteen 6U Cubesat small satellites to be deployed beyond low earth orbit. By providing an earth-escape trajectory, opportunities are created for the advancement of small satellite subsystems, including deep space communications and in-space propulsion. This SLS capability also creates low-cost options for addressing existing Agency strategic knowledge gaps and affordable science missions. A new approach to payload integration and mission assurance is needed to ensure safety of the vehicle, while also maintaining reasonable costs for the small payload developer teams. SLS EM-1 will provide the framework and serve as a test flight, not only for vehicle systems, but also payload accommodations, ground processing, and on-orbit operations. Through developing the requirements and integration processes for EM-1, NASA is outlining the framework for the evolved configuration of secondary payloads on SLS Block upgrades. The lessons learned from the EM-1 mission will be applied to processes and products developed for future block upgrades. In the heavy-lift configuration of SLS, payload accommodations will increase for secondary opportunities including small satellites larger than the traditional Cubesat class payload. The payload mission concept of operations, proposed payload capacity of SLS, and the payload requirements for launch and deployment will be described to provide potential payload users an understanding of this unique exploration capability.

Singer, Jody↗

Collaborative Research: Experimental and Theoretical Study of the Plasma Physics of Antihydrogen Generation and Trapping (Final Technical Report)

The charge-parity-time (CPT) invariance principle and the weak equivalence principle (WEP) undergird our current understanding of Nature. CPT, which is based on only Lorentz invariance, locality, and spin-statistics, is basic to local relativistic quantum field theory (QFT) models of physical laws. Testing established principles like these is a long-standing and honorable tradition in physics. Beginning with Newton’s Laws, many firmly established laws have been superseded, often to the great surprise of contemporaneous physicists. Certainly, CPT rests on firmer grounds than the earlier widely believed, but erroneous principles, of parity (P) and charge-parity (CP) invariance, but this does not necessarily make CPT inviolable. Tests of CPT confront the entire framework of QFT, and are quite distinct from most other “beyond the Standard Model” searches, which look for new physics within the QFT framework. With the failure, so far, to find new physics at the LHC or in dark matter searches, the motivation to test QFT itself is urgent. The revolutionary consequences of CPT and WEP violation would be so great that these principles are under intense scrutiny in many different systems. Here we focus on tests of CPT and WEP that employ antimatter, specifically antihydrogen. Such tests are difficult to realize experimentally, but constitute some of the simplest and most profound matter-antimatter comparisons that can be performed. Antimatter particles have been investigated since the prediction and subsequent discovery of the positron in the 1930s. That early discovery motivated the search for the antiproton, culminating in its creation and detection in Berkeley two decades later. As far as we know today, particles and their antiparticles share identical properties except for the sign of their charge. Antihydrogen is the simplest antimatter system—it is the antiparticle of the simplest atom, hydrogen. Differences between the spectra of the two are forbidden by CPT. The weak equivalence principle (WEP), demands that matter and antimatter accelerate identically in a gravitational field. WEP has never been subjected to a direct, free fall test using antimatter. Because of the weakness of the gravita tional force, direct antimatter WEP tests must employ a neutral particle, of which antihydrogen is the simplest to obtain. There are reasons to suspect that something is amiss with our understanding of antimatter. All generally accepted theories of the Big Bang predict that roughly equal amounts of matter and antimatter should have been created. Instead, very little antimatter has been observed in the Universe. This baryogenesis problem is arguably the most fundamental issue with the theory of the Big Bang. Its resolution may come from the discovery of enhanced CP violation, but could also come from CPT or WEP violation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Failure Mechanisms and Life Prediction of Thermal and Environmental Barrier Coatings under Thermal Gradients

Ceramic thermal and environmental barrier coatings (TEBCs) will play an increasingly important role in gas turbine engines because of their ability to further raise engine temperatures. However, the issue of coating durability is of major concern under high-heat-flux conditions. In particular, the accelerated coating delamination crack growth under the engine high heat-flux conditions is not well understood. In this paper, a laser heat flux technique is used to investigate the coating delamination crack propagation under realistic temperature-stress gradients and thermal cyclic conditions. The coating delamination mechanisms are investigated under various thermal loading conditions, and are correlated with coating dynamic fatigue, sintering and interfacial adhesion test results. A coating life prediction framework may be realized by examining the crack initiation and propagation driving forces for coating failure under high-heat-flux test conditions.

Zju, Dongming↗

Used fuel rail shock and vibration testing options analysis

The objective of the rail shock and vibration tests is to complete the framework needed to quantify loads of fuel assembly components that are necessary to guide materials research and establish a technical basis for review organizations such as the U.S. Nuclear Regulatory Commission (NRC). A significant body of experimental and numerical modeling data exists to quantify loads and failure limits applicable to normal conditions of transport (NCT) rail transport, but the data are based on assumptions that can only be verified through experimental testing. The test options presented in this report represent possible paths for acquiring the data that are needed to confirm the assumptions of previous work, validate modeling methods that will be needed for evaluating transported fuel on a case-by-case basis, and inform material test campaigns on the anticipated range of fuel loading. The ultimate goal of this testing is to close all of the existing knowledge gaps related to the loading of used fuel under NCT conditions and inform the experiments and analysis program on specific endpoints for their research. The options include tests that would use an actual railcar, surrogate assemblies, and real or simulated rail transportation casks. The railcar carrying the cradle, cask, and surrogate fuel assembly payload would be moved in a train operating over rail track modified or selected to impart shock and vibration forces that occur during normal rail transportation. Computer modeling would be used to help design surrogates that may be needed for a rail cask, a cask’s internal basket, and a transport cradle. The objective of the design of surrogate components would be to provide a test platform that effectively simulates responses to rail shock and vibration loads that would be exhibited by state-of-the-art rail cask, basket, and/or cradle structures. The computer models would also be used to help determine the placement of instrumentation (accelerometers and strain gauges) on the surrogate fuel assemblies, cask and cradle structures, and the railcar so that forces and deflections that would result in the greatest potential for damage to high burnup and long-cooled UNF can be determined. For purposes of this report we consider testing on controlled track when we have control of the track and speed to facilitate modeling.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Aspect-Oriented Monitoring of C Programs

The paper presents current work on extending ASPECTC with state machines, resulting in a framework for aspect-oriented monitoring of C programs. Such a framework can be used for testing purposes, or it can be part of a fault protection strategy. The long term goal is to explore the synergy between the fields of runtime verification, focused on program monitoring, and aspect-oriented programming, focused on more general program development issues. The work is inspired by the observation that most work in this direction has been done for JAVA, partly due to the lack of easily accessible extensible compiler frameworks for C. The work is performed using the SILVER extensible attribute grammar compiler framework, in which C has been defined as a host language. Our work consists of extending C with ASPECTC, and subsequently to extend ASPECTC with state machines.

runtime verifications↗

Quantitative Prediction of Perovskite Stability Using Accelerated Testing and Machine Learning

PV technologies based on hybrid perovskites offer the potential for reducing solar cell costs, but they are particularly vulnerable to degradation by environmental factors such as moisture, oxygen, and illumination. Commercialization will require not only stable materials and device architectures but also accelerated testing protocols and models that can predict degradation from the accelerated testing data. Here, we report results from in situ photoluminescence (PL) and photoconductivity (PC) measurements during perovskite degradation with simultaneous optical transmittance (Tr) measurements or reflected dark field (DF) imaging. From PL, PC, Tr, and DF, we determine (respectively) the steady-state quasi-Fermi level splitting, the mean effective carrier diffusion length, the extent of conversion of perovskite to higher bandgap degradation products, and the extent of scattering from domains with different orientation or composition, all as a function of time during degradation. Simultaneous measurement of PL-PC-Tr or PL-PC-DF on perovskite absorbers in an environmental chamber over a wide range of humidity, oxygen, temperature, and illumination levels yields a rich data set. We use machine learning to develop a model that accurately predicts (within 10%) the time for the diffusion length to decrease to 85% of its initial value. The model takes the environmental conditions and the first few measurements from the PL-PC-Tr or PL-PC-DF experiment as input. Thus, the model provides a framework to interpret the results of accelerated testing of absorber materials. One of the dominant features in the model of degradation for CH 3 NH 3 PbI 3 is the initial rate at which transmittance increase. For devices with opaque contacts, the pixel-averaged rate of change of the intensity in dark-field images can be used in place of transmittance. Results are also presented on full PV devices with in-situ current-voltage (JV) measurements. Here, the data from simultaneous PL-DF-JV under environmental stresses reveal intimate connection between degradation and shunts and provide a framework to extend accelerated testing to devices. Further, the presentation reveals underlying universal behavior in degradation pathways over a broad range of environmental stresses and perovskite compositions.

14 SOLAR ENERGY↗