Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A Run-Time Verification Framework for Smart Grid Applications Implemented on Simulation Frameworks

Smart grid applications are implemented and tested with simulation frameworks as the developers usually do not have access to large sensor networks to be used as a test bed. The developers are forced to map the implementation onto these frameworks which results in a deviation between the architecture and the code. On its turn this deviation makes it hard to verify behavioral constraints that are de- scribed at the architectural level. We have developed the ConArch toolset to support the automated verification of architecture-level behavioral constraints. A key feature of ConArch is programmable mapping for architecture to the implementation. Here, developers implement queries to identify the points in the target program that correspond to architectural interactions. ConArch generates run- time observers that monitor the flow of execution between these points and verifies whether this flow conforms to the behavioral constraints. We illustrate how the programmable mappings can be exploited for verifying behavioral constraints of a smart grid appli- cation that is implemented with two simulation frameworks.

Architecture baed testing↗

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

Understanding Type Ia Supernova Distance Biases by Simulating Spectral Variations

In the next decade, transient searches from the Vera C. Rubin Observatory and the Nancy Grace Roman Space Telescope will increase the sample of known Type Ia supernovae (SNe Ia) from ~10 3 to 10 5 . With this reduction of statistical uncertainties on cosmological measurements, new methods are needed to reduce systematic uncertainties. Here, characterizing the underlying spectroscopic evolution of SN Ia remains a major systematic uncertainty in current cosmological analyses, motivating a new simulation tool for the next era of SN Ia cosmology: Build Your Own Spectral Energy Distribution (byosed). byosed is used within the SNANA framework to simulate light curves by applying spectral variations to model SEDs, enabling flexible testing of possible systematic shifts in SN Ia distance measurements. We test the framework by comparing a nominal Roman SN Ia survey simulation using a baseline SED model to simulations using SEDs perturbed with byosed, and investigating the impact of ignoring specific SED features in the analysis. These features include semiempirical models of two possible, predicted relationships: between SN ejecta velocity and light-curve observables, and a redshift-dependent relationship between SN Hubble residuals and host-galaxy mass. We analyze each byosed simulation using the SALT2 and BEAMS with Bias Corrections framework, and estimate changes in the measured value of the dark-energy equation-of-state parameter, w. We find a difference of Δw = –0.023 for SN velocity and Δw = 0.021 for redshift-evolving host mass when compared to simulations without these features. By using byosed for SN Ia cosmology simulations, future analyses (e.g., the Rubin and Roman SN Ia samples) will have greater flexibility to constrain or reduce such SN Ia modeling uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Trial Implementation of the High-Impact, Low-Frequency Power Grid Event Risk Framework to Support Informed Decision-Making

In 2015, Pacific Northwest National Laboratory (PNNL) developed a multi-hazard risk-assessment framework for modeling high-impact, low-frequency (HILF) power grid events to support risk-informed decisions for power grid management and emergency planning. The identified framework elements are based on a systematic and comprehensive characterization of hazards to the level of detail required for modeling risk. In 2016, PNNL performed a trial implementation of the framework for a single hazard category and a set of key power grid asset types as a way to test the framework. A specific realization of a HILF event is referred to as an initiating event, or initiator. An initiating event is the manifestation of a hazard, and can be, for example, an earthquake of specified magnitude at a specified epicenter. Other examples of HILF events include geomagnetic disturbances and pandemics. For this test implementation, grid assets of a benchmark power system transmission network were assigned proxy geographical coordinates associated with Washington State locations; and real-world seismic hazard information was used for those locations. Based on the fragility of the grid assets to events of different severities, the set of possible failure scenarios (i.e., combinations of different asset failures) and their associated probabilities were determined, and recovery of grid assets and restoration of the network were considered. These combinations of failures and their subsequent recovery constitute a HILF event sequence that results in a given level of consequence, such as loss of power over a given geographic area for a given duration. The concurrent quantitative consideration of event probabilities and event consequences characterizes a risk model. For HILF event sequences, risk was expressed as expected unserved energy per year. This implementation demonstrates the feasibility and value of using the HILF event risk framework despite some of the identified challenges. This report discusses this trial implementation and presents risk results and insights from the implementation.

Veeramany, Arun↗

Multi-Source Data Aggregation and Real-Time Anomaly Classification and Localization in Power Distribution Systems

This paper proposes a real-time anomaly location and classification framework for power distribution systems to simultaneously determine the type of anomaly (i.e., short-circuit fault, cyber attack, DER switching) and its location. The proposed framework employs the data aggregation module to collect the measurement data from multiple field devices operating at different sampling rates, such as protection relays and D-PMUs. The output of the data aggregation is then fed into a multi-task learning-based long-based short-term memory (MTL-LSTM) to classify the type of anomaly and the location in two separate tasks. The proposed MTL-LSTM approach can be utilized in real-time operation in order to distinguish between normal and several anomalous operations and locate the anomaly. The proposed framework is tested on a modified IEEE 33-bus test feeder benchmark that integrates solar generation and energy storage. Furthermore, the results show that the proposed framework can locate and classify anomalies for several operation conditions with more than 96% accuracy. Further experiments highlight the impact of aggregating multiple sources of data on the performance of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Preserving Physics Knowledge at the Fast Flux Test Facility

One of the goals of the Department of Energy’s Office of Nuclear Energy, initiated under the Fuel Cycle Research and Development Program (FCRD) and continued under the Advanced Reactor Concepts Program (ARC) is to preserve the knowledge that has been gained in the United States on Liquid Metal Reactors (LMRs) that could support the development of an environmentally and economically sound nuclear fuel cycle. The Fast Flux Test Facility (FFTF) is the most recent LMR to operate in the United States, from 1982 to 1992, and was designed as a fully instrumented test reactor with on-line, real time test control and performance monitoring of components and tests installed in the reactor. The 10 years of operation of the FFTF provided a very useful framework for testing the advances in LMR safety technology based on passive safety features that may be of increased importance to new designs after the events at Fukushima. Knowledge preservation at the FFTF is focused on the areas of design, construction, and startup of the reactor, as well as on preserving information obtained from 10 years of successful operating history and extensive irradiation testing of fuels and materials. In order to ensure protection of information at risk, the program to date has sequestered reports, files, tapes, and drawings to allow for secure retrieval. A disciplined and orderly approach has been developed to respond to client’s requests for documents and data in order to minimize the search effort and ensure that future requests for this information can be readily accommodated.

data archiving↗

Knowledge Management at the Fast Flux Test Facility

One of the goals of the Department of Energy’s Office of Nuclear Energy, initiated under the Fuel Cycle Research and Development Program (FCRD) and continued under the Advanced Reactor Concepts Program (ARC) is to preserve the knowledge that has been gained in the United States on Liquid Metal Reactors (LMRs) that could support the development of an environmentally and economically sound nuclear fuel cycle. The Fast Flux Test Facility (FFTF) is the most recent LMR to operate in the United States, from 1982 to 1992, and was designed as a fully instrumented test reactor with on-line, real time test control and performance monitoring of components and tests installed in the reactor. The 10 years of operation of the FFTF provided a very useful framework for testing the advances in LMR safety technology based on passive safety features that may be of increased importance to new designs after the events at Fukushima. Knowledge preservation at the FFTF is focused on the areas of design, construction, and startup of the reactor, as well as on preserving information obtained from 10 years of successful operating history and extensive irradiation testing of fuels and materials. In order to ensure protection of information at risk, the program to date has sequestered reports, files, tapes, and drawings to allow for secure retrieval. The FFTF knowledge management program includes a disciplined and orderly approach to respond to client’s requests for documents and data in order to minimize the search effort and ensure that future requests for this information can be readily accommodated.

data preservation↗

Preserving physics knowledge at the fast flux test facility

One of the goals of the Dept. of Energy's Office of Nuclear Energy, initiated under the Fuel Cycle Research and Development Program (FCRD) and continued under the Advanced Reactor Concepts Program (ARC) is to preserve the knowledge that has been gained in the United States on Liquid Metal Reactors (LMRs) that could support the development of an environmentally and economically sound nuclear fuel cycle. The Fast Flux Test Facility (FFTF) is the most recent LMR to operate in the United States, from 1982 to 1992, and was designed as a fully instrumented test reactor with on-line, real time test control and performance monitoring of components and tests installed in the reactor. The 10 years of operation of the FFTF provided a very useful framework for testing the advances in LMR safety technology based on passive safety features that may be of increased importance to new designs after the events at Fukushima. Knowledge preservation at the FFTF is focused on the areas of design, construction, and startup of the reactor, as well as on preserving information obtained from 10 years of successful operating history and extensive irradiation testing of fuels and materials. In order to ensure protection of information at risk, the program to date has sequestered reports, files, tapes, and drawings to allow for secure retrieval. A disciplined and orderly approach has been developed to respond to client's requests for documents and data in order to minimize the search effort and ensure that future requests for this information can be readily accommodated. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Probabilistic Evaluation of Geoscientific Hypotheses with Geophysical Data: Application to Electrical Resistivity Imaging of a Fractured Bedrock Zone

As climate changes and populations grow, groundwater sustainability is becoming increasingly important. Groundwater models, based on a conceptual understanding of the subsurface structure, are crucial tools for making sustainable management decisions. Conceptual models of the subsurface are based on knowledge of geological processes, and, frequently, observations from geophysical data. A frequent problem in groundwater model development occurs when multiple geological phenomena could explain a single subsurface observation. Uncertainty in geophysical data makes it even more difficult to discern which explanations are consistent with the geophysics. Here, we present a framework for testing geological when a geological feature is observed in geophysical data, but its physical characteristics are uncertain. The framework builds on Popper-Bayes methods developed in previous work, and is applied to study a fractured bedrock zone in a mountainous watershed in southwest Colorado. First, we outline six hypotheses based on the geological history of the watershed. Then, using the proposed Popper-Bayes approach, we demonstrate that three of the six hypotheses are inconsistent with measured electrical resistivity data, even after accounting for uncertainty. Finally, we discuss the importance of the prior model, and how this framework for handling geophysical uncertainty can be applied in other settings.

54 ENVIRONMENTAL SCIENCES↗

Towards Acceptance Testing at the Exascale Frontier

At the 2007 Cray User Group meeting, the Oak Ridge Leadership Computing Facility (OLCF) introduced the OLCF Test Harness (OTH), a framework[1] used for acceptance testing of the Jaguar supercomputer[2]. Since then, the OTH framework has evolved to version 2.0 which adds new features and streamlines usability. The OTH is the key piece of software used to orchestrate acceptance testing for all OLCF computational resources before they are deployed for production use, including our leadership class high performance computing (HPC) systems. The OTH framework is written in Python and is publicly available[3].In this paper, we first describe the requirements, design, and structure of the OTH. Then, we present specific improvements developed to support acceptance testing of the OLCF’s Summit system[4]. We will also showcase new OTH features that have been added to streamline the acceptance test process as well as the motivation behind those changes. As part of this work, we also evaluated different workflow tools in order to determine whether these tools could complement the OTH in two key areas: automation and reporting. The advantages and disadvantages identified with each tool will be discussed. Lastly, we summarize the challenges and lessons learned collected from using the OTH for the acceptance of the last three flagship systems at the OLCF. These may be useful for other HPC centers developing their own testing frameworks or those interested in using the OTH.

Melesse Vergara, Veronica↗

Divergent responses of spring phenology to daytime and nighttime warming

Spring phenology (i.e., start of season, SOS) has shifted earlier in response to warmer temperatures. However, the respective influences of daytime and nighttime temperatures on SOS changes remain poorly understood. Here we characterized the responses of satellite-derived SOS to minimum temperature (Tmin) and maximum temperature (Tmax) across Appalachian Trail regions in the Eastern United States during 2000-2013. We found SOS responded differently to Tmin and Tmax at 81.5% of the study area. Furthermore, the SOS responses to Tmin and Tmax both changed across space, and specifically, these two responses showed significant divergent trends from cold to warm regions (P<0.001). We propose a new framework utilizing both Tmin and Tmax, instead of daily average temperature, in modeling phenology. This study, for the first time, disentangled phenological responses to daytime temperature from nighttime temperature across a wide range of temperatures. The findings suggest that model projections of future phenological changes should incorporate the divergent phenology responses to daytime and nighttime temperatures, in order to improve the representation of land-atmosphere interactions in Earth system models in light of asymmetric diurnal warming.

asymmetric warming, temperature sensitivity, Appal↗

An Autonomous System for Grouping Events in a Developing Aftershock Sequence

We describe a prototype detection framework that automatically clusters events in real time from a rapidly unfolding aftershock sequence. We use the fact that many aftershocks are repetitive, producing similar waveforms. By clustering events based on correlation measures of waveform similarity, the number of independent event instances that must be examined in detail by analysts may be reduced. Our system processes array data and acquires waveform templates with a short-term average (STA)/long-term average (LTA) detector operating on a beam directed at the P phases of the aftershock sequence. The templates are used to create correlation-type (subspace) detectors that sweep the subsequent data stream for occurrences of the same waveform pattern. Events are clustered by association with a particular detector. Hundreds of subspace detectors can run in this framework a hundred times faster than in real time. Nonetheless, to check the growth in the number of detectors, the framework pauses periodically and reclusters detections to reduce the number of event groups. These groups define new subspace detectors that replace the older generation of detectors. Because low-magnitude occurrences of a particular signal template may be missed by the STA/LTA detector, we advocate restarting the framework from the beginning of the sequence periodically to reprocess the entire data stream with the existing detectors. We tested the framework on 10 days of data from the Nevada Seismic Array (NVAR) covering the 2003 San Simeon earthquake. One hundred eighty-four automatically generated detectors produced 676 detections resulting in a potential reduction in analyst workload of up to 73%.

58 GEOSCIENCES↗

SCALING AN URBAN EMERGENCY EVACUATION FRAMEWORK: CHALLENGES AND PRACTICES

Critical infrastructure disruption, caused by severe weather events, natural disasters, terrorist attacks, etc., has significant impacts on urban transportation systems. We built a computational framework to simulate urban transportation systems under critical infrastructure disruption in order to aid real-time emergency evacuation. This framework will use large scale datasets to provide a scalable tool for emergency planning and management. Our framework, World-Wide Emergency Evacuation (WWEE), integrates population distribution and urban infrastructure networks to model travel demand in emergency situations at global level. Also, a computational model of agent-based traffic simulation is used to provide an optimal evacuation plan for traffic operation purpose [1]. In addition, our framework provides a web-based high resolution visualization tool for emergency evacuation modelers and practitioners. We have successfully tested our framework with scenarios in both United States (Alexandria, VA) and Europe (Berlin, Germany) [2]. However, there are still some major drawbacks for scaling this framework to handle big data workloads in real time. On our back-end, lack of proper infrastructure limits us in ability to process large amounts of data, run the simulation efficiently and quickly, and provide fast retrieval and serving of data. On the front-end, the visualization performance of microscopic evacuation results is still not efficient enough due to high volume data communication between server and client. We are addressing these drawbacks by using cloud computing and next-generation web technologies, namely Node.js, NoSQL, WebGL, Open Layers 3 and HTML5 technologies. We will describe briefly about each one and how we are using and leveraging these technologies to provide an efficient tool for emergency management organizations. Our early experimentation demonstrates that using above technologies is a promising approach to build a scalable and high performance urban emergency evacuation framework that can improve traffic mobility and safety under critical infrastructure disruption in today s socially connected world.

cloud computing↗

Test and Evaluation for Enhanced Security: A Quantitative Method to Incorporate Expert Knowledge into Test Planning Decisions.

Complex systems are comprised of technical, social, political and environmental factors as well as the programmatic factors of cost, schedule and risk. Testing these systems for enhanced security requires expert knowledge in many different fields. It is important to test these systems to ensure effectiveness, but testing is limited to due cost, schedule, safety, feasibility and a myriad of other reasons. Without an effective decision framework for Test and Evaluation (T&E) planning that can take into consideration technical as well as programmatic factors and leverage expert knowledge, security in complex systems may not be assessed effectively. Therefore, this paper covers the identification of the current T&E planning problem and an approach to include the full variety of factors and leverage expert knowledge in T&E planning through the use of Bayesian Networks (BN).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Quantum computing based hybrid deep learning for fault diagnosis in electrical power systems

Quantum computing (QC) and deep learning have shown promise of supporting transformative advances and have recently gained popularity in a wide range of areas. Here, this paper proposes a hybrid QC-based deep learning framework for fault diagnosis of electrical power systems that combine the feature extraction capabilities of conditional restricted Boltzmann machine with an efficient classification of deep networks. Computational challenges stemming from the complexities of such deep learning models are overcome by QC-based training methodologies that effectively leverage the complementary strengths of quantum assisted learning and classical training techniques. The proposed hybrid QC-based deep learning framework is tested on a simulated electrical power system with 30 buses and wide variations of substation and transmission line faults, to demonstrate the framework’s applicability, efficiency, and generalization capabilities. High computational efficiency is enjoyed by the proposed hybrid approach in terms of computational effort required and quality of diagnosis performance over classical training methods. In addition, superior and reliable fault diagnosis performance with faster response time is achieved over state-of-the-art pattern recognition methods based on artificial neural networks (ANN) and decision trees (DT).

42 ENGINEERING↗

A2Cloud‐RF : A random forest based statistical framework to guide resource selection for high‐performance scientific computing on the cloud

Summary This article proposes a random‐forest based A2Cloud framework to match scientific applications with Cloud providers and their instances for high performance. The framework leverages four engines for this task: PERF engine, Cloud trace engine, A2Cloud‐ext engine, and the random forest classifier (RFC) engine. The PERF engine profiles the application to obtain performance characteristics, including the number of single‐precision (SP) floating‐point operations (FLOPs), double‐precision (DP) FLOPs, x87 operations, memory accesses, and disk accesses. The Cloud trace engine obtains the corresponding performance characteristics of the selected Cloud instances including: SP floating point operations per second (FLOPS), DP FLOPS, x87 operations per second, memory bandwidth, and disk bandwidth. The A2Cloud‐ext engine uses the application and Cloud instance characteristics to generate objective scores that represent the application‐to‐Cloud match. The RFC engine uses these objective scores to generate two types of random forests to assist users with rapid analysis: application‐specific random forests (ARF) and application‐class based random forests. The ARF consider only the input application's characteristics to generate a random forest and provide numerical ratings to the selected Cloud instances. To generate the application‐class based random forests, the RFC engine downloads the application profiles and scores of previously tested applications that perform similar to the input application. Using these data, the RFC engine creates a random forest for instance recommendation. We exhaustively test this framework using eight real‐world applications across 12 instances from different Cloud providers. Our tests show significant statistical agreement between the instance ratings given by the framework and the ratings obtained via actual Cloud executions.

Samuel, David↗