Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

Understanding Type Ia Supernova Distance Biases by Simulating Spectral Variations

In the next decade, transient searches from the Vera C. Rubin Observatory and the Nancy Grace Roman Space Telescope will increase the sample of known Type Ia supernovae (SNe Ia) from ~10 3 to 10 5 . With this reduction of statistical uncertainties on cosmological measurements, new methods are needed to reduce systematic uncertainties. Here, characterizing the underlying spectroscopic evolution of SN Ia remains a major systematic uncertainty in current cosmological analyses, motivating a new simulation tool for the next era of SN Ia cosmology: Build Your Own Spectral Energy Distribution (byosed). byosed is used within the SNANA framework to simulate light curves by applying spectral variations to model SEDs, enabling flexible testing of possible systematic shifts in SN Ia distance measurements. We test the framework by comparing a nominal Roman SN Ia survey simulation using a baseline SED model to simulations using SEDs perturbed with byosed, and investigating the impact of ignoring specific SED features in the analysis. These features include semiempirical models of two possible, predicted relationships: between SN ejecta velocity and light-curve observables, and a redshift-dependent relationship between SN Hubble residuals and host-galaxy mass. We analyze each byosed simulation using the SALT2 and BEAMS with Bias Corrections framework, and estimate changes in the measured value of the dark-energy equation-of-state parameter, w. We find a difference of Δw = –0.023 for SN velocity and Δw = 0.021 for redshift-evolving host mass when compared to simulations without these features. By using byosed for SN Ia cosmology simulations, future analyses (e.g., the Rubin and Roman SN Ia samples) will have greater flexibility to constrain or reduce such SN Ia modeling uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

We report on a study to determine the maturity of different verification and validation technologies (V&V) on a representative example of NASA flight software. The study consisted of a controlled experiment where three technologies (static analysis, runtime analysis and model checking) were compared to traditional testing with respect to their ability to find seeded errors in a prototype Mars Rover. What makes this study unique is that it is the first (to the best of our knowledge) to do a controlled experiment to compare formal methods based tools to testing on a realistic industrial-size example where the emphasis was on collecting as much data on the performance of the tools and the participants as possible. The paper includes a description of the Rover code that was analyzed, the tools used as well as a detailed description of the experimental setup and the results. Due to the complexity of setting up the experiment, our results can not be generalized, but we believe it can still serve as a valuable point of reference for future studies of this kind. It did confirm the belief we had that advanced tools can outperform testing when trying to locate concurrency errors. Furthermore the results of the experiment inspired a novel framework for testing the next generation of the Rover.

Brat, Guillaume↗

Safeguarding the Health of the NASA Astronaut Community: the Need for Expanded Medical Monitoring for Former NASA Astronauts Under the Astronaut Occupational Health Program

The astronaut community is unique, and may be disproportionately exposed to occupational hazards not commonly seen in other communities. The extent to which the demands of the astronaut occupation and exposure to spaceflight-related hazards affect the health of the astronaut population over the life course is not completely known. Provision of health screening services to active and former astronauts ensures individual, mission, and community health and safety. Currently, the NASA Johnson Space Center (JSC) Flight Medicine Clinic (FMC) provides extensive medical monitoring to active astronauts throughout their careers. Upon retirement, astronauts may voluntarily return to the JSC FMC for an annual preventive exam. However, current retiree monitoring includes only selected screening tests, representing an opportunity for augmentation. The potential latent health effects of spaceflight demand an expanded framework of testing for former astronauts. The need is two-fold: screening tests widely recommended for other aging communities are necessary for astronauts to rule out conditions resulting from the natural aging process (e.g., colonoscopy, mammography), as opposed to conditions resulting directly from the astronaut occupation; and increased breadth of monitoring services will improve the understanding of occupational health risks and longitudinal health of the astronaut community, past, present, and future. To meet this need, NASA has begun an extensive exploration of the overall approach, cost, and policy implications of expanding existing medical monitoring under the Astronaut Occupational Health program for former NASA astronauts.

Rossi, Meredith↗

Trial Implementation of the High-Impact, Low-Frequency Power Grid Event Risk Framework to Support Informed Decision-Making

In 2015, Pacific Northwest National Laboratory (PNNL) developed a multi-hazard risk-assessment framework for modeling high-impact, low-frequency (HILF) power grid events to support risk-informed decisions for power grid management and emergency planning. The identified framework elements are based on a systematic and comprehensive characterization of hazards to the level of detail required for modeling risk. In 2016, PNNL performed a trial implementation of the framework for a single hazard category and a set of key power grid asset types as a way to test the framework. A specific realization of a HILF event is referred to as an initiating event, or initiator. An initiating event is the manifestation of a hazard, and can be, for example, an earthquake of specified magnitude at a specified epicenter. Other examples of HILF events include geomagnetic disturbances and pandemics. For this test implementation, grid assets of a benchmark power system transmission network were assigned proxy geographical coordinates associated with Washington State locations; and real-world seismic hazard information was used for those locations. Based on the fragility of the grid assets to events of different severities, the set of possible failure scenarios (i.e., combinations of different asset failures) and their associated probabilities were determined, and recovery of grid assets and restoration of the network were considered. These combinations of failures and their subsequent recovery constitute a HILF event sequence that results in a given level of consequence, such as loss of power over a given geographic area for a given duration. The concurrent quantitative consideration of event probabilities and event consequences characterizes a risk model. For HILF event sequences, risk was expressed as expected unserved energy per year. This implementation demonstrates the feasibility and value of using the HILF event risk framework despite some of the identified challenges. This report discusses this trial implementation and presents risk results and insights from the implementation.

Veeramany, Arun↗

Multi-Source Data Aggregation and Real-Time Anomaly Classification and Localization in Power Distribution Systems

This paper proposes a real-time anomaly location and classification framework for power distribution systems to simultaneously determine the type of anomaly (i.e., short-circuit fault, cyber attack, DER switching) and its location. The proposed framework employs the data aggregation module to collect the measurement data from multiple field devices operating at different sampling rates, such as protection relays and D-PMUs. The output of the data aggregation is then fed into a multi-task learning-based long-based short-term memory (MTL-LSTM) to classify the type of anomaly and the location in two separate tasks. The proposed MTL-LSTM approach can be utilized in real-time operation in order to distinguish between normal and several anomalous operations and locate the anomaly. The proposed framework is tested on a modified IEEE 33-bus test feeder benchmark that integrates solar generation and energy storage. Furthermore, the results show that the proposed framework can locate and classify anomalies for several operation conditions with more than 96% accuracy. Further experiments highlight the impact of aggregating multiple sources of data on the performance of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Probabilistic Evaluation of Geoscientific Hypotheses with Geophysical Data: Application to Electrical Resistivity Imaging of a Fractured Bedrock Zone

As climate changes and populations grow, groundwater sustainability is becoming increasingly important. Groundwater models, based on a conceptual understanding of the subsurface structure, are crucial tools for making sustainable management decisions. Conceptual models of the subsurface are based on knowledge of geological processes, and, frequently, observations from geophysical data. A frequent problem in groundwater model development occurs when multiple geological phenomena could explain a single subsurface observation. Uncertainty in geophysical data makes it even more difficult to discern which explanations are consistent with the geophysics. Here, we present a framework for testing geological when a geological feature is observed in geophysical data, but its physical characteristics are uncertain. The framework builds on Popper-Bayes methods developed in previous work, and is applied to study a fractured bedrock zone in a mountainous watershed in southwest Colorado. First, we outline six hypotheses based on the geological history of the watershed. Then, using the proposed Popper-Bayes approach, we demonstrate that three of the six hypotheses are inconsistent with measured electrical resistivity data, even after accounting for uncertainty. Finally, we discuss the importance of the prior model, and how this framework for handling geophysical uncertainty can be applied in other settings.

54 ENVIRONMENTAL SCIENCES↗

Protecting the Health of Astronauts: Enhancing Occupational Health Monitoring and Surveillance for Former NASA Astronauts to Understand Long-Term Outcomes of Spaceflight-Related Exposures

The astronaut community is unique, and may be disproportionately exposed to occupational hazards not commonly seen in other communities. The extent to which the demands of the astronaut occupation and exposure to spaceflight-related hazards affect the health of the astronaut population over the life course is not completely known. A better understanding of the individual, population, and mission impacts of astronaut occupational exposures is critical to providing clinical care, targeting occupational surveillance efforts, and planning for future space exploration. The ability to characterize the risk of latent health conditions is a significant component of this understanding. Provision of health screening services to active and former astronauts ensures individual, mission, and community health and safety. Currently, the NASA-Johnson Space Center (JSC) Flight Medicine Clinic (FMC) provides extensive medical monitoring to active astronauts throughout their careers. Upon retirement, astronauts may voluntarily return to the JSC FMC for an annual preventive exam. However, current retiree monitoring includes only selected screening tests, representing an opportunity for augmentation. The potential long-term health effects of spaceflight demand an expanded framework of testing for former astronauts. The need is two-fold: screening tests widely recommended for other aging populations are necessary to rule out conditions resulting from the natural aging process (e.g., colonoscopy, mammography); and expanded monitoring will increase NASA's ability to better characterize conditions resulting from astronaut occupational exposures. To meet this need, NASA has begun an extensive exploration of the overall approach, cost, and policy implications of e an Astronaut Occupational Health program to include expanded medical monitoring of former NASA astronauts. Increasing the breadth of monitoring services will ultimately enrich the existing evidence base of occupational health risks to astronauts. Such an expansion would therefore improve the understanding of the health of the astronaut population as a whole, and the ability to identify, mitigate, and manage such risks in preparation for deep space exploration missions.

Rossi, Meredith↗

Towards Acceptance Testing at the Exascale Frontier

At the 2007 Cray User Group meeting, the Oak Ridge Leadership Computing Facility (OLCF) introduced the OLCF Test Harness (OTH), a framework[1] used for acceptance testing of the Jaguar supercomputer[2]. Since then, the OTH framework has evolved to version 2.0 which adds new features and streamlines usability. The OTH is the key piece of software used to orchestrate acceptance testing for all OLCF computational resources before they are deployed for production use, including our leadership class high performance computing (HPC) systems. The OTH framework is written in Python and is publicly available[3].In this paper, we first describe the requirements, design, and structure of the OTH. Then, we present specific improvements developed to support acceptance testing of the OLCF’s Summit system[4]. We will also showcase new OTH features that have been added to streamline the acceptance test process as well as the motivation behind those changes. As part of this work, we also evaluated different workflow tools in order to determine whether these tools could complement the OTH in two key areas: automation and reporting. The advantages and disadvantages identified with each tool will be discussed. Lastly, we summarize the challenges and lessons learned collected from using the OTH for the acceptance of the last three flagship systems at the OLCF. These may be useful for other HPC centers developing their own testing frameworks or those interested in using the OTH.

Melesse Vergara, Veronica↗

Divergent responses of spring phenology to daytime and nighttime warming

Spring phenology (i.e., start of season, SOS) has shifted earlier in response to warmer temperatures. However, the respective influences of daytime and nighttime temperatures on SOS changes remain poorly understood. Here we characterized the responses of satellite-derived SOS to minimum temperature (Tmin) and maximum temperature (Tmax) across Appalachian Trail regions in the Eastern United States during 2000-2013. We found SOS responded differently to Tmin and Tmax at 81.5% of the study area. Furthermore, the SOS responses to Tmin and Tmax both changed across space, and specifically, these two responses showed significant divergent trends from cold to warm regions (P<0.001). We propose a new framework utilizing both Tmin and Tmax, instead of daily average temperature, in modeling phenology. This study, for the first time, disentangled phenological responses to daytime temperature from nighttime temperature across a wide range of temperatures. The findings suggest that model projections of future phenological changes should incorporate the divergent phenology responses to daytime and nighttime temperatures, in order to improve the representation of land-atmosphere interactions in Earth system models in light of asymmetric diurnal warming.

asymmetric warming, temperature sensitivity, Appal↗

Test and Evaluation for Enhanced Security: A Quantitative Method to Incorporate Expert Knowledge into Test Planning Decisions.

Complex systems are comprised of technical, social, political and environmental factors as well as the programmatic factors of cost, schedule and risk. Testing these systems for enhanced security requires expert knowledge in many different fields. It is important to test these systems to ensure effectiveness, but testing is limited to due cost, schedule, safety, feasibility and a myriad of other reasons. Without an effective decision framework for Test and Evaluation (T&E) planning that can take into consideration technical as well as programmatic factors and leverage expert knowledge, security in complex systems may not be assessed effectively. Therefore, this paper covers the identification of the current T&E planning problem and an approach to include the full variety of factors and leverage expert knowledge in T&E planning through the use of Bayesian Networks (BN).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Using XML and Java Technologies for Astronomical Instrument Control

Traditionally, instrument command and control systems have been highly specialized, consisting mostly of custom code that is difficult to develop, maintain, and extend. Such solutions are initially very costly and are inflexible to subsequent engineering change requests, increasing software maintenance costs. Instrument description is too tightly coupled with details of implementation. NASA Goddard Space Flight Center, under the Instrument Remote Control (IRC) project, is developing a general and highly extensible framework that applies to any kind of instrument that can be controlled by a computer. The software architecture combines the platform independent processing capabilities of Java with the power of the Extensible Markup Language (XML), a human readable and machine understandable way to describe structured data. A key aspect of the object-oriented architecture is that the software is driven by an instrument description, written using the Instrument Markup Language (IML), a dialect of XML. IML is used to describe the command sets and command formats of the instrument, communication mechanisms, format of the data coming from the instrument, and characteristics of the graphical user interface to control and monitor the instrument. The IRC framework allows the users to define a data analysis pipeline which converts data coming out of the instrument. The data can be used in visualizations in order for the user to assess the data in real-time, if necessary. The data analysis pipeline algorithms can be supplied by the user in a variety of forms or programming languages. Although the current integration effort is targeted for the High-resolution Airborne Wideband Camera (HAWC) and the Submillimeter and Far Infrared Experiment (SAFIRE), first-light instruments of the Stratospheric Observatory for Infrared Astronomy (SOFIA), the framework is designed to be generic and extensible so that it can be applied to any instrument. Plans are underway to test the framework with other types of instruments, such as remote sensing earth science instruments.

Ames, Troy↗

Quantum computing based hybrid deep learning for fault diagnosis in electrical power systems

Quantum computing (QC) and deep learning have shown promise of supporting transformative advances and have recently gained popularity in a wide range of areas. Here, this paper proposes a hybrid QC-based deep learning framework for fault diagnosis of electrical power systems that combine the feature extraction capabilities of conditional restricted Boltzmann machine with an efficient classification of deep networks. Computational challenges stemming from the complexities of such deep learning models are overcome by QC-based training methodologies that effectively leverage the complementary strengths of quantum assisted learning and classical training techniques. The proposed hybrid QC-based deep learning framework is tested on a simulated electrical power system with 30 buses and wide variations of substation and transmission line faults, to demonstrate the framework’s applicability, efficiency, and generalization capabilities. High computational efficiency is enjoyed by the proposed hybrid approach in terms of computational effort required and quality of diagnosis performance over classical training methods. In addition, superior and reliable fault diagnosis performance with faster response time is achieved over state-of-the-art pattern recognition methods based on artificial neural networks (ANN) and decision trees (DT).

42 ENGINEERING↗

A2Cloud‐RF : A random forest based statistical framework to guide resource selection for high‐performance scientific computing on the cloud

Summary This article proposes a random‐forest based A2Cloud framework to match scientific applications with Cloud providers and their instances for high performance. The framework leverages four engines for this task: PERF engine, Cloud trace engine, A2Cloud‐ext engine, and the random forest classifier (RFC) engine. The PERF engine profiles the application to obtain performance characteristics, including the number of single‐precision (SP) floating‐point operations (FLOPs), double‐precision (DP) FLOPs, x87 operations, memory accesses, and disk accesses. The Cloud trace engine obtains the corresponding performance characteristics of the selected Cloud instances including: SP floating point operations per second (FLOPS), DP FLOPS, x87 operations per second, memory bandwidth, and disk bandwidth. The A2Cloud‐ext engine uses the application and Cloud instance characteristics to generate objective scores that represent the application‐to‐Cloud match. The RFC engine uses these objective scores to generate two types of random forests to assist users with rapid analysis: application‐specific random forests (ARF) and application‐class based random forests. The ARF consider only the input application's characteristics to generate a random forest and provide numerical ratings to the selected Cloud instances. To generate the application‐class based random forests, the RFC engine downloads the application profiles and scores of previously tested applications that perform similar to the input application. Using these data, the RFC engine creates a random forest for instance recommendation. We exhaustively test this framework using eight real‐world applications across 12 instances from different Cloud providers. Our tests show significant statistical agreement between the instance ratings given by the framework and the ratings obtained via actual Cloud executions.

Samuel, David↗

CMB-S4: Iterative Internal Delensing and r Constraints

Abstract The tightest constraints on the tensor-to-scalar ratio r can only be obtained after removing a substantial fraction of the lensing B -mode sample variance. The planned Cosmic Microwave Background (CMB)-S4 experiment ( cmb-s4.org ) will remove the lensing B -mode signal internally by reconstructing the gravitational lenses from high-resolution observations. We document here a first lensing reconstruction pipeline able to achieve this optimally for arbitrary sky coverage. We make it part of a map-based framework to test CMB-S4 delensing performance and its constraining power on r , including inhomogeneous noise and two non-Gaussian Galactic polarized foreground models. The framework performs component separation of the high-resolution maps, followed by the construction of lensing B -mode templates, which are then included in a parametric small-aperture map cross-spectra-based likelihood for r . We find that the lensing reconstruction and framework achieve the expected performance, compatible with the target σ ( r ) ≃ 5 · 10 −4 in the absence of a tensor signal, after an effective removal of 92%–93% of the lensing B -mode variance, depending on the simulation set. The code for the lensing reconstruction can also be used for cross-correlation studies with large-scale structures, lensing spectrum reconstruction, cluster lensing, or other CMB lensing-related purposes. As part of our tests, we also demonstrate the joint optimal reconstruction of the lensing potential with the lensing curl potential mode at second order in the density fluctuations.

Astronomy & Astrophysics↗

Excitation spectra of aromatic molecules within a real-space G W -BSE formalism: Role of self-consistency and vertex corrections

Here, we present first-principles calculations on the vertical ionization potentials (IPs), electron affinities (EAs), and singlet excitation energies on an aromatic-molecule test set (benzene, thiophene, 1,2,5-thiadiazole, naphthalene, benzothiazole, and tetrathiafulvalene) within the GW and Bethe-Salpeter equation (BSE) formalisms. Our computational framework, which employs a real-space basis for ground-state and a transition-space basis for excited-state calculations, is well suited for high-accuracy calculations on molecules, as we show by comparing against G 0 W 0 calculations within a plane-wave-basis formalism. We then generalize our framework to test variants of the GW approximation that include a local density approximation (LDA)–derived vertex function (Γ LDA ) and quasiparticle-self-consistent (QS) iterations. We find that Γ LDA and quasiparticle self-consistency shift IPs and EAs by roughly the same magnitude, but with opposite sign for IPs and the same sign for EAs. G 0 W 0 and QS GW Γ LDA are more accurate for IPs, while G 0 W 0 Γ LDA and QS GW are best for EAs. For optical excitations, we find that perturbative GW -BSE underestimates the singlet excitation energy, while self-consistent GW -BSE results in good agreement with previous best-estimate values for both valence and Rydberg excitations. Finally, our work suggests that a hybrid approach, in which G 0 W 0 energies are used for occupied orbitals and G 0 W 0 Γ LDA for unoccupied orbitals, also yields optical excitation energies in good agreement with experiment but at a smaller computational cost.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Coupled Gas-Exchange Model for C4 Leaves Comparing Stomatal Conductance Models

Plant simulation models are abstractions of plant physiological processes that are useful for investigating the responses of plants to changes in the environment. Because photosynthesis and transpiration are fundamental processes that drive plant growth and water relations, a leaf gas-exchange model that couples their interdependent relationship through stomatal control is a prerequisite for explanatory plant simulation models. Here, we present a coupled gas-exchange model for C4 leaves incorporating two widely used stomatal conductance submodels: Ball–Berry and Medlyn models. The output variables of the model includes steady-state values of CO2 assimilation rate, transpiration rate, stomatal conductance, leaf temperature, internal CO2 concentrations, and other leaf gas-exchange attributes in response to light, temperature, CO2, humidity, leaf nitrogen, and leaf water status. We test the model behavior and sensitivity, and discuss its applications and limitations. The model was implemented in Julia programming language using a novel modeling framework. Our testing and analyses indicate that the model behavior is reasonably sensitive and reliable in a wide range of environmental conditions. The behavior of the two model variants differing in stomatal conductance submodels deviated substantially from each other in low humidity conditions. The model was capable of replicating the behavior of transgenic C4 leaves under moderate temperatures as found in the literature. The coupled model, however, underestimated stomatal conductance in very high temperatures. This is likely an inherent limitation of the coupling approaches using Ball–Berry type models in which photosynthesis and stomatal conductance are recursively linked as an input of the other.

59 BASIC BIOLOGICAL SCIENCES↗