Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

An Overview of the Total Lightning Jump Algorithm: Past, Present and Future Work

Rapid increases in total lightning prior to the onset of severe and hazardous weather have been observed for several decades. These rapid increases are known as lightning jumps and can precede the occurrence of severe weather by tens of minutes. Over the past decade, a significant effort has been made to quantify lightning jump behavior in relation to its utility as a predictor of severe and hazardous weather. Based on a study of 34 thunderstorms that occurred in the Tennessee Valley, early work conducted in our group at Huntsville determined that it was indeed possible to create a reasonable operational lightning jump algorithm (LJA) based on a statistical framework relying on the variance behavior of the lightning trending signal. We the expanded this framework and tested several variance-related LJA configurations on a much larger sample of 87 severe and non severe thunderstorms. This study determined that a configuration named the "2(sigma)" algorithm had the most promise in development of the operational LJA with a probability of detection (POD) of 87%, a false alarm rate (FAR) of 33%, a Heidke Skill Score (HSS) of 0.75. The 2(sigma) algorithm was then tested on an even larger sample of 711 thunderstorms of all types from four regions of the country where total lightning measurement capability existed. The result was very encouraging.Despite the larger number of storms and the inclusion of different regions of the country, the POD remained high (79%), the FAR was low (36%) and HSS was solid (0.71). Average lead time from jump to severe weather occurrence was 20.65 minutes, with a standard deviation of +/- 15 minutes. Also, trends in total lightning were compared to cloud to ground (CG) lightning trends, and it was determined that total lightning trends had a higher POD (79% vs 66%), lower FAR (36% vs 54 %) and a better HSS (0.71 vs 0.55). From the 711-storm case study it was determined that a majority of missed events were due to severe weather producing thunderstorms in low flashing environments. The latest efforts have been geared toward examining these low flashing storms in order to adjust the algorithm for such storms, thus enhancing the capability of the LJA. Future work will test the algorithm in real time using current satellite and radar based cell tracking methods, as well as, comparing total lightning jump occurrence to both satellite based and ground base observations of thunderstorms to create correlations between lightning jumps and the observed structures within thunderstorms. Finally this algorithm will need to be tested using Geostationary Lightning Mapper proxy data to transition the algorithm from VHF ground based lightning measurements to lower frequency space-based lightning measurements.

Schultz, Christopher J.↗

SILHIL Replication of Electric Aircraft Powertrain Dynamics and Inner-Loop Control for V&V of System Health Management Routines

Software-in-the-loop and Hardware-in-the-loop testing of failure prognostics and decision making tools for aircraft systems will facilitate more comprehensive and cost-effective testing than what is practical to conduct with flight tests. A framework is described for the offline recreation of dynamic loads on simulated or physical aircraft powertrain components based on a real-time simulation of airframe dynamics running on a flight simulator, an inner-loop flight control policy executed by either an autopilot routine or a human pilot, and a supervisory fault management control policy. The creation of an offline framework for verifying and validating supervisory failure prognostics and decision making routines is described for the example of battery charge depletion failure scenarios onboard a prototype electric unmanned aerial vehicle.

Verification and Validation↗

Antarctic Analog for Dilational Bands on Europa

Europa's surface shows signs of extension, which is revealed as lithospheric dilation expressed along ridges, dilational bands and ridged bands. Ridges, the most common tectonic feature on Europa, comprise a central crack flanked by two raised banks a few hundred meters high on each side. Together these three classes may represent a continuum of formation. In Tufts' Dilational Model ridge formation is dominated by daily tidal cycling of a crack, which can be superimposed with regional secular dilation. The two sources of dilation can combine to form the various band morphologies observed. New GPS data along a rift on the Ross Ice Shelf, Antarctica is a suitable Earth analog to test the framework of Tufts' Dilational Model. As predicted by Tufts' Dilational Model, tensile failures in the Ross Ice Shelf exhibit secular dilation, upon which a tidal signal can be seen. From this analog we conclude that Tufts' Dilational Model for Europan ridges and bands may be credible and that the secular dilation is most likely from a regional source and not tidally driven.

Tectonics↗

All-Sky Microwave Imager Data Assimilation at NASA GMAO

Efforts in all-sky satellite data assimilation at the Global Modeling and Assimilation Office (GMAO) at NASA Goddard Space Flight Center have been focused on the development of GSI configurations to assimilate all-sky data from microwave imagers such as the GPM Microwave Imager (GMI) and Global Change Observation Mission-Water (GCOM-W) Advanced Microwave Scanning Radiometer 2 (AMSR-2). Electromagnetic characteristics associated with their wavelengths allow microwave imager data to be relatively transparent to atmospheric gases and thin ice clouds, and highly sensitive to precipitation. Therefore, GMAOs all-sky data assimilation efforts are primarily focused on utilizing these data in precipitating regions. The all-sky framework being tested at GMAO employs the GSI in a hybrid 4D-EnVar configuration of the Goddard Earth Observing System (GEOS) data assimilation system, which will be included in the next formal update of GEOS. This article provides an overview of the development of all-sky radiance assimilation in GEOS, including some performance metrics. In addition, various projects underway at GMAO designed to enhance the all-sky implementation will be introduced.

NWP↗

Assessing the Viability of Using GEOS-Forecast Product for Landslides Forecasting: A Step Toward Early Warning System

Landslides across the globe are mostly triggered by extreme rainfall events affecting infrastructure, transportation and livelihoods. The risks are rarely quantified due to lack of data, analytical skills and limited modeling techniques. Knowledge of local to global scale landslide risks provides communities and national agencies the ability to adapt disaster management practices to mitigate and recover from these hazards. In order to minimize the risks and improve characterization of community resilience to landslides, it is vital to have reliable information about the factors triggering landslides such as rainfall, well ahead in time. Forecasting potential landslide activity and impacts can be achieved through reliable precipitation forecast models. However, it is challenging because of the temporal and spatial variability of precipitation, an important factor in triggering landslides. Evaluation of the precipitation field, associated errors, and sampling uncertainties is integral for development of efficient and reliable landslide forecasting and early warning system. This study develops a methodology to assess the viability of using a precipitation field provided by a global model and its potential integration in the landslide forecasting system. The study focuses on the comparison between the IMERG (Integrated Multi-satellitE Retrievals for Global Precipitation Mission) and GEOS (NASA Goddard Earth Observing System)-Forecast product over contiguous United States (CONUS). GEOS model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The framework is tested on the GEOS-Forecast Model initialized at 00 UTC using daily IMERG early product as reference using both categorical and continuous statistics. The categorical statistics includes the probability of detection (POD), success ratio (SR), critical success index (CSI), and the hit bias. Continuous statistics such as correlation, normalized standard deviation, and root-mean-square error are also evaluated. Overall, GEOS-Forecast precipitation field over the analysis period (~1 year) show underestimation with respect to IMERG early for the daily accumulated rainfall. However, the probability distribution function and cumulative distribution function of both show similar patterns. In terms of correlations, POD, SR, CSI, hit bias, the performance varies with respect to the rainfall threshold used.

Sana Khan↗

Python Based Plume Dynamics Estimation Tool (PyPDET) Rapid Plume Strike Analysis for RPOD Maneuvers in Deep Space Operations

I worked as a NASA Intern during the Summer 2023 term in the DS-00 division under the supervision of my mentor, Dr. Jonathan Pitt. Our goal was to build on our previous work from 2022 to develop a plume strike estimation tool using a prescribed physics methodology and model plume impingement effects while considering the dynamics of a rendezvous, operations, proximity, and docking (RPOD) maneuver. This tool supports previously configured CFD-DSMC calculations by allowing for rapid analysis of initial designs using a low-fidelity source flow model. Engineers can then use the high-fidelity CFD-DSMC tool to consolidate results as they work towards finalizing a design. This year’s project was focused on developing a software application that other engineers would be using in their analysis. Thus, the user’s experience was considered in the development of this application. Proper documentation, testability, and modularity of the codebase was our priority. For example, the project included auto documentation procedures to start building towards a User Manual, while also including dedicated demonstration cases for more explicit communication of functionality. Also, this project included a framework for testing the source code for future developments. Additionally, care was taken to develop the code using an Object-Oriented Programming approach. Thus, allowing for a modular extensibility of functionality in anticipation of future developments. The core work of this project was developing an algorithm that would transform the visiting vehicle and associated thruster data according to the kinematics described in the jet firing history. It would then calculate the estimated plume strikes on two of the target vehicles and write data accordingly into a VTK file. Summer work is to conclude by developing and presenting a PowerPoint slide deck at the intern exit briefing on August 11 th , 2023. Once the model for simple plume strike calculations is developed and tested there are several avenues to explore to continue development of this tool. These are also discussed in this report.

Plume Impingement↗

Land Surfaces at the Tipping-Point for Water and Energy Balance Coupling

The surface water and energy balances can be coupled or uncoupled depending on whether the evaporation regime is water-limited or energy-limited. As the landscape loses soil moisture during drydowns, a transition between the regimes may occur, which signifies a nonlinear change in water-energy-carbon coupling. Regions that switch often between these two regimes, that is, are dominated by neither regime, are particularly vulnerable to climate variability and change. To robustly identify these tipping points, we identify drydown events based on global soil moisture data sets from remote sensing. The event identification does not rely on precipitation information and is robust with respect to measurement noise. Then, the soil moisture thresholds delineating the evaporation regime transitions are determined by Sequential Monte Carlo Sampling and a two-stage parametrization strategy. Based on the estimated soil moisture thresholds across the globe, we estimate observation-based water availability indices which quantify the nonlinear controls of soil moisture on evaporation. This framework is tested and applied globally using Soil Moisture Active Passive soil moisture retrievals. Combined with a new tippling-point metric that describes the frequency of evaporation regime transitions, we identify regions that switch often between different evaporation regimes at the global scale. Given unit shifts in soil moisture, these regions will experience the most change in how their surface water and energy are coupled.

Jianzhi Dong↗

Long-term Running Experience with the Silicon Micro-strip Tracker at the D{\O} detector

The Silicon Micro-strip Tracker (SMT) at the D0 experiment in the Fermilab Tevatron collider has been operating since 2001. In 2006, an additional layer, referred to as 'Layer 0', was installed to improve impact parameter resolution and compensate for detector degradation due to radiation damage to the original innermost SMT layer. The SMT detector provides valuable tracking and vertexing information for the experiment. This contribution will highlight aspects of the long term operation of the SMT, including the impact of the silicon readout test-stand. Due to the full integration of the test-stand into the D0 trigger framework, this test-stand provides an advantageous tool for training of new experts and studying subtle effects in the SMT while minimizing impact on the global data acquisition.

43 PARTICLE ACCELERATORS↗

Application of the Koopman Operator-Theoretic Framework to Power System Dynamic State Estimation

Model-based and data-driven methods are combined to develop a hierarchical decentralized, robust dynamic state estimator (DSE). A two-level hierarchy is proposed, where the lower level consists of robust, model-based, decentralized DSEs. The state estimates sent from the lower level are received at the upper level, where they are filtered by a robust data-driven DSE. The proposed hybrid framework does not depend on the centralized infrastructure of the control centers; thus it can be completely embedded into the wide-area measurement systems. This feature will ultimately facilitate the placement of hierarchical decentralized control schemes at the phasor data concentrator locations. Also, the network model is not necessary; thus, a topology processor is not required. Finally, there is no assumption on the dynamics of the electric loads. The proposed framework is tested on the 2,000-bus synthetic Texas system and shown to be capable of reconstructing the dynamic states of the generators with high accuracy, and of forecasting in the advent of missing data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Hybrid Framework Combining Model-Based and Data-Driven Methods for Hierarchical Decentralized Robust Dynamic State Estimation: Preprint

This paper combines model-based and data-driven methods to develop a hierarchical decentralized robust dynamic state estimator (DSE). A two-level hierarchy is proposed, where the lower level is comprised of robust model-based decentralized DSEs. The state estimates sent from the lower level are received at the upper level, where they are filtered by a robust data- driven DSE, after a principled sparse selection. This selection allows us to shrink the dimension of the problem at the upper level, and hence to speed up the computational time significantly. The proposed hybrid framework does not depend upon the centralized infrastructure of the control centers, thus it can be completely embedded into the wide-area measurement systems. This feature will ultimately facilitate the placement of hierarchical decentralized control schemes at the phasor data concentrator (PDC) locations. Also, the network model is not necessary, thus a topology processor is not required. Finally, there is no assumption on the dynamics of the electric loads. The proposed framework is tested on a 2000-bus network.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DeepSurveySim: Simulation Software and Benchmark Challenges for Astronomical Observation Scheduling

Modern astronomical surveys have multiple competing scientific goals. Optimizing the observation schedule for these goals presents significant computational and theoretical challenges, and state-of-the-art methods rely on expensive human inspection of simulated telescope schedules. Automated methods, such as reinforcement learning, have recently been explored to accelerate scheduling. However, there do not yet exist benchmark data sets or user-friendly software frameworks for testing and comparing these methods. We present DeepSurveySim -- a high-fidelity and flexible simulation tool for use in telescope scheduling. DeepSurveySim provides methods for tracking and approximating sky conditions for a set of observations from a user-supplied telescope configuration. We envision this tool being used to produce benchmark data sets and for evaluating the efficacy of ground-based telescope scheduling algorithms, particularly for machine learning algorithms that would suffer in efficacy if limited to real data for training.We introduce three example survey configurations and related code implementations as benchmark problems that can be simulated with DeepSurveySim.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sensitivity-Based Reactive Power Dispatch of DERs to Support Transmission Grid During Emergency

This paper proposes a TSO-DSO framework including DER set-point dispatch using sensitivity analysis. We address all three steps of TSO-DSO integration stating by estimating the capability curve of an unbalanced distribution system and then modeling of capability curve on the transmission side grid and estimating the reactive power needed from DSO during emergencies, and ending by dispatching the requested reactive power from TSO. The proposed interaction framework is tested on an IEEE 37-node distribution network connected to IEEE 9 bus transmission system. The simulation shows that using sensitivity-based dispatch would reduce the number of communication signals between DERs and DSO and that can decrease the risk of communication contingency.

Alkhonain, Ahmed↗

A New Modeling Framework for Multi-Scale Simulation of Hydraulic Fracturing and Production from Unconventional Reservoirs

This paper describes a new modeling framework for microscopic to reservoir-scale simulations of hydraulic fracturing and production. The approach builds upon a fusion of two existing high-performance simulators for reservoir-scale behavior: the GEOS code for hydromechanical evolution during stimulation and the TOUGH+ code for multi-phase flow during production. The reservoir-scale simulations are informed by experimental and modeling studies at the laboratory scale to incorporate important micro-scale mechanical processes and chemical reactions occurring within the fractures, the shale matrix, and at the fracture-fluid interfaces. These processes include, among others, changes in stimulated fracture permeability as a result of proppant behavior rearrangement or embedment, or mineral scale precipitation within pores and microfractures, at µm to cm scales. In our new modeling framework, such micro-scale testing and modeling provides upscaled hydromechanical parameters for the reservoir scale models. We are currently testing the new modeling framework using field data and core samples from the Hydraulic Fracturing Field Test (HFTS), a recent field-based joint research experiment with intense monitoring of hydraulic fracturing and shale production in the Wolfcamp Formation in the Permian Basin (USA). Below, we present our approach coupling the reservoir simulators GEOS and TOUGH+ informed by upscaled parameters from micro-scale experiments and modeling. We provide a brief overview of the HFTS and the available field data, and then discuss the ongoing application of our new workflow to the HFTS data set.

58 GEOSCIENCES↗

Are current effectiveness criteria fit for purpose? Using a controversial strategic assessment as a test case

Highlights: • The effectiveness framework of Bond et al. (2015) is tested on a case study. • The strategic assessment of the proposed Browse LNG Precinct is evaluated. • The effectiveness framework is modified as a result of the analysis. • “Legitimacy” encompasses both pluralism and normative effectiveness. • Substantive effectiveness should include consideration of unintended consequences. - Abstract: The aim of this paper is to test the broader utility of the sustainability assessment effectiveness framework of Bond et al. (2015) by applying it to a controversial strategic assessment case study. The effectiveness framework comprises six dimensions: procedural effectiveness, substantive effectiveness, transactive effectiveness, normative effectiveness, pluralism, and knowledge and learning. It was originally developed to evaluate sustainability assessment at a system-wide level and it has not been previously applied to a specific case study. The analysis was conducted through document review and the first-hand experience of two of the authors who were involved in the case study in different capacities. The case study selected was the strategic assessment of the proposed Browse Liquefied Natural Gas (LNG) Precinct in Western Australia, which was conducted over the period 2007–2015 under the strategic assessment provisions of both the Western Australian and Australian Commonwealth environmental legislation. The framework provided a useful structure within which this complex case study could be explored, its strengths and weaknesses brought to light, and the interactions between the dimensions highlighted. We also found opportunities for refinement of the framework. As a result of this analysis we propose to replace the final three dimensions of the framework with legitimacy, where a legitimate process is one which all stakeholders agree is fair and which delivers an acceptable outcome for all parties, though we acknowledge the need for further conceptualisation of this dimension. We also suggest that the concept of substantive effectiveness should be expanded to incorporate the unintended consequences of impact assessment. Our research thus makes both a useful addition to the literature already published on the Browse case study, as well as to the literature on impact assessment effectiveness.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Accounting for Proof Test Data in a Reliability Based Design Optimization Framework

This paper investigates the use of proof (or acceptance) test data during the reliability based design optimization of structural components. It is assumed that every component will be proof tested and that the component will only enter into service if it passes the proof test. The goal is to reduce the component weight, while maintaining high reliability, by exploiting the proof test results during the design process. The proposed procedure results in the simultaneous design of the structural component and the proof test itself and provides the designer with direct control over the probability of failing the proof test. The procedure is illustrated using two analytical example problems and the results indicate that significant weight savings are possible when exploiting the proof test results during the design process.

Ventor, Gerharad↗

A Distributed Simulation Framework Applied to Artemis Analysis, Studies, Integration, and Test

The National Aeronautics and Space Administration (NASA) established the Artemis Program, a series of missions to return humans to the Moon and explore further than before. To execute the Artemis missions, NASA is collaborating with commercial and international partners to create the necessary infrastructure and logistics plan that will establish a long term presence on the Moon ahead of exploring Mars. NASA and its partners are developing a collection of space and surface systems to support crewed missions to the lunar surface that will provide the mobility, habitation, logistics, and exploration support necessary for Artemis mission successes which includes robust scientific investigations. This paper details the design, capabilities, and uses of the Artemis Distributed Simulation (ADS) being developed by the NASA Exploration Systems Simulations (NExSyS) Team to support Artemis architecture studies. ADS utilizes international interoperability standards to connect a collection of independent vehicle and service simulations; these include but are not limited to elements such as rovers, landers, and habitation elements along with services like communications, environment, visualization, and data logging. ADS’s distributed nature allows for the complex aggregation of constituent Artemis elements; this includes efficient scenario modification with the addition or removal of individual simulations representing Artemis elements or services. This capability provides support for the rapid performance of various Artemis mission trade studies exploring alternate configurations. Currently, ADS uses NASA developed simulations for development and testing; however, through the use of international simulation interoperability standards, ADS provides an integration framework to incorporate dissimilar authoritative vendor simulations as Artemis systems mature and vendor simulations become available. Vendor simulations will be able to join ADS and interact with other Artemis elements and vehicles while limiting the exposure of proprietary data. This paper describes the expansion of an existing distributed simulation infrastructure to accommodate a collaborative and dynamic framework for the Artemis Program. This work includes updated federation designs, integration into existing NASA facilities, advancements in visualizations, and advancements in human driven inputs. This paper will also outline recently completed and ongoing support and collaboration with NASA studies and testing, namely results from energetics and Human-In-The-Loop (HITL) studies. The paper concludes with a plan for future developments and facility integration to enable enhanced studies in preparation for a return of humans to the lunar surface.

Artemis↗

An analysis framework for characterizing and explaining development of EIA legislation in developing countries-Illustrated for Georgia, Ghana and Yemen

Actors in the field of international development co-operation supporting the development of EIA legislation in developing countries often do not achieve the results envisaged. The performance of EIA in these countries often remains weak. One reason, we assume, is that often those actors support the establishment of overly ambitious EIA legislation that cannot achieve its objectives in the light of constraining contexts. To provide more effective support we need to better understand the enabling and constraining contextual factors that influence the development of EIA legislation and to which support actors should align itself. In this article a new analysis framework for classifying, characterizing and explaining the development of EIA legislation is described, measured in terms of ambition levels. Ambitions are defined as intentions the EIA authorities aim to fulfill, expressed in formal EIA legislation. Three country cases, Yemen, Georgia and Ghana are used to illustrate the usefulness of our framework and as a first test to refine the framework. We have formulated the following five hypotheses that complement and refine our analysis framework. One, EIA legislation may develop multilinearly in terms of ambition levels. Two, ambitions in EIA legislation seem to be influenced to a great extent by the power and capacity of, on the one hand, the environmental authorities supporting EIA and, on the other hand, the sector authorities hindering the development of EIA. Three, the political system is the most important context factor influencing the rules of policy-making and the power of the different actors involved. Four, the importance of context factors on the development of ambitions is dependent on the phase of EIA system development. Five, some ambitions seem to be influenced by particular factors; for instance the ambitions for the object of study seem to be influenced by the level of environmental awareness of the sector ministries and parliament. The analysis framework may also assist actors involved in the development of EIA legislation in setting ambitions for EIA legislation that are feasible within the context in which it will be developed and implemented. Application of a country-specific EIA model would seem to be the preferred model to develop EIA legislation because by taking capacities of actors and context factors as a starting point, it offers more potential to well-performing EIA systems. - Highlights: Black-Right-Pointing-Pointer EIA systems develop from less to high ambitious and sometimes vice versa. Black-Right-Pointing-Pointer Ambitions in EIA legislation are determined by the capacity of environment- and sector authority. Black-Right-Pointing-Pointer The political system is the most important context factor explaining the ambitions of an EIA system. Black-Right-Pointing-Pointer An analysis framework developed to measure EIA system ambitions might help to setambitions.

54 ENVIRONMENTAL SCIENCES↗