Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

QMU as an Approach to Strengthening the Predictive Capabilities of Complex Models

Complex systems are made up of multiple interdependent parts, and the behavior of the entire system cannot always be directly inferred from the behavior of the individual parts. They are nonlinear and system responses are not necessarily additive. Examples of complex systems include energy, cyber and telecommunication infrastructures, human and animal social structures, and biological structures such as cells. To meet the goals of infrastructure development, maintenance, and protection for cyber-related complex systems, novel modeling and simulation technology is needed. Sandia has shown success using M&S in the nuclear weapons (NW) program. However, complex systems represent a significant challenge and relative departure from the classical M&S exercises, and many of the scientific and mathematical M&S processes must be re-envisioned. Specifically, in the NW program, requirements and acceptable margins for performance, resilience, and security are well-defined and given quantitatively from the start. The Quantification of Margins and Uncertainties (QMU) process helps to assess whether or not these safety, reliability and performance requirements have been met after a system has been developed. In this sense, QMU is used as a sort of check that requirements have been met once the development process is completed. In contrast, performance requirements and margins may not have been defined a priori for many complex systems, (i.e. the Internet, electrical distribution grids, etc.), particularly not in quantitative terms. This project addresses this fundamental difference by investigating the use of QMU at the start of the design process for complex systems. Three major tasks were completed. First, the characteristics of the cyber infrastructure problem were collected and considered in the context of QMU-based tools. Second, UQ methodologies for the quantification of model discrepancies were considered in the context of statistical models of cyber activity. Third, Bayesian methods for optimal testing in the QMU framework were developed. This completion of this project represent an increased understanding of how to apply and use the QMU process as a means for improving model predictions of the behavior of complex systems.

Gray, Genetha Anne↗

Leveraging Intrinsic Principal Directions for Multifidelity Uncertainty Quantification

In this work we propose an approach for accelerating Uncertainty Quantification (UQ) analysis in the context of Multifidelity applications. In the presence of complex multiphysics applications, which often require a prohibitive computational cost for each evaluation, multifidelity UQ techniques try to accelerate the convergence of statistics by leveraging the in- formation collected from a larger number of a lower fidelity model realizations. However, at the-state-of-the-art, the performance of virtually all the multifidelity UQ techniques is related to the correlation between the high and low-fidelity models. In this work we proposed to design a multifidelity UQ framework based on the identification of independent important directions for each model. The main idea is that if the responses of each model can be represented in a common space, this latter can be shared to enhance the correlation when the samples are drawn with respect to it instead of the original variables. There are also two main additional advantages that follow from this approach. First, the models might be correlated even if their original parametrizations are chosen independently. Second, if the shared space between models has a lower dimensionality than the original spaces, the UQ analysis might benefit from a dimension reduction standpoint. In this work we designed this general framework and we also tested it on several test problems ranging from analytical functions for verification purpose, up to more challenging application problems as an aero-thermo-structural analysis and a scramjet flow analysis.

42 ENGINEERING↗

Hybrid Ceramic-CMC Vane with EBC for Future Coal Derived Syngas Fired 65% Efficient Turbine Combined Cycle

The efficiency of both simple cycle and combined cycle power generation systems scale with the peak temperature at which the gas exits the combustor to drive the turbine. In conventional systems, a substantial fraction of the total turbine core flow exiting the compressor is diverted downstream to cool metallic turbine hardware rather than power the turbine, much of which is used to cool the first-stage turbine vane. The use of coal derived syngas fuels provides an additional challenge to the lifetime of materials utilized in the turbine, as particulate byproducts created in the coal gasification process melt in the combustion gas, and can subsequently deposit and interact with the turbine hardware. The development of durable hot-section materials capable of operating at temperature well above that of single crystal superalloy airfoil/zirconia based thermal barrier coatings is critical to realizing 65% efficient coal derived syngas fired gas turbine based power systems. To enable higher turbine inlet temperatures while lowering cooling air requirements, United Technologies Research Center (UTRC), the central R&D laboratory supporting UT Pratt & Whitney, led the conceptual design of a new type of ceramic composite turbine hot section materials system. The design focused on a novel hybrid monolithic ceramic-fiber reinforced ceramic matrix composite (CMC) first stage turbine vane having an environmental barrier coating. By utilizing ceramic construction in the turbine hot-section, the core flow normally used to cool metallic components will be substantially reduced, increasing efficiency and reducing emissions. To provide the framework for future demonstration testing, UTRC partnered with University of North Dakota Energy and Environmental Research Center (UNDEERC) to provide a conceptual design for a gasified coal fed high-pressure turbine combustor system designed to mimic the conditions expected in a future 65% fuel to busbar efficient syngas fueled gas turbine based combined cycle. The UNDEERC and UTRC collaborated on characterizing dusts from coal gasifier filtration systems.

10 SYNTHETIC FUELS↗

An Overview of Gemma FY20 Verification Activities

Gemma verification activities for FY20 can be divided into three categories: the development of specialized quadrature rules, initial progress towards the development of manufactured solutions for code verification, and automated code-verification testing. In the method-of-moments implementation of the electric-field integral equation, the presence of a Green’s function in the four-dimensional integrals yields singularities in the integrand when two elements are nearby. To address these challenges, we have developed quadrature rules to integrate the functions through which the singularities can be characterized. Code verification is necessary to develop confidence in the implementation of the numerical methods in Gemma. Therefore, we have begun investigating the use of manufactured solutions to more thoroughly verify Gemma. Manufactured solutions provide greater flexibility for testing aspects of the code; however, the aforementioned singularities provide challenges, and existing work is limited in rigor and quantity. Finally, we have implemented automated code-verification testing using the VVTest framework to automate the mesh refinement and execution of a Gemma simulation to generate mesh convergence data. This infrastructure computes the observed order of accuracy from these data and compares it with the theoretical order of accuracy to either develop confidence in the implementation of the numerical methods or detect coding errors.

97 MATHEMATICS AND COMPUTING↗

OC6 Phase Ia Definition Document: Validation of Nonlinear Hydrodynamic Loading on the DeepCwind Semisubmersible

The objective of OC6 Phase I is to investigate the persistent under-prediction (about 20% on average) of the structural loads in the OC5-DeepCwind floating semisubmersible wind system, as observed within the previous OC5 Phase II project. The OC5 results indicate that much of this under-prediction originates from the low-frequency response of the system at the surge/pitch natural frequencies, resulting from nonlinear hydrodynamic loading and/or overprediction of hydrodynamic damping. This work package therefore focuses on better understanding this low-frequency response behavior, the applicability of computational-fluid-dynamics (CFD) models and engineering-level hydrodynamic models for predicting the nonlinear hydrodynamic loading, and the level of uncertainty in the measured response characteristics. To address these objectives, two experimental campaigns were developed and performed in 2017 and 2018 by a sub-group of the OC5 project: Floating test campaign: A simplified OC5-DeepCwind semisubmersible model (no turbine, rigid tower) was moored to three taut-spring lines and subjected to motion decay and wave tests (regular and irregular waves), during which motion amplitudes of the model were measured (see Figure 1a). The purpose of this test campaign was to examine the repeatability of the low-frequency response of the system to wave excitation and determine the level of uncertainty in the response behavior.Constrained test campaign: The same model, but without the tower present, was fixed to a carriage and subjected to towing, forced oscillation and wave tests (regular and irregular waves), during which forces exerted upon the model were measured (see Figure 1b). The purpose of this test campaign was to examine the hydrodynamic loading contributions by separating the wave excitation and radiation forces. Both model test campaigns were performed in the concept basin of the Maritime Research Institute Netherlands (MARIN) in Wageningen, the Netherlands and the first test was within the framework of the MARINET2 project. Both experimental campaigns were examined within Phase Ia of the OC6 project. The purpose of this report is to supply the needed information to participants of the OC6 project to build and simulate the experimental campaigns.

17 WIND ENERGY↗

Essence2.0 Development and Deployment (Final Report)

The objective of the project was to take two core technologies that have been developed under the Recipient’s solid laboratory products and integrate them into a single CyberPhysical awareness platform and complete development on current field-tested prototypes that will extend the integrated capability of the platform. During the final development phase, the Recipient development team and its selected industry partners tested and hardened the platform to ensure resilient and secure operation of the integrated platform. The team also executed substantial field testing and established the framework for defining the organization and/or commercial infrastructure needed to sustain operations and provide readiness for a national scale deployment. The focus of the project was (1) the improvement, refinement, and deployment of technology for the detection of cyber-attacks on utility operational technology (OT) and information technology (IT) networks and assets, including Supervisory Control and Data Acquisition Systems (SCADA) systems; and (2) support for containment and remediation of adversarial threats and actions against those systems and environments.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Scalable Solution for Grid Optimization and DER Integration (CRADA Final Report)

Utilidata Inc. is an energy software company that provides clean energy and digital solutions for utilities. This work was the result of Utilidata Inc. being awarded a New York State Energy Research and Development Agency award to integrate Utilidata volt-VAR optimization (VVO) software with smart inverters to explore enhanced voltage control. This project was conducted in partnership with Utilidata Inc., National Grid, the New York State Energy and Research Development Authority, and the National Renewable Energy Laboratory (NREL). As part of the project NREL conducted modeling and simulation analysis, developed cost-benefit analysis framework, and conducted laboratory testing to understand the potential for smart inverter integration to a centralized VVO control scheme. The remainder of the report provides an executive summary of the work, an introduction to the challenges, sections detailing specific aspects of the work, and the overall findings and conclusions.

14 SOLAR ENERGY↗

Preliminary Plan to Inform Testing of a Heat Exchanger Test Article

This report presents a preliminary plan to guide the qualification testing of advanced heat exchanger (HX) components for nuclear-to-industrial heat transfer applications. The objective is to establish a defensible, physics-based methodology that integrates computational modeling, targeted experimentation, and in-service inspection considerations to demonstrate component performance and reliability under representative reactor conditions. The analysis identifies Sodium-cooled Fast Reactor (SFR) and High-Temperature Gas-cooled Reactor (HTGR) systems as reference configurations in terms of temperature, pressure, and chemical environment. Within these operating envelopes, dominant degradation mechanisms— including creep–fatigue interaction, flow-induced vibration, corrosion, and diffusion-bond deterioration—were evaluated to define test requirements. A comprehensive computationalexperimental framework is proposed to support life prediction and qualification activities. The framework couples high-fidelity structural-mechanics, thermal-hydraulic, and fluid-structure interaction models with accelerated degradation testing to produce a traceable linkage between microstructural evolution, mechanical performance, and remaining useful life (RUL). The approach adheres to established Verification, Validation, and Uncertainty Quantification (VVUQ) standards (ASME V&V 10/20; NUREG-2152) and incorporates a digital-twin architecture for continuous model refinement through data assimilation. The plan further outlines testing methodologies, including pre-test analyses, test-loop design parameters, and sensor placement strategies that maximize information yield while maintaining mechanistic fidelity. Complementary sections describe in-service inspection (ISI), on-line monitoring (OLM), and structural-health-monitoring (SHM) techniques applicable to compact HX geometries typical of advanced reactors. Collectively, these activities establish the technical foundation for demonstrating 40-60-year equivalent service life of advanced heat exchangers in support of the U.S. Department of Energy’s Advanced Reactor and Integrated Energy Systems programs. The forthcoming phase will execute the defined pre-test analyses, initiate hardware fabrication, and implement the integrated testing campaign to validate the proposed qualification methodology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Smart Buildings: Business Case and Action Plan

General Services Administration (GSA) has been a pioneer in using Smart Building technologies but it has yet to achieve the full benefits of an integrated, enterprise-wide Smart Building strategy. In July 2008, GSA developed an initial briefing memorandum that identified five actions for a Smart Buildings feasibility study: (1) Identify and cluster the major building systems under consideration for a Smart Buildings initiative; (2) Identify GSA priorities for these clusters; (3) Plan for future adoption of Smart Building strategies by identifying compatible hardware; (4) Develop a framework for implementing and testing Smart Building strategies and converged networks; and (5) Document relevant GSA and industry initiatives in this arena. Based on this briefing memorandum, PBS and FAS retained consultants from Lawrence Berkeley National Laboratory, Noblis, and the Building Intelligence Group to evaluate the potential for Smart Buildings within GSA, and to develop this report. The project has included extensive interviews with GSA staff (See Appendix A), a review of existing GSA standards and documents, and an examination of relevant GSA and industry initiatives. Based on interviews with GSA staff and a review of GSA standards and documents, the project team focused on four goals for evaluating how Smart Building technology can benefit GSA: (1) Achieve Energy Efficiency Mandates--Use Smart Building technology as a tool to meet EISA 2007 and EO 13423 goals for energy efficiency. (2) Enhance Property Management--Deploy enterprise tools for improved Operations and Maintenance (O&M) performance and verification. (3) Implement Network as the Fourth Utility--Utilize a converged broadband network to support Smart Building systems and provide GSA clients with connectivity for voice, data and video. (4) Enhance Safety and Security--Harmonize Physical Access Control Systems (PACS) with Smart Building Systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Response and Uniformity Studies of Directly Coupled Tiles

A finely-segmented scintillator-based calorimeter which capitalizes on the marriage of proven detection techniques with novel solid-state photo-detector devices such as Multi-pixel Photon Counters (MPPCs) is an interesting calorimetric system from the point of view of future detector design. A calorimeter system consisting of millions of channels will require a high degree of integration. The first steps towards this integration have already been facilitated by the small size and magnetic field immunity of the MPPCs. The photo-conversion occurs right at the tile, thus obviating the need for routing of long clear fibers. Similar considerations apply to the presence of wave-length shifting (WLS) fibers inside the tiles which couple it to the photo-detectors. Significant simplification in construction and assembly ensue if the MPPCs can be coupled directly to the scintillator tiles. Equally importantly, the total absence of fibers would offer greater flexibility in the choice of the transverse segmentation while enhancing the electro-mechanical integrability of the design. The NIU high-energy physics group has been studying the fiberless or direct-coupling option for some time now. Encouraging results on response and response uniformity have been obtained using radioactive sources. This MOU seeks to set up a framework to extend these tests using beams at the MTBF. The results will be relevant to high granularity scintillator/crystal electromagnetic and hadronic calorimetry. The tests involve a set of small directly-coupled tile counters fabricated at NIU which will be placed in the beam to study their response and response uniformity as a function of the incident position of the particles passing through them.

43 PARTICLE ACCELERATORS↗

A Risk Assessment Framework for Cyber-Physical Security in Distribution Grids with Grid-Edge DERs

Integration of inverter-based distributed energy resources (DERs) is reshaping the landscape of distribution grids to fulfill the socioeconomic, environmental, and sustainability goals. Addressing the technological challenges of DER grid integration requires an adaptive communication layer for efficient DER management and control. This transition has given rise to a cyberphysical system (CPS) architecture within the distribution system, causing new vulnerabilities for cyberphysical attacks. To better address potential threats, this paper presents a comprehensive risk assessment framework for cyberphysical security in distribution grids with grid-edge DERs. The framework incorporates a detailed CPS model accounting for dynamic DER characteristics within the distribution grid. It identifies vulnerabilities in DER communication systems, models attack scenarios, and addresses communication latency crucial for inverter control timescales. Subsequently, the quantification of attack impacts employs an attack probability model including both the vulnerability and criticality of cyber components. The proposed risk assessment framework was validated through testing on the modified IEEE 13-node and 123-node test feeders.

cyberattack↗

On stellar wind accretion in widely separated X-ray binaries, and the nature of 4U0115+63

Widely separated, eccentric pulsating X-ray binaries are shown to be appropriate systems for studying the basic properties of stellar wind accretion. They are free from the complications encountered in closed binaries, where the optical star nearly fills its critical lobe (Avni, 1977). A framework of four observational tests was set up to study the characteristics of wind accretion, and to distinguish between different models of wind acceleration. The tests are applied to the source 4U0115+63, and the accretion process is discussed in both its quiescent states, and during its transient high luminosity outbursts. For the quiescent steady state, two wind profiles, determined from observational data, are compared (Barlow-Lohen, 1977; Castor et al., 1975). The difficulties encountered during the transient high states with respect to the possibility of stellar wind accretion are discussed.

Avni, Y.↗

Applications of state estimation in aircraft flight-data analysis

This paper traces the evolution of the use of state estimation in the analysis of aircraft flight data and discusses some recent applications associated with airline turbulence upsets and high-angle-of-attack flight tests. A unifying mathematical framework for state estimation is reviewed, and several examples are shown that illustrate a general approach for estimating variables that are difficult to measure. It is hoped that the diversity of the applications discussed and the examples presented will make the flight-data analyst mindful of the potential advantages of using state estimation methods.

Bach, R. E., Jr.↗

Nonlinear viscoelastic characterization of structural adhesives

Measurements of the nonliner viscoelastic behavior of two adhesives, FM-73 and FM-300, are presented and discussed. Analytical methods to quantify the measurements are given and fitted into a framework of an accelerated testing and analysis procedure. The single integral model used is shown to function well and is analogous to a time-temperature stress-superposition procedure (TTSSP). Advantages and disadvantages of the creep power law method used in this study are given.

Rochefort, M. A.↗

An evaluation of simulated Thematic Mapper data and Landsat MSS data for discriminating suburban and regional land use and land cover

An airborne multispectral scanner, operating in the same spectral channels as the Landsat Thematic Mapper (TM), was used in a region east of Denver, CO, for a simulation test performed in the framework of using TM to discriminate the level I and level II classes. It is noted that at the 30-m spatial resolution of the Thematic Mapper Simulator (TMS) the overall discrimination for such classes as commercial/industrial land, rangeland, irrigated sod, irrigated alfalfa, and irrigated pasture was superior to that of the Landsat Multispectral Scanner, primarily due to four added spectral bands. For residential and other spectrally heterogeneous classes, however, the higher resolution of TMS resulted in increased variability within the class and a larger spectral overlap.

Toll, D. L.↗

Constraint-based scheduling

The GERRY scheduling system developed by NASA Ames with assistance from the Lockheed Space Operations Company, and the Lockheed Artificial Intelligence Center, uses a method called constraint-based iterative repair. Using this technique, one encodes both hard rules and preference criteria into data structures called constraints. GERRY repeatedly attempts to improve schedules by seeking repairs for violated constraints. The system provides a general scheduling framework which is being tested on two NASA applications. The larger of the two is the Space Shuttle Ground Processing problem which entails the scheduling of all the inspection, repair, and maintenance tasks required to prepare the orbiter for flight. The other application involves power allocation for the NASA Ames wind tunnels. Here the system will be used to schedule wind tunnel tests with the goal of minimizing power costs. In this paper, we describe the GERRY system and its application to the Space Shuttle problem. We also speculate as to how the system would be used for manufacturing, transportation, and military problems.

Zweben, Monte↗

Constraint-based scheduling

The GERRY scheduling system developed by NASA Ames with assistance from the Lockheed Space Operations Company, and the Lockheed Artificial Intelligence Center, uses a method called constraint based iterative repair. Using this technique, one encodes both hard rules and preference criteria into data structures called constraints. GERRY repeatedly attempts to improve schedules by seeking repairs for violated constraints. The system provides a general scheduling framework which is being tested on two NASA applications. The larger of the two is the Space Shuttle Ground Processing problem which entails the scheduling of all inspection, repair, and maintenance tasks required to prepare the orbiter for flight. The other application involves power allocations for the NASA Ames wind tunnels. Here the system will be used to schedule wind tunnel tests with the goal of minimizing power costs. In this paper, we describe the GERRY system and its applications to the Space Shuttle problem. We also speculate as to how the system would be used for manufacturing, transportation, and military problems.

Zweben, Monte↗

An expert system shell for inferring vegetation characteristics: Atmospheric techniques (Task G)

The NASA VEGetation Workbench (VEG) is a knowledge based system that infers vegetation characteristics from reflectance data. The VEG Subgoals have been reorganized into categories. A new subgoal category 'Atmospheric Techniques' containing two new subgoals has been implemented. The subgoal Atmospheric Passes allows the scientist to take reflectance data measured at ground level and predict what the reflectance values would be if the data were measured at a different atmospheric height. The subgoal Atmospheric Corrections allows atmospheric corrections to be made to data collected from an aircraft or by a satellite to determine what the equivalent reflectance values would be if the data were measured at ground level. The report describes the implementation and testing of the basic framework and interface for the Atmospheric Techniques Subgoals.

Harrison, P. Ann↗