Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing heterogeneity in vehicle capabilities and density, increased levels of automation are likely necessary to achieve operational safety and efficiency goals. This paper focuses on one example where increased automation has been suggested. Autonomous operations will need contingency management systems that can monitor evolving risk across a span of interrelated (or interdependent) hazards and, if necessary, execute appropriate control interventions via supervised or automated decision making. Accommodating this complex environment may require automated functions (autonomy) that apply artificial intelligence (AI) techniques that can adapt and respond to a quickly changing environment. This paper explores the use of Deep Reinforcement Learning (DRL) which has shown promising performance in complex and high-dimensional environments where the objective can be constructed as a sequential decision-making problem. An extension of a prior formulation of the contingency management problem as a Markov Decision Process (MDP) is presented and uses a DRL framework to train agents that mitigate hazards present in the simulation environment. A comparison of these learning-based agents and classical techniques is presented in terms of their performance, verification difficulties, and development process.

machine learning↗
NASA NTRSDate not supplied

Overview of the NASA LISA Laser System Development

NASA Goddard Space Flight Center (GSFC) is developing the Laser System (LS) for the Laser Interferometer Space Antenna (LISA) mission, led by the European Space Agency (ESA) with a launch date of 2035. The LS under development at NASA GSFC consists of the Laser Head (LH), the Frequency Reference System (FRS), and the Power Monitor (PMON) Detector Assemblies. Since late 2017, we have been developing various models to advance the technology readiness level (TRL) for the LH from prototype (TRL4) to a system model demonstration in a relevant environment (TRL6). For the LH and FRS, the models further breakdown into the optical and electronics modules where the LH is made up of the Laser Optical Module (LOM) and the Laser Electronics Module (LEM) and the FRS consists of the FRS Optical Reference Cavity (FRS-O) and the FRS Electronics (FRS-E). The LS development follows the established NASA process in demonstrating the performance requirements [1] through the TRL4 effort and then advancing the form factor and package design to meet relevant environment requirements and qualifying the TRL6 design through rigorous testing and performance verification for space applications. The LOM for the LH is a main oscillator power amplifier (MOPA) with wavelength of 1064 nm and nominal output power of 2 Watt throughout the mission. The low-power, low-noise main oscillator (MO) is a custom micro non-planar ring oscillator (µNPRO) [2] that is phase modulated then amplified by the forward pumped ytterbium-dope fiber power amplifier (PA) stage to meet the output power requirement. The FRS is baselined on the GRACE Follow-On (GFO) [3] approach with updated FRS-E design to work with the LH-LEM. The PMON is located on the Optical Bench Assembly (OBA) [4] that samples a small portion of the LH output signal and provides the feedback signal to the LH-LEM for relative intensity noise (RIN) control. In this paper, we will report on the latest status of the LH testing and system level tests, explain the other subsystems involved in the test campaigns, and discuss the path to bring each LS subsystem to TRL6. We will also present the NASA GSFC roadmap in advancing the LISA LS to TRL6+ and plans for future system level testing as well as the preparation for space flight development to meet the LISA launch date of 2035.

amplifier↗
DOE OSTI2020

The discrete Green's function paradigm for two-way coupled Euler-Lagrange simulation

We outline a methodology for the simulation of particle-laden flows whereby the dispersed and fluid phases are two-way coupled. The drag force which couples fluid and particle momentum depends on the undisturbed fluid velocity at the particle location, and this latter quantity requires modelling. We demonstrate that the undisturbed fluid velocity, in the low particle Reynolds number limit, can be related exactly to the discrete Green's function of the discrete Stokes equations. The method is general in that it can be extended to other partial differential equations which may be associated with particle-laden flows, such as the thermal energy equation or Maxwell's equations. In this work, we demonstrate the method of discrete Green's functions by obtaining these functions for the Navier-Stokes equations at low particle Reynolds number in a two-plane channel geometry. We perform verification at low and finite particle Reynolds number for the case of a point-particle settling under gravity parallel to a plane wall, for different wall normal separations. In comparing to other point-particle schemes the discrete Green's function approach is the most robust at low particle Reynolds number, accurate at all wall-normal separations and is the most accurate in the near wall region at finite Reynolds number. We discuss how the accuracy away from the wall at finite Reynolds number could be improved by appealing to Oseen-like discrete Green's functions. Finally we demonstrate that the discrete Green's function approach can have important implications on statistics of particle-laden turbulent channel flow.

42 ENGINEERING↗
DOE OSTI2024

Dynamic Modelling of HiveWind Floating Wind Substructure in OpenFAST

Current aero-elastic modes tend to consider the wind turbine floating substructures as rigid. However, the new generation of offshore wind platforms are leaner, less rigid. The OpenFAST code has been updated to consider the flexibility of the floating substructure. This presentation shows how a numerical model of the HiveWind design was created within OpenFAST as well as some verifications performed. When comparing the flexible model to a simplified rigid model (previous state-of-the-art), there are some significant differences in key performance indicators. The new flexibility capability within OpenFAST allows to calculate ultimate and fatigue loads within the floating substructure, allowing for the development of more economical designs.

ENGINEERING,WIND ENERGY↗
NASA NTRS2017

On Orbit Performance Validation and Verification of the SMAP Instrument Antenna

NASA’s Soil Moisture Active Passive (SMAP) Mission is currently flying in a 685 km orbit. Featuring a Synthetic Aperture Radar (SAR) and a radiometer sharing the same antenna, SMAP was developed in collaboration between Jet Propulsion Laboratory (JPL) and Goddard Space Flight Center (GSFC). While the radar requirements on the instrument antenna were more benign from an RF point of view, the radiometer requirement were more difficult to meet because of the stability required by the radiometer to operate to its full potential. The instrument antenna performance was predicted by a very detailed RF model and verified by measuring a 1/10th scale model with great accuracy before launch. Once in orbit, we had the opportunity to measure the antenna performance for both the radiometer and the radar and compare it with the predicted performance given by our RF model. This paper discusses the work done both at JPL and GSFC in order to verify and validate the on orbit performance of the SMAP instrument antenna.

offset reflector↗
NASA NTRS2016

SMAP Instrument Antenna, on Orbit Performance Validation and Verification

NASA’s Soil Moisture Active Passive (SMAP) Mission is currently flying in a 685 km orbit. Featuring a Synthetic Aperture Radar (SAR) and a radiometer sharing the same antenna, SMAP was developed in collaboration between Jet Propulsion Laboratory (JPL) and Goddard Space Flight Center (GSFC). While the radar requirements on the instrument antenna were more benign from an RF point of view, the radiometer requirement were more difficult to meet because of the stability required by the radiometer to operate to its full potential. The instrument antenna performance was predicted by a very detailed RF model and verified by measuring a 1/10th scale model with great accuracy before launch. Once in orbit, we had the opportunity to measure the antenna performance for both the radiometer and the radar and compare it with the predicted performance given by our RF model. This paper discusses the work done both at JPL and GSFC in order to verify and validate the on orbit performance of the SMAP instrument antenna.

reflector antenna↗
NASA NTRS1979

Analytical prediction with multidimensional computer programs and experimental verification of the performance, at a variety of operating conditions, of two traveling wave tubes with depressed collectors

Experimental and analytical results are compared for two high performance, octave bandwidth TWT's that use depressed collectors (MDC's) to improve the efficiency. The computations were carried out with advanced, multidimensional computer programs that are described here in detail. These programs model the electron beam as a series of either disks or rings of charge and follow their multidimensional trajectories from the RF input of the ideal TWT, through the slow wave structure, through the magnetic refocusing system, to their points of impact in the depressed collector. Traveling wave tube performance, collector efficiency, and collector current distribution were computed and the results compared with measurements for a number of TWT-MDC systems. Power conservation and correct accounting of TWT and collector losses were observed. For the TWT's operating at saturation, very good agreement was obtained between the computed and measured collector efficiencies. For a TWT operating 3 and 6 dB below saturation, excellent agreement between computed and measured collector efficiencies was obtained in some cases but only fair agreement in others. However, deviations can largely be explained by small differences in the computed and actual spent beam energy distributions. The analytical tools used here appear to be sufficiently refined to design efficient collectors for this class of TWT. However, for maximum efficiency, some experimental optimization (e.g., collector voltages and aperture sizes) will most likely be required.

Dayton, J. A., Jr.↗
NASA NTRS1996

The Verification-based Analysis of Reliable Multicast Protocol

Reliable Multicast Protocol (RMP) is a communication protocol that provides an atomic, totally ordered, reliable multicast service on top of unreliable IP Multicasting. In this paper, we develop formal models for R.W using existing automatic verification systems, and perform verification-based analysis on the formal RMP specifications. We also use the formal models of RW specifications to generate a test suite for conformance testing of the RMP implementation. Throughout the process of RMP development, we follow an iterative, interactive approach that emphasizes concurrent and parallel progress between the implementation and verification processes. Through this approach, we incorporate formal techniques into our development process, promote a common understanding for the protocol, increase the reliability of our software, and maintain high fidelity between the specifications of RMP and its implementation.

Wu, Yunqing↗
NASA NTRS2012

Process Sensitivity, Performance, and Direct Verification Testing of Adhesive Locking Features

Phase I: The use of adhesive locking features or liquid locking compounds (LLCs) (e.g., Loctite) as a means of providing a secondary locking feature has been used on NASA programs since the Apollo program. In many cases Loctite was used as a last resort when (a) self-locking fasteners were no longer functioning per their respective drawing specification, (b) access was limited for removal & replacement, or (c) replacement could not be accomplished without severe impact to schedule. Long-term use of Loctite became inevitable in cases where removal and replacement of worn hardware was not cost effective and Loctite was assumed to be fully cured and working. The NASA Engineering & Safety Center (NESC) and United Space Alliance (USA) recognized the need for more extensive testing of Loctite grades to better understand their capabilities and limitations as a secondary locking feature. These tests, identified as Phase I, were designed to identify processing sensitivities, to determine proper cure time, the correct primer to use on aerospace nutplate, insert and bolt materials such as A286 and MP35N, and the minimum amount of Loctite that is required to achieve optimum breakaway torque values. The .1900-32 was the fastener size tested, due to wide usage in the aerospace industry. Three different grades of Loctite were tested. Results indicate that, with proper controls, adhesive locking features can be successfully used in the repair of locking features and should be considered for design. Phase II: Threaded fastening systems used in aerospace programs typically have a requirement for a redundant locking feature. The primary locking method is the fastener preload and the traditional redundant locking feature is a self-locking mechanical device that may include deformed threads, non-metallic inserts, split beam features, or other methods that impede movement between threaded members. The self-locking resistance of traditional locking features can be directly verified during assembly by measuring the dynamic prevailing torque. Adhesive locking features or LLCs are another method of providing redundant locking, but a direct verification method has not been used in aerospace applications to verify proper installation when using LLCs because of concern for damage to the adhesive bond. The reliability of LLCs has also been questioned due to failures observed during testing with coupons for process verification, although the coupon failures have often been attributed to a lack of proper procedures. It is highly desirable to have a direct method of verifying the LLC cure or bond integrity. The purpose of the Phase II test program was to determine if the torque applied during direct verification of an adhesive locking feature degrades that locking feature. This report documents the test program used to investigate the viability of such a direct verification method. Results of the Phase II testing were positive, and additional investigation of direct verification of adhesive locking features is merited.

Golden, Johnny L.↗
DOE OSTI2024

Verification of RESRAD-OFFSITE Code (V.4)

This report documents the verification of RESRAD-OFFSITE Version 4.0 and describes, where necessary, the verification of the following: • The data comprising the standard dose and risk coefficient libraries in the RESRAD database files Master_dcf_ICRP07.mdb and Master_dcf_2k.mdb. • The extraction and transfer of the data from the selected database file to the computational code by the RESRAD-OFFSITE 4.0 interface, ResOWin.exe. • The different processes that are modeled by the main computational code in RESRAD OFFSITE 4.0, ResOMain.exe. • The data displayed in the graphical and text reports. Many verifications were performed as part of the quality assurance quality control program associated with the development and release of RESRAD-OFFSITE 4.0, namely: • developer testing, • internal independent testing, and • release testing. Some were also performed in response to questions from users regarding the performance of the code. The main text of the report focuses on summarizing a subset of those tests, both independent and developer tests that verified the computations performed by the code. The verifications included in this report served as the basis for the development of the release tests of the computational executables and provided the quantitative results to be compared with the code output. The input and output interfaces and the data transfers between the various executables of the code were tested while performing the verification testing. They were tested intentionally during release testing. This report also provides some basic information to help in understanding the activities that were verified. The report: • outlines the components of RESRAD-OFFSITE 4.0 and the interconnections between these components, • outlines the processes modeled by the computational code, • provides summary figures and tables to offer confirmation of the verification of the computational components of the code, • reproduces the verifiers’ reports, if available, in individual appendices, • refers to the previous verification report (Yu et al. 2011) for more details about some of the verifications, and • reproduces the test cases and the testers’ reports from the release testing in individual appendices, when possible.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1984

STS 41-D Solar Array Flight Experiment

The Solar Array Flight Experiment (SAFE) developed under the direction of the Marshall Space Flight Center, scheduled for launch on STS 41-D, will demonstrate a lightweight solar array technology which offers a factor of 3 improvement in weight and a factor of 10 improvement in specific volume over solar array systems currently in use in the space program. The experiment, which will include multiple deployment and retraction demonstration, verification of electrical and thermal performance, and verification of structural dynamic math models is 15 feet by 105 feet in size and, if completely covered with solar cells, would produce approximately 12.5 kW of electrical power. The unit has now been developed, tested, and is at Kennedy Space Center (KSC) being prepared for launch.

Turner, G. F.↗
DOE OSTI2020

Progress on Advancing the Robotic Air-slot Volumetric Inspection System (RAVIS) for Hanford Under-tank Inspection - 20519

The 27 in-service double-shell tank (DST) systems at Hanford provide interim storage for nearly 56 million gallons of nuclear and hazardous chemical legacy waste. The safe and reliable storage of the waste is critical to the site's extended cleanup mission. While in service, the leak integrity of the DSTs must be demonstrated to satisfy the Washington Administrative Code, inform decisions on tank management, and gauge fitness for continued service beyond originally intended design lives. The carbon steel plates and welds that comprise DST primary tank sidewalls and lower knuckles are routinely 'sampled' for volumetric non-destructive testing using ultrasonic inspection technology to determine whether corrosion pitting, cracking, or general corrosion are occurring that could compromise tank leak integrity. However, the carbon steel plates and welds that comprise the bottoms of primary tanks have not been thoroughly inspected since the DSTs were constructed (i.e., since 1968-1986) due to limited physical access to the exterior tank bottoms. The Robotic Air-slot Volumetric Inspection System, or 'RAVIS,' is being engineered to overcome the challenge of tank bottom in-service inspection. The system will be deployed under primary tanks within the small cooling channels/air-slots in the refractory pads upon which the tanks rest and will use ultrasonic guided wave inspection technology to volumetrically inspect physically inaccessible regions that make up ∼90% of a tank bottom, as well as regions that are physically accessible from the air-slots but comprise only ∼10% of a tank bottom. This paper describes the air-slot sensor and robotic deployment system and focuses on the testing approach and methods that are being applied to support (1) design feedback and performance acceptance (requirement verification) and (2) performance repeatability/reliability assessments (qualification) to ensure the RAVIS is prepared for successful inservice inspections of primary tank bottoms. Test progress made against the test plan, the results of 2019 testing, and the future outlook are included. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗