Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

System diagnostic builder

The System Diagnostic Builder (SDB) is an automated software verification and validation tool using state-of-the-art Artificial Intelligence (AI) technologies. The SDB is used extensively by project BURKE at NASA-JSC as one component of a software re-engineering toolkit. The SDB is applicable to any government or commercial organization which performs verification and validation tasks. The SDB has an X-window interface, which allows the user to 'train' a set of rules for use in a rule-based evaluator. The interface has a window that allows the user to plot up to five data parameters (attributes) at a time. Using these plots and a mouse, the user can identify and classify a particular behavior of the subject software. Once the user has identified the general behavior patterns of the software, he can train a set of rules to represent his knowledge of that behavior. The training process builds rules and fuzzy sets to use in the evaluator. The fuzzy sets classify those data points not clearly identified as a particular classification. Once an initial set of rules is trained, each additional data set given to the SDB will be used by a machine learning mechanism to refine the rules and fuzzy sets. This is a passive process and, therefore, it does not require any additional operator time. The evaluation component of the SDB can be used to validate a single software system using some number of different data sets, such as a simulator. Moreover, it can be used to validate software systems which have been re-engineered from one language and design methodology to a totally new implementation.

Nieten, Joseph L.↗

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Computational Fluid Dynamics↗

On-board fault-tolerant SAR processor for spaceborne imaging radar systems

A real-time high-performance and fault-tolerant FPGA-based hardware architecture for the processing of synthetic aperture radar (SAR) images has been developed for advanced spaceborne radar imaging systems. In this paper, we present the integrated design approach, from top-level algorithm specifications, system architectures, design methodology, functional verification, performance validation, down to hardware design and implementation.

imaging Radar↗

Spacecraft Multiple Array Communication System Performance Analysis

The Communication Systems Simulation Laboratory (CSSL) at the NASA Johnson Space Center is tasked to perform spacecraft and ground network communication system simulations, design validation, and performance verification. The CSSL has developed simulation tools that model spacecraft communication systems and the space and ground environment in which the tools operate. In this paper, a spacecraft communication system with multiple arrays is simulated. Multiple array combined technique is used to increase the radio frequency coverage and data rate performance. The technique is to achieve phase coherence among the phased arrays to combine the signals at the targeting receiver constructively. There are many technical challenges in spacecraft integration with a high transmit power communication system. The array combining technique can improve the communication system data rate and coverage performances without increasing the system transmit power requirements. Example simulation results indicate significant performance improvement can be achieved with phase coherence implementation.

Hwu, Shian U.↗

Development of a Telescoping Vaned Exhaust Nozzle for the ASTOVL LiftFan(Trademark) Application

A discussion on the development of a Telescoping, Vaned, Exhaust Nozzle (TEVEN) is presented. This nozzle was challenged to meet the thrust vectoring requirements of an Advanced Short Takeoff and Vertical Landing (ASTOVL) aircraft. The nozzle underwent a development process from concepts to detail design using computational flow analyses and from subscale performance verification tests to full-scale hardware design. The LiftFan(Trademark) nozzle is capable of providing a pitch vector range of about 80 degrees from up to 20 degrees forward to 60 degrees aft. In addition, a set of post exit yaw doors provide +/- 10 degrees yaw while maintaining a relatively high performance at all operating conditions. Further, the nozzle is axially compact, to be stowable in very short length (LJD less than 0.3), while efficiently converging the upstream nozzle flow from an annular cross section to a "D" shape at the nozzle exit. The discussion includes a review of various nozzle concepts, viscous flow analyses, and results from 1/3 scale nozzle model tests conducted at NASA LeRC Powered Lift Facility (PLF) in 1994.

Sokhey, Jack S.↗

Advanced composite fuselage technology

Boeing's ATCAS program has completed its third year and continues to progress towards a goal to demonstrate composite fuselage technology with cost and weight advantages over aluminum. Work on this program is performed by an integrated team that includes several groups within The Boeing Company, industrial and university subcontractors, and technical support from NASA. During the course of the program, the ATCAS team has continued to perform a critical review of composite developments by recognizing advances in metal fuselage technology. Despite recent material, structural design, and manufacturing advancements for metals, polymeric matrix composite designs studied in ATCAS still project significant cost and weight advantages for future applications. A critical path to demonstrating technology readiness for composite transport fuselage structures was created to summarize ATCAS tasks for Phases A, B, and C. This includes a global schedule and list of technical issues which will be addressed throughout the course of studies. Work performed in ATCAS since the last ACT conference is also summarized. Most activities relate to crown quadrant manufacturing scaleup and performance verification. The former was highlighted by fabricating a curved, 7 ft. by 10 ft. panel, with cocured hat-stiffeners and cobonded J-frames. In building to this scale, process developments were achieved for tow-placed skins, drape formed stiffeners, braided/RTM frames, and panel cure tooling. Over 700 tests and supporting analyses have been performed for crown material and design evaluation, including structural tests that demonstrated limit load requirements for severed stiffener/skin failsafe damage conditions. Analysis of tests for tow-placed hybrid laminates with large damage indicates a tensile fracture toughness that is higher than that observed for advanced aluminum alloys. Additional recent ATCAS achievements include crown supporting technology, keel quadrant design evaluation, and sandwich process development.

Ilcewicz, Larry B.↗

Verifying PLC Programs via Monitors: Extending the Integration of FRET and PLCverif

Verification of Programmable Logic Controller (PLC) programs requires reasoning about propositions qualified in terms of time. CERN’s PLCverif, an open-source tool for the analysis of safety-critical PLC systems, uses Linear Temporal Logic (LTL) for the specification of properties. Until now, PLCverif depended on third-party tools that accept LTL specifications to perform verification. However, our experience with industrial PLC programs shows that, to overcome analysis limitations, a wide range of techniques are needed to successfully verify complex properties. In this paper, we extend PLCverif to enable PLC program verification of pure-past LTL (PLTL) safety properties with assertion-based verification tools. To this end, we take an algorithm from the runtime-monitoring domain, apply it to bounded model checking of PLC programs, and implement it in PLCverif. We extend the integration of NASA’s Formal Requirements Elicitation Tool (FRET) into PLCverif to use PLTL properties generated with FRET. In addition, we leverage the program structure induced by the PLC scan-cycle for a state-space reduction. Finally, we expose the algorithm to a real-world case study of critical systems at CERN.

Formal verification↗

Shaped Pupil Coronagraph: Disk Science Mask Experimental Verification and Testing

The Shaped Pupil Coronagraph (SPC) is one of the two operating modes of the baseline coronagraph instrument for the proposed WFIRST mission. While in SPC mode, multiple sets of shaped pupil masks and focal plane masks would be available for various imaging tasks. The disk science mask set (SPC-DSM) is designed for exozodiacal disk science. With a 360 degree high contrast field of view, extending up to 20 λ/D, the SPC-DSM provides a powerful tool to study exozodiacal dust clouds associated with stellar debris disks to gain insight of the exoplanet formation and stellar disk dynamics. We will describe the performance verification and demonstration of the SPC-DSM coronagraph as tested in the high contrast imaging testbed (HCIT) at JPL. The goal of the testbed demonstration is an average contrast of 5e-9 over a 10% bandwidth centered at 565nm, in a field of view extending from 6.5 λ/D to 20 λ/D. We will discuss electric field conjugation, performance metrics, and model agreement as applied to the SPC-DSM.

Shi, Fang↗

Pioneer Venus Star Sensor

The design predictions and orbital performance verification of the solid state star scanner used in the Onboard Attitude Control of the Pioneer Venus Orbiter and Multiprobe are presented. The star sensor extended the scanner use to active despin control, and it differs from previous sensors in solid state detection, redundant electronics for reliability, larger field of view, and large dynamic spin range. The star scanner hardware and design performance based on the ability to predict all noise sources, signal magnitudes, and expected detection probability are discussed. In-flight data collected to verify sensor ground calibration are tabulated and plotted in predicted accuracy curves. It is concluded that the Pioneer Venus Star Sensor has demonstrated predictable star calibration in the range of .1 magnitude uncertainties and usable star catalogs of 100 stars with very high probabilities of detection, which were much better than expected and well within the mission requirements.

Gutshall, R. L.↗

Verification, Validation and Credibility Assessment of a Computational Model of the Advanced Resistive Exercise Device (ARED)

The Advanced Resistive Exercise Device (ARED) is the resistive exercise device used by astronauts on the International Space Station (ISS) to mitigate bone loss and muscle atrophy due to extended exposure to microgravity (micro g). The Digital Astronaut Project (DAP) has developed a multi-body dynamics model of biomechanics models for use in spaceflight exercise physiology research and operations. In an effort to advance model maturity and credibility of the ARED model, the DAP performed verification, validation and credibility (VV and C) assessment of the analyses of the model in accordance to NASA-STD-7009 'Standards for Models and Simulations'.

Werner, C. R.↗

Optical Testing and Verification Methods for the James Webb Space Telescope Integrated Science Instrument Module Element

NASA's James Webb Space Telescope (JWST) is a 6.6m diameter, segmented, deployable telescope for cryogenic IR space astronomy (~40K). The JWST Observatory includes the Optical Telescope Element (OTE) and the Integrated Science Instrument Module (ISIM) that contains four science instruments (SI) and the fine guider. The SIs are mounted to a composite metering structure. The SI and guider units were integrated to the ISIM structure and optically tested at the NASA Goddard Space Flight Center as a suite using the Optical Telescope Element SIMulator (OSIM). OSIM is a full field, cryogenic JWST telescope simulator. SI performance, including alignment and wave front error, were evaluated using OSIM. We describe test and analysis methods for optical performance verification of the ISIM Element, with an emphasis on the processes used to plan and execute the test. The complexity of ISIM and OSIM drove us to develop a software tool for test planning that allows for configuration control of observations, associated scripts, and management of hardware and software limits and constraints, as well as tools for rapid data evaluation, and flexible re-planning in response to the unexpected. As examples of our test and analysis approach, we discuss how factors such as the ground test thermal environment are compensated in alignment. We describe how these innovative methods for test planning and execution and post-test analysis were instrumental in the verification program for the ISIM element, with enough information to allow the reader to consider these innovations and lessons learned in this successful effort in their future testing for other programs.

spaceborne telescopes↗

Verification and Validation of Spectral Element Code for Supercritical CO2 Flow in Vertical Heated Tubes

The investigation of heat transfer in supercritical CO2 (sCO2) has garnered considerable attention in recent decades, given sCO2's potential as a promising working fluid for advanced power conversion cycles. Despite previous research efforts, there are still gaps in our understanding of sCO2 heat transfer, particularly in conditions associated with heat transfer deterioration. To delve into sCO2 heat transfer more comprehensively, we propose employing the high-fidelity computational fluid dynamics code NekRS to simulate sCO2 flow using the large eddy simulation technique. Through graphics processing unit acceleration, NekRS achieves a higher computational speed than traditional CPU-based systems. However, before using NekRS in practical applications involving sCO2, it is imperative to perform verification and validation. Here, this paper presents our efforts to verify and validate the NekRS code's capability for simulating sCO2 using heated vertical tubes, where heat transfer deterioration usually happens. To accommodate the unique properties of sCO2, we have modified the NekRS code by integrating third-party property modules, such as REFPROP and PROPATH. Our simulations are compared with experimental and numerical data from the literature, instilling confidence in leveraging NekRS for future engineering applications. Our simulations also reveal that the accuracy of the property module significantly impacts the results, with REFPROP outperforming PROPATH for sCO2 properties. Additionally, we observed that, depending on the flow direction, buoyancy can either enhance or suppress turbulence in sCO2 flow. In upward flow, under certain conditions, the suppressed turbulence leads to heat transfer deterioration, resulting in elevated wall temperatures.

NekRS↗

Draft Plan for Characterizing Commercial Data Products in Support of Earth Science Research

This presentation introduces a draft plan for characterizing commercial data products for Earth science research. The general approach to the commercial product verification and validation includes focused selection of a readily available commercial remote sensing products that support Earth science research. Ongoing product verification and characterization will question whether the product meets specifications and will examine its fundamental properties, potential and limitations. Validation will encourage product evaluation for specific science research and applications. Specific commercial products included in the characterization plan include high-spatial-resolution multispectral (HSMS) imagery and LIDAR data products. Future efforts in this process will include briefing NASA headquarters and modifying plans based on feedback, increased engagement with the science community and refinement of details, coordination with commercial vendors and The Joint Agency Commercial Imagery Evaluation (JACIE) for HSMS satellite acquisitions, acquiring waveform LIDAR data and performing verification and validation.

Ryan, Robert E.↗

Design for pressure regulating components

The design development for Pressure Regulating Components included a regulator component trade-off study with analog computer performance verification to arrive at a final optimized regulator configuration for the Space Storable Propulsion Module, under development for a Jupiter Orbiter mission. This application requires the pressure regulator to be capable of long-term fluorine exposure. In addition, individual but basically identical (for purposes of commonality) units are required for separate oxidizer and fuel pressurization. The need for dual units requires improvement in the regulation accuracy over present designs. An advanced regulator concept was prepared featuring redundant bellows, all metallic/ceramic construction, friction-free guidance of moving parts, gas damping, and the elimination of coil springs normally used for reference forces. The activities included testing of actual size seat/poppet components to determine actual discharge coefficients and flow forces. The resulting data was inserted into the computer model of the regulator. Computer simulation of the propulsion module performance over two mission profiles indicated satisfactory minimization of propellant residual requirements imposed by regulator performance uncertainties.

Wichmann, H.↗

Verification Testing: Meet User Needs Figure of Merit

Verification is the process through which Modeling and Simulation(M&S) software goes to ensure that it has been rigorously tested and debugged for its intended use. Validation confirms that said software accurately models and represents the real world system. Credibility gives an assessment of the development and testing effort that the software has gone through as well as how accurate and reliable test results are. Together, these three components form Verification, Validation, and Credibility(VV&C), the process by which all NASA modeling software is to be tested to ensure that it is ready for implementation. NASA created this process following the CAIB (Columbia Accident Investigation Board) report seeking to understand the reasons the Columbia space shuttle failed during reentry. The reports conclusion was that the accident was fully avoidable, however, among other issues, the necessary data to make an informed decision was not there and the result was complete loss of the shuttle and crew. In an effort to mitigate this problem, NASA put out their Standard for Models and Simulations, currently in version NASA-STD-7009A, in which they detailed their recommendations, requirements and rationale for the different components of VV&C. They did this with the intention that it would allow for people receiving MS software to clearly understand and have data from the past development effort. This in turn would allow the people who had not worked with the MS software before to move forward with greater confidence and efficiency in their work. This particular project looks to perform Verification on several MATLAB (Registered Trademark)(The MathWorks, Inc.) scripts that will be later implemented in a website interface. It seeks to take note and define the limits of operation, the units and significance, and the expected datatype and format of the inputs and outputs of each of the scripts. This is intended to prevent the code from attempting to make incorrect or impossible calculations. Additionally, this project will look at the coding generally and note inconsistencies, redundancies, and other aspects that may become problematic or slow down the codes run time. Certain scripts lacking in documentation also will be commented and cataloged.

validation↗

Verification and Validation of High Explosive Reactive Burn Models Implemented in LANL's EAP and LAP Code Base

Reactive burn models represent a significant leap in high explosive (HE) modeling capability. The first generation of engineering models of HE detonation are called programmed burn models and they are largely based on the distance between a prescribed detonation point and each zone in a simulation. There have been many advancements to programmed burn models over the years and when the assumptions upon which they are based are met, a properly tuned programmed burn model can be highly accurate but if any of their assumptions is not met, as is the case for corner turning or weakly initiated HE burn, they will give the wrong answer. Reactive burn models represent an entirely new way of modeling HE burn. They use the local conditions of a zone – e.g. temperature, pressure or density – as calculated by a hydrocode to determine if and when the zone is going to detonate and if so, how rapidly. This difference opens up an entirely new set of capabilities for HE modeling. It makes it possible to accurately and predictively model phenomena like the effect of confinement and the formation of dead zones. Reactive burn models have seen sustained development effort at LANL for at least the last decade but several recent developments make it timely to transition reactive burn models from a research topic to a production tool. The main goal of this milestone is to facilitate and accelerate the adoption of reactive burn as a commonly available modeling option, with recommendations on the resolution that will be required and uncertainties associated with their modeling choices. To achieve this, we have performed verification, validation, and uncertainty quantification (UQ) assessments of AWSD and SURF/SURFplus in xRage and FLAG on a variety of different problems.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Dynamics of Superfluid Helium in Low-Gravity

This report summarizes the work performed under a contract entitled 'Dynamics of Superfluid Helium in Low Gravity'. This project performed verification tests, over a wide range of accelerations of two Computational Fluid Dynamics (CFD) codes of which one incorporates the two-fluid model of superfluid helium (SFHe). Helium was first liquefied in 1908 and not until the 1930s were the properties of helium below 2.2 K observed sufficiently to realize that it did not obey the ordinary physical laws of physics as applied to ordinary liquids. The term superfluidity became associated with these unique observations. The low temperature of SFHe and it's temperature unifonrmity have made it a significant cryogenic coolant for use in space applications in astronomical observations with infrared sensors and in low temperature physics. Superfluid helium has been used in instruments such as the Shuttle Infrared Astronomy Telescope (IRT), the Infrared Astronomy Satellite (IRAS), the Cosmic Background Observatory (COBE), and the Infrared Satellite Observatory (ISO). It is also used in the Space Infrared Telescope (SIRTF), Relativity Mission Satellite formally called Gravity Probe-B (GP-B), and the Test of the Equivalence Principle (STEP) presently under development. For GP-B and STEP, the use of SFHE is used to cool Superconducting Quantum Interference Detectors (SQUIDS) among other parts of the instruments. The Superfluid Helium On-Orbit Transfer (SHOOT) experiment flown in the Shuttle studied the behavior of SFHE. This experiment attempted to get low-gravity slosh data, however, the main emphasis was to study the low-gravity transfer of SFHE from tank to tank. These instruments carried tanks of SFHE of a few hundred liters to 2500 liters. The capability of modeling the behavior of SFHE is important to spacecraft control engineers who must design systems that can overcome disturbances created by the movement of the fluid. In addition instruments such as GP-B and STEP are very sensitive to quasi-steady changes in the mass distribution of the liquid. The CFD codes were used to model the fluid's dynamic motion. Tests in one-g were performed with the main emphasis on being able to compute the actual damping of the fluid. A series of flights on the NASA Lewis reduced gravity DC-9 aircraft were performed with the Jet Propulsion Laboratory (JPL) Low Temperature Flight Facility and a superfluid Test Cell. The data at approximately 0.04g, lg and 2g were used to determine if correct fundamental frequencies can be predicted based on the acceleration field. Tests in zero gravity were performed to evaluate zero gravity motion.

Frank, David J.↗

The discrete Green's function paradigm for two-way coupled Euler–Lagrange simulation

We outline a methodology for the simulation of two-way coupled particle-laden flows. The drag force that couples fluid and particle momentum depends on the undisturbed fluid velocity at the particle location, and this latter quantity requires modelling. We demonstrate that the undisturbed fluid velocity, in the low particle Reynolds number limit, can be related exactly to the discrete Green's function of the discrete Stokes equations. In addition to hydrodynamics, the method can be extended to other physics present in particle-laden flows such as heat transfer and electromagnetism. The discrete Green's functions for the Navier–Stokes equations are obtained at low particle Reynolds number in a two-plane channel geometry. We perform verification at different Reynolds numbers for a particle settling under gravity parallel to a plane wall, for different wall-normal separations. Compared with other point-particle schemes, the Stokesian discrete Green's function approach is the most robust at low particle Reynolds number, accurate at all wall-normal separations. To account for degradation in accuracy away from the wall at finite Reynolds number, we extend the present methodology to an Oseen-like discrete Green's function. The extended discrete Green's function method is found to be accurate within 6% at all wall-normal separations for particle Reynolds numbers up to 24. Furthermore, the discrete Green's function approach is well suited to dilute systems with significant mass loading and this is highlighted by comparison against other Euler–Lagrange as well as particle-resolved simulations of gas–solid turbulent channel flow. Strong particle–turbulence coupling is observed in the form of turbulence modification and turbophoresis suppression, and these observations are placed in context of the different methods.

42 ENGINEERING↗