Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification & validation (V&V)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Sampled-Data Techniques Applied to a Digital Controller for an Altitude Autopilot

Sampled-data theory, using the Z transformation, is applied to the design of a digital controller for an aircraft-altitude autopilot. Particular attention is focused on the sensitivity of the design to parameter variations and the abruptness of the response, that is, the normal acceleration required to carry out a transient maneuver. Consideration of these two characteristics of the system has shown that the finite settling time design method produces an unacceptable system, primarily because of the high sensitivity of the response to parameter variations, although abruptness can be controlled by increasing the sampling period. Also demonstrated is the importance of having well-damped poles or zeros if cancellation is attempted in the design methods. A different method of smoothing the response and obtaining a design which is not excessively sensitive is proposed, and examples are carried through to demonstrate the validity of the procedure. This method is based on design concepts of continuous systems, and it is shown that if no pole-zero cancellations are allowed in the design, one can obtain a response which is not too abrupt, is relatively insensitive to parameter variations, and is not sensitive to practical limits on control-surface rate. This particular design also has the simplest possible pulse transfer function for the digital controller. Simulation techniques and root loci are used for the verification of the design philosophy.

Schmidt, Stanley F.↗

NASA Aerospace Flight Battery Program: Generic Safety, Handling and Qualification Guidelines for Lithium-Ion (Li-Ion) Batteries; Availability of Source Materials for Lithium-Ion (Li-Ion) Batteries; Maintaining Technical Communications Related to Aerospace Batteries (NASA Aerospace Battery Workshop)

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This document contains Part 1 - Volume I: Generic Safety, Handling and Qualification Guidelines for Lithium-Ion (Li-Ion) Batteries, Availability of Source Materials for Lithium-Ion (Li-Ion) Batteries, and Maintaining Technical Communications Related to Aerospace Batteries (NASA Aerospace Battery Workshop).

Manzo, Michelle A.↗

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

Time and frequency-domain identification and verification of BO-105 dynamic models

Mathematical models for the dynamics of the DLR BO 105 helicopter are extracted from flight test data using two different approaches: frequency-domain and time-domain identification. Both approaches are reviewed. Results from an extensive data consistency analysis are given. Identifications for 6 degrees of freedom (DOF) rigid body models are presented and compared in detail. The extracted models compare favorably and their prediction capability is demonstrated in verification results. Approaches to extend the 6 DOF models are addressed and first results are presented. System identification is broadly defined as the deduction of system characteristics from measured data. It provides the only possibility to extract both non-parametric (e.g., frequency responses) and parametric (e.g., state space matrices) aircraft models from flight test data and therefore gives a reliable characterization of the dynamics of the actually existing aircraft. Main applications of system identification are seen in areas where higher accuracies of the mathematical models are required: Simulation validation, control system design (in particular model-following control system design for in-flight simulation), and handling qualities.

Kaletka, Juergen↗

Extended Operation of Stirling Convertors

A high-efficiency 110 watt Stirling Radioisotope Generator 110 (SRG110) is being developed for potential NASA exploration missions. The SRG system efficiency is greater than 20%, making it an attractive candidate power system for deep space missions and unmanned rovers. The Department of Energy SRG110 Project team consists of the System Integrator, Lockheed Martin (LM), Stirling Technology Company (STC), and NASA Glenn Research Center (GRC). One of the GRC roles is to provide Independent Verification and Validation of the Stirling TDC's. At the request of LM, a part of this effort includes the extended operation of the TDC's in the dynamically balanced dual-opposed configuration. Performance data of the Stirling Converters over time is required to demonstrate that an SRG110 can meet long-duration mission requirements. A test plan and test system were developed to evaluate TDC's #13 and #14 steady-state performance for a minimum of 5000 hours and insure safe, round-the-clock operation of the TDC's. This paper will discuss the design and development, and status of the Extended Operation Test.

Roth, Mary Ellen↗

A Model-Based Approach to Engineering Behavior of Complex Aerospace Systems

One of the most challenging yet poorly defined aspects of engineering a complex aerospace system is behavior engineering, including definition, specification, design, implementation, and verification and validation of the system's behaviors. This is especially true for behaviors of highly autonomous and intelligent systems. Behavior engineering is more of an art than a science. As a process it is generally ad-hoc, poorly specified, and inconsistently applied from one project to the next. It uses largely informal representations, and results in system behavior being documented in a wide variety of disparate documents. To address this problem, JPL has undertaken a pilot project to apply its institutional capabilities in Model-Based Systems Engineering to the challenge of specifying complex spacecraft system behavior. This paper describes the results of the work in progress on this project. In particular, we discuss our approach to modeling spacecraft behavior including 1) requirements and design flowdown from system-level to subsystem-level, 2) patterns for behavior decomposition, 3) allocation of behaviors to physical elements in the system, and 4) patterns for capturing V&V activities associated with behavioral requirements. We provide examples of interesting behavior specification patterns, and discuss findings from the pilot project.

SysML↗

Designing to Sample the Unknown: Lessons from OSIRIS-REx Project Systems Engineering

On September 8, 2016, the third NASA New Frontiers mission launched on an Atlas V 411. The Origins, Spectral Interpretation, Resource Identification, Security-Regolith Explorer (OSIRIS-REx) will rendezvous with asteroid Bennu in 2018, collect a sample in 2020, and return that sample to Earth in September 2023. The development team has overcome a number of challenges in order to design and build a system that will make contact with an unexplored, airless, low-gravity body. This paper will provide an overview of the mission, then focus in on the system-level challenges and some of the key system-level processes. Some of the lessons here are unique to the type of mission, like discussion of operating at a largely-unknown, low-gravity object. Other lessons, particularly from the build phase, have broad implications. The OSIRIS-REx risk management process was particularly effective in achieving an on-time and under-budget development effort. The systematic requirements management and verification and the system validation also helped identify numerous potential problems. The final assessment of the OSIRIS-REx performance will need to wait until the sample is returned in 2023, but this post-launch assessment will capture some of the key systems-engineering lessons from the development team.

Asteroid↗

Ambient and Cryogenic Alignment Verification and Performance of the Infrared Multi-Object Spectrometer

The Infrared Multi-Object Spectrometer (IRMOS) is a facility instrument for the Kitt Peak National Observatory 4 and 2.1 meter telescopes. IRMOS is a near-IR (0.8 - 2.5 micron) spectrometer with low- to mid-resolving power (R = 300 - 3000). IRMOS produces simultaneous spectra of approximately 100 objects in its 2.8 x 2.0 arc-min field of view using a commercial Micro Electro-Mechanical Systems (MEMS) Digital Micro-mirror Device (DMD) from Texas Instruments. The IRMOS optical design consists of two imaging subsystems. The focal reducer images the focal plane of the telescope onto the DMD field stop, and the spectrograph images the DMD onto the detector. We describe ambient breadboard subsystem alignment and imaging performance of each stage independently, and the ambient and cryogenic imaging performance of the fully assembled instrument. Interferometric measurements of subsystem wavefront error serve to venfy alignment, and are accomplished using a commercial, modified Twyman-Green laser unequal path interferometer. Image testing provides further verification of the optomechanical alignment method and a measurement of near-angle scattered light due to mirror small-scale surface error. Image testing is performed at multiple field points. A mercury-argon pencil lamp provides spectral lines at 546.1 nm and 1550 nm, and a CCD camera and IR camera are used as detectors. We use commercial optical modeling software to predict the point-spread function and its effect on instrument slit transmission and resolution. Our breadboard test results validate this prediction. We conclude with an instrument performance prediction for first light.

Connelly, Joseph A.↗

Development and Experimental Validation of a Path-Dependent Spin Forming Finite Element Model

Spin forming is an advanced manufacturing process widely used in the aerospace and defense sectors to produce lightweight, high-strength cylindrical components with tight dimensional tolerances. This study explores the applicability of the path-dependent Mechanical Threshold Stress (MTS) constitutive model by simulating the evolution of geometry, machining forces, and plastic deformation during the spin forming of a 10-mm thick 6061-O aluminum cylinder. While numerical modeling of spin forming has advanced substantially over the past decade, systematic verification and experimental validation of material models remain limited, particularly in predicting through-thickness process evolution. The MTS model, incorporating a Voce hardening rule, is employed for its ability to represent cyclic loading, rapidly varying temperature fields, and strain rates characteristic of spin forming. Numerical convergence analysis indicates discretization uncertainties between 0.3% and 9.2% for key quantities of interest. Experimental validation demonstrates that the MTS model, when implemented with a verified mesh, accurately reproduces both elastic and plastic behavior of 6061-O aluminum, predicting peak roller loads within 11–18% of measurements, geometric tolerances within 3%, and plastic strain distributions within 10% of experimental values. Collectively, these results establish a validated computational framework for predictive spin-forming simulations with quantified confidence, providing a foundation for extension to other alloys, geometries, and forming conditions.

Spin forming↗

Extended Operation of Stirling Convertors

A high-efficiency 110 W Stirling Radioisotope Generator 110 (SRG110) is being developed for potential NASA exploration missions. The SRG system efficiency is greater than 20%, making it an attractive candidate power system for deep space missions and unmanned rovers. The Department of Energy SRG110 Project team consists of the System Integrator, Lockheed Martin (LM), Stirling Technology Company (STC), and NASA Glenn Research Center (GRC). One of the GRC roles is to provide Independent Verification and Validation of the Stirling TDC s. At the request of LM, a part of this effort includes the Extended Operation of the TDC s in the dynamically balanced dual-opposed configuration. Performance data of Stirling Convertors over time is required to demonstrate that an SRG110 can meet long-duration mission requirements. A test plan and test system were developed to evaluate TDC s #13 and #14 steady-state performance for a minimum of 5000 hours. Hardware, software and TDC preparation processes were developed to support this test and insure safe, round-the-clock operation of the TDC s. This paper will discuss the design and development, and status of the Extended Operation Test.

Roth, Mary Ellen↗

Simulation, Model Verification and Controls Development of Brayton Cycle PM Alternator: Testing and Simulation of 2 KW PM Generator with Diode Bridge Output

Professor Stankovic will be developing and refining Simulink based models of the PM alternator and comparing the simulation results with experimental measurements taken from the unit. Her first task is to validate the models using the experimental data. Her next task is to develop alternative control techniques for the application of the Brayton Cycle PM Alternator in a nuclear electric propulsion vehicle. The control techniques will be first simulated using the validated models then tried experimentally with hardware available at NASA. Testing and simulation of a 2KW PM synchronous generator with diode bridge output is described. The parameters of a synchronous PM generator have been measured and used in simulation. Test procedures have been developed to verify the PM generator model with diode bridge output. Experimental and simulation results are in excellent agreement.

Anna V Stankovic↗

SILHIL Replication of Electric Aircraft Powertrain Dynamics and Inner-Loop Control for V&V of System Health Management Routines

Software-in-the-loop and Hardware-in-the-loop testing of failure prognostics and decision making tools for aircraft systems will facilitate more comprehensive and cost-effective testing than what is practical to conduct with flight tests. A framework is described for the offline recreation of dynamic loads on simulated or physical aircraft powertrain components based on a real-time simulation of airframe dynamics running on a flight simulator, an inner-loop flight control policy executed by either an autopilot routine or a human pilot, and a supervisory fault management control policy. The creation of an offline framework for verifying and validating supervisory failure prognostics and decision making routines is described for the example of battery charge depletion failure scenarios onboard a prototype electric unmanned aerial vehicle.

Verification and Validation↗

Alignment and Performance of the Infrared Multi-Object Spectrometer

The Infrared Multi-Object Spectrometer (IRMOS) is a principle investigator class instrument for the Kitt Peak National Observatory 4 and 2.1 meter telescopes. IRMOS is a near-IR (0.8 - 2.5 micron) spectrometer with low-to mid-resolving power (R = 300 - 3000). IRMOS produces simultaneous spectra of approximately 100 objects in its 2.8 x 2.0 arc-min field of view (4 m telescope) using a commercial Micro Electro-Mechanical Systems (MEMS) micro-mirror array (MMA) from Texas Instruments. The IRMOS optical design consists of two imaging subsystems. The focal reducer images the focal plane of the telescope onto the MMA field stop, and the spectrograph images the MMA onto the detector. We describe ambient breadboard subsystem alignment and imaging performance of each stage independently, and ambient imaging performance of the fully assembled instrument. Interferometric measurements of subsystem wavefront error serve as a qualitative alignment guide, and are accomplished using a commercial, modified Twyman-Green laser unequal path interferometer. Image testing provides verification of the optomechanical alignment method and a measurement of near-angle scattered light due to mirror small-scale surface error. Image testing is performed at multiple field points. A mercury-argon pencil lamp provides a spectral line at 546.1 nanometers, a blackbody source provides a line at 1550 nanometers, and a CCD camera and IR camera are used as detectors. We use commercial optical modeling software to predict the point-spread function and its effect on instrument slit transmission and resolution. Our breadboard and instrument level test results validate this prediction. We conclude with an instrument performance prediction for cryogenic operation and first light in late 2003.

Connelly, Joseph A.↗

Investigation of a Verification and Validation Tool with a Turbofan Aircraft Engine Application

The development of more advanced control architectures for turbofan aircraft engines can yield gains in performance and efficiency over the lifetime of an engine. However, the implementation of these increasingly complex controllers is contingent on their ability to provide safe, reliable engine operation. Therefore, having the means to verify the safety of new control algorithms is crucial. As a step towards this goal, CoCoSim, a publicly available verification tool for Simulink, is used to analyze C-MAPSS40k, a 40,000 lbf class turbo-fan engine model developed at NASA for testing new control algorithms. Due to current limitations of the verification software, several modifications are made to C-MAPSS40k to achieve compatibility with CoCoSim. Some of these modifications sacrifice fidelity to the original model. Several safety and performance requirements typical for turbofan engines are identified and constructed into a verification framework. Preliminary results using an industry standard baseline controller for these requirements are presented. While verification capabilities are demonstrated, a truly comprehensive analysis will require further development of the verification tool.

V&↗

Microbiological methods for the water recovery systems test, revision 1.1

Current microbiological parameters specified to verify microbiological quality of Space Station Freedom water quality include the enumeration of total bacteria, anaerobes, aerobes, yeasts and molds, enteric bacteria, gram positives, gram negatives, and E. coli. In addition, other parameters have been identified as necessary to support the Water Recovery Test activities to be conducted at the NASA/MSFC later this year. These other parameters include aerotolerant eutrophic mesophiles, legionellae, and an additional method for heterotrophic bacteria. If inter-laboratory data are to be compared to evaluate quality, analytical methods must be eliminated as a variable. Therefore, each participating laboratory must utilize the same analytical methods and procedures. Without this standardization, data can be neither compared nor validated between laboratories. Multiple laboratory participation represents a conservative approach to insure quality and completeness of data. Invariably, sample loss will occur in transport and analyses. Natural variance is a reality on any test of this magnitude and is further enhanced because biological entities, capable of growth and death, are specific parameters of interest. The large variation due to the participation of human test subjects has been noted with previous testing. The resultant data might be dismissed as 'out of control' unless intra-laboratory control is included as part of the method or if participating laboratories are not available for verification. The purpose of this document is to provide standardized laboratory procedures for the enumeration of certain microorganisms in water and wastewater specific to the water recovery systems test. The document consists of ten separate cultural methods and one direct count procedure. It is not intended nor is it implied to be a complete microbiological methods manual.

Rhoads, Tim↗

Applying Standard Independent Verification and Validation (IVV) Techniques Within an Agile Framework: Is There a Compatibility Issue?

Agile methods have gained wide acceptance over the past several years, to the point that they are now a standard management and execution approach for small-scale software development projects. While conventional Agile methods are not generally applicable to large multi-year and mission-critical systems, Agile hybrids are now being developed (such as SAFe) to exploit the productivity improvements of Agile while retaining the necessary process rigor and coordination needs of these projects. From the perspective of Independent Verification and Validation (IVV), however, the adoption of these hybrid Agile frameworks is becoming somewhat problematic. Hence, we find it prudent to question the compatibility of conventional IVV techniques with (hybrid) Agile practices.This paper documents our investigation of (a) relevant literature, (b) the modification and adoption of Agile frameworks to accommodate the development of large scale, mission critical systems, and (c) the compatibility of standard IVV techniques within hybrid Agile development frameworks. Specific to the latter, we found that the IVV methods employed within a hybrid Agile process can be divided into three groups: (1) early lifecycle IVV techniques that are fully compatible with the hybrid lifecycles, (2) IVV techniques that focus on tracing requirements, test objectives, etc. are somewhat incompatible, but can be tailored with a modest effort, and (3) IVV techniques involving an assessment requiring artifact completeness that are simply not compatible with hybrid Agile processes, e.g., those that assume complete requirement specification early in the development lifecycle.

Agile↗

Moderate Resolution Imaging Spectrometer (MODIS) design evolution and associated development and verification of data product efforts

The Moderate Resolution Imaging Spectrometer (MODIS) is a key observing facility to be flown on the Earth Observing System (EOS). The facility is composed of two instruments called MODIS-N (nadir) and MODIS-T (tilt). The MODIS-N is being built under contract to NASA by the Santa Barbara Research Center. The MODIS-T is being fabricated by the Engineering Directorate at the Goddard Space Flight Center. The MODIS Science Team has defined nearly 40 biogeophysical data products for studies of the ocean and land surface and properties of the atmosphere including clouds that can be expected to be produced from the MODIS instruments shortly after the launch of EOS. The ocean, land, atmosphere, and calibration groups of the MODIS Science Team are now proceeding to plan and implement the operations and facilities involving the analysis of data from existing spaceborne, airborne, and in-situ sensors required to develop and validate the algorithms that will produce the geophysical data products. These algorithm development and validation efforts will be accomplished wherever possible within the context of existing or planned national and international experiments or programs such as those in the World Climate Research Program.

Salomonson, Vincent V.↗

Comparison of VIIRS Prelaunch RVS Among Independent Studies

The Visible Infrared Imaging Radiometer Suite (VIIRS) is a key sensor carried on the NPOESS (National Polar-orbiting Operational Environmental Satellite System), upgraded and developed recently from heritage instruments including AVHRR, OLS, MODIS, and SeaWiFS. It has on-board calibration components including a solar diffuser (SD) and a solar diffuser stability monitor (SDSM) for the reflective solar bands (RSB), a V-groove blackbody for the thermal emissive bands (TEB), and a space view (SV) port for background subtraction. These on-board calibrators are located at fixed scan angles. The VIIRS response versus scan angle (RVS) was characterized prelaunch in lab ambient conditions and will be used on-orbit to characterize the response for the all scan angles relative to the calibrator scan angle (SD for RSB and blackbody for TEB). Since the RVS is vitally important to the quality of calibrated radiance products, several independent studies were performed and their results were compared and validated. This document provides RVS results from three groups: the NPP Instrument Calibration Support Team (NICST), Raytheon, and the Aerospace Corporation. A comparison of the RVS results obtained using a 2nd order polynomial fit to measurement data is conducted for each band, detector, and half angle mirror (HAM) side. The associated RVS fitting residuals are examined and compared with the relative differences in RVS found between independent studies. Results show that the agreement is within 0.1% and comparable with fitting residuals for all bands except for RSB band M9, where a difference of 0.2% results from the application of the atmospheric water vapor correction for laboratory conditions during the test by Raytheon. NICST has slightly larger RSB RVS uncertainties but still well within the 0.3% total uncertainty allowed for the RVS characterization defined in the Performance Verification Plan.

Wu, Aisheng↗