Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Online Remote Sensing Interface

BasinTools Module 1 processes remotely sensed raster data, including multi- and hyper-spectral data products, via a Web site with no downloads and no plug-ins required. The interface provides standardized algorithms designed so that a user with little or no remote-sensing experience can use the site. This Web-based approach reduces the amount of software, hardware, and computing power necessary to perform the specified analyses. Access to imagery and derived products is enterprise-level and controlled. Because the user never takes possession of the imagery, the licensing of the data is greatly simplified. BasinTools takes the "just-in-time" inventory control model from commercial manufacturing and applies it to remotely-sensed data. Products are created and delivered on-the-fly with no human intervention, even for casual users. Well-defined procedures can be combined in different ways to extend verified and validated methods in order to derive new remote-sensing products, which improves efficiency in any well-defined geospatial domain. Remote-sensing products produced in BasinTools are self-documenting, allowing procedures to be independently verified or peer-reviewed. The software can be used enterprise-wide to conduct low-level remote sensing, viewing, sharing, and manipulating of image data without the need for desktop applications.

Lawhead, Joel↗

Requirements and Waivers

Good requirements are the first step for good communications, and good communications are central to insure an understanding between the customer and contractor. Failure to generate good requirements is unfortunately commonplace and repeated. Waivers to requirements are discussed from a risk based point of view. The assumption that every requirement will eventually be waived is used to establish a critical review of a draft safety requirement. Validation methods of requirements are addressed. Value added that safety requirements contribute to the Project is estimated to further our critical review of draft requirements.

Goodin, James Ronald↗

Reconfigurable antenna pattern verification

A method of verifying programmable antenna configurations is disclosed. The method comprises selecting a desired antenna configuration from a plurality of antenna configuration patterns, with the selected antenna configuration forming at least one reconfigurable antenna from reconfigurable antenna array elements. The method validates the formation of the selected antenna configuration to determine antenna performance of the at least one reconfigurable antenna.

Drexler, Jerome P.↗

Spring 2013 Graduate Engineering Internship Summary

In the spring of 2013, I participated in the National Aeronautics and Space Administration (NASA) Pathways Intern Employment Program at the Kennedy Space Center (KSC) in Florida. This was my final internship opportunity with NASA, a third consecutive extension from a summer 2012 internship. Since the start of my tenure here at KSC, I have gained an invaluable depth of engineering knowledge and extensive hands-on experience. These opportunities have granted me the ability to enhance my systems engineering approach in the field of payload design and testing as well as develop a strong foundation in the area of composite fabrication and testing for repair design on space vehicle structures. As a systems engineer, I supported the systems engineering and integration team with final acceptance testing of the Vegetable Production System, commonly referred to as Veggie. Verification and validation (V and V) of Veggie was carried out prior to qualification testing of the payload, which incorporated the process of confirming the system's design requirements dependent on one or more validation methods: inspection, analysis, demonstration, and testing.

Ehrlich, Joshua↗

Supporting Real-Time Operations and Execution through Timeline and Scheduling Aids

Since 2003, the NASA Ames Research Center has been actively involved in researching and advancing the state-of-the-art of planning and scheduling tools for NASA mission operations. Our planning toolkit SPIFe (Scheduling and Planning Interface for Exploration) has supported a variety of missions and field tests, scheduling activities for Mars rovers as well as crew on-board International Space Station and NASA earth analogs. The scheduled plan is the integration of all the activities for the day/s. In turn, the agents (rovers, landers, spaceships, crew) execute from this schedule while the mission support team members (e.g., flight controllers) follow the schedule during execution. Over the last couple of years, our team has begun to research and validate methods that will better support users during realtime operations and execution of scheduled activities. Our team utilizes human-computer interaction principles to research user needs, identify workflow processes, prototype software aids, and user test these. This paper discusses three specific prototypes developed and user tested to support real-time operations: Score Mobile, Playbook, and Mobile Assistant for Task Execution (MATE).

scheduling↗

Human-Automation Allocations for Current Robotic Space Operations

Within the Human Research Program, one risk delineates the uncertainty surrounding crew working with automation and robotics in spaceflight. The Risk of Inadequate Design of Human and Automation/Robotic Integration (HARI) is concerned with the detrimental effects on crew performance due to ineffective user interfaces, system designs and/or functional task allocation, potentially compromising mission success and safety. Risk arises because we have limited experience with complex automation and robotics. One key gap within HARI, is the gap related to functional allocation. The gap states: We need to evaluate, develop, and validate methods and guidelines for identifying human-automation/robot task information needs, function allocation, and team composition for future long duration, long distance space missions. Allocations determine the human-system performance as it identifies the functions and performance levels required by the automation/robotic system, and in turn, what work the crew is expected to perform and the necessary human performance requirements. Allocations must take into account each of the human, automation, and robotic systems capabilities and limitations. Some functions may be intuitively assigned to the human versus the robot, but to optimize efficiency and effectiveness, purposeful role assignments will be required. The role of automation and robotics will significantly change in future exploration missions, particularly as crew becomes more autonomous from ground controllers. Thus, we must understand the suitability of existing function allocation methods within NASA as well as the existing allocations established by the few robotic systems that are operational in spaceflight. In order to evaluate future methods of robotic allocations, we must first benchmark the allocations and allocation methods that have been used. We will present 1) documentation of human-automation-robotic allocations in existing, operational spaceflight systems; and 2) To gather existing lessons learned and best practices in these role assignments, from spaceflight operational experience of crew and ground teams that may be used to guide development for future systems. NASA and other space agencies have operational spaceflight experience with two key Human-Automation-Robotic (HAR) systems: heavy lift robotic arms and planetary robotic explorers. Additionally, NASA has invested in high-fidelity rover systems that can carry crew, building beyond Apollo's lunar rover. The heavy lift robotic arms reviewed are: Space Station Remote Manipulator System (SSRMS), Japanese Remote Manipulator System (JEMRMS), and the European Robotic Arm (ERA, designed but not deployed in space). The robotic rover systems reviewed are: Mars Exploration Rovers, Mars Science Laboratory rover, and the high-fidelity K10 rovers. Much of the design and operational feedback for these systems have been communicated to flight controllers and robotic design teams. As part of the mitigating the HARI risk for future human spaceflight operations, we must document function allocations between robots and humans that have worked well in practice.

robotic allocation↗

TPSAS-NF1676L-14571-DND

Structural dynamics major concern for Ares I - Highest slenderness ratio of any vehicle ever flown - First bending mode within control bandwidth - Phase stabilization of first bending mode required - Gain stabilization of higher modes Ares I-X provided early flight test of first stage flight for model and modeling method validation - Dynamically scaled at liftoff - Dummy upper stage, Orion/LAS, and 5th segment Made with surplus materials… - Booster & TVC – expired Shuttle RSRM - RoCS – disassembled from Peace Keeper ICBM - BDM’s and BTM’s – Old Shuttle BSM motors - Avionics – Atlas V

Eugene Heim↗

NASA Ames Fatigue Countermeasures Laboratory and AA FRMS - A Working Relationship

American Airlines and NASA Ames Research Center have a long-standing partnership to conduct human factors fatigue research in airline operations. Since 2016, using a mechanism known as a Space Act Agreement, NASA Ames’ Fatigue Countermeasures Laboratory has worked with the American’s Fatigue Risk Management team to gather sleep and alertness data from volunteer flight crew members. Operations studied include long-range transpacific flights, timing of inflight rest breaks during augmented flights, and rates of acclimation related to flights making theater changes. This mutually beneficial collaborative working arrangement allows American to conduct operations of specific interest under the FAA’s Alternative Means of Compliance process and provides NASA with a means to gather and analyze data that can be used to inform operational safety-related decisions. Earlier this year, results from the study of inflight rest breaks was published in the journal Aerospace Medicine and Human Performance. A total of 500 American pilots responded to a survey with landing crew reporting more and better-quality sleep during break 2 than break 3. Subsequent ratings of sleepiness and alertness at TOD were significantly better for crew who used break 2. Findings from this study were reported to the FAA leading to an inflight fatigue mitigation capability for many pilots in the industry. An upcoming study is to evaluate workload and alertness levels during Caribbean Turn (DFW-SJO-DFW) operations. For this study, the FRMS team and NASA will ask volunteers to collect data on sleep, workload, performance, and alertness using scientifically valid methods The information gained in this study will help inform how workload and fatigue interact with duty duration during short-haul, daytime operations.

in-flight rest↗

Understanding the Feasibility of MAB Phase Structures for Lunar Applications

During the ten-week internship, my work focused on synthesis, characterization, and tailoring the flowability of the MAB phase powders for improving the surface finish and decreasing porosity of 3D-printed MAB phase structures. My mentor for the project was Dr. Samuel Hocker from NASA Langley and my faculty advisor was Dr. Surojit Gupta from the University of North Dakota. I also collaborated with Daniel Trieff from the University of North Dakota in developing characterization paradigm of 3D printed samples. The microencapsulation was performed via novel solvent casting-based microencapsulation process pioneered in UND, wherein a polymer (PLA, PHA) was dissolved into dichloromethane and precipitated onto the surface of the MoAlB particles. Two 100mL samples of microencapsulated powder was outsourced to Particle Technology Labs for flowability testing along with a 100mL control sample to determine if microencapsulation is a valid method for improving the flowability. The microencapsulated powders were characterized using SEM, Differential Scanning Calorimetry, and optical microscopy. The SEM images showed no change between the pure and microencapsulated powders. The optical microscopy analysis indicated a reduction in reflectivity for the PLA microencapsulated powders as well as hydrophobic properties. Both results suggest that microencapsulation was successful as PLA is a hydrophobic polymer and the change in reflectivity could be a result of the light being dispersed through the polymer coating. A reflectivity analysis will be done to bring more perspective to these observations. If powder flowability is improved, then the project will move forward with testing the printability of the microencapsulated powders and characterizing the structures using the designed characterization protocol. We are waiting for the DSC results. The characterization protocol for the 3D-printed MAB structures included a visual inspection of the plates to rule out any samples that had spalled or delaminated, optical microscopy to document surface features, porosity, and decomposition, and cleaning of the plates using an ultrasonic bath in preparation for SEM, EDS, and profilometry analyses.

MAB Phase↗

Close out the Critical Commitment for System Wide Safety’s Technical Challenge 3 (TC 3)

- Deliver validated methods and recommended practices to reduce certification costs for ground and onboard vehicle guidance and control systems through expanded acceptability of analysis as evidence for certification FY 2022. - Communicate results to maximize public awareness of the research and transfer capabilities via a set of on-demand training seminars and supporting materials including reports, publications and open source software codes where applicable.

Joseph C Coughlan↗

Runtime Monitoring for Unmanned Aerospace Systems with Neural Network Components

AI components (e.g., Deep Neural Networks) are increasingly used in unmanned Aerospace systems for safety-relevant applications. Rigorous Verification and Validation methods for such components are still in their infancy and thus, monitoring of the AI's behavior during runtime is essential. In this paper, we will present a runtime-monitoring architecture, which combines the advanced statistical analysis framework SYSAI (System Analysis using Statistical AI) with temporal and probabilistic runtime monitoring carried out by R2U2 (Realizable, Responsive, and Unobtrusive Unit). Learned statistical models of complex systems with AI components are produced by the SYSAI framework and provide detailed information to enable the R2U2 runtime monitor to efficiently perform advanced safety and performance checks in nominal and off-nominal conditions. We will present initial results of our tool set and architecture on a case study, a DNN-based autonomous centerline tracking system (ACT).

Yuning He↗

Evaluation of Spectral Band Adjustment Factors for Cross-Calibration of Visible Imagers

The NASA CERES EBAF dataset provides TOA SW and LW fluxes for long-term monitoring of the Earth’s energy balance and to validate climate models. The EBAF products, based on the Terra, Aqua, and NOAA20 CERES instrument observed radiances, rely on coincident measurements from the onboard MODIS or VIIRS imagers to determine cloud properties used for angular distribution model scene selection, which is required to convert the CERES observed radiances into flux values. Furthermore, CERES utilizes geostationary imager (GEO) hourly fluxes and clouds to infer the regional averaged daily flux in the SYN1deg product. A seamless transition of fluxes and clouds can only occur if the analogous MODIS, VIIRS, and GEO channels are properly inter-calibrated. The analogous band SRFs differ noticeably and require scene dependent spectral band adjustment factors (SBAF) for proper radiometric scaling between them. Given their disparate but overlapping SRFs, the coincident VIIRS I1 and M5 band TOA reflectance measurements provide the optimal opportunity to validate SBAFs over many surface and cloud conditions. The CERES project maintains SCIAMACHY, GOME-2, and Hyperion scene-stratified hyper-spectral reflectance measurements that can be convolved with sensor pair SRFs to compute the corresponding SBAF. This study highlights the SCIAMACHY, GOME-2, and Hyperion based SBAFs for different MODIS, VIIRS, and GEO inter-calibration targets, including all-sky tropical ocean (ATO), Libya-4, Dome-C, and deep convective clouds. To mitigate the observed sensor radiance fluctuations due to atmospheric absorption and aerosol variations, the Earth target observed radiances are correlated with multiple atmospheric parameters, such as precipitable water and ozone. The remaining M5 and I1 mean spectral band radiance difference should be resolved by the SBAF correction. The formulation of hyper-spectral sensor based SBAFs and validation methods can be verified in future utilizing high-accuracy, SI-traceable hyper-spectral measurements from CLARREO Pathfinder.

David R Doelling↗

Extension and validation of a method for locating damaged members in large space trusses

The damage location approach employs the control system capabilities for the structure to test the structure and measure the dynamic response. The measurements are then used in a system identification algorithm to produce a model of the damaged structure. The model is compared to one for the undamaged structure to find regions of reduced stiffness which indicate the location of damage. Kabe's 3,4 stiffness matrix adjustment method was the central identification algorithm. The strength of his method is that, with minimal data, it preserves the representation of the physical connectivity of the structure in the resulting model of the damaged truss. However, extensive storage and computational effort were required as a result. Extension of the damage location method to overcome these problems is the first part of the current work. The central system identification algorithm is replaced with the MSMT method of stiffness matrix adjustment which was previously derived by generalizing an optimal-update secant method form quasi-Newton approaches for nonlinear optimization. Validation of the extended damage location method is the second goal.

Smith, Suzanne Weaver↗

Model-Based Method for Sensor Validation

Fault detection, diagnosis, and prognosis are essential tasks in the operation of autonomous spacecraft, instruments, and in situ platforms. One of NASA s key mission requirements is robust state estimation. Sensing, using a wide range of sensors and sensor fusion approaches, plays a central role in robust state estimation, and there is a need to diagnose sensor failure as well as component failure. Sensor validation can be considered to be part of the larger effort of improving reliability and safety. The standard methods for solving the sensor validation problem are based on probabilistic analysis of the system, from which the method based on Bayesian networks is most popular. Therefore, these methods can only predict the most probable faulty sensors, which are subject to the initial probabilities defined for the failures. The method developed in this work is based on a model-based approach and provides the faulty sensors (if any), which can be logically inferred from the model of the system and the sensor readings (observations). The method is also more suitable for the systems when it is hard, or even impossible, to find the probability functions of the system. The method starts by a new mathematical description of the problem and develops a very efficient and systematic algorithm for its solution. The method builds on the concepts of analytical redundant relations (ARRs).

Vatan, Farrokh↗

Comparative Study in Laboratory Rats to Validate Sperm Quality Methods and Endpoints

Abstract The Naval Health Research Center, Detachment (Toxicology) performs toxicity studies in laboratory animals to characterize the risk of exposure to chemicals of Navy interest. Research was conducted at the Toxicology Detachment at WPAFB, OH in collaboration with Wright State University, Department of Biological Sciences for the validation of new bioassay methods for evaluating reproductive toxicity. The Hamilton Thorne sperm analyzer was used to evaluate sperm damage produced by exposure to a known testicular toxic agent, methoxyacetic acid and by inhalation exposure to JP-8 and JP-5 in laboratory rats. Sperm quality parameters were evaluated (sperm concentration, motility, and morphology) to provide evidence of sperm damage. The Hamilton Thorne sperm analyzer utilizes a DNA specific fluorescent stain (similar to flow cytometry) and digitized optical computer analysis to detect sperm cell damage. The computer assisted sperm analysis (CASA) is a more rapid, robust, predictive and sensitive method for characterizing reproductive toxicity. The results presented in this poster report validation information showing exposure to methoxyacetic acid causes reproductive toxicity and inhalation exposure to JP-8 and JP-5 had no significant effects. The CASA method detects early changes that result in reproductive deficits and these data will be used in a continuing program to characterize the toxicity of chemicals, and combinations of chemicals, of military interest to formulate permissible exposure limits.

Price, W. A.↗

On the validity of the modified equation approach to the stability analysis of finite-difference methods

The validity of the modified equation stability analysis introduced by Warming and Hyett was investigated. It is shown that the procedure used in the derivation of the modified equation is flawed and generally leads to invalid results. Moreover, the interpretation of the modified equation as the exact partial differential equation solved by a finite-difference method generally cannot be justified even if spatial periodicity is assumed. For a two-level scheme, due to a series of mathematical quirks, the connection between the modified equation approach and the von Neuman method established by Warming and Hyett turns out to be correct despite its questionable original derivation. However, this connection is only partially valid for a scheme involving more than two time levels. In the von Neumann analysis, the complex error multiplication factor associated with a wave number generally has (L-1) roots for an L-level scheme. It is shown that the modified equation provides information about only one of these roots.

Chang, Sin-Chung↗

The Second SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-2)

Eight international laboratories specializing in the determination of marine pigment concentrations using high performance liquid chromatography (HPLC) were intercompared using in situ samples and a variety of laboratory standards. The field samples were collected primarily from eutrophic waters, although mesotrophic waters were also sampled to create a dynamic range in chlorophyll concentration spanning approximately two orders of magnitude (0.3 25.8 mg m-3). The intercomparisons were used to establish the following: a) the uncertainties in quantitating individual pigments and higher-order variables (sums, ratios, and indices); b) an evaluation of spectrophotometric versus HPLC uncertainties in the determination of total chlorophyll a; and c) the reduction in uncertainties as a result of applying quality assurance (QA) procedures associated with extraction, separation, injection, degradation, detection, calibration, and reporting (particularly limits of detection and quantitation). In addition, the remote sensing requirements for the in situ determination of total chlorophyll a were investigated to determine whether or not the average uncertainty for this measurement is being satisfied. The culmination of the activity was a validation of the round-robin methodology plus the development of the requirements for validating an individual HPLC method. The validation process includes the measurements required to initially demonstrate a pigment is validated, and the measurements that must be made during sample analysis to confirm a method remains validated. The so-called performance-based metrics developed here describe a set of thresholds for a variety of easily-measured parameters with a corresponding set of performance categories. The aggregate set of performance parameters and categories establish a) the overall performance capability of the method, and b) whether or not the capability is consistent with the required accuracy objectives.

Source record↗

Validation of Test Methods for Air Leak Rate Verification of Spaceflight Hardware

As deep space exploration continues to be the goal of NASAs human spaceflight program, verification of the performance of spaceflight hardware becomes increasingly critical. Suitable test methods for verifying the leak rate of sealing systems are identified in program qualification testing requirements. One acceptable method for verifying the air leak rate of gas pressure seals is the tracer gas leak detector method. In this method, a tracer gas (commonly helium) leaks past the test seal and is transported to the leak detector where the leak rate is quantified. To predict the air leak rate, a conversion factor of helium-to-air is applied depending on the magnitude of the helium flow rate. The conversion factor is based on either the molecular mass ratio or the ratio of the dynamic viscosities. The current work was aimed at validating this approach for permeation-level leak rates using a series of tests with a silicone elastomer O-ring. An established pressure decay method with constant differential pressure was used to evaluate both the air and helium leak rates of the O-ring under similar temperature and pressure conditions. The results from the pressure decay tests showed, for the elastomer O-ring, that neither the molecular flow nor the viscous flow helium-to-air conversion factors were applicable. Leak rate tests were also performed using nitrogen and argon as the test gas. Molecular mass and viscosity based helium-to-test gas conversion factors were applied, but did not correctly predict the measured leak rates of either gas. To further this study, the effect of pressure boundary conditions was investigated. Often, pressure decay leak rate tests are performed at a differential pressure of 101.3 kPa with atmospheric pressure on the downstream side of the test seal. In space applications, the differential pressure is similar, but with vacuum as the downstream pressure. The same O-ring was tested at four unique differential pressures ranging from 34.5 to 137.9 kPa. Up to six combinations of upstream and downstream pressures for each differential pressure were compared. For a given differential pressure, the various combinations of upstream and downstream dry air pressures did not significantly affect the leak rate. As expected, the leak rate of the O-ring increased with increasing differential pressure. The results suggested that the current leak test pressure conditions, used to verify spacecraft sealing systems with elastomer seals, produce accurate values even though the boundary conditions do not model the space application.

helium leak detector↗