Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

A Consistent EPIC Visible Channel Calibration using VIIRS and MODIS as a Reference

The Earth Polychromatic Imaging Camera (EPIC) aboard the Deep Space Climate Observatory (DSCOVR) satellite constantly images the sunlit disk of Earth from the Lagrange-1 (L1) point in 10 spectral channels spanning the UV, VIS, and NIR spectrums. Recently, the DSCOVR EPIC team has publicly released version 2 dataset, which has implemented improved navigation, stray-light correction, and flat-fielding of the CCD array. The EPIC 2-year data record must be well-calibrated for consistent cloud, aerosol, trace gas, land use and other retrievals. Because EPIC lacks onboard calibrators, the observations made by EPIC channels must be calibrated vicariously using the coincident measurements from radiometrically stable instruments that have onboard calibration systems. MODIS and VIIRS are best-suited instruments for this task as they contain similar spectral bands that are well-calibrated onboard using solar diffusers and lunar tracking. We have previously calibrated the EPIC version 1 dataset by using EPIC and VIIRS angularly matched radiance pairs over both all-sky ocean and deep convective clouds (DCC). We noted that the EPIC image required navigations adjustments, and that the EPIC stray-light correction provided an offset term closer to zero based on the linear regression of the EPIC and VIIRS ray-matched radiance pairs. We will evaluate the EPIC version 2 navigation and stray-light improvements using the same techniques. In addition, we will monitor the EPIC channel calibration over the two years for any temporal degradation or anomalous behavior. These two calibration methods will be further validated using desert and DCC invariant Earth targets. The radiometric characterization of the selected invariant targets is performed using multiple years of MODIS and VIIRS measurements. Results of these studies will be shown at the conference.

Haney, C. O.↗

Neural Network (NN) Retrievals of Stratocumulus Cloud Properties Using Multiangle Polarimetric Observations During ORACLES

The ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) campaign is taking place in the SouthEast Atlantic during the Austral Spring for three consecutive years from 20162018. The study area encompasses one of the Earths three semipermanent subtropical Stratocumulus (Sc) cloud decks,and experiences very large aerosol optical depths, mainly biomass burning, originating from Africa. Over time, cloud optical depth (COD), lifetime and cloud microphysics (number concentration, effective radii Reff and precipitation) are expected to be influenced by indirect aerosol effects. These changes play a key role in the energetic balance of the region, and are part of the core investigation objectives of the ORACLES campaign, which acquires measurements of clean and polluted scenes of above cloud aerosols (ACA). Simultaneous retrievals of aerosol and cloud optical properties are being developed (e.g. MODIS, OMI), butstill challenging, especially for passive, single viewing angle instruments. By comparison, multiangle polarimetric instruments like RSP (Research Scanning Polarimeter) show promise for detection and quantification of ACA, however, there are no operational retrieval algorithms available yet. Here we describe anew algorithm to retrieve cloud and aerosol optical properties from observations by RSP flown on the ER2and P3 during the 2016 ORACLES campaign. The algorithm is based on training a NN, and is intended to retrieve aerosol and cloud properties simultaneously. However, the first step was to establish the retrievalscheme for low level Sc cloud optical properties. The NN training was based on simulated RSP total and polarized radiances for a range of COD, Reff, and effective variances, spanning 7 wavelength bands and 152 viewing zenith angles. Random and correlated noise were added to the simulations to achieve a morerealistic representation of the signals. Before introducing the input variables to the network, the signals are projected on a principle component plane that retains the maximal signal information but minimizes the noise contribution. We will discuss parameter choices for the network and present preliminary results of cloudretrievals from ORACLES, compared with standard RSP low-levelcloud retrieval method that has been validated against in situ observations.

Cloud-aerosol↗

A Preliminary Modeling Study of Biofilm Accumulation in the Water Recovery System

Bacterial biofilms are ubiquitous in wastewater systems on earth and in spacecraft, such as in the International Space Station (ISS) wastewater processing assembly (WPA), where they cause problems in the tank, solenoid valves, and pipelines. Downstream filter applications, tank cycling, and regular biocide water flushing have been used to control biofilm accumulation on board the ISS. Biofilm control is expected to be a challenge for long-term missions with a dormancy period of up to a year, as stagnant water systems are highly susceptible to biofilm growth. Flushing of the system with biocidal water has been proposed to avoid biomass problems for long-term missions. To validate the proposed flush method, a mathematical model, based on the metabolism maintenance rate of bacteria, is being developed to understand the current biofilm accumulation rate in the ISS WPA system and to calculate the biomass production rate under dormancy-like conditions. This method of quantification of biofilm can be applied as a function of nutrient inputs to guide the selection and optimization of biofilm mitigation approaches. The method can also be helpful in understanding, defining, quantifying, visualizing, and simulating the state of the water processing system during operation and after dormancy.

Angie M Diaz↗

Isotopically Tracking Nitrogen Oxides, Nitrous Acid, And Nitric Acid, Particulate Nitrate from Wildfire During FIREX-AQ

Wildfires are an important source of reactive nitrogen species including nitrogen oxides (NOx = NO + NO2) and nitrous acid (HONO), as well as products such as nitric acid (HNO3) and particulate nitrate (p-NO3-). These species have strongly influence air quality and climate. In summer of 2019 (July 25 —August 21), as part of the FIREX-AQ ground mission, we drove ~3000 miles and sampled smoke of different ages in both daytime and nighttime from 5 different wildfires in the western US. Using recently developed methods that have been validated in both laboratory and field settings, we conducted high time resolution collection of NOx, NO2, HONO, HNO3, and p-NO3- for off-line characterization of isotopic composition δ15N, δ18O and Δ17O (=δ17O−0.52 δ18O). δ15N serves as a potential tracer for tracking sources and reactive nitrogen cycling pathways, δ18O and Δ17O provide key information about oxidation pathways (i.e. O3 versus RO2). Our measured δ15N for HONO ranges from -4.9‰ to +5.2‰ and -8‰ to +5.2‰ respectively, in the majority overlapping with our prior lab controlled burning results, which suggests the capability of δ15N for tracing the biomass burning emissions against other sources including vehicular emissions and soil emissions. In addition, our measurements show δ18O and Δ17O for NO2 and HONO vary significantly day vs night, as well as in young smoke vs aged smoke, likely reflecting different oxidizing mechanisms under different smoke conditions. Preliminary results of isotopic signatures of all the above reactive nitrogen species will be presented, and their relationships will be explored to identify wildfire derived reactive nitrogen source signatures and to constrain atmospheric processing pathways (e.g. secondary formation of HONO) for different fires under various smoke conditions depending on fuel types, fire conditions and meteorological conditions.

Jiajue Chai↗

On-orbit/On-surface Servicing, Assembly, and Manufacturing (OSAM) Architecture Simulation System (OASiS)

On-orbit/on-surface servicing, assembly, and manufacturing (OSAM) –recently renamed“in-space servicing, assembly, and manufacturing”(ISAM) –will aid in the development of vital research-enabling structuresin space, such as the In-space Assembled Telescope, the Lunar Gateway, and the Lunar Safe Haven. As these structures become larger and more complex, developers will need new methods for verifying and validating their OSAM mission architectures at full-scale prior to launch, without paying for extensive facility upgrades or additional hardware prototypes. Under the OSAM Architecture Simulation System (OASiS) project, modular OSAM modeling and simulation capabilities were developed to help rapidly prototype and evaluate OSAM technologies and operational concepts.Theywerethenusedto demonstrate and evaluate data from the simulation of a simpleOSAM operation against ananaloghardware setup. Using collected test data, the teamevaluatedthe accuracy of the simulation environment against the behavior of real hardwareandgainedinsight on how to further improve OSAM modeling and simulation. With thesenewcapabilities and many more to come, developers will be able to test complex OSAM operations on multiple scales, iterate on technology designs faster, achieve higher operational accuracy, and ultimately reduce mission development costs. A comprehensive, high-fidelity simulation environment will ensure the successful servicing, assembly, and manufacturing of structures that help us study and explore our universe.

isam↗

Structures and Materials Research at NASA Langley Research Center

NASA explores the unknown in air and space, innovates for the benefit of humanity, and inspires the world through discovery. The Structures and Materials discipline at NASA Langley Research Center supports this mission through advanced materials and manufacturing approaches applied to innovative structural concepts. We start with synthesizing novel material systems and applying tools and methods to predict and validate their static, dynamic, durability and damage tolerance behavior. We mature materials from test tube to test flight by developing manufacturing techniques that enable the advancement of aerospace structures from concept to reality. We develop advanced measurement techniques for health management and nondestructive evaluation. We draw on our structures and materials core capabilities to enable safe, reliable lightweight aerospace structures for application in all environments. You will find the results of our work in the assembly of large structures in space and on other planets, vehicles that carry crew into space, vehicles that operate at high speeds and in extreme environments, and technology for passenger and crew safety in commercial aviation. This presentation will provide an overview of Langley Research Center’s role within the agency, then focus on how current Structures and Materials research areas support a variety of NASA missions in space operations, exploration, and aeronautics.

Structures↗

The Examination of Individual Factors and AFTE Training Outcomes

Introduction: Motion sickness is common among military aviators. It describes a specific group of symptoms that include epigastric awareness, nausea, pallor, sweating, salivation, and fatigue. Occurrences of these symptoms can pose a significant risk to safety and adversely impact mission success. Accordingly, researchers have developed specific interventions to act as countermeasures. For example, Autogenic Feedback Training Exercise has been empirically validated as a training method that mitigates the impact of motion sickness. However, it remains unclear the extent to which individual factors moderate (or mediate) the effects of this intervention. The examination of individual factors such as interoceptive accuracy (IA) and specific personality traits might provide insight into whom may benefit most from AFTE. Methods: Participants were administered the Big Five Inventory (BFI) and State Trait Anxiety Inventory (STAI). In addition, they were given an interoceptive accuracy task (i.e., heartbeat counting task). The participants’ reported value was then compared to the actual number of heart beats obtained via ECG. Completion of the IA task was followed by pre- AFTE and Post-AFTE rotating chair tests to evaluate motion sickness and the effects of AFTE training. Results: Participants (n=16) were evaluated on IA, personality factors (i.e., BFI & STAI) and performance on the rotating chair. IA was unrelated to personality traits (p > .05), but inversely related to state anxiety post training (p < .05). Finally, IA did not predict performance (i.e., rotations or minutes tolerated ?) on rotating chair F (1, 14) = 1.18, p> .05). Discussion:(1) IA is unrelated to personality traits as measured by BFI and STAI. (2) Individual factors are unrelated to AFTE training outcome. (3) AFTE training can be beneficial for all.

motion sickness↗

A Grounded Theory of UAS Reported Accidents

Context: The manufacture and operation of sUAS are not as regulated as today’s commercial operation, and their widespread use introduces new risks and hazards to the general public. Aim: Our intent is to understand the various processes that prevent or portend sUAS incidents or accidents and the influence that pilots’ expectations and training have on these processes. Method: We use classic grounded theory on sUAS reported accidents (and incidents). Results: We identified three categories, Control Interference, Reviewing and Reporting, which describe various processes surrounding UAS accidents based on the dataset analyzed. Conclusion: The use of grounded theory can offer a different perspective in the analysis of UAS accidents. In addition, the traceability between data sources and the method results facilitate result validation, and navigation. While the results are preliminary, the concepts can be expanded through the use of other accident datasets or used as basis for UAS accident surveys.

Carlos Paradis↗

A Grounded Theory of UAS Reported Accidents

Context: The manufacture and operation of sUAS are not as regulated as today’s commercial operation, and their widespread use introduces new risks and hazards to the general public. Aim: Our intent is to understand the various processes that prevent or portend sUAS incidents or accidents and the influence that pilots’ expectations and training have on these processes. Method: We use classic grounded theory on sUAS reported accidents (and incidents). Results: We identified three categories, Control Interference, Reviewing and Reporting, which describe various processes surrounding UAS accidents based on the dataset analyzed. Conclusion: The use of grounded theory can offer a different perspective in the analysis of UAS accidents. In addition, the traceability between data sources and the method results facilitate result validation, and navigation. While the results are preliminary, the concepts can be expanded through the use of other accident datasets or used as basis for UAS accident surveys.

Carlos Paradis↗

New Tools for Automating Arcjet Sample Recession Tracking and Analysis

Arcjet Computer Vision (arcjetCV) has been significantly upgraded to enhance accuracy and performance in tracking material recession and shock-material standoff in test videos. These improvements include integrating new machine learning models, developing a specialized edge detection class, and incorporating a more comprehensive training dataset. These upgrades have refined the software’s ability to automate time-resolved recession tracking, making it more precise and reliable for analyzing complex physical processes. In parallel, a new tool called STARscan (Spatial Targeting and Alignment Rig for Scanning) is being developed to capture detailed 3D surface data before and after testing. By comparing these pre- and post-test scans with arcjetCV’s automated video analysis results, users can achieve a more comprehensive assessment of material recession. This method enables cross-validation of results, improving confidence in the analysis of tested materials. The expanded capabilities of arcjetCV have been successfully demonstrated on videos from various facilities, including the NASA Ames arcjets, UIUC’s PlasmatronX, and the VKI Plasmatron. It has been adopted as a new standard for in-situ recession tracking by the Mars Sample Return Project and Orion. ArcjetCV’s improved efficiency and accuracy are critical for reducing testing uncertainties and validating heatshield material performance under extreme conditions. The software’s user-friendly graphical interface ensures ease of use, enabling seamless processing and precise analysis of arcjet videos, providing deeper insights into material behavior in hypersonic environments. ArcjetCV is now available on both PyPI and Conda, allowing easy installation via "pip install arcjetCV" or through the Conda package manager, ensuring broad accessibility and streamlined deployment for users across various platforms.

Ablation↗

Blind Validation Study of PRICE TruePlanning and SEER-H

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning by PRICE Systems, and System Estimation and Evaluation of Resources-Hardware (SEER-H) by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. This study is an independent verification of the accuracy of these tools and was originally published in 2018. The purpose of this presentation is to circulate the findings of that study among the NASA cost community. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER-H had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. Nine of the twelve mission's actual costs fell within the 80% confidence interval of SEER's probabilistic estimates; however, none of the missions fell within PRICE’s confidence intervals. There were several factors independent of PRICE and SEER-H which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

SEER↗

DNS of Flows over Periodic Hills using a Discontinuous-Galerkin Spectral-Element Method

Direct numerical simulation (DNS) of turbulent compressible flows is performed using a higher-order space-time discontinuous-Galerkin finite-element method. The numerical scheme is validated by performing DNS of the evolution of the Taylor-Green vortex and turbulent flow in a channel. The higher-order method is shown to provide increased accuracy relative to low-order methods at a given number of degrees of freedom. The turbulent flow over a periodic array of hills in a channel is simulated at Reynolds number 10,595 using an 8th-order scheme in space and a 4th-order scheme in time. These results are validated against previous large eddy simulation (LES) results. A preliminary analysis provides insight into how these detailed simulations can be used to improve Reynoldsaveraged Navier-Stokes (RANS) modeling

DNS↗

A unique method to study acoustic transmission through ducts using signal synthesis and averaging of acoustic pulses

An acoustic impulse technique using a loudspeaker driver is developed to measure the acoustic properties of a duct/nozzle system. A signal synthesis method is used to generate a desired single pulse with a flat spectrum. The convolution of the desired signal and the inverse Fourier transform of the reciprocal of the driver's response are then fed to the driver. A signal averaging process eliminates the jet mixing noise from the mixture of jet noise and the internal noise, thereby allowing very low intensity signals to be measured accurately, even for high velocity jets. A theoretical analysis is carried out to predict the incident sound field; this is used to help determine the number and locations of the induct measurement points to account for the contributions due to higher order modes present in the incident tube method. The impulse technique is validated by comparing experimentally determined acoustic characteristics of a duct-nozzle system with similar results obtained by the impedance tube method. Absolute agreement in the comparisons was poor, but the overall shapes of the time histories and spectral distributions were much alike.

Salikuddin, M.↗

Blind Study Validating Parametric Costing Tools PRICE TruePlanning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Paul D Friz↗

Blind Study Validating Parametric Costing Tools PRICE True Planning and SEER-H for NASA Science Missions

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE True Planning - Space Missions Catalog by PRICE Systems, and SEER-H by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. However, no independent verification of the accuracy of these tools is publicly available. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE True Planning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. There were several factors independent of PRICE and SEER which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

Friz, Paul D.↗

Long-term motion of resonant satellites with arbitrary eccentricity and inclination

A first-order, semi-analytical method for the long-term motion of resonant satellites is introduced. The method provides long-term solutions, valid for nearly all eccentricities and inclinations, and for all commensurability ratios. The method allows the inclusion of all zonal and tesseral harmonics of a nonspherical planet. We present here an application of the method to a synchronous satellite including J2 and J22 harmonics. Global, long-term solutions for this problem are given for arbitrary values of eccentricity, argument of perigee and inclination.

Nacozy, P. E.↗