Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Evaluation and Windspeed Dependence of MODIS Aerosol Retrievals Over Open Ocean

The Maritime Aerosol Network (MAN) data set provides high quality ground-truth to validate the MODIS aerosol product over open ocean. Prior validation of the ocean aerosol product has been limited to coastal and island sites. Comparing MODIS Collection 5 ocean aerosol retrieval products with collocated MAN measurements from ships shows that MODIS is meeting the pre-launch uncertainty estimates for aerosol optical depth (AOD) with 64% and 67% of retrievals at 550 nm, and 74% and 78% of retrievals at 870 nm, falling within expected uncertainty for Terra and Aqua, respectively. Angstrom Exponent comparisons show a high correlation between MODIS retrievals and shipboard measurements (R= 0.85 Terra, 0.83 Aqua), although the MODIS aerosol algorithm tends to underestimate particle size for large particles and overestimate size for small particles, as seen in earlier Collections. Prior analysis noted an offset between Terra and Aqua ocean AOD, without concluding which sensor was more accurate. The simple linear regression reported here, is consistent with other anecdotal evidence that Aqua agreement with AERONET is marginally better. However we cannot claim based on the current study that the better Aqua comparison is statistically significant. Systematic increase of error as a function of wind speed is noted in both Terra and Aqua retrievals. This wind speed dependency enters the retrieval when winds deviate from the 6 m/s value assumed in the rough ocean surface and white cap parameterizations. Wind speed dependency in the results can be mitigated by using auxiliary NCEP wind speed information in the retrieval process.

Kleidman, Richard G.↗

Validation and Simulation of Ares I Scale Model Acoustic Test - 2 - Simulations at 5 Foot Elevation for Evaluation of Launch Mount Effects

The Ares I Scale Model Acoustics Test (ASMAT) is a series of live-fire tests of scaled rocket motors meant to simulate the conditions of the Ares I launch configuration. These tests have provided a well documented set of high fidelity measurements useful for validation including data taken over a range of test conditions and containing phenomena like Ignition Over-Pressure and water suppression of acoustics. Expanding from initial simulations of the ASMAT setup in a held down configuration, simulations have been performed using the Loci/CHEM computational fluid dynamics software for ASMAT tests of the vehicle at 5 ft. elevation (100 ft. real vehicle elevation) with worst case drift in the direction of the launch tower. These tests have been performed without water suppression and have compared the acoustic emissions for launch structures with and without launch mounts. In addition, simulation results have also been compared to acoustic and imagery data collected from similar live-fire tests to assess the accuracy of the simulations. Simulations have shown a marked change in the pattern of emissions after removal of the launch mount with a reduction in the overall acoustic environment experienced by the vehicle and the formation of highly directed acoustic waves moving across the platform deck. Comparisons of simulation results to live-fire test data showed good amplitude and temporal correlation and imagery comparisons over the visible and infrared wavelengths showed qualitative capture of all plume and pressure wave evolution features.

Strutzenberg, Louise L.↗

Validation and Simulation of Ares I Scale Model Acoustic Test - 3 - Modeling and Evaluating the Effect of Rainbird Water Deluge Inclusion

The Ares I Scale Model Acoustics Test (ASMAT) is a series of live-fire tests of scaled rocket motors meant to simulate the conditions of the Ares I launch configuration. These tests have provided a well documented set of high fidelity measurements useful for validation including data taken over a range of test conditions and containing phenomena like Ignition Over-Pressure and water suppression of acoustics. Building on dry simulations of the ASMAT tests with the vehicle at 5 ft. elevation (100 ft. real vehicle elevation), wet simulations of the ASMAT test setup have been performed using the Loci/CHEM computational fluid dynamics software to explore the effect of rainbird water suppression inclusion on the launch platform deck. Two-phase water simulation has been performed using an energy and mass coupled lagrangian particle system module where liquid phase emissions are segregated into clouds of virtual particles and gas phase mass transfer is accomplished through simple Weber number controlled breakup and boiling models. Comparisons have been performed to the dry 5 ft. elevation cases, using configurations with and without launch mounts. These cases have been used to explore the interaction between rainbird spray patterns and launch mount geometry and evaluate the acoustic sound pressure level knockdown achieved through above-deck rainbird deluge inclusion. This comparison has been anchored with validation from live-fire test data which showed a reduction in rainbird effectiveness with the presence of a launch mount.

Strutzenberg, Louise L.↗

Validation and Simulation of ARES I Scale Model Acoustic Test -1- Pathfinder Development

The Ares I Scale Model Acoustics Test (ASMAT) is a series of live-fire tests of scaled rocket motors meant to simulate the conditions of the Ares I launch configuration. These tests have provided a well documented set of high fidelity measurements useful for validation including data taken over a range of test conditions and containing phenomena like Ignition Over-Pressure and water suppression of acoustics. To take advantage of this data, a digital representation of the ASMAT test setup has been constructed and test firings of the motor have been simulated using the Loci/CHEM computational fluid dynamics software. Within this first of a series of papers, results from ASMAT simulations with the rocket in a held down configuration and without water suppression have then been compared to acoustic data collected from similar live-fire tests to assess the accuracy of the simulations. Detailed evaluations of the mesh features, mesh length scales relative to acoustic signals, Courant-Friedrichs-Lewy numbers, and spatial residual sources have been performed to support this assessment. Results of acoustic comparisons have shown good correlation with the amplitude and temporal shape of pressure features and reasonable spectral accuracy up to approximately 1000 Hz. Major plume and acoustic features have been well captured including the plume shock structure, the igniter pulse transient, and the ignition overpressure. Finally, acoustic propagation patterns illustrated a previously unconsidered issue of tower placement inline with the high intensity overpressure propagation path.

Putnam, G. C.↗

A Case Study Comparing Citizen Science Aurora Data with Global Auroral Boundaries Derived from Satellite Imagery and Empirical Models

Aurorasaurus is a citizen science project that offers a new, global data source consisting of ground-based reports of the aurora. For this case study, aurora data collected during the 17-18 March 2015 geomagnetic storm are examined to identify their conjunctions with Defense Meteorological Satellite Program (DMSP) satellite passes over the high latitude auroral regions. This unique set of aurora data can provide ground-truth validation of existing auroral precipitation models. Particularly, the solar wind driven, Oval Variation, Assessment, Tracking, Intensity, and Online Nowcasting (OVATION) Prime 2013 (OP-13) model and a Kp-dependent model of Zhang-Paxton (Z-P) are utilized for our boundary validation efforts. These two similar models are compared for the first time. Global equatorward auroral boundaries are derived from the OP 13 model and the DMSP Special Sensor Ultraviolet Spectrographic Imager (SSUSI) far ultraviolet (FUV) data using the Z-P model at a fixed flux level of 0.2 erg cm(exp -2)s(exp -1). These boundaries are then compared with citizen science reports as well as with each other. Even though there are some large differences between the global boundaries for a few cases, the average difference is about 1.5 deg in geomagnetic latitude, with OP-13 being equatorward of Z-P model. When these boundaries are compared with each other as a function of local time, no clear overall trend as a function of local time was observed. It is also found that the ground based reports are more consistent with the predictions of the OP-13 model.

Kosar, Burcu C.↗

Development and Experimental Validation of a Heat Transfer Model for Spilled Molten Salt Pools

A spill of radionuclide-bearing molten salt is one of the major postulated events that needs to be analyzed for liquid fluorine salt-cooled high-temperature reactor (FHR) or molten salt reactor licensing purposes. In this postulated event, radioactive source term materials (RSTMs) in the molten salt are discharged from the reactor vessel to the reactor building. The release of RSTMs from the spilled salt pool to the gas space in the reactor building is expected to be controlled by the cooling behavior of the spilled salt, including the growth and shrinkage of the solid crust on the surface of the spilled salt pool. This paper presents a simulation model for spilled salt pool heat transfer and validation efforts. The validation data come from two molten salt spill tests that were performed recently: the PELE2 test by the Rapid Experimental Laboratory of Kairos Power LLC (KP) and the Argonne salt cooling test conducted by Argonne National Laboratory. The former was a large-scale test involving kilograms of molten spilled FLiNaK salt, and the latter was a relatively smaller-scale test targeting various processes associated with a salt spill event. Both tests generated valuable data sets that can be used to assess salt cooling and validate evaluation models. This paper provides a new one-dimensional model that can simulate the cooling process of a spilled salt pool as well as the thermal responses of heat structures, such as the stainless steel liner and the concrete below the salt. The model has been implemented as part of KP-SAM code, which is a branch of the systems code SAM specific to KP FHR. In conclusion, the simulation results of the model are compared with the data of the PELE2 and Argonne tests, and reasonable agreements are observed between the model and test data.

heat transfer model↗

Advances in Stereo Photogrammetry Capabilities for in-Situ Ejecta Measurements in Lunar Plume-Surface Interactions

Plume-surface interaction is a critical topic of interest as human spaceflight programs establish a renewed presence on the Moon and push onwards to Mars. The erosion of regolith and high-speed ejection of soil and rocks which occurs during a powered spacecraft landing on lunar or terrestrial bodies can pose serious risks to the vehicle during landing and to existing ground assets. Ground testing campaigns have provided data sets in relevant environments (e.g., low pressure) in tandem with predictive computational model validation. To-date, limited in-situ flight data exists to inform the study of the key phenomena of plume-surface interaction: plume-flow physics, soil erosion, and ejecta dynamics. In two upcoming lunar missions, erosion of the lunar regolith will be measured in-situ using the stereo photogrammetry technique as part of NASA’s Commercial Lunar Payload Services (CLPS) Program. The Stereo Cameras for Lunar Plume Surface Studies (SCALPSS) will use a multiple-camera system to measure the erosion of the lunar regolith due to the vehicles’ rocket engine plumes during descent and after landing. The application of stereo photogrammetry to accurately measure a realistic eroded shape has been validated in laboratory work ahead of the scheduled flights. In preparation for future CLPS, Artemis, or other lunar science missions, recent advancements have been made to measure the ejecta structure and particle dynamics in addition to the erosion of regolith using a SCALPSS-like photogrammetry system. The thickness and ejection angle of entrained soil and dust produced during plume-induced erosion can be used to determine how far debris will travel, and thus how it may impact nearby infrastructure or the landing vehicle itself. The present work highlights the development of this new flight instrumentation capability and its value to advancements in the plume-surface interaction measurement topic for lunar or planetary landings.

Olivia K. Tyrrell↗

Terrain Relative Navigation for Guided Descent on Titan

Titan’s dense atmosphere, low gravity, and high winds at high altitudes create descent times of >90 minutes with standard entry/descent/landing (EDL) architectures and result in large unguided landing ellipses, with 99% values of 110x110 km and 149x72 km in recent Titan lander proposals. Enabling precision landing on Titan could increase science return for the types of missions proposed to date and make additional types of landing sites accessible, opening up new possibilities for science investigations. Precision landing on Titan has unique challenges, because the hazy atmosphere makes it difficult to see the surface and because it requires guided descent with divert ranges that are one to two orders of magnitude larger than needed for other target bodies, i.e. up to on the order of 100 km. It is conceivable that such a divert capability could be provided economically by a parafoil or other steerable aerodynamic decelerator deployed several 10s of km above the surface. The long descent times lead to large inertial navigation errors, hence a need for terrain relative navigation (TRN). This would require a TRN capability that can operate at such altitudes, despite challenges of seeing the surface sufficiently clearly and of depending on map products that are two orders of magnitude lower in spatial resolution than those for Mars and airless bodies. We then develop algorithms for map matching and feature tracking with descent images and test these with synthetic images created from Cassini/Huygens data sets and our radiative transfer model. We also introduce new possibilities for TRN based on the potential to discriminate some specific types of terrain onboard in descent imagery, such as lake vs adjacent ground and dune vs interdune. We use sensor measurement noise models in simulations of state estimation with an extended Kalman filter that includes coordinates of a set of tracked features in the state vector. Case studies were done for two notional landing sites, one in a site with only dry ground and one in a Titan lake district. In both cases, the filter error model shows 3 position error at touchdown on the order of 2 km. More work is needed to validate these results with higher fidelity camera models and larger data sets, but this is very promising.

Matthies, Larry↗

A wall interference assessment/correction system

A Wall Signature method, the Hackett method, has been selected to be adapted for the 12-ft Wind Tunnel wall interference assessment/correction (WIAC) system in the present phase. This method uses limited measurements of the static pressure at the wall, in conjunction with the solid wall boundary condition, to determine the strength and distribution of singularities representing the test article. The singularities are used in turn for estimating wall interferences at the model location. The Wall Signature method will be formulated for application to the unique geometry of the 12-ft Tunnel. The development and implementation of a working prototype will be completed, delivered and documented with a software manual. The WIAC code will be validated by conducting numerically simulated experiments rather than actual wind tunnel experiments. The simulations will be used to generate both free-air and confined wind-tunnel flow fields for each of the test articles over a range of test configurations. Specifically, the pressure signature at the test section wall will be computed for the tunnel case to provide the simulated 'measured' data. These data will serve as the input for the WIAC method-Wall Signature method. The performance of the WIAC method then may be evaluated by comparing the corrected parameters with those for the free-air simulation. Each set of wind tunnel/test article numerical simulations provides data to validate the WIAC method. A numerical wind tunnel test simulation is initiated to validate the WIAC methods developed in the project. In the present reported period, the blockage correction has been developed and implemented for a rectangular tunnel as well as the 12-ft Pressure Tunnel. An improved wall interference assessment and correction method for three-dimensional wind tunnel testing is presented in the appendix.

Lo, Ching F.↗

Validation of Saharan Dust Layer Characteristics with Lidar Observations

Lidar backscattering profiles available from the LITE data set have been used to estimate the optical depths of the Saharan dust layer over West Africa and E. Atlantic regions, in the context of validating the 3-D conceptual model of the Saharan dust plume proposed by Karyampudi and Carlson. The aerosol extinction profiles and optical depths were retrieved from LITE using the Fernald et al. (1972) method. An extinction-to-backscattering ratio, S(sub a), of 25 was selected for optical depth calculations. The spatial analysis of total column and Saharan dust layer optical depths show higher optical depths over W. Africa that decrease westward over E. Atlantic. The higher optical depths over W. Africa, in general, are associated with heavy dust being raised from the surface in dust source regions. Rapid depletion of these heavy dust particles, perhaps due to sedimentation, appear to decrease the dust loading within the dust layer as the plume leaves the west African continent. Higher optical depths are generally confined to the southern edge of the dust layer, where the middle level jet appears to transport the heavy dust concentrations that tend to mix downward from vertical mixing associated with the strong vertical shears underneath the middle jet. Thus, LITE measurements although, in general, validate the Saharan dust plume conceptual model, show maximum values of optical depths near the southern edge of the dust plume over the E. Atlantic region instead of near the center of the dust plume as described in the conceptual model.

Karyampudi, V. Mohan↗

The Grand Banks ERS-1 SAR wave spectra validation experiment

As part of the ERS-1 validation program, the ERS-1 Synthetic Aperture Radar (SAR) wave spectra validation experiment was carried out over the Grand Banks of Newfoundland (Canada) in Nov. 1991. The principal objective of the experiment was to obtain complete sets of wind and wave data from a variety of calibrated instruments to validate SAR measurements of ocean wave spectra. The field program activities are described and the rather complex wind and wave conditions which were observed are summarized. Spectral comparisons with ERS-1 SAR image spectra are provided. The ERS-1 SAR is shown to have measured swell and range traveling wind seas, but did not measure azimuth traveling wind seas at any time during the experiment. Results of velocity bunching forward mapping and new measurements of the relationship between wind stress and sea state are also shown.

Vachon, P. W.↗

Integrated Cloud-Aerosol-Radiation Product using CERES, MODIS, CALIPSO and CloudSat Data

This paper documents the development of the first integrated data set of global vertical profiles of clouds, aerosols, and radiation using the combined NASA A-Train data from the Aqua Clouds and Earth's Radiant Energy System (CERES) and Moderate Resolution Imaging Spectroradiometer (MODIS), Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO), and CloudSat. As part of this effort, cloud data from the CALIPSO lidar and the CloudSat radar are merged with the integrated column cloud properties from the CERES-MODIS analyses. The active and passive datasets are compared to determine commonalities and differences in order to facilitate the development of a 3- dimensional cloud and aerosol dataset that will then be integrated into the CERES broadband radiance footprint. Preliminary results from the comparisons for April 2007 reveal that the CERES-MODIS global cloud amounts are, on average, 0.14 less and 0.15 greater than those from CALIPSO and CloudSat, respectively. These new data will provide unprecedented ability to test and improve global cloud and aerosol models, to investigate aerosol direct and indirect radiative forcing, and to validate the accuracy of global aerosol, cloud, and radiation data sets especially in polar regions and for multi-layered cloud conditions.

Sun-Mack, Sunny↗

Provenance in Data Interoperability for Multi-Sensor Intercomparison

As our inventory of Earth science data sets grows, the ability to compare, merge and fuse multiple datasets grows in importance. This requires a deeper data interoperability than we have now. Efforts such as Open Geospatial Consortium and OPeNDAP (Open-source Project for a Network Data Access Protocol) have broken down format barriers to interoperability; the next challenge is the semantic aspects of the data. Consider the issues when satellite data are merged, cross-calibrated, validated, inter-compared and fused. We must match up data sets that are related, yet different in significant ways: the phenomenon being measured, measurement technique, location in space-time or quality of the measurements. If subtle distinctions between similar measurements are not clear to the user, results can be meaningless or lead to an incorrect interpretation of the data. Most of these distinctions trace to how the data came to be: sensors, processing and quality assessment. For example, monthly averages of satellite-based aerosol measurements often show significant discrepancies, which might be due to differences in spatio- temporal aggregation, sampling issues, sensor biases, algorithm differences or calibration issues. Provenance information must be captured in a semantic framework that allows data inter-use tools to incorporate it and aid in the intervention of comparison or merged products. Semantic web technology allows us to encode our knowledge of measurement characteristics, phenomena measured, space-time representation, and data quality attributes in a well-structured, machine-readable ontology and rulesets. An analysis tool can use this knowledge to show users the provenance-related distrintions between two variables, advising on options for further data processing and analysis. An additional problem for workflows distributed across heterogeneous systems is retrieval and transport of provenance. Provenance may be either embedded within the data payload, or transmitted from server to client in an out-of-band mechanism. The out of band mechanism is more flexible in the richness of provenance information that can be accomodated, but it relies on a persistent framework and can be difficult for legacy clients to use. We are prototyping the embedded model, incorporating provenance within metadata objects in the data payload. Thus, it always remains with the data. The downside is a limit to the size of provenance metadata that we can include, an issue that will eventually need resolution to encompass the richness of provenance information required for daata intercomparison and merging.

Lynnes, Chris↗

Time series modeling of human operator dynamics in manual control tasks

A time-series technique is presented for identifying the dynamic characteristics of the human operator in manual control tasks from relatively short records of experimental data. Control of system excitation signals used in the identification is not required. The approach is a multi-channel identification technique for modeling multi-input/multi-output situations. The method presented includes statistical tests for validity, is designed for digital computation, and yields estimates for the frequency responses of the human operator. A comprehensive relative power analysis may also be performed for validated models. This method is applied to several sets of experimental data; the results are discussed and shown to compare favorably with previous research findings. New results are also presented for a multi-input task that has not been previously modeled to demonstrate the strengths of the method.

Biezad, D. J.↗

Time Series Modeling of Human Operator Dynamics in Manual Control Tasks

A time-series technique is presented for identifying the dynamic characteristics of the human operator in manual control tasks from relatively short records of experimental data. Control of system excitation signals used in the identification is not required. The approach is a multi-channel identification technique for modeling multi-input/multi-output situations. The method presented includes statistical tests for validity, is designed for digital computation, and yields estimates for the frequency response of the human operator. A comprehensive relative power analysis may also be performed for validated models. This method is applied to several sets of experimental data; the results are discussed and shown to compare favorably with previous research findings. New results are also presented for a multi-input task that was previously modeled to demonstrate the strengths of the method.

Biezad, D. J.↗

The FIRE Project

The International Satellite Cloud Climatology Project's (ISCCP) First ISCCP Regional Experiment (FIRE) project is a program to validate the cloud parameters derived by the ISCCP. The 4- to 5-year program will concentrate on clouds in the continental United States, particularly cirrus and marine stratocumulus clouds. As part of the validation process, FIRE will acquire satellite, aircraft, balloon, and surface data. These data (except for the satellite data) will be amalgamated into one common data set. Plans are to generate a standardized format structure for use in the PCDS. Data collection will begin in April 1986, but will not be available to the general scientific community until 1987 or 1988. Additional pertinent data sets already reside in the PCDS. Other qualifications of the PCDS for use in this validation program were enumerated.

Mcdougal, D.↗

Peak2Patch: High-Fidelity Functional Group Identification through Attention-Based Fusion of Infrared and Mass Spectra

Identifying molecular structure based on spectroscopic readings is a key task in a variety of chemical and biological applications. Common spectroscopy techniques, such as Infrared (IR) Spectroscopy and Mass Spectrometry (MS), provide detailed information on the structure of molecular compounds but nonetheless require expert-level knowledge to decode. Machine learning has emerged as a potential solution for automating structure prediction from chemical spectra; however, current approaches generally focus on single sensor modalities, neglecting to leverage the complementary information contained within differing spectra. In this paper, we introduce Peak2Patch, a novel approach to fusion-enhanced prediction of functional groups from IR and mass spectra. First, we perform a detailed comparison of backbone networks for encoding both sparse mass spectra and dense IR spectra and demonstrate the superior performance of transformer neural networks over current state-of-the-art convolutional neural networks. Second, we evaluate three broad categories of fusion: early (raw feature), middle (deep feature), and late (decision) fusion, demonstrating the potential of a deep feature fusion-based approach. Lastly, we present Peak2Patch, our attention-based fusion scheme, which leverages cross-attention to mix features between encoded tokens of the two modalities. We validate our approach on a publicly available multimodal spectroscopic data set of 790k simulated molecules, demonstrating a large improvement in functional group prediction over both the previous state-of-the-art and our own strong single-modal baselines.

Jacobson, Philip [Sandia National Laboratories (SN↗

Automatic Loss Factor Modeling and Attribution on Unlabeled PV Energy Data

We present a novel approach for modeling the loss factors of photovoltaic power generation systems (PV systems). This method is a white-box machine learning model built on convex optimization that is fast, interpretable, and auditable. It takes as an input the measured daily energy produced by the system, over a multi-year period, and returns a multiplicative decomposition model of the daily energy signal and full attribution of the total energy loss to each feature. The methods section of this paper has two major components: (1) the description of the signal decomposition (SD) model, expressed in the SD framework, and (2) the attribution of total energy losses via Shapley values. We validate the method on synthetic and open-source data sets and compare to similar methods from the literature.

artificial intelligence↗