Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

XCal: model-based approach to X-ray CT spectral calibration

Transmission X-ray computed tomography (CT) is widely used to quantitatively reconstruct 3D objects composed of multiple materials. However, accurate CT reconstruction requires the system to be calibrated to account for the effective X-ray spectrum. Unfortunately, measurement of the effective spectrum is ill-posed, and existing calibration methods require that the system be recalibrated when the system parameters are changed. In this paper, we propose XCal, a multi-energy model-based spectral calibration approach for X-ray CT. The XCal approach models the effective spectrum using a separable physics-based model of the CT system. The model parameters are then estimated by fitting calibration data with known objects at multiple energies. An important advantage of XCal is that it allows the user to change scanner settings, such as the source voltage or X-ray filters, without the need for recalibration. Evaluations on simulated and measured datasets demonstrate that XCal significantly improves the accuracy of the estimated spectrum as compared to existing calibration methods.

Li, Wenrui [Purdue Univ., West Lafayette, IN (Unit↗

Patterns and controls on island-wide aboveground biomass accumulation in second-growth forests of Puerto Rico

This dataset includes two products from Martinuzzi et al. (2022): "biomass.tif" is a 26-m resolution forest biomass (AGB) map for Puerto Rico derived from NASA G-LiHT lidar data and forest inventory data (FIA plots), in raster format. "input_multivariate_v2.shp" is a point shapefile with information on forest age, substrate, past land use, topographic wetness, slope, and precipitation, for each forest pixel. These two datasets can be used to evaluate spatial patterns of AGB in second-growth forests across transects of lidar data in humid forests of Puerto Rico, and to analyze relationship(s) between AGB and environmental variables. Additional information on these products can be found on the supporting file called "Readme.txt" included within the data archive, as well as in the original manuscript by Martinuzzi et al (2022).

54 ENVIRONMENTAL SCIENCES↗

Development of a Comprehensive Two-Phase Flow Database for the Validation of NEK-2P

Three-dimensional (3-D) two-phase Computational Fluid Dynamics (CFD) codes are emerging as a powerful and potentially practical tool for applications in which detailed local flow information is needed. However, two-phase flow models and associated closure relations are not well established for CFD applications, which is partly due to the lack of high-quality validation data. The main objective of this work is to develop a comprehensive database of two-phase flows that can be used to validate two-phase CFD codes such as NEK-2P. In this project, four advanced local measurement systems, including Particle Image Velocimetry and Planar Laser-Induced Fluorescence (PIV-PLIF), high-speed imaging, x-ray densitometry, and multi-sensor conductivity probe are employed to measure the local two-phase flow parameters of both gas and liquid phases. By combining these techniques, the local void fraction, bubble velocity, interfacial area concentration, bubble frequency, liquid velocity, turbulence intensity, etc., in various two-phase flow regimes can be obtained. These local measurement techniques are first used in a 25.4 mm circular pipe test section. Seven air-water two-phase flow conditions spanning the bubbly, slug, churn-turbulent, and annular flow regimes are measured in this facility. The obtained database contains the radial profiles of both gas- and liquid-phase parameters at three axial locations along the test section. The second facility used in this work contains a 30 mm × 10 mm rectangular test section, in which three two-phase flow and two single-phase flow conditions are measured. Two-dimensional distributions of local two-phase flow parameters in the cross-sectional plane are measured in this facility at three axial locations as well. A facility featuring a 3×3 electrically heated rod bundle is also designed and being constructed in this project. This facility is specially designed for optical measurements and is expected to provide high-quality boiling data in the future. Preliminary analyses have been performed for the data taken in the 25.4 mm circular pipe. Both center-peaked and wall-peaked void fraction profiles have been observed in the data depending on the two-phase flow conditions and/or developing lengths. The 1-D drift-flux model was evaluated with the newly obtained datasets, in which both gas- and liquid-phases data were directly measured. The distribution parameter model has been optimized based on a new void-profile classification method proposed in this study. The optimized drift-flux model shows a significant improvement in predicting both gas velocity and void fraction. The measured liquid-phase turbulence was used to benchmark Sato’s turbulence model considering the bubble-induced shear stress for the three tested bubbly flows. The benchmark results showed good agreement between the PIV measurements and model predictions. In the bubbly flows tested that have low void fractions less than 3%, the effect of the bubble-induced turbulence was found not significant. However, the bubble-induced shear stress becomes important with the increase of the void fraction. The Conjugate Heat Transfer (CHT) model was developed and implemented in NEK-2P. This model allows the coupled simulation of the solid domain and two-phase fluid domain, allowing the specification of realistic boundary conditions. The CHT implementation was verified first with non-boiling simulations. The predicted temperatures in the fluid domain were shown to be identical in simulations with or without the CHT model. The CHT model was then validated through simulations of three Becker benchmark CHF tests performed under both Dryout (DO) and Departure from Nucleate Boiling (DNB) conditions. Reasonably good agreement was obtained between calculated wall temperatures and corresponding experimental data.

42 ENGINEERING↗

The Brazilian Earth System Model ocean–atmosphere (BESM-OA) version 2.5: evaluation of its CMIP5 historical simulation

The performance of the coupled ocean–atmosphere component of the Brazilian Earth SystemModel version 2.5 (BESM-OA2.5) was evaluated in simulating the historical period1850–2005. After a climate model validation procedure in which the main atmospheric andoceanic variabilities were evaluated against observed and reanalysis datasets, theevaluation specifically focused on the mean climate state and the most importantlarge-scale climate variability patterns simulated in the historical run, which wasforced by the observed greenhouse gas concentration. The most significant upgrades in themodel's components are also briefly presented here. BESM-OA2.5 could reproduce the mostimportant large-scale variabilities, particularly over the Atlantic Ocean (e.g., theNorth Atlantic Oscillation, the Atlantic Meridional Mode, and the Atlantic MeridionalOverturning Circulation), and the extratropical modes that occur in both hemispheres. Themodel's ability to simulate such large-scale variabilities supports its usefulness forseasonal climate prediction and in climate change studies.

58 GEOSCIENCES↗

Standardization Process for Space Radiation Models Used for Space System Design

The space system design community has three concerns related to models of the radiation belts and plasma: 1) AP-8 and AE-8 models are not adequate for modern applications; 2) Data that have become available since the creation of AP-8 and AE-8 are not being fully exploited for modeling purposes; 3) When new models are produced, there is no authorizing organization identified to evaluate the models or their datasets for accuracy and robustness. This viewgraph presentation provided an overview of the roadmap adopted by the Working Group Meeting on New Standard Radiation Belt and Space Plasma Models.

Barth, Janet↗

Assessment of Turbulent Shock-Boundary Layer Interaction Computations Using the OVERFLOW Code

The performance of two popular turbulence models, the Spalart-Allmaras model and Menter s SST model, and one relatively new model, Olsen & Coakley s Lag model, are evaluated using the OVERFLOWcode. Turbulent shock-boundary layer interaction predictions are evaluated with three different experimental datasets: a series of 2D compression ramps at Mach 2.87, a series of 2D compression ramps at Mach 2.94, and an axisymmetric coneflare at Mach 11. The experimental datasets include flows with no separation, moderate separation, and significant separation, and use several different experimental measurement techniques (including laser doppler velocimetry (LDV), pitot-probe measurement, inclined hot-wire probe measurement, preston tube skin friction measurement, and surface pressure measurement). Additionally, the OVERFLOW solutions are compared to the solutions of a second CFD code, DPLR. The predictions for weak shock-boundary layer interactions are in reasonable agreement with the experimental data. For strong shock-boundary layer interactions, all of the turbulence models overpredict the separation size and fail to predict the correct skin friction recovery distribution. In most cases, surface pressure predictions show too much upstream influence, however including the tunnel side-wall boundary layers in the computation improves the separation predictions.

Oliver, A. B.↗

Satellite Monitoring of Cyanobacterial Harmful Algal Bloom Frequency in Recreational Waters and Drinking Water Sources

Cyanobacterial harmful algal blooms (cyanoHAB) cause extensive problems in lakes worldwide, including human and ecological health risks, anoxia and sh kills, and taste and odor problems. CyanoHABs are a particular concern in both recreational waters and drinking water sources because of their dense biomass and the risk of exposure to toxins. Successful cyanoHAB assessment using satellites may provide an indicator for human and ecological health protection. In this study, methods were developed to assess the utility of satellite technology for detecting cyanoHAB frequency of occurrence at locations of potential management interest. The European Space Agency's MEdium Resolution Imaging Spectrometer (MERIS) was evaluated to prepare for the equivalent series of Sentinel-3 Ocean and Land Colour Imagers (OLCI) launched in 2016 as part of the Copernicus program. Based on the 2012 National Lakes Assessment site evaluation guidelines and National Hydrography Dataset, the continental United States contains 275,897 lakes and reservoirs greater than 1 ha in area. Results from this study show that 5.6% of waterbodies were resolvable by satellites with 300 m single-pixel resolution and 0.7% of waterbodies were resolvable when a three by three pixel (3 x 3-pixel) array was applied based on minimum Euclidian distance from shore. Satellite data were spatially joined to U.S. public water surface intake (PWSI) locations, where single-pixel resolution resolved 57% of the PWSI locations and a 3 x 3-pixel array resolved 33% of the PWSI locations. Recreational and drinking water sources in Florida and Ohio were ranked from 2008 through 2011 by cyanoHAB frequency above the World Health Organizations (WHO) high threshold for risk of 100,000 cells m/L. The ranking identified waterbodies with values above the WHO high threshold, where Lake Apopka, FL (99.1%) and Grand Lake St. Marys, OH (83%) had the highest observed bloom frequencies per region. The method presented here may indicate locations with high exposure to cyanoHABs and therefore can be used to assist in prioritizing management resources and actions for recreational and drinking water sources.

Cyanobacteria↗

Improving Surface Soil Moisture Estimates in West Africa Through GRACE Data Assimilation

Recent annual trends of precipitation and terrestrial water storage (TWS) in West Africa have been increasing over the past decade. Despite a significant impact of soil moisture on the TWS in West Africa, there is little research on the recent spatial and temporal behaviors of surface soil moisture (SSM) along with the hydrological trends and variability in West Africa. In this study, we assimilate TWS estimates from the Gravity Recovery and Climate Experiment (GRACE) mission into the Catchment Land Surface Model (CLSM) and evaluate its impacts on SSM simulations for the years, 2002–2017. The evaluation is performed using reference datasets: the African Monsoon Multidisciplinary Analysis (AMMA) in situ soil moisture observations, three currently available microwave satellite SSM observations from the Advanced Scatterometer (ASCAT), the Soil Moisture Ocean Salinity (SMOS), and the Soil Moisture Active Passive (SMAP) satellites and also the triple collocation analysis (TCA). Overall, modeled SSM shows good agreement with the reference datasets in terms of the anomaly SSM correlations. However, both modeled and ASCAT SSM are limited in their representation of the drying rates, as observed by ground observations, SMOS and SMAP estimates. Further, GRACE data assimilation results in improved SSM simulations in the humid regions with large annual TWS variability. This study demonstrates the utility of land data assimilation to inform hydrological conditions in West Africa, where soil moisture monitoring is necessary for water resource and livestock management.

West Africa↗

A Three-Step Semi Analytical Algorithm (3SAA) for Estimating Inherent Optical Properties Over Oceanic, Coastal, and Inland Waters From Remote Sensing Reflectance

We present a three-step inverse model (3SAA) for estimating the inherent optical properties (IOPs) of surface waters from the remote sensing reflectance spectra, Rrs(). The derived IOPs include the total (a()), phytoplankton (aphy()), and colored detrital matter (acdm()), absorption coefficients, and the total (bb()) and particulate (bbp()) backscattering coefficients. The first step uses an improved neural network approach to estimate the diffuse attenuation coefficient of downwelling irradiance from Rrs. a() and bbp() are then estimated using the LS2 model (Loisel et al., 2018), which does not require spectral assumptions on IOPs and hence can assess a() and bb() at any wavelength at which Rrs() is measured. Then, an inverse optimization algorithm is combined with an optical water class (OWC) approach to assess aphy() and acdm() from anw().The proposed model is evaluated using an in situ dataset collected in open oceanic, coastal, and inland waters. Comparisons with other standard semi-analytical algorithms (QAA and GSM), as well as match-up exercises, have also been performed. The applicability of the algorithm on OLCI observations was assessed through the analysis of global IOPs spatial patterns derived from 3SAA and GSM. The good performance of 3SAA is manifested by median absolute percentage differences (MAPD) of 13%, 23%, 34% and 34% for bbp(443), anw(443), aphy(443) and acdm(443), respectively for oceanic waters. Due to the absence of spectral constraints on IOPs in the inversion of total IOPs, and the adoption of an OWC-based approach, the performance of 3SAA is only slightly degraded in bio-optical complex inland waters.

ocean color↗

NASA Investigation of Flow Direction Effects on Impedance Eduction for Acoustic Liners

In support of a collaboration with the International Forum for Aviation Research (IFAR), the NASA Langley Liner Physics Team has acquired a detailed dataset for use in the evaluation of flow direction effects on the acoustic liner impedance eduction process. Measurements are acquired with four acoustic liners designed to cover a range of sensitivities to source sound pressure level and tangential mean flow effects, specifically at source levels of 120 and 140 dB and centerline Mach numbers of 0.0, 0.1, 0.2, and 0.3. These measurements include detailed flow profile surveys upstream and downstream of the liner test window, as well as acoustic pressure data over the extent of the test window. The results clearly demonstrate the importance of the choice of Mach number used in the impedance eduction analysis. Average Mach number differences of less than 0.01 result in significant variation in the educed impedance spectra. These data will soon be supplied to the IFAR partners and will be made available for the general public within the next year.

acoustic↗

NASA Investigation of Flow Direction Effects on Impedance Eduction for Acoustic Liners

In support of a collaboration with the International Forum for Aviation Research (IFAR), the NASA Langley Liner Physics Team has acquired a detailed dataset for use in the evaluation of flow direction effects on the acoustic liner impedance eduction process. Measurements are acquired with four acoustic liners designed to cover a range of sensitivities to source sound pressure level and tangential mean flow effects, specifically at source levels of 120 and 140 dB and centerline Mach numbers of 0.0, 0.1, 0.2, and 0.3. These measurements include detailed flow profile surveys upstream and downstream of the liner test window, as well as acoustic pressure data over the extent of the test window. The results clearly demonstrate the importance of the choice of Mach number used in the impedance eduction analysis. Average Mach number differences of less than 0.01 result in significant variation in the educed impedance spectra. These data will soon be supplied to the IFAR partners and will be made available for the general public within the next year.

acoustic↗

Retrievals of Aerosol Optical Depth Over the Western North Atlantic Ocean During ACTIVATE

Aerosol optical depth was retrieved from two airborne remote sensing instruments, the Research Scanning Polarimeter (RSP) and Second Generation High Spectral Resolution Lidar (HSRL-2), during the National Aeronautics and Space Administration (NASA) Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE). The field campaign offers a unique opportunity to evaluate an extensive 3-year dataset under a wide range of meteorological conditions from two instruments on the same platform. However, a long-standing issue in atmospheric field studies is that there is a lack of reference datasets for properly validating field measurements and estimating their uncertainties. Here we address this issue by using the triple collocation method, in which a third collocated satellite dataset from the Moderate Resolution Imaging Spectroradiometer (MODIS) is introduced for comparison. HSRL-2 is found to provide a more accurate retrieval than RSP over the study region. The error standard deviation of HSRL-2 with respect to the ground truth is 0.027. Moreover, this approach enables us to develop a simple, yet efficient, quality control criterion for RSP data. The physical reasons for the differences in two retrievals are determined to be cloud contamination, aerosols near the surface, multiple aerosol layers, absorbing aerosols, non-spherical aerosols, and simplified retrieval assumptions. These results demonstrate the pathway for optimal aerosol retrievals by combining information from both lidars and polarimeters for future airborne and satellite missions.

Aerosol optical depth↗

A Novel Framework for Multi-Path Data Fusion in Earth Observation and New Observing Strategies: Applications to Predicting Forest Canopy Height

Exponential growth of data from Earth Observation (EO) assets has necessitated the development of sophisticated methods for data interpretation and management. NASA’s New Observing Strategy (NOS) approach aims to coordinate operations among complex heterogenous systems of constellations, requiring advanced Artificial Intelligence and Machine Learning (AI/ML) techniques. Despite significant advancements in AI/ML across various domains, the EO and machine learning for satellite (SatML) fields remain fragmented, often relying on adapted techniques rather than domain-specific solutions. We present a novel end-to-end data fusion framework tailored specifically for EO and SatML, addressing this gap by facilitating rapid development of AI/ML applications. This framework, called, Multimodal Earth Observation Workflow for Machine Learning (MEOW-ML), sup- ports the entire AI/ML lifecycle, from dataset manipulation, to model training, evaluation, and logging, and is designed to expedite the development of next-generation NOS deployments and SOTA in EO. We apply our framework to predict canopy height model (CHM) derived from lidar data. We integrate multiple data modalities through a hierarchical, multi-path model architecture, effectively identifying and leveraging the unique strengths of each data source to enhance predictive accuracy. Our experiments demonstrate that the multi-path architecture outperforms traditional single-path models and provides significant advantages in both accuracy and computational efficiency.

Mark Moussa↗

Acoustic Testing of the Joby Aviation Propeller in the National Full-Scale Aerodynamics Complex 40- by 80-Foot Wind Tunnel

The advanced air mobility sector has progressed in recent years with electric vertical take-Off and landing vehicles at the forefront. In response, the NASA Advanced Air Mobility Project has initiated the Advanced Air Mobility National Campaign to partner with industry to progress this emerging market. This resulted in NASA’s Revolutionary Vertical Lift Technology project to participate to progress research efforts for software tool validation for these advanced air mobility vehicle configurations. Noise has been identified as one of the main obstacles to succeeding in this emerging market for community acceptance. To further understand electric vertical take-Off and landing vehicle noise, an isolated Joby Aviation S4 propeller was tested in the National Full-Scale Aerodynamics Complex 40- by 80-Foot Wind Tunnel to aid in providing high quality performance, loads, and acoustic data. Details of test hardware and setup are described with a focus on acoustics, which includes facility, test model, microphone locations, and data acquisition system details. Additionally, the data processing techniques and completed test matrix for acoustic points are provided. To aid in identifying potential acoustic reflections, an acoustic reflection test was performed prior to the start of the test and highlighted the presence of reflections at every microphone location. Acoustic results are provided for various flight regimes for sweeps of blade pitch, RPM, flow angle, and wind speed. These results show an optimum RPM for a specific thrust level for noise, and further reductions in RPM can increase noise levels. This dataset will be used to evaluate and improve computational tools.

Aviation Propeller↗

Machine Learning Toolkit for Extreme Scale

Support Vector Machines (SVM) is a popular machine learning technique, which has been applied to a wide range of domains such as science, finance, and social networks for supervised learning. MaTEx undertakes the challenge of designing a scalable parallel SVM training algorithm for large scale systems, which includes commodity multi-core machines, tightly connected supercomputers and cloud computing systems. Several techniques are proposed for improved speed and memory space usage including adaptive and aggressive elimination of samples for faster convergence , and sparse format representation of data samples. Several heuristics for earliest possible to lazy elimination of non-contributing samples are considered in MaTEx. In many cases, where an early sample elimination might result in a false positive, low overhead mechanisms for reconstruction of key data structures are proposed. The proposed algorithm and heuristics are implemented and evaluated on various publicly available datasets

Source record↗

Fuzzy Simplicial Networks: A Topology-Inspired Model to Improve Task Generalization in Few-shot Learning

Deep learning has shown great success in settings with massive amounts of data but has struggled when data is limited. Few-shot learning algorithms, which seek to address this limitation, are designed to generalize well to new tasks with limited data. Typically, models are evaluated on unseen classes and datasets that are defined by the same fundamental task as they are trained for (e.g. category membership). One can also ask how well a model can generalize to fundamentally different tasks within a fixed dataset (for example: moving from category membership to tasks that involve detecting object orientation or quantity). To formalize this kind of shift we define a notion of “independence of tasks” and identify three new sets of labels for established computer vision datasets that test a model's ability to generalize to tasks which draw on orthogonal attributes in the data. We use these datasets to investigate the failure modes of metric-based few-shot models. Based on our findings, we introduce a new few-shot model called Fuzzy Simplicial Networks (FSN) which leverages a construction from topology to more flexibly represent each class from limited data. In particular, FSN models can not only form multiple representations for a given class but can also begin to capture the low-dimensional structure which characterizes class manifolds in the encoded space of deep networks. We show that FSN outperforms state-of-the-art models on the challenging tasks we introduce in this paper while remaining competitive on standard few-shot benchmarks.

deep learning↗

A Bayesian Learning Approach to Wireless Outdoor Heatmap Construction using Deep Gaussian Process

We present a novel Bayesian learning approach to outdoor radio heatmap construction utilizing deep Gaussian process (GP). The proposed approach employs a two-layer hierarchy which consists of two cascaded Gaussian processes that are capable of modeling more complex input-output relations than standard single-layer Gaussian processes. Since deriving the exact model likelihood is challenging, a lower bound is optimized instead so that gradient descent-based methods can be performed to find out the optimal model parameters. Typically, inducing points are used in GPs to facilitate low-rank approximation of covariance (kernel) matrices for computation speedup. However, the inaccuracy induced by inducing points can accumulate when stacking multiple layers of GP which may hinder the performance of deep GP. Moreover, since inducing points need to be learned, having them at all layers of deep GP also incurs computational burden. To overcome the above challenges, in contrast to the canonical deep GP model, we use a modified architecture where a full standard GP resides in the first layer and inducing points are only introduced for the second layer. This modified architecture strikes a balance between model accuracy and training complexity. In the proposed model, the noise parameter of the first GP layer is also eliminated to improve the training efficiency as the noise parameter at the output of the second layer suffices to model the uncertainty in the output. The proposed approach is evaluated on real-world datasets, in the form of location-Received Signal Strength (RSS) pairs, collected from the Platform for Open Wireless Data-driven Experimental Research (POWDER) located at the campus of the University of Utah. Experiment results show that the proposed approach can achieve smaller prediction errors on various training and testing data configurations than DNN-based and GP-based methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Neural Image Compression: Generalization, Robustness, and Spectral Biases

Recent advances in neural image compression (NIC) have resulted in models which are starting to outperform traditional codecs. While this has led to growing excitement about using these methods in real-world applications, the successful adoption of any machine learning system (including NIC) in the wild requires it to generalize (and be robust) to unseen distribution shifts at deployment time. Unfortunately, current research lacks comprehensive datasets and informative tools to evaluate and understand compression performance in real-world settings. To bridge this crucial gap, first, this paper presents a comprehensive benchmark suite to evaluate the out-of-distribution (OOD) performance of image compression methods. Specifically, we design CLIC-C and Kodak-C by introducing 15 common corruptions to popular CLIC and Kodak benchmarks. Next, we propose spectrally inspired introspection tools to gain a deeper understanding of errors introduced by image compression methods as well as their OOD performance. To this end, we carry out a detailed performance comparison of the classical codec with various variants of NIC (e.g., original, variable rate, pruned), revealing intriguing findings that challenge our current understanding of the strengths and limitations of NIC. Finally, we corroborate our empirical findings with theoretical analysis, providing an in-depth view of the OOD performance of NIC. Our benchmarks, spectral introspection tools, and findings provide a crucial bridge to the real-world adoption of NIC. We hope that our work will propel future efforts in designing more robust and generalizable NIC methods.

neural networks, Variational Autoencoder, robustne↗