Search NASA⌕ Search

SEARCH · Search NASA

Results for “data-driven approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Application of Machine Learning Techniques to Aviation Operations: NASA Case Studies

There is an increasing interest in applying methods based on Machine Learning Techniques(MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues relating to data, feature selection and validation of the models are illustrated by examining case studies of the application of MLT to problems in air traffic management at NASA. Further research is needed in the application of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Lessons Learned in the Application of Machine Learning Techniques to Air Traffic Management

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in Air Traffic Management (ATM). The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large databases. This paper reviews the current-state-of-the art in applying MLT to aviation operations, its promises and challenges. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The promises and challenges in applying MLT to ATM is traced through three examples based on the authors’ experience, each separated by a decade, to show the influence of data and feature selection in the successful application of MLT to ATM. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Machine Learning Techniques↗

Revisiting the Solar Research Cyberinfrastructure Needs: A White Paper of Findings and Recommendations

Solar and Heliosphere physics are areas of remarkable data-driven discoveries. Recent advances in high cadence, high-resolution multiwavelength observations, growing amounts of data from realistic modeling, and operational needs for uninterrupted science-quality data coverage generate the demand for a solar metadata standardization and overall healthy data infrastructure. This white paper is prepared as an effort of the working group “Uniform Semantics and Syntax of Solar Observations and Events” created within the “Towards Integration of Heliophysics Data, Modeling, and Analysis Tools” EarthCube Research Coordination Network (@HDMIEC RCN), with primary objectives to discuss current advances and identify future needs for the solar research cyberinfrastructure. The white paper summarizes presentations and discussions held during the special working group session at the EarthCube Annual Meeting on June 19th, 2020, as well as community contribution gathered during a series of preceding workshops and subsequent RCN working group sessions. The authors provide examples of the current standing of the solar research cyberinfrastructure, and describe the problems related to current data handling approaches. The list of the top-level recommendations agreed by the authors of the current white paper is presented at the beginning of the paper.

SMD↗

A New Machine Learning Based Analysis for Improving Satellite Retrieved Atmospheric Composition Data: OMI SO2 as an Example

Despite recent progress, satellite retrievals of anthropogenic SO2 still suffer from relatively low signal-tonoise ratios. In this study, we demonstrate a new machine learning data analysis method to improve the quality of satellite SO2 products. In the absence of large ground-truth datasets for SO2, we start from SO2 slant column densities (SCDs) retrieved from the Ozone Monitoring Instrument (OMI) using a data-driven, physically based algorithm and calculate the ratio between the SCD and the root mean square (rms) of the fitting residuals for each pixel. To build the training data, we select presumably clean pixels with small SCD / rms ratios (SRRs) and set their target SCDs to zero. For polluted pixels with relatively large SRRs, we set the target to the original retrieved SCDs. We then train neural networks (NNs) to reproduce the target SCDs using predictors including SRRs for individual pixels, solar zenith, viewing zenith and phase angles, scene reflectivity, and O3 column amounts, as well as the monthly mean SRRs. For data analysis, we employ two NNs: (1) one trained daily to produce analyzed SO2 SCDs for polluted pixels each day and (2) the other trained once every month to produce analyzed SCDs for less polluted pixels for the entire month. Test results for 2005 show that our method can significantly reduce noise and artifacts over background regions. Over polluted areas, the monthly mean NN-analyzed and original SCDs generally agree to within ±15 %, indicating that our method can retain SO2 signals in the original retrievals except for large volcanic eruptions. This is further confirmed by running both the NN-analyzed and original SCDs through a topdown emission algorithm to estimate the annual SO2 emissions for ∼ 500 anthropogenic sources, with the two datasets yielding similar results. We also explore two alternative approaches to the NN-based analysis method. In one, we employ a simple linear interpolation model to analyze the original SCD retrievals. In the other, we develop a PCA–NN algorithm that uses OMI measured radiances, transformed and dimension-reduced with a principal component analysis (PCA) technique, as inputs to NNs for SO2 SCD retrievals. While the linear model and the PCA–NN algorithm can reduce retrieval noise, they both underestimate SO2 over polluted areas. Overall, the results presented here demonstrate that our new data analysis method can significantly improve the quality of existing OMI SO2 retrievals. The method can potentially be adapted for other sensors and/or species and enhance the value of satellite data in air quality research and applications.

Can Li↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗

Enhancements to Linear Stability-Based, CFD-integrated Transition Prediction for High-Speed Flows

Combining linear stability calculations with computational fluid dynamics (CFD) simulations has great potential for the automated modeling of high-speed flows, especially when adequate information about the configuration and the disturbance environment is available. However, a significant impediment to the applicability of this technique is the lack of an efficient method to calculate the crucial amplification ratio corresponding to the onset of transition in hypersonic flows. This ratio, also known as the "transition N-factor," is dependent upon the freestream disturbance environment as well as the surface properties of the test article. In response to the need for an engineering solution to predict the transition N-factor within conventional hypersonic wind tunnels, this paper presents a data-driven correlation that expands the existing correlations from straight circular cones with a narrow range of half angles to a broader array of axisymmetric configurations. Furthermore, when tested against a chosen dataset that was not used in its calibration, the suggested correlation shows good predictive accuracy with an RMS error of only 6.9%. Although similar accuracy may also be achieved via existing correlations based on similar datasets, predictions based on the proposed correlation have the advantage of not requiring an extensive amount of configuration-specific data. Practical applications often have access to the input parameters needed for this correlation, such as the freestream disturbance intensity, Mach number, and body-based slenderness Reynolds number. Additionally, this correlation outperforms the traditional assumption of a constant N-factor, particularly for configurations with blunted nose geometries. The development of this correlation is grounded in an extensive dataset encompassing conical models with body half-angles varying between 5 degrees and 16 degrees, Mach numbers ranging from 5 to 14, and nosetip-based Reynolds numbers approaching the transition reversal limit for blunt-nosed cones.

CFD↗

A Machine Learning Approach to Determine Surface Radiative Fluxes based on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) projects provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. An alternative data product, Fast Longwave and Shortwave radiative Flux (FLASHFlux), was created to provide data to the applied sciences and educational users. FLASHFlux provides Top-of-Atmosphere radiative fluxes, Clouds properties, and parameterized surface radiative fluxes within four days for footprint (Level 2) data. We investigate the use of Artificial Neural Network (ANN) using MODerate resolution Imaging Spectroradiometer (MODIS) derived clouds properties and meteorology from the Global Assimilation and Meteorology Office (GMAO) scaled to the CERES footprint from the CERES Clouds Radiative Swath (CRS) data product to compute surface radiative fluxes. We test ANN produce fluxes against surface fluxes produced from the Fu-Liou model used in CRS and the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) used in FLASHFlux. We also validated each model with ground-based observations. Furthermore, we investigate Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training and provide insight for future models. Advances in machine learning, along with increases in computational capabilities and available data allow us to estimate effects of unresolved processes in our climate without direct modeling. This work evaluates the ability to create accurate data-driven models to supplement or replace current models that estimate surface radiative fluxes.

Climatology↗

Enhancements to Linear Stability-Based, CFD-integrated Transition Prediction for High-Speed Flows

Combining linear stability calculations with computational fluid dynamics (CFD) simulations has great potential for the automated modeling of high-speed flows, especially when adequate information about the configuration and the disturbance environment is available. However, a significant impediment to the applicability of this technique is the lack of an efficient method to calculate the crucial amplification ratio corresponding to the onset of transition in hypersonic flows. This ratio, also known as the "transition N-factor," is dependent upon the freestream disturbance environment as well as the surface properties of the test article. In response to the need for an engineering solution to predict the transition N-factor within conventional hypersonic wind tunnels, this paper presents a data-driven correlation that expands the existing correlations from straight circular cones with a narrow range of half angles to a broader array of axisymmetric configurations. Furthermore, when tested against a chosen dataset that was not used in its calibration, the suggested correlation shows good predictive accuracy with an RMS error of only 6.9%. Although similar accuracy may also be achieved via existing correlations based on similar datasets, predictions based on the proposed correlation have the advantage of not requiring an extensive amount of configuration-specific data. Practical applications often have access to the input parameters needed for this correlation, such as the freestream disturbance intensity, Mach number, and body-based slenderness Reynolds number. Additionally, this correlation outperforms the traditional assumption of a constant N-factor, particularly for configurations with blunted nose geometries. The development of this correlation is grounded in an extensive dataset encompassing conical models with body half-angles varying between 5 degrees and 16 degrees, Mach numbers ranging from 5 to 14, and nosetip-based Reynolds numbers approaching the transition reversal limit for blunt-nosed cones.

CFD↗

Teachers’ Use and Adaptation of A Model-Based Climate Curriculum: A Three-Year Longitudinal Study

Foregrounding climate education in formal science learning environments provides students with opportunities to develop critical climate-related knowledge and skills. However, research has shown many challenges to teaching and learning about Earth’s climate and global climate change (GCC). This longitudinal study aims to establish how secondary science teachers, over time, implement model-based climate curricula in support of students’ climate and GCC education by utilizing EzGCM. The model (EzGCM) is a data-driven, computer-based climate modeling tool use to explore global climate data. Multiple sources of data collection, including teacher interviews, classroom observations, and daily reflections, were employed to address the research question: “How did two teachers’ implementation strategies evolve over the three-year study while utilizing a model-based, climate-focused curriculum?” This study provides insight into how and why these resources [model-based climate education curricula] are utilized in science learning environments, thereby informing ongoing efforts to enhance climate education and, in doing so, preparing the next generation of climate-literate adults prepared to confront this most critical global challenge of our age. The findings showed while both teachers engaged in increasingly model-centric instructional practices, these changes were modest. Furthermore, both teacher’s observed classroom practices were less model-centric than the designed curriculum. Ultimately emphasizing the transition from existing practices to improved ones, rather than seeking the perfect approach, the study offers practical insights that can honestly assist secondary educators in real-world settings by highlighting state of climate education in secondary science classrooms.

Secondary science teaching↗

Planning Bias: Planning as a Source of Sampling Bias

Many data-driven planning methods are trained on data generated by planners. It is well known that many statistical learning methods are sensitive to sampling bias, and yet there has been little or no attention to planning as a sampling method and its role in introducing sampling bias into planner-generated training data. Recently, it has been demonstrated that A**,* in the presence of problems with variable heuristic error, prefers some solutions over other equally cost-optimal solutions. But, as we discuss in this paper, mitigation may not be as simple as resolving arbitrary tie-breaking by sampling from ties uniformly at random. In this paper, we formalize an intuition of planning bias. We focus on problems which output a single solution. Diverse planning only complicates the problem by generalizing it to bias in the set of sets; we show how it is subject to bias in the single solution. We make some useful observations about deterministic algorithms in contrast to non-deterministic algorithms. We explain how information entropy may be a good way to measure planning bias, and discuss some issues in evaluating practical approaches to measurement. We address the intuition that uniform random tiebreaking should mitigate bias; and sketch a novel approach to constructing an appropriate random distribution for duplicate detection during forward search for unbiased A*. Finally, we suggest directions for future work.

Planning Scheduling Algorithms↗

Openet: Applications of Satellite-Based Evapotranspiration Data for Water Resources Management in the Western United States

Advancing water security in overallocated river basins globally requires consistent and reproducible information on consumptive use of water that can anchor the development of data-driven solutions to the challenge of balancing water supply and demand. OpenET is a fully automated system for field-scale (30 m), satellite-based mapping of evapotranspiration (ET) at daily, monthly and annual timesteps. OpenET currently provides spatially contiguous data throughout the 23 westernmost states in the continental US, and includes both current information as well as multi-year timeseries of ET. The OpenET consortium has implemented an ensemble of satellite-based ET models (ALEXI/DisALEXI, eeMETRIC, PT-JPL, geeSEBAL, SIMS and SSEBop) on Google Earth Engine, which provides a shared computing platform for collaboration on processing of data from Landsat and other satellites, land cover and meteorological inputs, leading to increased consistency and accuracy across the ensemble of models. Earth Engine also facilitates hosting and distribution of data via open data collections and an application programming interface. We provide updates on the OpenET framework, open data services and data access tools, approach to geographic expansion, recent accuracy assessments, and describe how a user-driven design approach has facilitated successful applications of OpenET data for a wide range of water resource management activities. Applications to date include: use of ET data to improve quantification of ET and consumptive use in Oregon, Utah and the Upper Colorado River Basin; streamlining of water use reporting requirements in the California Delta; support for calculation of water budgets for the implementation of the Sustainable Groundwater Management Act in California; and integration into decision support tools for irrigation management. The use cases demonstrate how satellite-derived ET data that are easily accessed and seen as broadly accepted can accelerate adoption of innovative water management practices at scale, and support advances in the sustainability of water supplies. Uptake and use of data by the OpenET science community has also led to advances in our understanding of the impacts of landcover change, irrigation intensification and wildfire events on hydrology and the water security.

Applications↗

On the Use of SMAP Soil Moisture for Forecasting NDVI Over CONUS Cropland Regions

Vegetation health forecasting (NDVI as a proxy) informs decision-makers about the end of season crop yield productivity but is not well-documented. This study tests improvements in vegetation health forecasting by developing a data-driven Dynamic Agricultural Productivity Indicator ( DAPI ), which simultaneously incorporates satellite-based root zone soil moisture (RZSM) and satellite-based NDVI data. RZSM is estimated via data assimilation of satellite based SMAP SM dataset. We employ the proposed DAPI forecast across four cropland types in CONUS, including corn, cotton, soybeans, and wheat. Results demonstrate superior performance of the DAPI forecasts compared to climatology-based NDVI forecasts, with the largest improvements in water-limited regions. DAPI shows particularly good performance during hydrologic disturbances such as floods and droughts. To this end, the DAPI approach is useful in estimating future vegetation health for identifying potential food-insecure areas, predicting crop price changes, and projecting expected commodities market trends.

Manh Le↗

A Combined Computational, Experimental, and Technology Development Approach to In-Space Laser Manufacturing Maturation at NASA Marshall Space Flight Center

In-space manufacturing (ISM) is emerging as a field vital to continued access and capabilities in the space environment. NASA Marshall Space Flight Center (MSFC) is advancing the frontier of in-space laser manufacturing (ISLM) techniques through work initially focused on maturing laser beam welding (LBW) and laser forming (LF) for use in space. Such techniques proffer the ability to assemble and join structures in space from sheet metal or other stock – extant satellites, in situ resource utilization of Lunar regolith, etc. – by forming to desired shapes and then joining via in-space welding (ISW). ISLM processes are useful for assembly, joining, modification, and repair of structures in free space and on the Lunar surface such as large observatories, antennas, trusses, blast/thermal/radiation shields, pressure vessels, and more. However, these techniques are not yet qualified & certified (Q&C) for regular application in space. It would be prohibitively expensive, laborious, and time-consuming to perform Q&C via traditional experimental approaches as data collection & experimentation in space is resource-intensive. As such, benchmark experiments and focused, properly instrumented technology demonstration efforts in space can collect sufficient data that – when combined with verified computational models in an integrated computational materials engineering (ICME) approach – can validate ICME tools capable of translating more readily obtained ground data to in-space, in situ, computationally informed Q&C of ISLM techniques. Several ISLM projects at MSFC are obtaining the data required to validate ICME tools through both ground and flight experiments. A parabolic flight experiment of LBW under vacuum is manifested for August 2024, including both microgravity and Lunar gravity profiles. This collaboration with the Ohio State University is investigating common aerospace alloys such as 316L stainless steel, 2219 aluminum alloy, and Ti64 titanium alloy. In situ data collection includes videography, thermography, and reference thermocouples to build a thermal model of the welds. This will elucidate the relevant physics when combined with post-flight microstructural examination and mechanical testing. MSFC is also progressing towards a suborbital flight experiment of LBW under vacuum, which could provide reams of data on ISW during sustained, high-quality reduced gravity. The effect of combined thermal (cryogenic and high-temperature) and vacuum exposure on both LBW (NASA-funded) and LF (DARPA-funded) is being investigated through ground experiments. In addition to the copious data collected during these ground experiments, ruggedization of LBW hardware will also be pursued. The datasets from these experiments will be used to validate computational models which will inform future ISLM efforts in an ICME framework. A variety of techniques across lengths scales, from CALPHAD-driven thermodynamics & kinetics to phase field modeling of solidification to kinetic Monte Carlo simulations of grain evolution at the mesoscale, will be employed to accelerate the infusion and eventual Q&C of LBW and LF for use in space. The development of data-driven surrogate models to bridge ground to flight experiments and thereby reduce the need for resource-intensive experiments in space will also be investigated. These ICME techniques, surrogate models, and datasets from ground testing can also be employed to advance manufacturing in terrestrial environments.

in-space welding↗

A Distributed Model Identification Algorithm for Multi-Agent Systems: Preprint

In this study, we investigate agent-based approach for system model identification with emphasis on power distribution system applications. Departing from conventional practices of relying on historical data for offline model identification, we adopt online update approach utilizing real-time data by employing the latest data points for gradient computation. This methodology offers advantages including a large reduction in the communication network's bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt in real-time to disturbances. Furthermore, we extend our model identification process from linear frameworks to more complex non-linear convex models. This extension is validated through numerical studies demonstrating improved control performance for a synthetic IEEE test case.

data-driven control↗

Data-Driven State of Health Estimation for Second-Life Batteries Using Interpolated Synthetic Data and Feature Selection

Accurate estimation of the State of Health (SOH) for second-life batteries (SLBs) is crucial given their increasing use in energy storage applications. Precise SOH prediction is essential for safe operation and robust battery management systems. A major challenge is the limited availability of datasets for building reliable degradation models. To address this, synthetic data generation through linear interpolation is performed to extend the available data, making it more representative of real-world battery operating conditions. By analyzing feature correlation with SOH, the most relevant features are selected for the model. The proposed approach employs a convolutional neural network (CNN) model trained on this interpolated, feature-selected dataset, using time series data of voltage, temperature, and current over a cycle. By focusing on highly correlated features, the model achieves over 95% accuracy, with mean absolute error and root mean squared error up to 2.27% and 2.64%, respectively, in SOH estimation for two battery datasets tested. These results highlight the potential of combining synthetic data generation and feature selection to enhance SOH predictions, showcasing the superior performance of the proposed CNN model for both new batteries and SLBs.

feature selection↗

Data about data – when, why and how metadata can support the digital plant

A structured approach for recording data quality and contextual information about how and why a signal exists – i.e. metadata – is central to interpret and use sensor data correctly. This is becoming increasingly important with the global trend with data-driven applications such as digital twins and AI-models. But a structured metadata collection and organization of sensor data is not routine in most plants, which can result in lost information and missed opportunities to make use of the investments made in the data collection. Therefore, the IWA task group on Metadata Collection and Organization in wastewater resource recovery systems (MetaCO) was initiated in 2020 and recently delivered the IWA scientific and technical report number 31. The report gives and in-depth description about metadata in water resources recovery facilities (WRRFs) and is available as open access at IWA publishing. The report is the outcome of the collaboration between more than 80 water professionals with the intention to serve WRRF data users with a guide on how to structure and make use of metadata throughout the data pipeline in order to maximize the value of sensor data.

Alferes, Janelcy [VITO, Belgium]↗