Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Development of a satellite microwave radiometer to sense the surface temperature of the world oceans

A proposed S-band radiometer for determining the ocean surface temperature with an absolute accuracy of + or - 1 Kelvin and a resolution of + or - .1 Kelvin was placed under the Advanced Applications Flight Experiment for further development into Nimbus readiness state. The results of assessing the following are described: effects due to the state of the sea surface, effects caused by the intervening atmosphere, and effects associated with imperfections in the instrument itself. An extensive sea truth program is also described for correlation of aircraft test flight measurements or of satellite remote measurement to in-situ data. An improved radiometer design is a modified Dicke-switch type with temperature stabilized, microwave integrated circuit, front-end and with a pulsed injection-noise nulling system. The radiometer has a multimode rectangular horn antenna with very low ohmic losses and a beam efficiency of 98% or better.

Hidy, G. M.↗

A generalized tool for accurate time-domain separation of excited modes in spin-torque oscillators

We propose and develop an advanced signal processing technique that, combined with micromagnetic simulations, is able to deeply describe the non-stationary behavior of spin-torque oscillators, both in terms of time domain and spatial distribution of the magnetization dynamics. The Hilbert-Huang Transform is used for the identification of the time traces of each oscillation in a multimode excitation and enhanced with masking signals and the Ensemble Empirical Mode Decomposition. We emphasize that the technique developed here is general and can be used for any physical non-linear system in the presence of multimode dynamical excitation or intermittence.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Multimodal CO2 Transportation Cost Model

This model provides a cost estimate for transporting CO2 via truck or rail in the United States using commercially available equipment and technologies. The model includes an analysis of direct and indirect CO2 emissions to determine costs per net tonne of CO2 transported. Publicly available data and methods published in the peer-reviewed literature are used to the extent possible; references are available at the bottom of the "Calculations" sheet. Upstream (i.e., liquefaction, buffer storage) and downstream (i.e., buffer storage, reconditioning) activities are included in the model of emissions and costs. All capital and operating expenditures are estimated in the "Calculations" sheet. The cost of financing the project is determined in the "FINEX" sheet. All user inputs are done via drop down menus in on the "User Interface" sheet. Summary results are also provided on the "User Interface" sheet.

Myers, CoreyA↗

Multifunction Imaging and Spectroscopic Instrument

A proposed optoelectronic instrument would perform several different spectroscopic and imaging functions that, heretofore, have been performed by separate instruments. The functions would be reflectance, fluorescence, and Raman spectroscopies; variable-color confocal imaging at two different resolutions; and wide-field color imaging. The instrument was conceived for use in examination of minerals on remote planets. It could also be used on Earth to characterize material specimens. The conceptual design of the instrument emphasizes compactness and economy, to be achieved largely through sharing of components among subsystems that perform different imaging and spectrometric functions. The input optics for the various functions would be mounted in a single optical head. With the exception of a targeting lens, the input optics would all be aimed at the same spot on a specimen, thereby both (1) eliminating the need to reposition the specimen to perform different imaging and/or spectroscopic observations and (2) ensuring that data from such observations can be correlated with respect to known positions on the specimen. The figure schematically depicts the principal components and subsystems of the instrument. The targeting lens would collect light into a multimode optical fiber, which would guide the light through a fiber-selection switch to a reflection/ fluorescence spectrometer. The switch would have four positions, enabling selection of spectrometer input from the targeting lens, from either of one or two multimode optical fibers coming from a reflectance/fluorescence- microspectrometer optical head, or from a dark calibration position (no fiber). The switch would be the only moving part within the instrument.

Mouroulis, Pantazis↗

Interactive multi-spectral analysis of more than one Sonrai village in Niger, West Africa

Use of LANDSAT data and an interaction system is considered for identifying and measuring small scale compact human settlements (villages) for demographic and anthropological studies. Because village components are not uniformly distributed within any one village, they apparently are multimodal, spectrally. Therefore, the functions of location and enumeration are kept separate. Measurement of a known village is compared with CCT response.

Reining, P.↗

Progress on Understanding Rayleigh–Taylor Flow and Mixing Using Synergy Between Simulation, Modeling, and Experiment

Simultaneous advances in numerical methods and computing, theoretical techniques, and experimental diagnostics have all led independently to better understanding of Rayleigh–Taylor (RT) instability, turbulence, and mixing. In particular, experiments have provided significant motivation for many simulation and modeling studies, as well as validation data. Numerical simulations have also provided data that is not currently measurable or very difficult to measure accurately in RT unstable flows. Thus, simulations have also motivated new measurements in this class of buoyancy-driven flows. This overview discusses simulation and modeling studies synergistic with experiments and examples of how experiments have motivated simulations and models of RT instability, flow, and mixing. First, a brief summary of measured experimental and calculated simulation quantities, of experimental approaches, and of issues and challenges in the simulation and modeling of RT experiments is presented. Implicit large-eddy, direct numerical, and large-eddy simulations validated using RT experimental data are then discussed. This is followed by a discussion of modeling using analytical, modal, buoyancy–drag, and turbulent transport models of RT mixing experiments. The discussion will focus on three-dimensional RT mixing arising from multimode perturbations. Finally, this focused review concludes with a perspective on future simulation, modeling, and experimental directions for further research. Research in simulation and modeling of RT unstable flows, coupled with experiments, has made significant progress over the past several decades. This overview serves as an opportunity to both discuss progress and to stimulate future research on simulation and modeling of this unique class of hydrodynamically unstable turbulent flows.

42 ENGINEERING↗

Design of fiber optic probes for laser light scattering

A quantitative analysis is presented of the role of optical fibers in laser light scattering. Design of a general fiber optic/microlens probe by means of ray tracing is described. Several different geometries employing an optical fiber of the type used in lightwave communications and a graded index microlens are considered. Experimental results using a nonimaging fiber optic detector probe show that due to geometrical limitations of single mode fibers, a probe using a multimode optical fiber has better performance, for both static and dynamic measurements of the scattered light intensity, compared with a probe using a single mode fiber. Fiber optic detector probes are shown to be more efficient at data collection when compared with conventional approaches to measurements of the scattered laser light. Integration of fiber optic detector probes into a fiber optic spectrometer offers considerable miniaturization of conventional light scattering spectrometers, which can be made arbitrarily small. In addition static and dynamic measurements of scattered light can be made within the scattering cell and consequently very close to the scattering center.

Dhadwal, Harbans S.↗

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning↗

Collaborative Project: Building improved optimized parameter estimation algorithms to improve methane and nitrogen fluxes in a climate model

Soils in natural and managed ecosystems and wetlands are well known sources of methane, nitrous oxides, and reactive nitrogen gases, but the magnitudes of gas flux to the atmosphere are still poorly constrained. Thus, the reasons for the large increases in atmospheric concentrations of methane and nitrous oxide since the preindustrial time period are not well understood. The low atmospheric concentrations of methane and nitrous oxide, despite being more potent greenhouse gases than carbon dioxide, complicate empirical studies to provide explanations. In addition to climate concerns, the emissions of reactive nitrogen gases from soils are important to the changing nitrogen balance in the earth system, subject to human management, and may change substantially in the future. Thus improved modeling of the emission fluxes of these species from the land surface is important. Currently, there are emission modules for methane and some nitrogen species in the Community Earth System Model’s Community Land Model (CLM-ME/N); however, there are large uncertainties and problems in the simulations, resulting in coarse estimates. In this proposal, we seek to improve these emission modules by combining state-of-the-art process modules for emissions, available data, and new optimization methods. In earth science problems, we often have substantial data and knowledge of processes in disparate systems, and thus we need to combine data and a general process level understanding into a model for projections of future climate that are as accurate as possible. The best methodologies for optimization of parameters in earth system models are still being developed. In this proposal we will develop and apply surrogate algorithms that a) were especially developed for computationally expensive simulations like CLM-ME/N models; b) were (in the earlier surrogate optimization Stochastic RBF) demonstrated to perform very well on computationally expensive complex partial differential equations in earth science with limited numbers of simulations; and, c) will be (as part of the proposed research) significantly improved both by adding asynchronous parallelism, early truncation of unsuccessful simulations, and the improvement of both serial and parallel performance by the use of derivative and sensitivity information from global and local surrogate approximations S(x) . The algorithm development and testing will be focused on the CLM-ME/N model application, but the methods are general and are expected to also perform well on optimization for parameter estimation of other climate models and other classes of continuous multimodal optimization problems arising from complex simulation models. In addition, this proposal will compile available datasets of emissions of methane, nitrous oxides and reactive nitrogen species and develop protocols for site level comparisons with the CLM-ME/N. Once the model parameters are optimized against site level data, the model will be simulated at the global level and compared to atmospheric concentration measurements for the current climate, and future emissions will be estimated using climate change as simulated by the CESM. This proposal combines experts in earth system modeling, optimization, computer science, and process level understanding of soil gas emissions in an interdisciplinary team in order to improve the modeling of methane and nitrogen gas emissions. This proposal thus meets the requirements of the SciDAC RFP, by integrating state-of-the-art computer science and earth system to build an improved earth system model.

54 ENVIRONMENTAL SCIENCES↗

Brain metastases in women with epithelial ovarian cancer: multimodal treatment including surgery or gamma-knife radiation is associated with prolonged survival

Objective: To explore the impact of treatment modality on survival in patients with brain metastases from epithelial ovarian cancer. Methods: We conducted a retrospective review of cases of ovarian cancer with brain metastases treated at institutions in three countries (Canada, China, and India) and conducted a search for studies regarding brain metastases in ovarian cancer reporting survival related to treatment modality. Survival was analyzed according to treatment regimens involving (1) some form of surgical excision or gamma-knife radiation with or without other modalities, (2) other modalities without surgery or gamma-knife radiation, or (3) palliation only. Results: Twelve patients (mean age 56 years) with detailed treatment/outcome data were included; five were from China, four from Canada, and three from India. Median time from diagnosis of ovarian cancer to brain metastasis was 19 months (range 10 to 37 months), and overall median survival time from diagnosis of ovarian cancer was 38 months (13 to 82 months). Median survival time from diagnosis of brain metastasis was 17 months (1 to 45 months). Among patients who had multimodal treatment including gamma-knife radiotherapy or surgical excision, the median survival time after the identification of brain metastasis was 25.6 months, compared with 6.0 months in patients whose treatment did not include this type of focused localized modality (P = 0.006). Analysis of 20 studies also indicated that use of gamma-knife radiotherapy and excisional surgery in multi-modal treatment resulted in improved median survival interval (25 months vs. 6.0 months, P < 0.001). Conclusions: In the subset of patients with brain metastases from ovarian cancer, prolonged survival may result from use of multidisciplinary therapy, particularly if metastases are amenable to localized treatments such as gamma-knife radiotherapy and surgical excision. (author)

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Autonomous Propulsion System Technology Being Developed to Optimize Engine Performance Throughout the Lifecycle

The goal of the Autonomous Propulsion System Technology (APST) project is to reduce pilot workload under both normal and anomalous conditions. Ongoing work under APST develops and leverages technologies that provide autonomous engine monitoring, diagnosing, and controller adaptation functions, resulting in an integrated suite of algorithms that maintain the propulsion system's performance and safety throughout its life. Engine-to-engine performance variation occurs among new engines because of manufacturing tolerances and assembly practices. As an engine wears, the performance changes as operability limits are reached. In addition to these normal phenomena, other unanticipated events such as sensor failures, bird ingestion, or component faults may occur, affecting pilot workload as well as compromising safety. APST will adapt the controller as necessary to achieve optimal performance for a normal aging engine, and the safety net of APST algorithms will examine and interpret data from a variety of onboard sources to detect, isolate, and if possible, accommodate faults. Situations that cannot be accommodated within the faulted engine itself will be referred to a higher level vehicle management system. This system will have the authority to redistribute the faulted engine's functionality among other engines, or to replan the mission based on this new engine health information. Work is currently underway in the areas of adaptive control to compensate for engine degradation due to aging, data fusion for diagnostics and prognostics of specific sensor and component faults, and foreign object ingestion detection. In addition, a framework is being defined for integrating all the components of APST into a unified system. A multivariable, adaptive, multimode control algorithm has been developed that accommodates degradation-induced thrust disturbances during throttle transients. The baseline controller of the engine model currently being investigated has multiple control modes that are selected according to some performance or operational criteria. As the engine degrades, parameters shift from their nominal values. Thus, when a new control mode is swapped in, a variable that is being brought under control might have an excessive initial error. The new adaptive algorithm adjusts the controller gains on the basis of the level of degradation to minimize the disruptive influence of the large error on other variables and to recover the desired thrust response.

Litt, Jonathan S.↗

Mind the gap: Bridging the divide between AI aspirations and the reality of autonomous microscopy

What does materials science look like in the “Age of Artificial Intelligence?” Each material’s domain—synthesis, characterization, and modeling—has a different answer to this question, motivated by unique challenges and constraints. This work focuses on the tremendous potential of autonomous characterization within electron microscopy. We present our recent advancements in developing domain-aware, multimodal models for microscopy analysis capable of describing complex atomic systems. We then address the critical gap between the theoretical promise of autonomous microscopy and its current practical limitations, showcasing recent successes while highlighting the necessary developments to achieve robust, real-world autonomy.

2D materials↗

Coupling Shared E-scooters and Public Transit: A Spatial and Temporal Analysis

The integration of shared e-scooters with public transit is a promising solution for urban mobility's first/last-mile challenge. This study explores spatiotemporal factors influencing this integration, using 35-day e-scooter trip data from Chicago. Employing a random-effect negative binomial approach, we modeled the frequency of e-scooter trips to access/egress to/from bus stops and train stations. Results indicate that weather conditions, design features like intersection density, and multimodal network density significantly influence usage. The transit system characteristics such as service frequency have a positive effect on the integration of e-scooters and trains while a similar effect for bus and e-scooter integration was not significant. Furthermore, safety-related variables such as accident and crime rates as well as demographic characteristics were also revealed to be significant factors in our study. These findings offer vital insights to urban planners and policymakers for infrastructure, safety enhancements, and interventions to encourage efficient e-scooter-public transit integration.

Chicago↗

Three-dimensional multimodal imaging and analysis of biphasic microstructure in a Ti–Ni–Sn thermoelectric material

The three-dimensional microstructure of levitation melted TiNi{sub 1.20}Sn has been characterized using the TriBeam system, a scanning electron microscope equipped with a femtosecond laser for rapid serial sectioning, to map the character of interfaces. By incorporating both chemical data (energy dispersive x-ray spectroscopy) and crystallographic data (electron backscatter diffraction), the grain structure and phase morphology were analyzed in a 155 μm × 178 μm × 210 μm volume and were seen to be decoupled. The predominant phases present in the material, half-Heusler TiNiSn, and full-Heusler TiNi{sub 2}Sn have a percolated structure. The distribution of coherent interfaces and high-angle interfaces has been measured quantitatively.

36 MATERIALS SCIENCE↗

Multimodal differential emission measure in the solar corona

The Atmospheric Imaging Assembly (AIA) telescope on board the Solar Dynamics Observatory provides coronal extreme ultraviolet imaging over a broader temperature sensitivity range than the previous generations of instruments (Extreme Ultraviolet Imager; EUVI, EIT, and TRACE). Differential emission measure tomography (DEMT) of the solar corona based on AIA data is presented here for the first time. The main product of DEMT is the three-dimensional distribution of the local differential emission measure (LDEM). While in previous studies, based on EIT or EUVI data, there were three available EUV bands, the present study is based on the four cooler AIA bands (aimed at studying the quiet sun). The AIA filters allow exploration of new parametric LDEM models. Since DEMT is better suited for lower activity periods, we use data from Carrington Rotation 2099, when the Sun was in its most quiescent state during the AIA mission. Also, we validate the parametric LDEM models by using them to perform a bi-dimensional differential emission measure (DEM) analysis on sets of simultaneous AIA images, and comparing results with those obtained using other methods. Our study reveals a ubiquitous bimodal LDEM distribution in the quiet diffuse corona, characterized by two well-defined average centroid temperatures 〈T{sub 0,1}〉=(1.47±0.05) MK and 〈T{sub 0,2}〉=(2.57±0.05) MK. We argue that the nanoflare heating scenario is less likely to explain these results, and that alternative mechanisms, such as wave dissipation, appear better supported by our results.

79 ASTRONOMY AND ASTROPHYSICS↗

Joint Analysis of Program Data Representations using Machine Learning for Improved Software Assurance and Development Capabilities

We explore the use of multiple deep learning models for detecting flaws in software programs. Current, standard approaches for flaw detection rely on a single representation of a software program (e.g., source code or a program binary). We illustrate that, by using techniques from multimodal deep learning, we can simultaneously leverage multiple representations of software programs to improve flaw detection over single representation analyses. Specifically, we adapt three deep learning models from the multimodal learning literature for use in flaw detection and demonstrate how these models outperform traditional deep learning models. We present results on detecting software flaws using the Juliet Test Suite and Linux Kernel.

97 MATHEMATICS AND COMPUTING↗

Correlative multimodal chemical imaging via machine learning

Machine learning approach can combine mass spectral imaging (MSI) techniques, one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The machine learning approach can perform transformations on the spectral image data of the two MSI techniques to reduce dimensionality, and using a correlation technique, find relationships between the transformed spectral image data. The determined relationships can be used to generate MSI spectra of desired resolution.

Ovchinnikova, Olga S.↗