Search NASA⌕ Search

SEARCH · Search NASA

Results for “Self Organizing Map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Synoptic Weather Regime Classifications for March, April and May, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

Synoptic Weather Regime Classifications for June, July and August, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

Synoptic Weather Regime Classifications for December, January and February, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

{node_som_ml,synop_wea_reg}↗

Synoptic Weather Regime Classifications for September, October and November, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

SOM Classification of Martian TES Data

A classification scheme based on unsupervised self-organizing maps (SOM) is described. Results from its application to the ASU mineral spectral database are presented. Applications to the Martian Thermal Emission Spectrometer data are discussed. Additional information is contained in the original extended abstract.

Hogan, R. C.↗

Gene Expression Dynamics Inspector (GEDI): for integrative analysis of expression profiles

Genome-wide expression profiles contain global patterns that evade visual detection in current gene clustering analysis. Here, a Gene Expression Dynamics Inspector (GEDI) is described that uses self-organizing maps to translate high-dimensional expression profiles of time courses or sample classes into animated, coherent and robust mosaics images. GEDI facilitates identification of interesting patterns of molecular activity simultaneously across gene, time and sample space without prior assumption of any structure in the data, and then permits the user to retrieve genes of interest. Important changes in genome-wide activities may be quickly identified based on 'Gestalt' recognition and hence, GEDI may be especially useful for non-specialist end users, such as physicians. AVAILABILITY: GEDI v1.0 is written in Matlab, and binary Matlab.dll files which require Matlab to run can be downloaded for free by academic institutions at http://www.chip.org/~ge/gedihome.html Supplementary information: http://www.chip.org/~ge/gedihome.html.

Database Management Systems↗

Identification and Control of Aircrafts using Multiple Models and Adaptive Critics

We compared two possible implementations of local linear models for control: one approach is based on a self-organizing map (SOM) to cluster the dynamics followed by a set of linear models operating at each cluster. Therefore the gating function is hard (a single local model will represent the regional dynamics). This simplifies the controller design since there is a one to one mapping between controllers and local models. The second approach uses a soft gate using a probabilistic framework based on a Gaussian Mixture Model (also called a dynamic mixture of experts). In this approach several models may be active at a given time, we can expect a smaller number of models, but the controller design is more involved, with potentially better noise rejection characteristics. Our experiments showed that the SOM provides overall best performance in high SNRs, but the performance degrades faster than with the GMM for the same noise conditions. The SOM approach required about an order of magnitude more models than the GMM, so in terms of implementation cost, the GMM is preferable. The design of the SOM is straight forward, while the design of the GMM controllers, although still reasonable, is more involved and needs more care in the selection of the parameters. Either one of these locally linear approaches outperform global nonlinear controllers based on neural networks, such as the time delay neural network (TDNN). Therefore, in essence the local model approach warrants practical implementations. In order to call the attention of the control community for this design methodology we extended successfully the multiple model approach to PID controllers (still today the most widely used control scheme in the industry), and wrote a paper on this subject. The echo state network (ESN) is a recurrent neural network with the special characteristics that only the output parameters are trained. The recurrent connections are preset according to the problem domain and are fixed. In a nutshell, the states of the reservoir of recurrent processing elements implement a projection space, where the desired response is optimally projected. This architecture trades training efficiency by a large increase in the dimension of the recurrent layer. However, the power of the recurrent neural networks can be brought to bear on practical difficult problems. Our goal was to implement an adaptive critic architecture implementing Bellman s approach to optimal control. However, we could only characterize the ESN performance as a critic in value function evaluation, which is just one of the pieces of the overall adaptive critic controller. The results were very convincing, and the simplicity of the implementation was unparalleled.

Principe, Jose C.↗

NASA Tech Briefs, December 2005

Topics covered include: Video Mosaicking for Inspection of Gas Pipelines; Shuttle-Data-Tape XML Translator; Highly Reliable, High-Speed, Unidirectional Serial Data Links; Data-Analysis System for Entry, Descent, and Landing; Hybrid UV Imager Containing Face-Up AlGaN/GaN Photodiodes; Multiple Embedded Processors for Fault-Tolerant Computing; Hybrid Power Management; Magnetometer Based on Optoelectronic Microwave Oscillator; Program Predicts Time Courses of Human/ Computer Interactions; Chimera Grid Tools; Astronomer's Proposal Tool; Conservative Patch Algorithm and Mesh Sequencing for PAB3D; Fitting Nonlinear Curves by Use of Optimization Techniques; Tool for Viewing Faults Under Terrain; Automated Synthesis of Long Communication Delays for Testing; Solving Nonlinear Euler Equations With Arbitrary Accuracy; Self-Organizing-Map Program for Analyzing Multivariate Data; Tool for Sizing Analysis of the Advanced Life Support System; Control Software for a High-Performance Telerobot; Java Radar Analysis Tool; Architecture for Verifiable Software; Tool for Ranking Research Options; Enhanced, Partially Redundant Emergency Notification System; Close-Call Action Log Form; Task Description Language; Improved Small-Particle Powders for Plasma Spraying; Bonding-Compatible Corrosion Inhibitor for Rinsing Metals; Wipes, Coatings, and Patches for Detecting Hydrazines; Rotating Vessels for Growing Protein Crystals; Oscillating-Linear-Drive Vacuum Compressor for CO2; Mechanically Biased, Hinged Pairs of Piezoelectric Benders; Apparatus for Precise Indium-Bump Bonding of Microchips; Radiation Dosimetry via Automated Fluorescence Microscopy; Multistage Magnetic Separator of Cells and Proteins; Elastic-Tether Suits for Artificial Gravity and Exercise; Multichannel Brain-Signal-Amplifying and Digitizing System; Ester-Based Electrolytes for Low-Temperature Li-Ion Cells; Hygrometer for Detecting Water in Partially Enclosed Volumes; Radio-Frequency Plasma Cleaning of a Penning Malmberg Trap; Reduction of Flap Side Edge Noise - the Blowing Flap; and Preventing Accidental Ignition of Upper-Stage Rocket Motors.

Source record↗

Ice Roughness in Short Duration SLD Icing Events

Ice accretion codes depend on models of roughness parameters to account for the enhanced heat transfer during the ice accretion process. While mitigating supercooled large droplet (SLD or Appendix O) icing is a significant concern for manufacturers seeking future vehicle certification due to the pending regulation, historical ice roughness studies have been performed using Appendix C icing clouds which exhibit mean volumetric diameters (MVD) much smaller than SLD clouds. Further, the historical studies of roughness focused on extracting parametric representations of ice roughness using multiple images of roughness elements. In this study, the ice roughness developed on a 21-in. NACA 0012 at 0deg angle of attack exposed to short duration SLD icing events was measured in the Icing Research Tunnel at the NASA Glenn Research Center. The MVD's used in the study ranged from 100 micrometer to 200 micrometers, in a 67 m/s flow, with liquid water contents of either 0.6 gm/cubic meters or 0.75 gm/cubic meters. The ice surfaces were measured using a Romer Absolute Arm laser scanning system. The roughness associated with each surface point cloud was measured using the two-dimensional self-organizing map approach developed by McClain and Kreeger (2013) resulting in statistical descriptions of the ice roughness.

Icing↗

Characterization of Ice Roughness Variations in Scaled Glaze Icing Conditions

Because of the significant influence of surface tension in governing the stability and breakdown of the liquid film in flooded stagnation regions of airfoils exposed to glaze icing conditions, the Weber number is expected to be a significant parameter governing the formation and evolution of ice roughness. To investigate the influence of the Weber number on roughness formation, 53.3-cm (21-in.) and 182.9-cm (72-in.) NACA 0012 airfoils were exposed to flow conditions with essentially the same Weber number and varying stagnation collection efficiency to illuminate similarities of the ice roughness created on the different airfoils. The airfoils were exposed to icing conditions in the Icing Research Tunnel (IRT) at the NASA Glenn Research Center. Following exposure to the icing event, the airfoils were then scanned using a ROMER Absolute Arm scanning system. The resulting point clouds were then analyzed using the self-organizing map approach of McClain and Kreeger (2013) to determine the spatial roughness variations along the surfaces of the iced airfoils. The roughness characteristics on each airfoil were then compared using the relative geometries of the airfoil. The results indicate that features of the ice shape and roughness such as glaze-ice plateau limits and maximum airfoil roughness were captured well by Weber number and collection efficiency scaling of glaze icing conditions. However, secondary ice roughness features relating the instability and waviness of the liquid film on the glaze-ice plateau surface are scaled based on physics that were not captured by the local collection efficiency variations.

Roughness Formation↗

Probabilistic Forecasting of Surface Ozone with a Novel Statistical Approach

The recent change in the Environmental Protection Agency's surface ozone regulation, lowering the surface ozone daily maximum 8-h average (MDA8) exceedance threshold from 75 to 70 ppbv, poses significant challenges to U.S. air quality (AQ) forecasters responsible for ozone MDA8 forecasts. The forecasters, supplied by only a few AQ model products, end up relying heavily on self-developed tools. To help U.S. AQ forecasters, this study explores a surface ozone MDA8 forecasting tool that is based solely on statistical methods and standard meteorological variables from the numerical weather prediction (NWP) models. The model combines the self-organizing map (SOM), which is a clustering technique, with a step wise weighted quadratic regression using meteorological variables as predictors for ozone MDA8. The SOM method identifies different weather regimes, to distinguish between various modes of ozone variability, and groups them according to similarity. In this way, when a regression is developed for a specific regime, data from the other regimes are also used, with weights that are based on their similarity to this specific regime. This approach, regression in SOM (REGiS), yields a distinct model for each regime taking into account both the training cases for that regime and other similar training cases. To produce probabilistic MDA8 ozone forecasts, REGiS weighs and combines all of the developed regression models on the basis of the weather patterns predicted by an NWP model. REGiS is evaluated over the San Joaquin Valley in California and the northeastern plains of Colorado. The results suggest that the model performs best when trained and adjusted separately for an individual AQ station and its corresponding meteorological site.

Ozone variables↗

The First Twenty Years (1994 2014) of Ozone Soundings from Rapa Nui (27 deg S, 109 deg W, 51 m a.s.l.)

Ozone (O3) soundings have been performed on Easter Island or Rapa Nui (27 8S, 109 8W, 51 m a.s.l.) since 1994 as part of the Global Atmospheric Watch Programme of the World Meteorological Organization. In this work, we analyze 260 soundings compiled over the period 19942014, and make the data available for the international community. We characterize O3 profiles over this remote area of the Pacific by means of statistical analyses that consider, on the one hand, a traditional climatology that describes the data in terms of seasonal cycles based on monthly averages and, on the other hand, a process-oriented analysis based on self-organizing maps. Our analyses show the influence of both tropical and subtropical/mid-latitude air masses at Rapa Nui. The former occurs in summer and fall when convective conditions prevail, and the latter in late winter and spring when subsiding conditions are recurrent. The occurrence of stratospheric intrusions in late winter and spring in connection with deep troughs and the presence of the subtropical jet stream is also apparent in the data set. The tropospheric ozone column is in good agreement with the corresponding data derived from satellites but with a systematic overestimate of summer and fall values. There is evidence of an upward trend in ozone near the surface, which suggests the impact of local pollution. We look forward to an enhancement of the Rapa Nui observing site, given its location that offers a privileged position to observe climate change over the sparsely sampled and vast South Pacific Ocean.

tropical and subtropical/mid-latitude air masses↗

Ice Roughness and Thickness Evolution on a Swept NACA 0012 Airfoil

Several recent studies have been performed in the Icing Research Tunnel (IRT) at NASA Glenn Research Center focusing on the evolution, spatial variations, and proper scaling of ice roughness on airfoils without sweep exposed to icing conditions employed in classical roughness studies. For this study, experiments were performed in the IRT to investigate the ice roughness and thickness evolution on a 91.44-cm (36-in.) chord NACA 0012 airfoil, swept at 30-deg with 0deg angle of attack, and exposed to both Appendix C and Appendix O (SLD) icing conditions. The ice accretion event times used in the study were less than the time required to form substantially three-dimensional structures, such as scallops, on the airfoil surface. Following each ice accretion event, the iced airfoils were scanned using a ROMER Absolute Arm laser-scanning system. The resulting point clouds were then analyzed using the self-organizing map approach of McClain and Kreeger to determine the spatial roughness variations along the surfaces of the iced airfoils. The resulting measurements demonstrate linearly increasing roughness and thickness parameters with ice accretion time. Further, when compared to dimensionless or scaled results from unswept airfoil investigations, the results of this investigation indicate that the mechanisms for early stage roughness and thickness formation on swept wings are similar to those for unswept wings.

glaze icing↗

Classification of Meteorological Influences Surrounding Extreme Precipitation Events in the United States using the MERRA-2 Reanalysis

Extreme precipitation events can have a large impact on society through flooding that can result in property destruction, crop losses, economic losses, the spread of water-borne diseases, and fatalities. Observations indicate there has been a statistically significant increase in extreme precipitation events over the past 15 years in the Northeastern United States and other localized regions of the country have become crippled with record flooding events, for example, the flooding that occurred in the Southeast United States associated with Hurricane Matthew in October 2016. Extreme precipitation events in the United States can be caused by various meteorological influences such as extratropical cyclones, tropical cyclones, mesoscale convective complexes, general air mass thunderstorms, upslope flow, fronts, and the North American Monsoon. Reanalyses, such as the Modern Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2), have become a pivotal tool to study the meteorology surrounding extreme precipitation events. Using days classified as an extreme precipitation events based on a combination of observational gauge and radar data, two techniques for the classification of these events are used to gather additional information that can be used to determine how events have changed over time using atmospheric data from MERRA-2. The first is self organizing maps, which is an artificial neural network that uses unsupervised learning to cluster like patterns and the second is an automated detection technique that searches for characteristics in the atmosphere that define a meteorological phenomena. For example, the automated detection for tropical cycles searches for a defined area of suppressed sea level pressure, alongside thickness anomalies aloft, indicating the presence of a warm core. These techniques are employed for extreme precipitation events in preselected regions that were chosen based an analysis of the climatology of precipitation.

Monsoon↗

Detecting And Characterizing Archetypes of Unintended Consequences in Engineered Systems

When designing engineered systems, the potential for unintended consequences of design policies or design decisions exists despite best intentions. Conditions that might cause the formation of unintended consequences are often known only in hindsight. However, since these conditions are associated with a single event, it is difficult to uncover the general patterns of conditions leading to unintended consequences. In this research, patterns of conditions associated with unintended consequences are learned from historical data and represented in the form of archetypes. While previous work using systems theoretic modeling has identified high-level archetypes, this work leverages a self-organizing map to learn archetypes of unintended consequences from human-tagged risk factors in a large data set of lessons learned from adverse events at NASA. The sixty-six identified archetypes contain patterns of conditions such as complexity and human-machine interaction associated with the formation of unintended consequences. To validate the archetypes, a sample of the archetypes is represented using system dynamics in order to illustrate that the identified archetypes are specialized versions of known high-level archetypes of unintended consequences. While the research is based upon a specific dataset, the archetypes apply to any engineered system and the pattern of leading indicators open a new path to manage unintended consequences and mitigate the magnitude of potentially adverse outcomes.

Hannah S Walsh↗

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗

Detection of CH 4 Hotspots from NASA’s GEOS Composition Analysis System

Recent research indicates that 8 to 12% of the global oil and gas production methane emissions could be attributed to ultra-emitters, which result in high concentration ‘hotspots’ near point sources. Identifying these emissions in near real time provides useful information to the policy makers and private industry, who are working to reduce their impact. To meet this need, scientists are increasingly analyzing satellite data from the TROPOspheric Monitoring Instrument (TROPOMI) instrument aboard ESA’s Sentinel 5-Precursor mission. While direct analysis of TROPOMI level 2 swath data has been successful in identifying some large emission events, identifying hotpots is challenging because of the imaging noise due to a variety of artifacts and limits in daily coverage. Here we explore possible methodologies to detect methane hotspots using a new, gap-filled, and temporally continuous methane product from NASA’s Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS), which assimilates column averaged methane mole fractions from the TROPOMI with capabilities to assimilate other remote sensing measurements. The CoDAS has been expanded from a heritage of stratospheric composition and carbon dioxide assimilation allowing for the support of regional modeling, validation with non-coincident operations, and merging variety of datasets. The current work mainly explores Observing System Simulation Experiments with methane GEOS simulations without assimilation to prepare the groundwork for further experiments with assimilated TROPOMI. First, known hotspots based on the known inventory are identified to demonstrate the capability of the system to point out emission hotspots. In the next step, a variety of machine learning techniques such as Self-Organizing Maps and Deep Learning are explored to automate detection of the plumes. Finally, a few approaches to quantify emissions from the identified hotspots are presented and are evaluated against the inventory. The effort is directed toward a future evaluation of the CoDAS based methane monitoring system’s ability to successfully detect and quantify hotspots.

Nikolay Balashov↗

Adversary phase change detection using SOMs and text data.

In this work, we developed a self-organizing map (SOM) technique for using web-based text analysis to forecast when a group is undergoing a phase change. By 'phase change', we mean that an organization has fundamentally shifted attitudes or behaviors. For instance, when ice melts into water, the characteristics of the substance change. A formerly peaceful group may suddenly adopt violence, or a violent organization may unexpectedly agree to a ceasefire. SOM techniques were used to analyze text obtained from organization postings on the world-wide web. Results suggest it may be possible to forecast phase changes, and determine if an example of writing can be attributed to a group of interest.

99 GENERAL AND MISCELLANEOUS↗