SEARCH · Search NASA

Results for “data representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

All sources NASA NTRS DOE OSTI

DOE OSTI2023

CASTLE: Conflict Analysis Strategy Testing Laboratory Environment v.1.0.0

SAND2024-01743O The Conflict Analysis Strategy Testing Laboratory Environment (CASTLE) is a software framework that enables and simplifies building a novel, turn-based strategy game in which it can define its own rules, maps, pieces, and interactions. The software is for novice to experienced programmers with some knowledge of Unity3D, a tool used in game production. CASTLE includes a library of common game mechanics used for strategic wargames and traditional board games, such as cards, tokens, dice, and grid maps. It follows design principles popularized by the video game industry and uses singletons for managing portions of the code. CASTLE builds on Unity's component-based design and can respond to engine events during execution. Among the numerous user-friendly features: Build games quickly and cost-effectively Network in real-time and apply data to new games developed on the framework Host multiple participants online Connect rule- or machine learning-based agents to a CASTLE game to serve as opponents or to simulate games Collect data collection from players and in-game behaviors Create a survey to gather demographics or opinions from players Store data locally or save it to an external database through Representational State Transfer (REST) functions CASTLE, which was prototyped using Microsoft Azure, is also designed for easily distributing online games using popular cloud services. The multiplayer functionality includes an agent interface, allowing developers to construct AI players that can substitute for humans in any of the games. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fabian, Nathan↗

DOE OSTI2020

Developing a simulator-based satellite dataset for using machine learning techniques to derive aerosol-cloud-precipitation interactions in models and observations in a consistent framework

Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Topological Simplifications of Hypergraphs

Here we study hypergraph visualization via its topological simplification. We explore both vertex simplification and hyperedge simplification of hypergraphs using tools from topological data analysis. In particular, we transform a hypergraph into its graph representations, known as the line graph and clique expansion. A topological simplification of such a graph representation induces a simplification of the hypergraph. In simplifying a hypergraph, we allow vertices to be combined if they belong to almost the same set of hyperedges, and hyperedges to be merged if they share almost the same set of vertices. Our proposed approaches are general and mathematically justifiable, and put vertex simplification and hyperedge simplification in a unifying framework.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1989

Modeling of the Earth's gravity field using the New Global Earth Model (NEWGEM)

Traditionally, the global gravity field was described by representations based on the spherical harmonics (SH) expansion of the geopotential. The SH expansion coefficients were determined by fitting the Earth's gravity data as measured by many different methods including the use of artificial satellites. As gravity data have accumulated with increasingly better accuracies, more of the higher order SH expansion coefficients were determined. The SH representation is useful for describing the gravity field exterior to the Earth but is theoretically invalid on the Earth's surface and in the Earth's interior. A new global Earth model (NEWGEM) (KIM, 1987 and 1988a) was recently proposed to provide a unified description of the Earth's gravity field inside, on, and outside the Earth's surface using the Earth's mass density profile as deduced from seismic studies, elevation and bathymetric information, and local and global gravity data. Using NEWGEM, it is possible to determine the constraints on the mass distribution of the Earth imposed by gravity, topography, and seismic data. NEWGEM is useful in investigating a variety of geophysical phenomena. It is currently being utilized to develop a geophysical interpretation of Kaula's rule. The zeroth order NEWGEM is being used to numerically integrate spherical harmonic expansion coefficients and simultaneously determine the contribution of each layer in the model to a given coefficient. The numerically determined SH expansion coefficients are also being used to test the validity of SH expansions at the surface of the Earth by comparing the resulting SH expansion gravity model with exact calculations of the gravity at the Earth's surface.

Kim, Yeong E.↗

NASA NTRS2024

Digital Lunar Exploration Sites (DLES) Terrain Crafting

Humans will soon be returning to the surface of the Moon with NASA’s Artemis program. The Artemis program is an international collaboration that will consist of a complex series of space systems and missions to explore the lunar surface and pave the way for the future exploration of Mars. NASA and its partners rely heavily on simulation for lighting and navigation studies as well as training astronauts, flight controllers, and mission support staff. The NASA Exploration Systems Simulations (NExSyS) team in the Simulation and Graphics Branch (ER7) in the Engineering Directorate at NASA’s Johnson Space Center has built up many simulation products to support this effort, one of which is the Digital Lunar Exploration Sites (DLES). DLES is a collection of products used to simulate and render the lunar surface in a digital environment. We discussed and presented an overview of the DLES products at the 2022 IEEE Aerospace Conference in Big Sky, MT with a paper titled "Digital Lunar Exploration Sites". This “DLES Terrain Crafting” paper will expand on the information previously provided in “DLES” paper and dive deeper into the details of the terrain crafting process and the toolsets used to support this task. The best digital data currently available of the lunar surface is provided by the Lunar Reconnaissance Orbiter (LRO). Its Lunar Orbiter Laser Altimeter (LOLA) achieves an impressive resolution of 5m per pixel at the Lunar South Pole (LSP) and can generate datasets covering a large continuous region near the LSP. There are a few additional methods, such as Shape from Shading which can infer higher resolution data (up to 1m per pixel) from the LRO Narrow Angle Camera (NAC) images. However, surface-based simulations require higher-resolution data, and this paper will discuss the process of enhancing the terrain to meet that need. The process begins with capturing statistical data of craters in the regions of interest using images provided by the LRO NAC. This data is then used to scatter artificial features which are not captured in the truth data, resulting in an enhanced DEM with a much higher resolution of 20cm per pixel. Many tools were built up to assist in the creation of these artificial Digital Elevation Models (DEM), which this paper will discuss in detail. DEMs themselves are a very powerful representation of a planetary surface, and many operations and tools can utilize the data they contain. This paper includes a description of the rendering of the lunar surface in a graphics engine, generation of contact patches to simulate tire to ground interaction, and ray tracing utilities to model Line of Sight (LOS) interactions with the terrain. This paper will also explore some new tool sets currently under development which aim to utilize Machine Learning (ML) to assist in the identification of craters from LRO NAC imagery. While this is not a novel idea, the NExSyS team is developing a unique approach which may result in more robust identification of crater characteristics.

Artemis↗

NASA NTRS2005

The Contribution of CEOP Data to the Understanding and Modeling of Monsoon Systems

CEOP has contributed and will continue to provide integrated data sets from diverse platforms for better understanding of the water and energy cycles, and for validaintg models. In this talk, I will show examples of how CEOP has contributed to the formulation of a strategy for the study of the monsoon as a system. The CEOP data concept has led to the development of the CEOP Inter-Monsoon Studies (CIMS), which focuses on the identification of model bias, and improvement of model physics such as the diurnal and annual cycles. A multi-model validation project focusing on diurnal variability of the East Asian monsoon, and using CEOP reference site data, as well as CEOP integrated satellite data is now ongoing. Preliminary studies show that climate models have difficulties in simulating the diurnal signals of total rainfall, rainfall intensity and frequency of occurrence, which have different peak hours, depending on locations. Further more model diurnal cycle of rainfall in monsoon regions tend to lead the observed by about 2-3 hours. These model bias offer insight into lack of, or poor representation of, key components of the convective and stratiform rainfall. The CEOP data also stimulated studies to compare and contrasts monsoon variability in different parts of the world. It was found that seasonal wind reversal, orographic effects, monsoon depressions, meso-scale convective complexes, SST and land surface land influences are common features in all monsoon regions. Strong intraseasonal variability is present in all monsoon regions. While there is a clear demarcation of onset, breaks and withdrawal in the Asian and Australian monsoon region associated with climatological intraseasonal variabillity, it is less clear in the American and Africa monsoon regions. The examination of satellite and reference site data in monsoon has led to preliminary model experiments to study the impact of aerosol on monsoon variability. I will show examples of how the study of the dynamics of aerosol-water cycle interactions in the monsoon region, can be best achieved using the CEOP data and modeling strategy.

Lau, William K. M.↗

DOE OSTI2020

Algorithms for Efficient Reproducible Floating Point Summation

We define “reproducibility” as getting bitwise identical results from multiple runs of the same program, perhaps with different hardware resources or other changes that should not affect the answer. Many users depend on reproducibility for debugging or correctness. However, dynamic scheduling of parallel computing resources, combined with nonassociative floating point addition, makes reproducibility challenging even for summation, or operations like the BLAS. We describe a “reproducible accumulator” data structure (the “binned number”) and associated algorithms to reproducibly sum binary floating point numbers, independent of summation order. We use a subset of the IEEE Floating Point Standard 754-2008 and bitwise operations on the standard representations in memory. Our approach requires only one read-only pass over the data, and one reduction in parallel, using a 6-word reproducible accumulator (more words can be used for higher accuracy), enabling standard tiling optimization techniques. Summing n words with a 6-word reproducible accumulator requires approximately 9 n floating point operations (arithmetic, comparison, and absolute value) and approximately 3 n bitwise operations. The final error bound with a 6-word reproducible accumulator and our default settings can be up to 2 29 times smaller than the error bound for conventional (recursive) summation on ill-conditioned double-precision inputs.

Computer Science↗

NASA NTRS1996

Program Converts VAX Floating-Point Data To UNIX

VAX Floating Point to Host Floating Point Conversion (VAXFC) software converts non-ASCII files to unformatted floating-point representation of UNIX machine. This is done by reading bytes bit by bit, converting them to floating-point numbers, then writing results to another file. Useful when data files created by VAX computer must be used on other machines. Written in C language.

Alves, Marcos↗

NASA NTRS2015

Evaluation of the 7-km GEOS-5 Nature Run

This report documents an evaluation by the Global Modeling and Assimilation Office (GMAO) of a two-year 7-km-resolution non-hydrostatic global mesoscale simulation produced with the Goddard Earth Observing System (GEOS-5) atmospheric general circulation model. The simulation was produced as a Nature Run for conducting observing system simulation experiments (OSSEs). Generation of the GEOS-5 Nature Run (G5NR) was motivated in part by the desire of the OSSE community for an improved high-resolution sequel to an existing Nature Run produced by the European Centre for Medium-Range Weather Forecasts (ECMWF), which has served the community for several years. The intended use of the G5NR in this context is for generating simulated observations to test proposed observing system designs regarding new instruments and their deployments. Because NASA's interest in OSSEs extends beyond traditional weather forecasting applications, the G5NR includes, in addition to standard meteorological components, a suite of aerosol types and several trace gas concentrations, with emissions downscaled to 10 km using ancillary information such as power plant location, population density and night-light information. The evaluation exercise described here involved more than twenty-five GMAO scientists investigating various aspects of the G5NR performance, including time mean temperature and wind fields, energy spectra, precipitation and the hydrological cycle, the representation of waves, tropical cyclones and midlatitude storms, land and ocean surface characteristics, the representation and forcing effects of clouds and radiation, dynamics of the stratosphere and mesosphere, and the representation of aerosols and trace gases. Comparisons are made with observational data sets when possible, as well as with reanalyses and other long model simulations. The evaluation is broad in scope, as it is meant to assess the overall realism of basic aspects of the G5NR deemed relevant to the conduct of OSSEs. However, because of the relatively short record and other practical considerations, these comparisons cannot provide a definitive, statistically sound assessment of all model deficiencies, or guarantee the G5NR's suitability for all OSSE applications. Differences between the observed and simulated behavior also must be judged in the context of basic internal atmospheric variability which can introduce variations that are not necessarily controlled by the prescribed sea surface temperatures used in generating the G5NR. The results show that the G5NR performs well as measured by the majority of metrics applied in this evaluation. Particular benefits derived from the 7-km resolution of G5NR include realistic representations of extreme weather events in both the tropics and extratropics including tropical cyclones, Nor'easters and mesoscale convective complexes; improved representation of the diurnal cycle of precipitation over land; well-resolved surface-atmosphere interactions such as katabatic wind flows over Antarctica and Greenland; and resolution of orographically generated gravity waves that propagate into the upper atmosphere and influence the large scale circulation. Obvious deficiencies in the G5NR include a "splitting" of the inter-tropical convergence zone, which leads to a weaker-than-observed Hadley circulation and related deficiencies in the depiction of stationary wave patterns. Also, while the G5NR captures global cloud features and radiative effects well in general, close comparison with observations reveals higher-than-observed cloud brightness, likely due to an overabundance of cloud condensate; less distinct cloud minima in subtropical subsidence zones, consistent with a weak Hadley circualtion; and too few near-coastal marine stratocumulus clouds.

GEOS-5↗

DOE OSTI2017

Beyond Fine Tuning: Adding capacity to leverage few labels

In this paper we present a technique to train neural network models on small amounts of data. Current methods for training neural networks on small amounts of rich data typically rely on strategies such as fine-tuning a pre-trained neural networks or the use of domain-specific hand-engineered features. Here we take the approach of treating network layers, or entire networks, as modules and combine pre-trained modules with untrained modules, to learn the shift in distributions between data sets. The central impact of using a modular approach comes from adding new representations to a network, as opposed to replacing representations via fine-tuning. Using this technique, we are able surpass results using standard fine-tuning transfer learning approaches, and we are also able to significantly increase performance over such approaches when using smaller amounts of data.

data science↗

NASA NTRS1981

Representations of solar EUV fluxes for aeronomical applications

Pilot studies performed on Atmosphere Explorer-E satellite data on solar EUV fluxes for the rising part of the sunspot cycle 21 have demonstrated the feasibility of expressing the variability of solar EUV fluxes in aeronomically attractive terms involving a relatively small total number of date-dependent variables supported by the relatively large number of wavelength-peculiar parameters. Attention is given to the distribution of solar EUV sources and their variability, observations of solar cycle variations, and a model representation of EUV variability.

Hinteregger, H. E.↗

DOE OSTI2026

Monthly Mean In Situ Surface Flux Observations Paired with Satellite-Derived and Reanalysis-Based Flux Data for the Great Lakes Region, 2001–2020

Surface radiative and turbulent heat fluxes over the Great Lakes strongly influence regional hydrological and meteorological processes, and their accurate representation is critical for numerical weather prediction and coupled atmosphere–lake modeling. However, direct flux observations are spatially sparse across the region, so gridded reanalysis and satellite-derived products are often used for climatological analyses and model evaluation despite differences in their flux representations. This dataset provides processed, quality-controlled, monthly mean surface flux observations from the Great Lakes Evaporation Network (GLEN), AmeriFlux, and the National Data Buoy Center, paired with spatiotemporally matched flux estimates from two reanalysis products, the fifth generation European Centre for Medium-Range Weather Forecasts (ECMWF) reanalysis dataset (ERA5) and the Modern Era Reanalysis for Research and Applications, version 2 (MERRA-2), and two satellite-derived products, the Clouds and Earth's Radiant Energy Systems Energy Balanced and Filled (CERES-EBAF) and the Cloud, Albedo and Surface Radiation dataset from AVHRR data - Edition 3 (CLARA-A3). The dataset includes sixteen observational stations with variable temporal coverage within 2001–2020. For each station, a CSV file contains monthly time series of available flux variables, including surface downwelling shortwave radiation (SW), surface downwelling longwave radiation (LW), sensible heat (SH) flux, and latent heat flux (LH), alongside matched gridded product values where available. Columns in the CSV file correspond to different variables sourced from each dataset, with column titles structured as "{dataset}_{variable}". Columns with relevant metadata are also provided in each CSV file, including station latitude and longitude, monthly timestamps, and the name of the sourced observational data. These files are structured for direct use in common analysis tools, including Microsoft Excel, Python pandas, and Python matplotlib. This dataset supports climatological analysis of the Great Lakes regional surface energy budget, evaluation of satellite-derived and reanalysis-based flux products, and development or validation of flux representations in numerical weather prediction and coupled atmosphere–lake models.

Great Lakes↗

NASA NTRS1992

An improved model of the Earth's gravity field - GEM-T3

An improved model of the Earth's gravitational field is developed from a combination of conventional satellite tracking, satellite altimeter measurements, and surface gravimetric data (GEM-T3). This model gives improved performance for the computation of satellite orbital effects as well as a superior representation of the geoid from that achieved in any previous Goddard Earth Model. The GEM-T3 model uses altimeter data directly to define the orbits, geoid, and dynamic height fields. Altimeter data acquired during the GEOS-3 (1975-1976), SEASAT (1978), and GEOSAT (1986-1987) missions were used to compute GEM-T3. In order to accommodate the non-gravitational signal mapped by these altimeters, spherical harmonic models of the dynamic height of the ocean surface were recovered for each mission simultaneously with the gravitational field. The tracking data utilized in the solution includes more than 1300 arcs of data encompassing 31 different satellites. The observational data base is highly dependent on SLR, but also includes TRANET Doppler, optical, S-Band average range-rate and satellite-to-satellite tracking acquired between ATS-6 and GEOS-3. The GEM-T3 model has undergone extensive error calibration.

Nerem, R. S.↗

NASA NTRS1985

An initialization procedure for assimilating geostationary satellite data into numerical weather prediction models

An attempt was made to offset the limitations of GEO satellites for supplying timely initialization data for numerical weather prediction models (NWP). The NWP considered combined an isentropic representation of the free atmosphere with a sigma-coordinate model for the lower 200 mb. A flux form of the predictive equations described vertical transport interactions at the boundary of the two model domains, thereby accounting for the poor vertical temperature and wind field resolution of GEO satellite data. A variational analysis approach was employed to insert low resolution satellite-sensed temperature data at varying rates. The model vertical resolution was limited to that available from the satellite. Test simulations demonstrated that accuracy increases with the frequency of data updates, e.g., every 0.5-1 hr. The tests also showed that extensive cloud cover negates the capabilities of IR sensors and that microwave sensors will be needed for temperature estimations for 500-1000 mb levels.

Gal-Chen, T.↗

NASA NTRS1995

Are Event Traces Really That Necessary?

Many performance monitoring tools are currently available to the super-computing community. The performance data gathered and analyzed by these tools fall under two categories: statistics and event traces. Statistical data is much more compact but lack the probative power event traces offer. Event traces, on the other hand, can easily fill up the entire file system during execution such that the instrumented execution have to be terminated. In this paper, we propose an innovative methodology for monitoring and trace representation that offers a middle ground. The user can trace-off trace data size vs. quality incrementally. Specifically, the user will be able to limit the amount of trace collected and, at the same time, carry out some of the analysis event traces offer for the entire execution. With the help of a few CFD examples, we illustrate the use of our technique in performance tuning. We also compare quantitatively, the quality of the traces we collected vs. event traces.

Schmidt, Melisa↗

NASA NTRS2014

Assimilation of Dual-Polarimetric Radar Observations with WRF GSI

Dual-polarimetric (dual-pol) radar typically transmits both horizontally and vertically polarized radio wave pulses. From the two different reflected power returns, more accurate estimate of liquid and solid cloud and precipitation can be provided. The upgrade of the traditional NWS WSR-88D radar to include dual-pol capabilities will soon be completed for the entire NEXRAD network. Therefore, the use of dual-pol radar network will have a broad impact in both research and operational communities. The assimilation of dual-pol radar data is especially challenging as few guidelines have been provided by previous research. It is our goal to examine how to best use dual-pol radar data to improve forecast of severe storm and forecast initialization. In recent years, the Development Testbed Center (DTC) has released the community Gridpoint Statistical Interpolation (GSI) DA system for the Weather Research and Forecasting (WRF) model. The community GSI system runs in independently environment, yet works functionally equivalent to operational centers. With collaboration with the NASA Short-term Prediction Research and Transition (SPoRT) Center, this study explores regional assimilation of the dual-pol radar variables from the WSR-88D radars for real case storms. Our presentation will highlight our recent effort on incorporating the horizontal reflectivity (ZH), differential reflectivity (ZDR), specific differential phase (KDP), and radial velocity (VR) data for initializing convective storms, with a significant focus being on an improved representation of hydrometeor fields. In addition, discussion will be provided on the development of enhanced assimilation procedures in the GSI system with respect to dual-pol variables. Beyond the dual-pol variable assimilation procedure developing within a GSI framework, highresolution (≤1 km) WRF model simulations and storm scale data assimilation experiments will be examined, emphasizing both model initialization and short-term forecast of precipitation fields and processes. Further details of the methodology of data assimilation, the impact of different dual-pol variables, the influence on precipitation forecast will be presented at the conference.

Li, Xuanli↗

NASA NTRS2014

Assimilation of Dual-Polarimetric Radar Observations with WRF GSI

Li, Xuanli↗

NASA NTRS2002

Transients in Pacific/North American Plate Boundary Deformation: Synthesis and Modeling of GPS and Borehole Strain Observations

This is the Final Technical Report on research conducted between 1 June 1997 and 14 September 2001 entitled "Transients in Pacific/North American plate boundary deformation: Synthesis and modeling of GPS and borehole strain observations." As the project title implies, our effort involved a geodetic study of strain transients, i.e., temporal variations in deformation rates, that occur within plate boundary zones and their relationship to earthquakes and plate motions. Important transients occur during and following large earthquakes, and there are also strain transients not apparently associated with earthquakes. A particularly intriguing class of transients, for which there is a modest but growing list of examples, are preseismic anomalies. Such earthquake precursors, if further documented and understood, would have obvious importance for earthquake hazard mitigation. Because the timescales for these diverse transients range over at least 6 orders of magnitude (minutes to years), no single geodetic technique is optimum. We therefore undertook a systematic synthesis of Global Positioning Satellite (GPS) and borehole strainmeter data in three areas in California where there are adequate numbers of both types of instruments (or their equivalent): the San Francisco Bay region (within the Bay Area Regional Deformation network), southern California (within the Southern California Integrated GPS Network), and Parkfield (where a two-color laser system provides a proxy for continuous GPS measurements). An integral component of our study was the elucidation of the physical mechanisms by which such transients occur and propagate. We therefore initiated the development of multiple forward models, using two independent approaches. In the first, we explored the response to specified earthquake slip in viscoelastic models that incorporated failure criteria and the geometry of major faults in California. In the second approach, we examined the dynamical response of a complex rheological medium to the application of a far-field stress imposed by plate motions. The forward models were used both to gain insight into the range of strain transients to be expected under different assumed mechanical conditions and to develop representations for strain fields that allow GPS, borehole, and other strain data to be combined in a self-consistent, yet well-determined, manner. The models also provided a basis for hypothesis testing, by which data from a strain transient well characterized by GPS and borehole observations were utilized to distinguish among competing candidates for the causative physical mechanism and the governing physical characteristics. During the three years of this project, continued to a fourth year through a no-cost extension of the grant, we published 14 papers and presented or co-authored 37 papers at national scientific meetings.

Solomon, Sean C.↗