Search NASA⌕ Search

SEARCH · Search NASA

Results for “Open Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Achieving Fast Operational Intelligence in NASA's Deep Space Network Through Complex Event Processing

NASA’s Deep Space Network (DSN) is a complex, global project, in which the expertise of human operators remain crucial for its successful operation. To find ways to save costs in operations and to improve its services, a number of modernization efforts are underway in the DSN. One such effort is a research and technology development task at the Jet Propulsion Laboratory that is investigating the use of complex event processing (CEP) for intelligent assessment of situations, trend analysis, and advanced automation. The technology leverages the significant business intelligence (BI) and data science advancements made in the enterprise industries over the last several years. The open source big data processing engine Apache SparkTM and the high-throughput, distributed messaging system Apache Kafka form the core of the DSN Complex Event Processing (DCEP) framework. This paper discusses the system engineering perspective of why achieving efficient, lower-cost operations in the DSN is a challenging problem, how the DCEP system handles the use cases that help realize intelligent operations, and how this solution fits into the overall model of the planned DSN Follow-the- Sun Operations (FtSO).

Choi, Joshua S.↗

Data Access Tools And Services At The Goddard Distributed Active Archive Center (GDAAC)

As one of the largest providers of Earth Science data from the Earth Observing System, GDAAC provides the latest data from the Moderate Resolution Imaging Spectroradiometer (MODIS), Atmospheric Infrared Sounder (AIRS), Solar Radiation and Climate Experiment (SORCE) data products via GDAAC's data pool (50TB of disk cache). In order to make this huge volume of data more accessible to the public and science communities, the GDAAC offers multiple data access tools and services: Open Source Project for Network Data Access Protocol (OPeNDAP), Grid Analysis and Display System (GrADS/DODS) (GDS), Live Access Server (LAS), OpenGlS Web Map Server (WMS) and Near Archive Data Mining (NADM). The objective is to assist users in retrieving electronically a smaller, usable portion of data for further analysis. The OPeNDAP server, formerly known as the Distributed Oceanographic Data System (DODS), allows the user to retrieve data without worrying about the data format. OPeNDAP is capable of server-side subsetting of HDF, HDF-EOS, netCDF, JGOFS, ASCII, DSP, FITS and binary data formats. The GrADS/DODS server is capable of serving the same data formats as OPeNDAP. GDS has an additional feature of server-side analysis. Users can analyze the data on the server there by decreasing the computational load on their client's system. The LAS is a flexible server that allows user to graphically visualize data on the fly, to request different file formats and to compare variables from distributed locations. Users of LAS have options to use other available graphics viewers such as IDL, Matlab or GrADS. WMS is based on the OPeNDAP for serving geospatial information. WMS supports OpenGlS protocol to provide data in GIs-friendly formats for analysis and visualization. NADM is another access to the GDAAC's data pool. NADM gives users the capability to use a browser to upload their C, FORTRAN or IDL algorithms, test the algorithms, and mine data in the data pool. With NADM, the GDAAC provides an environment physically close to the data source. NADM will benefit users with mining or offer data reduction algorithms by reducing large volumes of data before transmission over the network to the user.

Pham, Long↗

Aerosol and Cloud Observations and Data Products by the GLAS Polar Orbiting Lidar Instrument

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. The backscatter lidar operates at two wavelengths, 532 and 1064 nm. Both receiver channels meet and exceed their design goals, and beginning with a two month period through October and November 2003, an excellent global lidar data set now exists. The data products for atmospheric observations include the calibrated, attenuated backscatter cross section for cloud and aerosol; height detection for multiple cloud layers; planetary boundary layer height; cirrus and aerosol optical depth and the height distribution of aerosol and cloud scattering cross section profiles. The data sets are now in open release through the NASA data distribution system. The initial results on global statistics for cloud and aerosol distribution has been produced and in some cases compared to other satellite observations. The sensitivity of the cloud measurements is such that the 70% global cloud coverage result should be the most accurate to date. Results on the global distribution of aerosol are the first that produce the true height distribution for model inter-comparison.

Spinhirne, J. D.↗

Performance Year 1 Technical Report - OPEN COG Grid: Extendable Coherent Models-Datasets for Cognitive Power Grids

The OPEN COG Grid project is a collaborative effort between LLNL, NREL, and Texas A&M University (TAMU) to develop synthetic power system datasets that (i) contain all technical information that would be available in a real system, allowing to conduct studies ranging from dynamic simulation to long term planning studies; ii) are accessible to researchers from the broader data sciences community, as oppossed to power system experts only; and (iii) This report summarizes the work conducted during the first 15 months of execution of the project. These activities encompassed: 1. Conduct a survey of existing open data sets and open source power systems simulators, their supported use cases, and accessibility (Chapter 1). 2. Define a new extensible specification for power system data, covering all parameters necessary for most computational use cases (Chapter 2). 3. Collecting real technical system data to complete missing parameters in existing open source datasets (Chapter 3). 4. Develop models that capture the behavior of emergent actors in power grids, neglected by existing datasets; aggregated residential demand response (Chapter 4) and demand response of cryptocurrency miners (Chapter 5). 5. Collect detailed spatial information on distributed energy resources, particular, solar photovoltaic facilities (Chapter 6). The following chapters provide detailed descriptions of these tasks, the assumptions taken, and their findings. In conducting these tasks, the project team produced: two (accepted) conference papers; one journal paper under submission; one draft journal paper pending submission; released one repository with the developed power system data specification, with documentation and examples; and one extended dataset for the Texas power grid under review for release. The team hopes these contributions will enhance access to power system data and remove barriers to the development of new computational techniques for power systems, particularly, those inspired by cognitive sciences.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Spring 2021 Sea Ice Transport in the Southern Beaufort Sea Occurred During Coastal Lead Opening Events

Winds blew a record large portion of the Arctic’s multiyear sea ice (MYI) into the southern Beaufort Sea (SBS) in winter 2021. From early March, a network of buoys from the Sea Ice Dynamic Experiment (SIDEx) tracked the MYI as it drifted across the SBS toward the Chukchi Sea. Transport was episodic as the consolidated ice pack interacted with coastal boundaries and repeatedly fractured. We investigated variability in 2021 MYI transport by relating in situ sea ice drift to remotely sensed coastal lead opening events, which have been associated with increased ice drift speeds in winter. Daily ice concentration data show ten opening events occurred throughout March and April 2021. Opening lasted 1-5 consecutive days as southeasterly winds pushed the SBS ice pack away from coastal boundaries. During opening, the ice pack abruptly accelerated and its response to wind forcing stabilized around free drift conditions, drifting at 2.1 % of wind speeds (median rate of 13.7 km d −1 ). With this efficient wind-to-ice momentum transfer, nearly all (94 %) alongshore MYI transport in March-April 2021 occurred during opening events, which comprised just half of March-April days. Only 6 % of transport occurred during the other half of days without observed opening. On these days, the ice was mostly stationary (median 1.7 km d −1 drift rate, 0.6 % of wind speeds) as northwesterly winds compressed the pack against the coast. Spatiotemporal discontinuities in ice-wind speed ratios were measured across several coastal leads that transected the SIDEx buoy network, providing direct observations of changes in ice drift regime as coastal leads opened. These results quantify the disproportionate contribution of offshore and alongshore winds in breaking the SBS ice pack away from the coast, opening leads, and driving SBS ice transport during spring 2021, highlighting the critical role these episodic events play in consolidation season sea ice drift.

Oceanography↗

Scalable GPS Data Logging To Support Advanced Fleet Analysis

This highlight details the key takeaways from a project that utilized NLR's Fleet Research, Energy Data, and Insights (FleetREDI) data analysis pipeline. National Laboratory of the Rockies researchers developed and demonstrated low-cost, open-source Arduino data loggers with 3D-printed cases that are compatible with global navigational systems and built with components available ubiquitously worldwide, enabling cost-effective collection and analysis of fleet operational data. Validated on an overseas transit bus fleet, NLR analysis showed that, with sufficient charging opportunities, 90% of observed duty cycles could be accomplished by electric buses with no modifications to operations.

33 ADVANCED PROPULSION SYSTEMS↗

Detection And Avoidance Of Obstacles By Helicopters

Report discusses problems relevant to control subsystems enabling helicopters on nap-of-the-Earth flight paths to detect and avoid obstacles automatically. Indicates similarities between this and obstacle-avoidance problem of industrial mobile robots. Two approaches extend two-dimensional obstacle-avoidance concept to three dimensions. First involves direct search of three-dimensional range-map data for indications of openings between obstacles. Second involves compression of data into two-dimensional map for path search.

Cheng, Victor H. L.↗

Open Science in Action: The Role of SWxSOC in Expedited Data Release and Cloud-based Data Processing for Heliophysics Missions

NASA's Space Weather Science Operations Center (SWxSOC) is an effort to develop a multi-mission Science Operations Center for the community and specifically Space Weather missions that require data products to be released consistently and quickly. The SWxSOC is committed to Open Science in its approach to software development and data product releases. We are currently supporting the Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) that will fly on the Lunar Gateway and the PADRE Small Sat mission. SWxSOC has established an open-source, reusable solution for transitioning data management from on-premises to the cloud, processing data files, and setting up a cloud-based analysis environment to monitor instrument anomalies. Leveraging Amazon Web Services (AWS) and making open-source tools available on GitHub, HERMES exemplifies NASA's commitment to open-source standardization, showcasing the real-world effectiveness of cloud technology in data processing, analysis, and observability. This enhances current operations and ensures faster, standardized deployments for future missions.

hermes↗

Event generators for high-energy physics experiments

We provide an overview of the status of Monte-Carlo event generators for high-energy particle physics. Guided by the experimental needs and requirements, we highlight areas of active development, and opportunities for future improvements. Particular emphasis is given to physics models and algorithms that are employed across a variety of experiments. These common themes in event generator development lead to a more comprehensive understanding of physics at the highest energies and intensities, and allow models to be tested against a wealth of data that have been accumulated over the past decades. A cohesive approach to event generator development will allow these models to be further improved and systematic uncertainties to be reduced, directly contributing to future experimental success. Event generators are part of a much larger ecosystem of computational tools. They typically involve a number of unknown model parameters that must be tuned to experimental data, while maintaining the integrity of the underlying physics models. Making both these data, and the analyses with which they have been obtained accessible to future users is an essential aspect of open science and data preservation. It ensures the consistency of physics models across a variety of experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A note on the effect of reflected solar radiation on airborne and ground measurements in the thermal infrared

The magnitude of thermal solar radiation reflected from water surfaces is considered. It is shown both theoretically and by field observation that, for instruments with small fields of view, the reflected thermal solar radiation can contribute significantly to the measured energy. Comparison of thermal scanner data taken from aircraft at a 16 deg azimuth angle from the mirror point of the sun over the open ocean with data taken at a 164 deg anzimuth angle from the mirror point of the sun at the same angle from nadir is indicative of a difference of 2.8 K in the equivalent black body radiation temperature. Observations taken from a surface vessel into sunglint 80 deg from nadir are indicative of an equivalent black body radiation temperature that is 34 K warmer than the temperature obtained at a similar nadir angle away from the sunglint.

Whitehead, V. S.↗

Earth Science Informatics Comes of Age

The volume and complexity of Earth science data have steadily increased, placing ever-greater demands on researchers, software developers and data managers tasked with handling such data. Additional demands arise from requirements being levied by funding agencies and governments to better manage, preserve and provide open access to data. Fortunately, over the past 10-15 years significant advances in information technology, such as increased processing power, advanced programming languages, more sophisticated and practical standards, and near-ubiquitous internet access have made the jobs of those acquiring, processing, distributing and archiving data easier. These advances have also led to an increasing number of individuals entering the field of informatics as it applies to Geoscience and Remote Sensing. Informatics is the science and technology of applying computers and computational methods to the systematic analysis, management, interchange, and representation of data, information, and knowledge. Informatics also encompasses the use of computers and computational methods to support decisionmaking and other applications for societal benefits.

Jodha, Siri↗

Geocuration Lessons Learned from the Climate Data Initiative Project

Curation is traditionally defined as the process of collecting and organizing information around a common subject matter or a topic of interest and typically occurs in museums, art galleries, and libraries. The task of organizing data around specific topics or themes is a vibrant and growing effort in the biological sciences but to date this effort has not been actively pursued in the Earth sciences. This presentation will introduce the concept of geocuration, which we define it as the act of searching, selecting, and synthesizing Earth science data/metadata and information from across disciplines and repositories into a single, cohesive, and useful compendium. We also present the Climate Data Initiative (CDI) project as an prototypical example. The CDI project is a systematic effort to manually curate and share openly available climate data from various federal agencies. CDI is a broad multi-agency effort of the U.S. government and seeks to leverage the extensive existing federal climate-relevant data to stimulate innovation and private-sector entrepreneurship to support national climate change preparedness. The geocuration process used in the CDI project, key lessons learned, and suggestions to improve similar geocuration efforts in the future will be part of this presentation.

climate↗

Climate Data Initiative: A Geocuration Effort to Support Climate Resilience

Curation is traditionally defined as the process of collecting and organizing information around a common subject matter or a topic of interest and typically occurs in museums, art galleries, and libraries. The task of organizing data around specific topics or themes is a vibrant and growing effort in the biological sciences but to date this effort has not been actively pursued in the Earth sciences. In this paper, we introduce the concept of geocuration and define it as the act of searching, selecting, and synthesizing Earth science data/metadata and information from across disciplines and repositories into a single, cohesive, and useful collection. We present the Climate Data Initiative (CDI) project as a prototypical example. The CDI project is a systematic effort to manually curate and share openly available climate data from various federal agencies. CDI is a broad multi-agency effort of the U.S. government and seeks to leverage the extensive existing federal climate-relevant data to stimulate innovation and private-sector entrepreneurship to support national climate-change preparedness. We describe the geocuration process used in the CDI project, lessons learned, and suggestions to improve similar geocuration efforts in the future.

Metada↗

Climate Data Initiative: A Geocuration Effort to Support Climate Resilience

Curation is traditionally defined as the process of collecting and organizing information around a common subject matter or a topic of interest and typically occurs in museums, art galleries, and libraries. The task of organizing data around specific topics or themes is a vibrant and growing effort in the biological sciences but to date this effort has not been actively pursued in the Earth sciences. In this paper, we introduce the concept of geocuration and define it as the act of searching, selecting, and synthesizing Earth science data/metadata and information from across disciplines and repositories into a single, cohesive, and useful compendium We present the Climate Data Initiative (CDI) project as an exemplar example. The CDI project is a systematic effort to manually curate and share openly available climate data from various federal agencies. CDI is a broad multi-agency effort of the U.S. government and seeks to leverage the extensive existing federal climate-relevant data to stimulate innovation and private-sector entrepreneurship to support national climate-change preparedness. We describe the geocuration process used in CDI project, lessons learned, and suggestions to improve similar geocuration efforts in the future.

virtual collections↗

The Earth System Grid Federation : an Open Infrastructure for Access to Distributed Geospatial Data

The Earth System Grid Federation (ESGF) is a multi-agency, international collaboration that aims at developing the software infrastructure needed to facilitate and empower the study of climate change on a global scale. The ESGF's architecture employs a system of geographically distributed peer nodes, which are independently administered yet united by the adoption of common federation protocols and application programming interfaces (APIs). The cornerstones of its interoperability are the peer-to-peer messaging that is continuously exchanged among all nodes in the federation; a shared architecture and API for search and discovery; and a security infrastructure based on industry standards (OpenID, SSL, GSI and SAML). The ESGF software is developed collaboratively across institutional boundaries and made available to the community as open source. It has now been adopted by multiple Earth science projects and allows access to petabytes of geophysical data, including the entire model output used for the next international assessment report on climate change (IPCC-AR5) and a suite of satellite observations (obs4MIPs) and reanalysis data sets (ANA4MIPs).

search,↗

2025 TEM Workshop

The TEM Data Management Workshop will take place on August 26 from 9 a.m. to 12 p.m. MT, and will be held virtually on TEAMS. The primary goal of this workshop is to engage NSUF users and stakeholders in discussions about the data needs for the utilization of AI and ML in the analysis of TEM data. Key topics to be covered include data storage, data sharing, data tagging, metadata inclusion, standardized data formats, data augmentation, and annotated training datasets. Additionally, the workshop will provide valuable insights into resources such as the Nuclear Research Data System (NRDS) for data storage and sharing, as well as open-source codes for data analysis.

Bachhav, Mukesh↗

Aerodynamics of seeing on large transport aircraft

Data were obtained in the full scale flight environment of the Kuiper Airborne Observatory (KAO) on the nature of turbulent shear layer over the open cavity. These data were used to verify proposed aerodynamic scaling relationships to describe the behavior of the turbulent layers and to estimate the optical performance of systems of various wavelengths operating within the KAO environment. These data and wind tunnel data are used to scale the expected optical effects for a potential stratospheric observatory for infrared astronomy (SOFIA) in which a telescope approximately 3.5 times larger than that on the KAO is envisioned. It appears that the use of combinations of active and passive aeromechanical flow control techniques can improve the optical behavior of systems in the SOFIA environment. Experiments to verify these potential improvements can be performed on the KAO with sufficient modifications to the cavity and aero-mechanical technique installations.

Rose, W. C.↗

Program Analyzes Crack-Growth Data

Crack Growth Rate Data Analysis program used for cyclis crack-growth testing of compact tension specimens. Program digitizes data on crack-opening displacement vs. load and reduces these into data on crack-growth rate vs. stress-intensity excursion. Written in HP BASIC.

Demonet, Charles M.↗