Search NASA⌕ Search

SEARCH · Search NASA

Results for “data sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Building near-real-time processing pipelines with the spark-MPI platform

Advances in detectors and computational technologies provide new opportunities for applied research and the fundamental sciences. Concurrently, dramatic increases in the three V's (Volume, Velocity, and Variety) of experimental data and the scale of computational tasks produced the demand for new real-time processing systems at experimental facilities. Recently, this demand was addressed by the Spark-MPI approach connecting the Spark data-intensive platform with the MPI high-performance framework. In contrast with existing data management and analytics systems, Spark introduced a new middleware based on resilient distributed datasets (RDDs), which decoupled various data sources from high-level processing algorithms. The RDD middleware significantly advanced the scope of data-intensive applications, spreading from SQL queries to machine learning to graph processing. Spark-MPI further extended the Spark ecosystem with the MPI applications using the Process Management Interface. The paper explores this integrated platform within the context of online ptychographic and tomographic reconstruction pipelines.

97 MATHEMATICS AND COMPUTING↗

DEEPEN Data Catalog for Magmatic Geothermal Systems in the United States

This data catalog contains information related to the Training Site Analysis for the Geothermica project "DE-risking Exploration of geothermal Plays in magmatic ENvironments (DEEPEN)." The DEEPEN project aims to reduce exploration risk for geothermal fluids in magmatic systems by developing improved an improved framework for interpretation of exploration data using the Play Fairway Analysis (PFA) methodology. The Training Site Analysis performed for DEEPEN leverages existing datasets to develop a customized PFA approach to exploration for multiple geothermal resource types in magmatic systems (conventional hydrothermal resources, supercritical fluid and superheated steam resources, and superhot EGS resources). This data catalog contains links to publicly available data files related to 8 training sites in the United States. US training sites are: the Cascades/Aleutians PFA project; the Hawaii PFA project, the Oregon Cascades PFA project, the Snake River Plain, Idaho PFA project, the Washington State PFA project, Newberry Volcano, Coso Geothermal Field, and the Geysers Geothermal field. This database contains an overview of these training sites, data sources, and links to publicly available exploration datasets. For the five PFA projects, details on exploration data related to PFA components (heat, fluid, permeability, sometimes seal) are provided, including a summary of data weighting methodologies.

15 GEOTHERMAL ENERGY↗

SBML Level 3: an extensible format for the exchange and reuse of biological models

Systems biology has experienced dramatic growth in the number, size, and complexity of computational models. To reproduce simulation results and reuse models, researchers must exchange unambiguous model descriptions. We review the latest edition of the Systems Biology Markup Language (SBML), a format designed for this purpose. A community of modelers and software authors developed SBML Level 3 over the past decade. Its modular form consists of a core suited to representing reaction-based models and packages that extend the core with features suited to other model types including constraint-based models, reaction-diffusion models, logical network models, and rule-based models. The format leverages two decades of SBML and a rich software ecosystem that transformed how systems biologists build and interact with models. More recently, the rise of multiscale models of whole cells and organs, and new data sources such as single-cell measurements and live imaging, has precipitated new ways of integrating data with models. We provide our perspectives on the challenges presented by these developments and how SBML Level 3 provides the foundation needed to support this evolution.

59 BASIC BIOLOGICAL SCIENCES↗

Soil and Water Chemistry and Trace Metal Extractability and Speciation in Wetland Soils from Illinois and South Carolina and Stream Sediments from Tennessee

Dataset revised on October 15, 2021. This revision adds sulfur and iron X-ray absorption near-edge structure spectra for the wetland soils and stream sediments from the field areas. It also renames the sample locations in a way that is more intuitive to readers of the companion paper that is under review. Finally, the data filenames and organization have been updated in their labeling to parallel the data sources in the associated paper. The abstract text and methods were also revised to reflect the data that was added to the dataset.Trace metals are essential for microbially-mediated biogeochemical processes occurring in anoxic wetland soils and stream bed sediments, such as denitrification, methanogenesis, and mercury methylation. Low availability of these elements may potentially inhibit key components of anaerobic carbon and nitrogen cycling and contaminant transformation. The solid-phase speciation of trace metals likely plays an important role in controlling their bioavailability. Metal speciation is well studied in contaminated soils and sediments as well as those naturally elevated in trace metals. However, less is known regarding the chemical forms of trace metals in systems having concentrations similar to geological background levels, the very settings where metal limitations may be most prevalent. We have investigated trace metal concentrations, extractability, and solid-phase speciation in three freshwater subsurface aquatic systems: marsh wetland soils, riparian wetland soils, and the sediments of a streambed.Data are provided for marsh wetland soils at Argonne National Laboratory, riparian wetland soils in the Tims Branch watershed at Savannah River National Laboratory, and stream bed sediments from East Fork Poplar Creek near Oak Ridge National Laboratory. Soil and sediment elemental abundances, mineralogy, and extractable nutrients as well as dissolved major elements, anions, trace metals, and nutrients in the overlying surface waters are provided. In addition, the results of sequential chemical extraction for the trace metals cobalt, nickel, copper, and zinc from the soils and sediment are reported as well as X-ray absorption near-edge structure (XANES) spectra in these materials are reported. To aid interpretation of these data, XANES spectra of sulfur in the soils and sediments as well as both XANES and extended X-ray absorption fine structure (EXAFS) spectra of iron in these materials are reported. The data package also includes the XANES spectra of reference standards and a potential interferent in the measurements. All data are provided in text-based CSV format with header sections indicating the data contained in each file and the corresponding units. Note that "u" is used in place of Greek lower case mu to indicate the micro prefix on units.

54 ENVIRONMENTAL SCIENCES↗

November 2021 Operational Highlights

Completed: 1. the initial tests of document workflows for Titan on the Red, which included standing up a software encryption capability to test data ingestion; 2. a software encryption capability in order to ingest the first data source by the end of the month; 3. a stand-alone computer for classified ontology data entry. Titan on the Red is an artificial intelligence/machine learning system to make digitizing, cataloging, and searching NSRC collections easier and more efficient. Created Online Vault backups, with one copy stored at LANL and one shipped to Lawrence Livermore National Laboratory. The Online Vault is a classified, searchable library of LANL’s nuclear weapons design and test history. Imported new Laboratory Directed Research and Development (LDRD) documents based on revised access categories. Bulk ingested nearly 10,000 documents via java-based PowerLoader. This application ingests metadata and content into the Online Vault to meet the requirements for the NSRC collections. Rehoused 300 linear feet of weapons physics documents in archival, acid-free storage folders and boxes.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Intercomparisons of temperature, density and wind measurements from in situ and satellite techniques

Atmospheric temperature, density, and wind data retrieved by various means are intercompared, covering the 1980-1984 period. The study encompasses such data sources as radiosonde, rocketsonde, in situ measurements, remote measurements, satellites, and NOAA-6 and 7 TOVS data. Larger temperature differences (up to 7-8 K) are noted for the rocketsonde/satellite comparison than for the radiosonde/satellite comparison (less than 1 K). The rocketsonde measurements were found to be internally consistent to less than 1 K up to 50 km and to less than 3 K up to 60 km. A general agreement of the density data obtained from small rocketsondes and large sounding rocket systems is suggested to be within 15 percent up to 85 km of altitude. The usefulness of intermixing the measurements of the various atmospheric parameters obtained from different instruments is emphasized, and some suggestions are made concerning the approaches to such intermixing.

Schmidlin, F. J.↗

Dynamic and static initialization of a mesoscale model using VAS satellite data

Various combinations of temperature and moisture data from the VISSR Atmospheric Sounder (VAS), conventional radiosonde data, and National Meteorological Center (NMC) global analysis, were used in a successive-correction type of objective-analysis procedure to produce analyses for 1200 GMT. The NMC global analyses served as the first-guess field for all of the objective analysis procedures. The first-guess field was enhanced by radiosonde data alone, VAS data alone, both radiosonde and VAS data, or by neither data source. In addition, two objective analyses were used in a dynamic initialization: one included only radiosonde data and the other used both radiosonde and VAS data. The dependence of 12 hour forecast skill on data type and the methods by which the data were used in the analysis/initialization were then investigated. This was done by comparison of forecast and observed fields, of sea-level pressure, temperature, wind, moisture, and accumulated precipitation. The use of VAS data in the initial conditions had a slight positive impact upon forecast temperature and moisture but a negative impact upon forecast wind. This was true for both the static and dynamic initialization experiments. Precipitation forecasts from all of the model simulations were nearly the same.

Beauchamp, James G.↗

A survey of geographical information systems applications for the Earth Science and Applications Division, Space Sciences Laboratory, Marshall Space Flight Center

The purpose of this document is to introduce Geographical Information System (GIS) terminology and summarize interviews conducted with scientists in the Earth Science and Applications Division (ESAD). There is a growing need in ESAD for GIS technology. With many different data sources available to the scientists comes the need to be able to process and view these data in an efficient manner. Since most of these data are stored in vastly different formats, specialized software and hardware are needed. Several ESAD scientists have been using a GIS, specifically the Man-computer Interactive Data Access System (MCIDAS). MCIDAS can solve many of the research problems that arise, but there are areas of research that need more powerful tools; one such example is the multispectral image analysis which is described in this document. Given the strong need for GIS in ESAD, we recommend that a requirements analysis and implementation plan be developed using this document as a basis for further investigation.

Rickman, D.↗

Open clusters as laboratories: The angular momentum evolution of young stars

This is the annual status report for the third year of our LTSA grant 'Open Clusters as Laboratories.' Because we have now had a few years to work on the project, we have started to produce and publish a large number of papers. We have been extremely successful in obtaining ROSAT observations of open clusters. With the demise of the PSPC on ROSAT, our main data source has come to an end and we will be able to concentrate on analyzing those data.

Stauffer, John R.↗

Remote Sensing Education and Development Countries: Multilateral Efforts through the Committee on Earth Observation Satellites (CEOS)

The Committee on Earth Observation Satellites (CEOS) is an international organization which coordinates space-based Earth observations world wide. Created in 1984, CEOS now comprises 38 national space agencies, regional organizations and international space-related and research groups. The aim of CEOS is to achieve international coordination in the planning of satellite missions for Earth observation and to maximize the utilization of data from these missions world-wide. With regard to developing countries, the fundamental aim of CEOS is to encourage the creation and maintenance of indigenous capability that is integrated into the local decision-making process, thereby enabling developing countries to obtain the maximum benefit from Earth observation. Obtaining adequate access to remote sensing information is difficult for developing countries and students and teachers alike. High unit data prices, the specialized nature of the technology , difficulty in locating specific data, complexities of copyright provisions, the emphasis on "leading edge" technology and research, and the lack of training materials relating to readily understood application are frequently noted obstacles. CEOS has developed an education CD-ROM which is aimed at increasing the integration of space-based data into school curricula, meeting the heretofore unsatisfied needs of developing countries for information about Earth observation application, data sources and future plans; and raising awareness around the world of the value of Earth observation data from space. The CD-ROM is designed to be used with an Internet web browser, increasing the information available to the user, but it can also be used on a stand-alone machine. It contains suggested lesson plans and additional resources for educators and users in developing countries.

Charles, Leslie Bermann↗

Mars Structural and Stratigraphic Mapping along the Coprates Rise

This geologic mapping project supports a topical study of structures in east Thaumasia associated with the Coprates rise. The study examines cuesta-like features on the east flank of the Coprates rise first identified by Saunders et al. [1]. Mapping combines detailed local stratigraphy, structural geology and topography. Hogbacks and cuestas indicate erosion of tilted rock units. The extent of the erosion will be determined in the course of the mapping. The region of interest lies along the eastern margin of Thaumasia bounded by latitudes -15 and -35 and longitudes 50 to 70 W (Figure 1). Three MTM geologic quadrangles are being compiled for publication by the USGS (-20057, -25057, -30057). All existing data sources are used including THEMIS, MOC, CTX, HiRISE, MOLA and gravity, as well as higher level data available through the PDS data nodes at ASU, UA and Washington University. The extremely valuable ASU JMARS tools are used for analysis of many of the data sets. ArcGIS software has been obtained and is being learned for the map compilation.

Saunders, R Stephen↗

Open Source Mission Control for Chrome

New technology presents the possibility to evolve mission control. WARP (Web Applications for Resource Prospector) a new open source toolset for mission visualization, brings mission control to the Chrome Web Browser. WARP integrates multiple data sources into a coherent visualization toolset from which users may assemble their own software, thus giving mission controllers more flexibility. This frees us to operate based on mission needs, rather than constraints enforced by software application boundaries.

software engineering↗

Machine Learning in the Big Data Era: Are We There Yet?

In this paper, we discuss the machine learning challenges of the Big Data era. We observe that recent innovations in being able to collect, access, organize, integrate, and query massive amounts of data from a wide variety of data sources have brought statistical machine learning under more scrutiny and evaluation for gleaning insights from the data than ever before. In that context, we pose and debate the question - Are machine learning algorithms scaling with the ability to store and compute? If yes, how? If not, why not? We survey recent developments in the state-of-the-art to discuss emerging and outstanding challenges in the design and implementation of machine learning algorithms at scale. We leverage experience from real-world Big Data knowledge discovery projects across domains of national security and healthcare to suggest our efforts be focused along the following axes: (i) the data science challenge - designing scalable and flexible computational architectures for machine learning (beyond just data-retrieval); (ii) the science of data challenge the ability to understand characteristics of data before applying machine learning algorithms and tools; and (iii) the scalable predictive functions challenge the ability to construct, learn and infer with increasing sample size, dimensionality, and categories of labels. We conclude with a discussion of opportunities and directions for future research.

Big Data↗

Presentation Extensions of the SOAP

A set of extensions of the Satellite Orbit Analysis Program (SOAP) enables simultaneous and/or sequential presentation of information from multiple sources. SOAP is used in the aerospace community as a means of collaborative visualization and analysis of data on planned spacecraft missions. The following definitions of terms also describe the display modalities of SOAP as now extended: In SOAP terminology, View signifies an animated three-dimensional (3D) scene, two-dimensional still image, plot of numerical data, or any other visible display derived from a computational simulation or other data source; a) "Viewport" signifies a rectangular portion of a computer-display window containing a view; b) "Palette" signifies a collection of one or more viewports configured for simultaneous (split-screen) display in the same window; c) "Slide" signifies a palette with a beginning and ending time and an animation time step; and d) "Presentation" signifies a prescribed sequence of slides. For example, multiple 3D views from different locations can be crafted for simultaneous display and combined with numerical plots and other representations of data for both qualitative and quantitative analysis. The resulting sets of views can be temporally sequenced to convey visual impressions of a sequence of events for a planned mission.

Carnright, Robert↗

Development and Preliminary Analysis of a U.S. Geothermal Heat Pump Installation Database

This paper seeks to addresses the significant gap in the literature regarding the installation and adoption of geothermal heat pump (GHP) systems in the United States. While the "2021 U.S. Geothermal Power Production and District Heating Market Report" published by the National Renewable Energy Laboratory (NREL) focused on direct-use geothermal district heating systems, it did not include an analysis of GHP installations (Robins et al. 2021). To bridge this gap, NREL has compiled a novel database currently containing 70,470 records of GHP installations, primarily sourced from state well permits and small-scale studies. Our methodology emphasizes the collection, cleaning, and standardization of data, addressing challenges such as inconsistent reporting formats and privacy concerns. Despite limitations in data on capacity, costs, and performance, our preliminary geospatial analysis reveals insights into the distribution of GHP systems across urban and rural areas and climate zones. The paper highlights the importance of publicly accessible data for advancing GHP technology adoption with a discussion of existing data sources and their limitations, advocating for improved collaboration between NREL and industry stakeholders.

data collection↗

Archi: Agentic Operations at the CMS Experiment

We present Archi, an open-source, end-to-end framework for scientific collaborations that combines the systematic ingestion and organization of heterogeneous data sources with the deployment of configurable, private, and extensible agents that retrieve and reason over them. An instance of Archi has been deployed for the Computing Operations team of the CMS experiment at CERN's LHC since February 2026 as a support agent for technical operators, offering retrieval and analysis capabilities by combining documentation, historical data, and live monitoring systems. We evaluate the system on operator feedback and a question set collected from production usage, graded by human and automated panels. The system proves effective at operational tasks, resolving real-world queries posed by CMS operators. We also observe that locally-hosted, open-weight models perform competitively, enabling fully private management of sensitive data.

Lugato, Pietro [MIT; CERN]↗

An Adaptive Middleware Framework for Scientific Computing at Extreme Scales

Large computing systems including clusters, clouds, and grids, provide high-performance capabilities that can be utilized for many applications. But as the ubiquity of these systems increases and the scope of analysis being done on them grows, there is a growing need for applications that 1) do not require users to learn the details of high performance systems, and 2) are flexible and adaptive in their usage of these systems to accommodate the best time-to-solution for end users. We introduce a new adaptive interface design and a prototype implementation within the framework of an established middleware framework, MeDICi, for high performance computing systems and describe the applicability of this adaptive design to a real-life scientific workflow. This adaptive framework provides an access model for implementing a processing pipeline using high performance systems that are not local to the data source, making it possible for the compute capabilities at one site to be applied to analysis on data being generated at another site in an automated process. This adaptive design improves overall time-to-solution by moving the data analysis task to the most appropriate resource dynamically, reacting to failures and load fluctuations.

97 MATHEMATICS AND COMPUTING↗