Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Online and Offline Data Quality Monitoring for the Mu2e Calorimeter

This thesis presents the design, implementation, and validation of a calorimeter Data Quality Monitoring (DQM) toolchain for the Mu2e experiment at Fermilab. Mu2e searches for charged lepton flavor violation via coherent muon-to-electron conversion in the field of an aluminum nucleus, $\mu^- Al \rightarrow e^-Al$, a process whose observation would constitute clear evidence of physics beyond the Standard Model. Achieving target sensitivity requires stringent control of detector performance and data integrity during acquisition, as subtle issues in readout configuration, data formatting, or electronics behavior can compromise reconstruction and bias downstream analyzes. To address these challenges, this work develops a multi-layer DQM approach spanning both raw data validation and reconstructed digi-level diagnostics. At the low level, a fragment analysis component performs word- and bit-field decoding of calorimeter readout blocks, enabling sanity checks of the expected structure and producing detailed error and integrity statistics useful for commissioning and troubleshooting. At the digi level, the CaloDigiDQM analyzer is implemented within the art framework and transforms each CaloDigiCollection into a structured hierarchy of ROOT histograms designed for fast drill-down diagnostics. The module generates coherent monitoring views at global, disk, board, and channel granularity, including occupancy, waveform-derived features (baseline, RMS, peak amplitude and position), and left-right sensor consistency metrics. Detector-aware channel-to-electronics mapping is performed through the conditions system (CaloDAQMap), ensuring that diagnostics remain aligned with hardware identifiers used in operations. For end-to-end testing without reliance on live DAQ data, a synthetic CaloDigi producer is developed to generate realistic waveforms with controlled noise and pulse shapes. The resulting system supports both offline ROOT-file production and online operation, including optional histogram streaming through otsdaq via ots::HistoSender. This toolchain provides a practical and scalable foundation for calorimeter commissioning and stable data collection, enabling early detection of anomalies and reducing operational risk for Mu2e.

Vakulenko, Mark [Drew U.] (ORCID:0009000276197818)↗

Marmot

Marmot is a data formatting and visualization tool for production cost modelling results. It provides an efficient way to view PLEXOS production cost modeling results quickly, while also creating publication ready figures and data tables.

Levie, Daniel↗

NCSU Flux Tower Data

NCSU Flux Tower Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument descripotion Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Sonic Anemometer, 3 Condensation Particle Counters, 1 SP2, 1 POPS Start Date: 2022-06-01 End Date: 2022-9-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU flux tower was located next to the AMF sampling pad. The flux tower consisted of a 10 m telescoping tower. Mounted at the top of the tower was a sonic anemometer (RM Young 8000) and a Krypton Hygrometer. A sample line (¼” conductive tubing) and communication line was laid to a trailer located underneath and slightly adjacent to the tower. The sample line brought aerosol inside the trailer at 4.5 L min-1, where it was distributed between 3 CPCs (TSI 3776c, Dc ~ 2.5 nm, TSI 3771, Dc ~10nm, and TSI 3772, Dc ~40 nm) with different size cuts. Also sampling was a printed particle optical spectrometer (POPS) and a single particle soot photometer (SP2). Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU RDMA data

NCSU RDMA Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Nano-Scanning Mobility Particle (SMPS); A Radial Differential Mobility Analyzer (RDMA) coupled with 1 Condensation Particle Counter Start Date: 2022-06-01 End Date: 2022-9-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU RDMA was operated at a sheath-to-sample flow ratio of 5:1.5 L min−1. The RDMA was configured to scan from 5 to 55 nm. It was located into the temperature-controlled trailer adjacent to the NCSU Flux Tower to observe size distributions of the aerosols.The sample line was dried with three silica-gel driers in series, and then neutralized with X-ray neutralizer. Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU HTDMA data

NCSU HTDMA data Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Humidified Tandem Differential Mobility Analyzer; 2 Differential Mobility Analyzers (DMA1 and DMA2). Start Date: 2022-06-01 End Date: 2022-09-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU HTDMA was operated at a sheath-to-sample flow ratio of 5:1 L min−1. The HTDMA was configured to measure hygroscopic growth factors of dry particles with mobility diameters of D = 15, 20, 30, 40, and 50 nm at RH ~ 70%. A complete cycle for all diameters took ~30 minutes. A sample line brought aerosol inside the trailer at 2.5 L min-1, where it was distributed between NCSU RDMA (1.5 L min-1) and NCSU HTDMA (1 L min-1) lines. The sample line was dried with three silica-gel driers in series, and then neutralized with X-ray neutralizer. The sample line entered DMA1 (operated as an electrostatic classifier). Monodisperse particles with certain fractions were humidified with temperature controlled Nafion membrane immersed in water before entering DMA2 (operated in scanning mobility particle sizer). Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU Black Carbon (SP2) Data

NCSU SP2 Data Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Single Particle Soot Photometer (SP2) Start Date: 2022-06-01 End Date: 2022-09-27 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The SP2 was located in the temperature-controlled trailer adjacent to the NCSU Flux Tower to observe refractory black carbon (rBC) number concentration and mixing states of black carbon. The sample line brought aerosol inside the trailer at 4.5 L min-1, where it was distributed between 3 CPCs (TSI 3776c, Dc ~ 2.5 nm, TSI 3771, Dc ~10nm, and TSI 3772, Dc ~40 nm) with different size cuts, a printed particle optical spectrometer (POPS), and SP2. Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

Interactive Web Application for Traffic Simulation Data Management and Visualization

As traffic simulation software becomes more effective for realistically simulating and analyzing traffic dynamics and vehicle interactions on the mesoscopic and microscopic level, the management, dissemination, and collaborative visualization of traffic simulation results produced by individual transportation planners presents a significant challenge. Existing online content management systems have a very limited capability in allowing users to query specific traffic simulation scenarios and geospatially visualize simulation results through shareable and interactive web interfaces. This paper presents a web-based application for promoting the archiving, sharing, and visualization of large-scale traffic simulation outputs. The application is developed to enhance cyber-physical controls, communications, and public education for collaborative transportation planning. Unique features of the web application include: (a) allowing users to upload their new traffic simulation scenarios (parameters and outputs), as well as search existing scenarios using easily accessible interfaces; (b) optimizing simulation output files with heterogeneous data formats and projected coordinate systems for web-based storage and management using a scalable and searchable data/metadata standard; (c) standardizing user-uploaded simulation outputs using web interfaces and data processing libraries with parallel computing capacity; and (d) providing shareable web visual interfaces for visualizing the traffic flow and signal information stored in simulation outputs (e.g., regional traffic patterns and individual vehicle interactions) and visually comparing multiple simulation outputs both spatially and temporally. Furthermore, the paper presents the conceptual design and implementation of this application, and demonstrates the application’s performance for sharing, comparing, and visualizing simulation outputs from VISSIM and SUMO, two commonly used traffic simulation software programs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Implementation of TSL Evaluations Beyond the Incoherent Approximation [Slides]

This presentation discusses the motivation behind the project, which is to facilitate the production of TSL libraries that contain high fidelity physics including coherent inelastic effects, such as graphite and beryllium. High fidelity TSL libraries are of interest in various applications, for example in relation to neutron scattering instrument response analysis and directional biases (reflection) in neutronic analysis. In summation, the removal of typical approximations, in terms of incoherent, cubic, and atom site are examined. The application of generalized equations to crystalline graphite and beryllium TSL evaluations and the validation of data and data formats is also discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Mortar: An Open Testbed for Portable Building Analytics

Access to large amounts of real-world data has long been a barrier to the development and evaluation of analytics applications for the built environment. Open datasets exist, but they are limited in their span (how much data is available) and context (what kind of data is available and how it is described). Evaluation of such analytics is also limited by how the analytics themselves are implemented, often using hard-coded names of building components, points and locations, or unique input data formats. To advance the methodology for how such analytics are implemented and evaluated, we present Mortar: an open testbed for portable building analytics, currently spanning 90 buildings and containing over 9.1 billion data points. All buildings in the testbed are described using Brick, a recently developed metadata schema, providing rich functional descriptions of building assets and subsystems. We also propose a simple architecture for writing portable analytics applications that are robust to the diversity of buildings and can configure themselves based on context. We demonstrate the utility of Mortar by implementing 11 applications from the literature.

47 OTHER INSTRUMENTATION↗

Grid Optimization Competition Challenge 3 Problem Formulation

This report contains the problem formulation for the Grid Optimization (GO) Competition Challenge 3. The Grid Optimization Competition is run by a team of researchers from a number of organizations, including the sponsor Advanced Research Projects Agency - Energy (ARPA-E), lead organization Pacific Northwest National Laboratory (PNNL), and technical contributors from Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), Texas A&M University (TAMU), Georgia Institute of Technology (GT), University of Wisconsin (UW), and others. The GO Competition poses challenge problems in the field of power grid management, invites entrants to develop solvers for these problems, invokes the solvers on a set of problem instances using common hardware, ranks the solvers according to their performance, and awards prizes according to the rankings. The overall goal of the GO Competition is to spur innovative research on high impact and computationally challenging problems in power grid management from initial development through commercial deployment. Complete information about the GO Competition can be found online at [2]. The webpage covers previous Challenges, rules, timeline, registration information, data formats, scoring methods, computational platform information, information on supported solvers and languages, sponsor information, frequently asked questions, administrator contact information, publicly available problem instances, computer code for reading and evaluating problem and solution data, a sandbox for testing solvers, and a solver submission interface, results, and publications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Biolink Model: A universal schema for knowledge graphs in clinical, biomedical, and translational science

Abstract Within clinical, biomedical, and translational science, an increasing number of projects are adopting graphs for knowledge representation. Graph‐based data models elucidate the interconnectedness among core biomedical concepts, enable data structures to be easily updated, and support intuitive queries, visualizations, and inference algorithms. However, knowledge discovery across these “knowledge graphs” (KGs) has remained difficult. Data set heterogeneity and complexity; the proliferation of ad hoc data formats; poor compliance with guidelines on findability, accessibility, interoperability, and reusability; and, in particular, the lack of a universally accepted, open‐access model for standardization across biomedical KGs has left the task of reconciling data sources to downstream consumers. Biolink Model is an open‐source data model that can be used to formalize the relationships between data structures in translational science. It incorporates object‐oriented classification and graph‐oriented features. The core of the model is a set of hierarchical, interconnected classes (or categories) and relationships between them (or predicates) representing biomedical entities such as gene, disease, chemical, anatomic structure, and phenotype. The model provides class and edge attributes and associations that guide how entities should relate to one another. Here, we highlight the need for a standardized data model for KGs, describe Biolink Model, and compare it with other models. We demonstrate the utility of Biolink Model in various initiatives, including the Biomedical Data Translator Consortium and the Monarch Initiative, and show how it has supported easier integration and interoperability of biomedical KGs, bringing together knowledge from multiple sources and helping to realize the goals of translational science.

60 APPLIED LIFE SCIENCES↗

Automated Generation of Graph-based Cyber Threat Intel

With the advancement of AI technology and tools, specifically in the cybersecurity domain, both cyber defenders and threat actors are continuously adapting the use of these capabilities to expedite their operations. With this phenomenon, threat intelligence that is up to date, refreshable, and has relevant context to a specific threat becomes more and more important as it enables cybersecurity professionals to gain insight into relevant data and relationships to guide their operations. This project enables users to frequently aggregate threat intelligence from various sources, such as vendor vulnerability advisories affecting critical infrastructure, malware reports, and adversary writeups into a centralized, standardized database. The project utilizes the Structured Threat Intelligence eXpression (STIX) for a standardized, shareable threat intelligence data format and Neo4j as a graph database solution to store STIX nodes and relationships. Initial results of the project include datasets of over 8,000 nodes and 20,000 relationships extracted from over 500 data sources that have been released within the past month.

Threat Intelligence↗

Blue Keanu: A Scientific Visualization Tool For Network Data

This software allows the user to visualize complex PCAP-ng files captured from network capture software such as Wireshark. The visualization runs in a GUI window that can be zoomed or moved to areas of interest in a waterfall type display. The user then can see an area of interest that looks different than the typical traffic visually, such as a human interaction or non-repetitive area of data. The program will tell the user the packet number and byte offset of interest for fast analysis of discrete atomic or non-random events. This is particularly useful for visualization of unknown binary format data, such as in PLC or SCADA protocols that may have human or other non-repetitive activity for further analysis, reverse engineering, or fast forensic analysis.

Durller, MichaelGeorge↗

pvlib iotools—Open-source Python functions for seamless access to solar irradiance data

Access to accurate solar resource data is critical for numerous applications, including estimating the yield of solar energy systems, developing radiation models, and validating irradiance datasets. However, lack of standardization in data formats and access interfaces across providers constitutes a major barrier to entry for new users. pvlib python’s iotools subpackage aims to solve this issue by providing standardized Python functions for reading local files and retrieving data from external providers. All functions follow a uniform pattern and return convenient data outputs, allowing users to seamlessly switch between data providers and explore alternative datasets. The pvlib package is community-developed on GitHub: https://github.com/pvlib/pvlib-python. As of pvlib python version 0.9.5, the iotools subpackage supports 12 different datasets, including ground measurement, reanalysis, and satellite-derived irradiance data. The supported ground measurement networks include the Baseline Surface Radiation Network (BSRN), NREL MIDC, SRML, SOLRAD, SURFRAD, and the US Climate Reference Network (CRN). Additionally, satellite-derived and reanalysis irradiance data from the following sources are supported: PVGIS (SARAH & ERA5), NSRDB PSM3, and CAMS Radiation Service (including McClear clear-sky irradiance).

14 SOLAR ENERGY↗

21 cm Power Spectrum Analysis of North Celestial Pole Observations with the Tianlai Dish Pathfinder Array

The Tianlai Dish Pathfinder Array (TDPA) is a radio interferometer designed to test techniques for 21 cm intensity mapping in the post-reionization Universe as a means of measuring large-scale cosmic structure. Using nine nights of observations targeting the North Celestial Pole field, totaling approximately 107 hr of integration time, we analyze data in the frequency range 700–800 MHz (corresponding to redshift z ∼ 0.9). We do the data format conversion, radio frequency interference flagging, calibration, imaging and point source subtraction, and foreground removal via Singular Value Decomposition. The spherically averaged power spectrum Δ 2 (k) is obtained. Furthermore, this work successfully establishes and validates a comprehensive data analysis framework for the TDPA. We identify key improvements including sky model refinement, increased integration time, and pipeline optimization that will enable future detection of the 21 cm signal through auto-correlation and cross-correlation with optical galaxy surveys.

cosmology: large-scale structure of universe↗

NXREFINE

NXRefine implements a complete workflow for both data acquisition and reduction of single crystal diffuse x-ray scattering collected as a series of area detector frames during continuous sample rotation. The data are stored in HDF5 files, which conform to the NeXus data format standard. These files contain a comprehensive set of metadata, including the incident wavelength, powder calibration scans used to define detector distances, beam centers, and yaw, pitch, and roll corrections. Automated peak searches of the three-dimensional data arrays define a set of Bragg peaks that are used to define an orientation matrix, defined according to Busing and Levy, which is then used to transform the data from angular coordinates to reciprocal space coordinates using the CCTW program. Multiple rotations at different detector translations and offset rotation axes are combined to ensure that there are no gaps in the reconstructed data, and allow the construction of masks to eliminate detector artifacts due to Compton scattering within the sensor layers. Finally, the data can be transformed into 3D-ΔPDF maps using the punch-and-fill method after symmetrization.

OSBORN, RAYMOND↗

Thermodynamics of Plutonium Monocarbide from Anharmonic and Relativistic Theory

Thermodynamics of plutonium monocarbide is studied from first-principles theory that includes relativistic electronic structure and anharmonic lattice vibrations. Density-functional theory (DFT) is expanded to include orbital-orbital coupling in addition to the relativistic spin-orbit interaction for the electronic structure and it is combined with anharmonic, temperature dependent, lattice dynamics derived from the self-consistent ab initio lattice dynamics (SCAILD) method. The obtained thermodynamics are compared to results from simpler quasi-harmonic theory and experimental data. Formation enthalpy, specific heat, and Gibbs energy calculated from the anharmonic model are validated by direct comparison with a calculation of phase diagram (CALPHAD) assessment of PuC and sub-stochiometric PuC0.896. Overall, the theory reproduces CALPHAD results and measured data for PuC rather well, but the comparison is hampered by the sub-stoichiometric nature of plutonium monocarbide. It was found that a bare theoretical approach that ignores spin-orbit and orbital-orbital coupling (orbital polarization) of the plutonium 5f electrons promotes too soft phonons and Gibbs energies that are incompatible with that of the CALPHAD assessment of the experimental data. The investigation of PuC suggests that the electronic structure is accurately described by plutonium 5f electrons as “band like” and delocalized, but correlate through spin polarization, orbital polarization, and spin-orbit coupling, in analogy to previous findings for plutonium metal.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Citizen Green #1 Well: MICP and Pycnometry Data, Sidewall Cores

This submission includes information on helium pycnometry & MICP measurements conducted on sidewall sub-samples from the Citizen Green #1 well drilled on King Island, CA (API 07720688) as part of the WESTCARB partnership basin characterization effort. Cores were acquired with a rotary sidewall tool at a range of depths. See the sidewallCore submission for additional formation data.

Citizen Green↗