Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data manipulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Experiment Level 1 Sensor Data v2-1

This is the version 2-1 Level 1 (L1) data release for COMPASS-FME environmental sensors located at our Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental site. This manipulative, ecosystem-scale TEMPEST experiment addresses the potential for freshwater and estuarine-water disturbance events to alter tree function, species composition, and ecosystem processes in a deciduous coastal forest in MD, USA. The experiment uses a large-unit (2000 m2), un-replicated experimental design, with three 50 m × 40 m plots serving as control, freshwater, and estuarine-water treatments. L1 data are close to raw, but are units-transformed and have out-of-instrument-bounds, out-of-service, and outlier flags added. Duplicates and missing data are removed but otherwise these data are not filtered, and have not been subject to any additional algorithmic or human QA/QC. Any scientific analyses of L1 data should be performed with care. **This dataset will be updated quarterly with new data for the duration of the project** This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific CSV (comma separated value) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are normally logged every 15 minutes. Please see v2-1 TEMPEST L1 Sensor Package Quick Start.pdf for detailed information on data package structure, temporal coverage, and versioning. The TEMPEST flood events occurred on the following dates. They lasted for ~10 hours each day and delivered ~80,000 gallons to each plot; many data streams are available at 1 or 5 minute frequency during these periods. * Tests: Aug 25 (fresh plot) and Sep 9 (salt plot), 2021 * TEMPEST 1: June 22, 2022 * TEMPEST 2: June 6-7, 2023 * TEMPEST 3: June 11-13, 2024 This dataset was updated 2026-03-12: (i) data now go through 2025-12-31 (previous end was 2025-06-30) and (ii) dataset and file names updated to “…v2-1” (previously was “v2-0”).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Experiment Level 2 Sensor Data v2-1

This is the version v2-1 Level 2 (L2) data release for COMPASS-FME environmental sensors located at our Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental site. This manipulative, ecosystem-scale TEMPEST experiment addresses the potential for freshwater and estuarine-water disturbance events to alter tree function, species composition, and ecosystem processes in a deciduous coastal forest in MD, USA. The experiment uses a large-unit (2000 m2), un-replicated experimental design, with three 50 m × 40 m plots serving as control, freshwater, and estuarine-water treatments. Level 2 (L2) data consist of sensor observations from the COMPASS-FME synoptic sites, TEMPEST, and DELUGE. Compared to the L1 data, these are more consistent (always 15-minute timestamps for the entire year); better QA/QC’d (out of bounds, out of service, and extreme outlier values are removed); and more complete, with a gap-filled time series available alongside the main observations, and additional derived (calculated) variables. L2 data are intended to be rapidly and easily usable in analyses and simulations. However, algorithmic outlier identification always carries the risk of removing valid data, and Level 1 data may be more suitable for analyses that focus on variability or extreme events. This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific Parquet (a high performance, space efficient format; see https://parquet.apache.org) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are reported every 15 minutes. Please see v2-1 TEMPEST L2 Sensor Package Quick Start.pdf for detailed information on data package structure, temporal coverage, and versioning. Data files are in Apache Parquet, a high performance, space efficient format for tabular data. These files can be read using R's `arrow` package (https://arrow.apache.org/docs/r/), with similar tools available in other languages. The TEMPEST flood events occurred on the following dates. They lasted for ~10 hours each day and delivered ~80,000 gallons to each plot; many data streams are available at 1 or 5 minute frequency during these periods. * Tests: Aug 25 (fresh plot) and Sep 9 (salt plot), 2021 * TEMPEST 1: June 22, 2022 * TEMPEST 2: June 6-7, 2023 * TEMPEST 3: June 11-13, 2024

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗
NASA NTRSDate not supplied

Use of Assistive Technology to Augment API Capabilities

Application Programming Interfaces (APIs) allow for access to data and capabilities of computer applications by developers or users with experience in computer programming. Recent development with both Thermal Desktop and ESATAN-TMS have provided APIs to allow users to develop their own capabilities that interface with the Graphical User Interfaces (GUI) or manipulate the thermal model data. However, these APIs are only as good as the breadth of features in the native code accessible through the API. If a particular code’s feature is not accessible through the API, then users have very limited options besides waiting for updates to the API that expose the necessary functionality, particularly if model data access or user action, such as a button click, is required. However, Assistive Technology features that allow for users with a disability to more fully experience a software’s capabilities may be creatively utilized to gain further access to data and capabilities not yet exposed by the API. This paper describes the process to augment the features of the OpenTD API via assistive technology and describes how to identify the application instance, navigate GUI elements, updates values on forms, and execute actions such as selecting a listbox item or clicking a button. It concludes with identifying some of the pitfalls to avoid and describes methods to best implement this approach.

Application Programming Interface↗
NASA NTRSDate not supplied

Use of Assistive Technology to Augment API Capabilities

Application Programming Interfaces (APIs) allow for access to data and capabilities of computer applications by developers or users with experience in computer programming. Recent development with both Thermal Desktop and ESATAN-TMS have provided APIs to allow users to develop their own capabilities that interface with the Graphical User Interfaces (GUI) or manipulate the thermal model data. However, these APIs are only as good as the breadth of features in the native code accessible through the API; if a particular code’s feature is not accessible through the API, then users have very limited options besides waiting for updates to the API that expose the necessary functionality, particularly if model data access or user action, such as a button click, is required. However, Assistive Technology features that allow for differently-abled users to more fully experience a software’s capabilities may be creatively utilized to gain further access to data and capabilities not yet exposed by the API. This paper describes the process to augment the features of the OpenTD API via assistive technology and describes how to identify the application instance, navigate GUI elements, updates values on forms, and execute actions such as selecting a listbox item or clicking a button. It concludes with identifying some of the pitfalls to avoid and describes methods to best implement this approach.

Application Programming Interface↗
NASA NTRS1979

SKYMAP system description: Star catalog data base generation and utilization

The specifications, design, software description, and use of the SKYMAP star catalog system are detailed. The SKYMAP system was developed to provide an accurate and complete catalog of all stars with blue or visual magnitudes brighter than 9.0 for use by attitude determination programs. Because of the large number of stars which are brighter than 9.0 magnitude, efficient techniques of manipulating and accessing the data were required. These techniques of staged distillation of data from a Master Catalog to a Core Catalog, and direct access of overlapping zone catalogs, form the basis of the SKYMAP system. The collection and tranformation of data required to produce the Master Catalog data base is described. The data flow through the main programs and levels of star catalogs is detailed. The mathematical and logical techniques for each program and the format of all catalogs are documented.

Gottlieb, D. M.↗
NASA NTRS1974

Census Cities experiment in urban change detection

The author has identified the following significant results. Mapping of 1970 and 1972 land use from high-flight photography has been completed for all test sites: San Francisco, Washington, Phoenix, Tucson, Boston, New Haven, Cedar Rapids, and Pontiac. Area analysis of 1970 and 1972 land use has been completed for each of the mandatory urban areas. All 44 sections of the 1970 land use maps of the San Francisco test site have been officially released through USGS Open File at 1:62,500. Five thousand copies of the Washington one-sheet color 1970 land use map, census tract map, and point line identification map are being printed by USGS Publication Division. ERTS-1 imagery for each of the eight test sites is being received and analyzed. Color infrared photo enlargements at 1:100,000 of ERTS-1 MSS images of Phoenix taken on October 16, 1972 and May 2, 1973 are being analyzed to determine to what level land use and land use changes can be identified and to what extent the ERTS-1 imagery can be used in updating the 1970 aircraft photo-derived land use data base. Work is proceeding on the analysis of ERTS-1 imagery by computer manipulation of ERTS-1 MSS data in digital format. ERTS-1 CCT maps at 1:24,000 are being analyzed for two dates over Washington and Phoenix. Anniversary tape sets have been received at Purdue LARS for some additional urban test sites.

Wray, J. R.↗
DOE OSTI2023

Analysis of X-ray images and spectra (aXis2000): A toolkit for the analysis of X-ray spectromicroscopy data

Spectromicroscopy refers to analytical methods that combine imaging and spectroscopy to provide detailed, spatially resolved analytical information about a sample, such as the type and quantitative spatial distributions of chemical components, geometric or magnetic alignment information, crystal structure, etc. The analysis of X-ray images and spectra (aXis2000) software described in this work provides a set of routines within a single, integrated, graphical-oriented package to read, display, manipulate and analyze spectromicroscopy data, with particular focus on soft X-ray spectromicroscopy methods such as scanning transmission X-ray microscopy (STXM), X-ray photoemission electron microscopy (XPEEM), scanning photoelectron X-ray microscopy (SPEM) and transmission X-ray microscopy (TXM). Here, this free software is described and compared to other software that can provide similar or complementary capabilities. Examples of spectromicroscopic analyses using advanced features of aXis2000 are provided.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1974

The role of higher-multipolar and repulsive forces in the calculation of collision-broadened line-widths of linear molecules

Collision-broadened line widths in CO-CO2 and CO-O2 collisions have been calculated by incorporating interactions due to octopoles and hexadecapoles and short-range repulsive interactions into Anderson's (1949) theory. It is shown how these higher-order interactions can be manipulated to yield good agreement with experimental data. A critical evaluation of this totally empirical manipulation suggests that a thorough revision of the theory is required for all but simple dipole-dipole interactions. In the process of the evaluation, the values of the multipole moments are discussed.

Varanasi, P.↗
DOE OSTI2025

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Experiment Tree Inventory

This is the tree inventory (diameter, species, and live/dead status) data from the Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental site. This manipulative, ecosystem-scale TEMPEST experiment is part of the COMPASS-FME (Coastal Observations, Mechanisms, and Predictions Across Systems and Scales: Field Measurements and Experiments; see https://compass.pnnl.gov/FME/COMPASSFME) project. It addresses the potential for freshwater and estuarine-water disturbance events to alter tree function, species composition, and ecosystem processes in a deciduous coastal forest in eastern Maryland, USA. The experiment uses a large-unit (2000 m2), un-replicated experimental design, with three 50 m × 40 m plots serving as control, freshwater, and estuarine-water treatments.This dataset includes:- An overall dataset README file.- The tree inventory data in both "wide" and "long" forms. These contain the same information but are structured differently, with the former more useful for human viewers and the latter more amenable for programmatic analyses.- A key to the species/genus codes used, which follow the U.S. Department of Agriculture's PLANTS schema (https://plants.usda.gov/).- A copy of the R code used to generate the wide- and long-form data files.All files are comma-separated value (CSV) and no special software is required to read them.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1992

Origins of Energetic Ions in the Earth's Magnetosheath

The analysis and interpretation of the combined scientific data from the Hot Plasma Composition Experiment (HPCE) and the Charge Energy Mass (CHEM) spectrometer on the Active Mesospheric Particle Tracer Experiment (AMPTE) Charge Composition Explorer (CCE) spacecraft are discussed. These combined data sets have and will be used to survey the energetic ion environment in the Earth's magnetosheath to determine the origins and relative strengths of the energetic ion populations found there. A computer code was developed to analyze and interpret the data sets. The focus of the first year was on the determination of the contribution of leaked magnetospheric protons to the total energetic proton population. Emphasis was placed on intervals when the AMPTE spacecraft was in the plasma depletion layer because it was argued that in this region, only the leaked population contributes to the energetic ion population. Manipulation of the CHEM data and comparison of the CHEM and HPCE data over their common energy range near the magnetopause also contributed directly to a second study of that region.

Fuselter, S. A.↗
DOE OSTI2023

pyEGAF: An open-source Python library for the Evaluated Gamma-ray Activation File

The Evaluated Gamma-ray Activation File (EGAF) is one of the most comprehensive resources for thermal neutron-capture data. This database contains data from prompt gamma activation analysis measurements carried out in a consistent manner using the same experimental configuration at the Budapest Research Reactor for 245 isotopes. Although these valuable datasets have been freely available for many years, one of the drawbacks is the outdated and cryptic Evaluated Nuclear Structure Data File (ENSDF) format that is currently adopted for dissemination, making it difficult for users unfamiliar with the format to access and utilize the data contained therein. Furthermore, the ENSDF format does not readily lend itself to modern computational technologies and a parser is required to interpret the complicated mixed-record format. To help overcome these challenges, we have developed a translator to convert the ENSDF-formatted datasets into an open standard JavaScript Object Notation (JSON) format enabling accessibility to applications using different programming languages running in different environments. To compliment this effort, we have also developed an open-source software package implemented in Python, pyEGAF, that is designed to interact with the JSON data structures for general purpose access, manipulation, and analysis of the neutron-capture $\gamma$-ray data in EGAF. The new format, together with the pyEGAF library, greatly enhances access to the wider applications community where EGAF data may be useful or is required.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2006

Discerning Trends in Performance Across Multiple Events

Mass Data is a computer program that enables rapid, easy discernment of trends in performance data across multiple flights and ground tests. The program can perform Fourier analysis and other functions for the purposes of frequency analysis and trending of all variables. These functions facilitate identification of past use of diagnosed systems and of anomalies in such systems, and enable rapid assessment of related current problems. Many variables, for computation of which it is usually necessary to perform extensive manual manipulation of raw downlist data, are automatically computed and made available to all users, regularly eliminating the need for what would otherwise be an extensive amount of engineering analysis. Data from flight, ground test, and simulation are preprocessed and stored in one central location for instantaneous access and comparison for diagnostic and trending purposes. Rules are created so that an event log is created for every flight, making it easy to locate information on similar maneuvers across many flights. The same rules can be created for test sets and simulations, and are searchable, so that information on like events is easily accessible.

Slater, Simon↗
DOE OSTI2025

A Graph-Net with Node Embeddings to Detect False Data Injection Attacks in Photovoltaic Systems

Distributed energy resources (DER) contribute to the operational stability of the larger power grid both at utility-scale as well as commercial and residential scales in aggregated forms. These DER in-turn are susceptible to increasing cyber threats. An adversary can plug into the same local network that a field photovoltaic (PV) system uses to interconnect its data loggers and inverters and manipulate certain measurements collected from the network or trick existing irradiance and inverter readings through false data injection attacks (FDIA). Control routines that rely on these measurements can propagate the false data, impacting critical decisions that result in a suboptimal operation or even cause intentional harm leading to inverter-tripping or unscheduled loads that need to be shed. To detect FDIA in PV systems, the paper introduces an attention-based graph neural network with node embeddings and applied it to a simple prototypical DC-coupled microgrid with PV, energy storage, and load. The algorithm shows a detection accuracy of up to 98.95%. The proposed FDIA detection technique will provide micro-grid operators with an effective method to safeguard their systems, guaranteeing the secure and reliable operation.

Parvez, Imtiaz [Utah Valley University]↗
NASA NTRS1983

Effective use of remote sensing products in litigation

A boiled-down version of major legal principles affecting the admissibility of data and products from remote sensing devices is presented. It is suggested that enhancements or classifications of digital data (from scanning devices or from digitized aerial photography) be proffered as evidence in a fashion similar to the manner in which maps from photogrammetric techniques are introduced as evidence. Every effort should be made to illucidate the processes by which digital data are analytically treated or manipulated. Remote sensing expert witnesses should be practiced in providing concise and clear explanations of both data and methods. Special emphasis should be placed on being prepared to provide a detailed accounting of steps taken to calibrate and verify spectral characteristics with ground truth.

Jaynes, R. A.↗
NASA NTRS1991

Silvabase: A flexible data file management system

The need for a more flexible and efficient data file management system for mission planning in the Mission Operations Laboratory (EO) at MSFC has spawned the development of Silvabase. Silvabase is a new data file structure based on a B+ tree data structure. This data organization allows for efficient forward and backward sequential reads, random searches, and appends to existing data. It also provides random insertions and deletions with reasonable efficiency, utilization of storage space well but not at the expense of speed, and performance of these functions on a large volume of data. Mission planners required that some data be keyed and manipulated in ways not found in a commercial product. Mission planning software is currently being converted to use Silvabase in the Spacelab and Space Station Mission Planning Systems. Silvabase runs on a Digital Equipment Corporation's popular VAX/VMS computers in VAX Fortran. Silvabase has unique features involving time histories and intervals such as in operations research. Because of its flexibility and unique capabilities, Silvabase could be used in almost any government or commercial application that requires efficient reads, searches, and appends in medium to large amounts of almost any kind of data.

Lambing, Steven J.↗
NASA NTRS2001

The Role of Remote Sensing Displays in Earth Climate and Planetary Atmospheric Research

The communities of scientists who study the Earth's climate and the atmospheres of the other planets barely overlap, but the types of questions they pose and the resulting implications for the use and interpretation of remote sensing data sets have much in common. Both seek to determine the characteristic behavior of three-dimensional fluids that also evolve in time. Climate researchers want to know how and why the general patterns that define our climate today might be different in the next century. Planetary scientists try to understand why circulation patterns and clouds on Mars, Venus, or Jupiter are different from those on Earth. Both disciplines must aggregate large amounts of data covering long time periods and several altitudes to have a representative picture of the rapidly changing atmosphere they are studying. This emphasis separates climate scientists from weather forecasters, who focus at any one time on a limited number of images. Likewise, it separates planetary atmosphere researchers from planetary geologists, who rely primarily on single images (or mosaics of images covering the globe) to study two-dimensional planetary surfaces that are mostly static over the duration of a spacecraft mission yet reveal dynamic processes acting over thousands to millions of years. Remote sensing displays are usually two-dimensional projections that capture an atmosphere at an instant in time. How scientists manipulate and display such data, how they interpret what they see, and how they thereby understand the physical processes that cause what they see, are the challenges I discuss in this chapter. I begin by discussing differences in how novices and experts in the field relate displays of data to the real world. This leads to a discussion of the use and abuse of image enhancement and color in remote sensing displays. I then show some examples of techniques used by scientists in climate and planetary research to both convey information and design research strategies using remote sensing displays.

DelGenio, Anthony D.↗
NASA NTRS1994

Experimenter's Laboratory for Visualized Interactive Science

ELVIS (Experimenter's Laboratory for Visualized Interactive Science) is an interactive visualization environment that enables scientists, students, and educators to visualize and analyze large, complex, and diverse sets of scientific data. It accomplishes this by presenting the data sets as 2-D, 3-D, color, stereo, and graphic images with movable and multiple light sources combined with displays of solid-surface, contours, wire-frame, and transparency. By simultaneously rendering diverse data sets acquired from multiple sources, formats, and resolutions and by interacting with the data through an intuitive, direct-manipulation interface, ELVIS provides an interactive and responsive environment for exploratory data analysis.

Hansen, Elaine R.↗