SEARCH · Search NASA

Results for “Data manipulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

All sources NASA NTRS DOE OSTI

NASA NTRS2018

GMI-IPS: Python Processing Software for Aircraft Campaigns

NASA's Atmospheric Tomography Mission (ATom) seeks to understand the impact of anthropogenic air pollution on gases in the Earth's atmosphere. Four flight campaigns are being deployed on a seasonal basis to establish a continuous global-scale data set intended to improve the representation of chemically reactive gases in global atmospheric chemistry models. The Global Modeling Initiative (GMI), is creating chemical transport simulations on a global scale for each of the ATom flight campaigns. To meet the computational demands required to translate the GMI simulation data to grids associated with the flights from the ATom campaigns, the GMI ICARTT Processing Software (GMI-IPS) has been developed and is providing key functionality for data processing and analysis in this ongoing effort. The GMI-IPS is written in Python and provides computational kernels for data interpolation and visualization tasks on GMI simulation data. A key feature of the GMI-IPS, is its ability to read ICARTT files, a text-based file format for airborne instrument data, and extract the required flight information that defines regional and temporal grid parameters associated with an ATom flight. Perhaps most importantly, the GMI-IPS creates ICARTT files containing GMI simulated data, which are used in collaboration with ATom instrument teams and other modeling groups. The initial main task of the GMI-IPS is to interpolate GMI model data to the finer temporal resolution (1-10 seconds) of a given flight. The model data includes basic fields such as temperature and pressure, but the main focus of this effort is to provide species concentrations of chemical gases for ATom flights. The software, which uses parallel computation techniques for data intensive tasks, linearly interpolates each of the model fields to the time resolution of the flight. The temporally interpolated data is then saved to disk, and is used to create additional derived quantities. In order to translate the GMI model data to the spatial grid of the flight path as defined by the pressure, latitude, and longitude points at each flight time record, a weighted average is then calculated from the nearest neighbors in two dimensions (latitude, longitude). Using SciPya's Regular Grid Interpolator, interpolation functions are generated for the GMI model grid and the calculated weighted averages. The flight path points are then extracted from the ATom ICARTT instrument file, and are sent to the multi-dimensional interpolating functions to generate GMI field quantities along the spatial path of the flight. The interpolated field quantities are then written to a ICARTT data file, which is stored for further manipulation. The GMI-IPS is aware of a generic ATom ICARTT header format, containing basic information for all flight campaigns. The GMI-IPS includes logic to edit metadata for the derived field quantities, as well as modify the generic header data such as processing dates and associated instrument files. The ICARTT interpolated data is then appended to the modified header data, and the ICARTT processing is complete for the given flight and ready for collaboration. The output ICARTT data adheres to the ICARTT file format standards V1.1. The visualization component of the GMI-IPS uses Matplotlib extensively and has several functions ranging in complexity. First, it creates a model background curtain for the flight (time versus model eta levels) with the interpolated flight data superimposed on the curtain. Secondly, it creates a time-series plot of the interpolated flight data. Lastly, the visualization component creates averaged 2D model slices (longitude versus latitude) with overlaid flight track circles at key pressure levels. The GMI-IPS consists of a handful of classes and supporting functionality that have been generalized to be compatible with any ICARTT file that adheres to the base class definition. The base class represents a generic ICARTT entry, only defining a single time entry and 3D spatial positioning parameters. Other classes inherit from this base class; several classes for input ICARTT instrument files, which contain the necessary flight positioning information as a basis for data processing, as well as other classes for output ICARTT files, which contain the interpolated model data. Utility classes provide functionality for routine procedures such as: comparing field names among ICARTT files, reading ICARTT entries from a data file and storing them in data structures, and returning a reduced spatial grid based on a collection of ICARTT entries. Although the GMI-IPS is compatible with GMI model data, it can be adapted with reasonable effort for any simulation that creates Hierarchical Data Format (HDF) files. The same can be said of its adaptability to ICARTT files outside of the context of the ATom mission. The GMI-IPS contains just under 30,000 lines of code, eight classes, and a dozen drivers and utility programs. It is maintained with GIT source code management and has been used to deliver processed GMI model data for the ATom campaigns that have taken place to date.

Damon, M. R.↗

NASA NTRSDate not supplied

How Autonomous Intelligent Systems Can Facilitate Earth-independent Medical Care: Going Beyond Telepresence

During the last decade, teleoperated robotic systems have extended humans’ sensorimotor competence to digitally fly beyond the physical barrier of distance and scale and thus transmit sensorimotor skills of the human through direct communication. Telepresence capabilities have enabled tele-physical remote access at small scales thanks to telerobotic mediums. Although the concept was initially motivated by space applications, such technologies quickly have expanded into the medical domain and resulted in teleoperated medical robots, including telerobotic surgical systems (such as the da Vinci surgical system). Effective telepresence fundamentally depends on an agile, reliable, and secure communication medium that can transmit real-time information between the operator and a remote device. However, direct telepresence may not be achievable for long-duration exploration spaceflight missions. Thus, autonomous systems and local intelligence represent potential solutions to the aforementioned issues. One example solution employs demonstration systems which enable learning from the pre-captured inputs of a skilled human operator. These will be computationally modeled and later probabilistically replicated toward the completion of remote physical tasks when direct telepresence is not viable - such as under communication blackout conditions. In other words, trained autonomous systems (e.g., robots) can perform remote operations that mimic the physical performance of experts during remote operations/training. Beyond learning the physics of the task, autonomous agents can also be used to conduct algorithmic decision-making that mimics the higher-level cognition of the expert. Thus, using an autonomous system, pre-trained cognitive and manipulation-based skills can be leveraged (acquired during pre-mission events) to produce digital twins of an intelligent operator. Such systems can be used for the real-time conduction of intricate tasks in complex and unstructured environments. Such systems will operationalize “cognitive digital twins” and can expand the reach of human cognition and manipulation through the power of data-driven learning from demonstration algorithms. This system category will be discussed as a fully autonomous operation in this talk. In addition to the above, we will also propose and discuss the possibility of partial-automation using remote intelligence and remote sensing. In contrast to full automation, partial automation can close the loop through a local operator equipped with augmented sensory awareness through wearable systems. Such technologies will allow the local operator to conduct delicate tasks while being guided using sensory augmentation and being monitored to gauge her/his level of cognitive focus and performance. The difference with the previous category is that a remote human will conduct the task. Further, rather than making a digital twin of human cognition, we will augment the control inputs of the local human to match those of the skilled expert operator who is not accessible in real-time. Going beyond classic telepresence and thus approaching intelligent telepresence, our vision is that autonomous agents will eventually enable the safe, consistent and efficient delivery of complex, remote and smart medical care during space exploration across operators in an Earth-independent fashion. We will discuss our collective vision from NASA and MERIIT@NYU lab in this talk.

Telepresence↗

NASA NTRS2023

Developing a Hybrid Space Suit Simulator as a Research Tool for Assessing Extravehicular Activity Relevant Workload

Suited testing time is limited and hard to come by, expensive, and requires a whole team to operate and monitor the suit; however, pressurized spacesuits are not always necessary for initial developmental efforts or assessment of informatics. The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a Hybrid Space Suit Simulator (HS3) to support characterization of human performance during planetary surface exploration analogs. The primary goal of HS3 is to create a low cost, modular, and unpressurized suit simulator for use as a research tool which provides relevant physical and cognitive workload approximations with EVA-like immersion during planetary extravehicular activity (EVA) simulations. HS3 consists of a soft suit, communication, thermal control, gloves, boots, helmet, and integrated bioinformatics/sensors. The modular design of HS3 allows it to be modified to support test objectives as needed. HS3 enables H-3PO and NASA to complete critical human health and performance testing to address open risks and knowledge gaps in a timely, repeatable, and controlled manner. Four engineering runs were completed with HS3 as a baseline for capability. General workload was assessed while traversing on a passive treadmill and conducting geology tasks. Liquid cooling temperature, suit temperature, and metabolic rates were collected during one extended three-hour engineering run. For the duration of the engineering run the suit temperature was 26.6 ± 1.58 °C while suit humidity was 53.7 ± 5.11 %. Helmet temperature was higher than suit temperature at 27.8 ± 1.58 °C. Helmet humidity was lower than average suit humidity at 50.12 ± 11.3 °C. The liquid cooling temperature remained stable at 22.4 ± 1.62 °C. Resting metabolic rate was 597 ± 88 BTU/hr while metabolic rate increased during traverse tasks at 1500 ± 319 BTU/hr and geology tasks at 921 ± 129 BTU/hr. Following the engineering runs, a characterization study will be conducted. The subjects will perform EVA-like scenarios in both a shirtsleeve only and donned HS3, consisting of EVA task circuit focused on traversing, geological rock sampling, and task board manipulation. The characterization study will provide data capability for implementing HS3 in analog EVA testing environments.

Monica Hew↗

DOE OSTI2016

The Life Cycle of an OpenStudio Measure: Development, Testing, Distribution, and Application

An OpenStudio Measure is a script that can manipulate an OpenStudio model and associated data to apply energy conservation measures (ECMs), run supplemental simulations, or visualize simulation results. The OpenStudio software development kit (SDK) and accessibility of the Ruby scripting language makes measure authorship accessible to both software developers and energy modelers. This paper discusses the life cycle of an OpenStudio Measure from development, testing, and distribution, to application.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS1995

Visualization Techniques in Space and Atmospheric Sciences

Unprecedented volumes of data will be generated by research programs that investigate the Earth as a system and the origin of the universe, which will in turn require analysis and interpretation that will lead to meaningful scientific insight. Providing a widely distributed research community with the ability to access, manipulate, analyze, and visualize these complex, multidimensional data sets depends on a wide range of computer science and technology topics. Data storage and compression, data base management, computational methods and algorithms, artificial intelligence, telecommunications, and high-resolution display are just a few of the topics addressed. A unifying theme throughout the papers with regards to advanced data handling and visualization is the need for interactivity, speed, user-friendliness, and extensibility.

Szuszczewicz, E. P.↗

DOE OSTI2018

Near-real-time environmental monitoring and large-volume data collection over slow communication links

Climate change studies are one of the most important aspects of modern science and related experiments are getting bigger and more complex. One such experiment is the Spruce and Peatland Responses Under Changing Environments conducted in northern Minnesota. The SPRUCE experimental mission is to assess ecosystem-level biological responses of vulnerable, high-carbon terrestrial ecosystems to a range of climate warming manipulations and an elevated CO 2 atmosphere. This manipulation experiment generates a lot of observational data and requires a reliable on-site data collection system, dependable methods to transfer data to a robust scientific facility, and real-time monitoring capabilities. Furthermore this publication shares our experience of establishing a near-real-time data collection and monitoring system via a satellite link using the not very well-known possibilities of PakBus protocol.

47 OTHER INSTRUMENTATION↗

DOE OSTI2015

Big Biomedical data as the key resource for discovery science

Modern biomedical data collection is generating exponentially more data in a multitude of formats. This flood of complex data poses significant opportunities to discover and understand the critical interplay among such diverse domains as genomics, proteomics, metabolomics, and phenomics, including imaging, biometrics, and clinical data. The Big Data for Discovery Science Center is taking an “-ome to home” approach to discover linkages between these disparate data sources by mining existing databases of proteomic and genomic data, brain images, and clinical assessments. In support of this work, the authors developed new technological capabilities that make it easy for researchers to manage, aggregate, manipulate, integrate, and model large amounts of distributed data. Guided by biological domain expertise, the Center’s computational resources and software will reveal relationships and patterns, aiding researchers in identifying biomarkers for the most confounding conditions and diseases, such as Parkinson’s and Alzheimer’s.

Alzheimer's disease (ID)↗

NASA NTRS2016

Earth Science Data Analytics: Bridging Tools and Techniques with the Co-Analysis of Large, Heterogeneous Datasets

The continuum of ever-evolving data management systems affords great opportunities to the enhancement of knowledge and facilitation of science research. To take advantage of these opportunities, it is essential to understand and develop methods that enable data relationships to be examined and the information to be manipulated. This presentation describes the efforts of the Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster to understand, define, and facilitate the implementation of ESDA to advance science research. As a result of the void of Earth science data analytics publication material, the cluster has defined ESDA along with 10 goals to set the framework for a common understanding of tools and techniques that are available and still needed to support ESDA.

science data analysis↗

NASA NTRS1978

The effect of wind on the microwave emission from the ocean's surface at 37 GHz

The microwave brightness temperature measurements from the Electrically Scanned Microwave Radiometer (frequency = 37 GHz) are compared with oceanic wind measurements from data buoys. It is shown that the brightness temperature can be manipulated to yield a measure of the surface roughening which can be very well accounted for by a simple geometric optics model. The data of 1.4, 8.36 and 19.34 GHz were similarly manipulated and shown to require a surface with less slope variance than predicted by optical measurements. It is also shown that the surface may be treated as isotropic to an accuracy equivalent to the roughening produced by a 2 m/s wind speed increment.

Wilheit, T. T.↗

NASA NTRSDate not supplied

Open Source Application of Fusing Aerosol Products from GEO and LEO Satellites

Retrieving aerosol optical depths (AODs) from sun-synchronous polar orbiting (aka low earth orbit, LEO) satellites, such as MODISs, and VIIRSs, OMI, TROPOMI, etc, has become well-established as a tool for extracting information on particulate matter (PM) and related processes in the atmosphere. However, with recently launched geostationary satellites (GEO), such as GOES-16/17/18, and Himawari-8/9, and Meteosat Third Generation (MTG) they provide a much higher temporal resolution (order of 10 minutes), typically an image once or more per hour during daylight compared to LEO once per day. By combining these observations, we may be able to characterize the diurnal cycle of global AOD at the local, regional and global scale. While the science community is still exploring the new data from GEO observations, we have been thinking about how to properly combine/merge/fuse those data considering differences in their spatial and temporal resolutions. However, this poses a “Big Data” challenge. The big data challenge is not just about data storage, but also about data discoverability, and accessibility, and even more, about data migration/mirroring in the cloud-computing environment. This paper is merely showing some of the efforts and approaches we have attempted in fusing six satellites’ Level 2 aerosol data (three are from GEO (GOES-16/17 and Himawari-8), and the other three are from LEO (TERRA/MODIS, AQUA/MODIS, SNPP-VIIRS) from Dark Target (DT) aerosol retrieval algorithm. Having the on-demand capability of fusing remote sensing products onto the desired temporal and spatial domain enables researchers and application practitioners to better manipulate and work with satellite and sensor data. It is our hopeWe hope that by making such an open-source package, and the accompanying functionality, the scientific community will be granted easier access to aerosol data processing resources. The MEaSUREs Program (Making Earth System Data Records for Use in Research Environments) expands our understanding of the Earth's current system through atmospheric and surface measurements. In an effort to aid the scientific research component and improve open source methods, this project developed Python code for fusing six satellite Level 2 aerosol data (three are from geostationary satellites (GEO), and the other three are from low earth orbital satellites (LEO)) from Dark Target Aerosol Retrieval Algorithm.

Jennifer Wei↗

NASA NTRS1992

Hand/Eye Coordination For Fine Robotic Motion

Fine motions of robotic manipulator controlled with help of visual feedback by new method reducing position errors by order of magnitude. Robotic vision subsystem includes five cameras: three stationary ones providing wide-angle views of workspace and two mounted on wrist of auxiliary robot arm. Stereoscopic cameras on arm give close-up views of object and end effector. Cameras measure errors between commanded and actual positions and/or provide data for mapping between visual and manipulator-joint-angle coordinates.

Lokshin, Anatole M.↗

NASA NTRS1997

Visualization of IACG data

The common data format (CDF), adopted by the international solar terrestrial physics (ISTP) program and the Interagency Consultative Group (IACG), is considered. Extensive data sharing and data analysis are needed to ensure the success of the ISTP/IACG program. The CDF user guidelines and tools for creation, visualization and manipulation are underlined. Computer software applications based on CDF data sets and designed using ISTP/IACG guidelines are shown.

Kessel, Ramona L.↗

DOE OSTI2026

Data sharing helps avoid “smoking gun” claims of topological milestones

Manipulating the topology of electronic bands can realize new states of matter, with possible implications for information technology. A central question is how to tell whether a topological regime has been achieved. Experiments are often guided by a prediction of a distinct and self-explanatory signal called “the smoking gun.” However, in micrometer- or nanometer-scale specimens, phenomenology can mimic the anticipated behavior without containing the exotic states. We show limited data that are consistent with the presence of four topological phenomena; by considering additional data, we identified the most likely origins of the observed patterns as trivial. Finally, we argue that the reliability of smoking gun–type claims can be greatly enhanced by releasing comprehensive datasets, discussing alternative scenarios, and disclosing the total volume of study.

Frolov, S. M. [Univ. of Pittsburgh, PA (United Sta↗

DOE OSTI2020

Methods of particle manipulation and analysis

Methods described herein, in some embodiments, permit extraction of particle structural and/or surface charge data from gradient induced particle motion in channels. In one aspect, a method of manipulating particle motion comprises introducing a fluid into a channel, the fluid comprising particles, and driving particle accumulation to a preselected location in the channel by setting advective velocity of the fluid to offset diffusiophoretic mobility of the particles at the preselected location.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Methods of particle manipulation and analysis

Ault, Jesse↗

DOE OSTI2016

Does Plant Biomass Manipulation in Static Chambers Affect Nitrous Oxide Emissions from Soils?

One of the most widespread approaches for measurement of greenhouse gas emissions from soils involves the use of static chambers. This method is relatively inexpensive, is easily replicated, and is ideally suited to plot-based experimental systems. Among its limitations is the loss of detection sensitivity with increasing chamber height, which creates challenges for deployment in systems including tall vegetation. It is not always possible to avoid inclusion of plants within chambers or to extend chamber height to fully accommodate plant growth. Thus, in many systems, such as perennial forages and biomass crops, plants growing within static chambers must either be trimmed or folded during lid closure. Currently, data on how different types of biomass manipulation affect measured results is limited. For this study, we compare the effects of cutting vs. folding of biomass on nitrous oxide measurements in switchgrass (Panicum virgatum L.) and alfalfa (Medicago sativa L.) systems. We report only limited evidence of treatment effects during discrete sampling events and little basis for concern that effects may intensify over time as biomass manipulation is repeatedly imposed. However, nonsignificant treatment effects that were consistently present amounted to significant overall trends in three out of the four systems studied. Such minor disparities in flux could amount to considerable quantities over time, suggesting that caution should be exercised when comparing cumulative emission values from studies using different biomass manipulation strategies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2019

Data-driven cyber attack detection and mitigation for decentralized wide-area protection and control in smart grids

Modern power systems have already evolved into complicated cyber physical systems (CPS), often referred to as smart grids, due to the continuous expansion of the electrical infrastructure, the augmentation of the number of heterogeneous system components and players, and the consequential application of a diversity of information and telecommunication technologies to facilitate the Wide Area Monitoring, Protection and Control (WAMPAC) of the day-to-day power system operation. Because of the reliance on cyber technologies, WAMPAC, among other critical functions, is prone to various malicious cyber attacks. Successful cyber attacks, especially those sabotage the operation of Bulk Electric System (BES), can cause great financial losses and social panics. Application of conventional IT security solutions is indispensable, but it often turns out to be insufficient to mitigate sophisticated attacks that deploy zero-day vulnerabilities or social engineering tactics. To further improve the resilience of the operation of smart grids when facing cyber attacks, it is desirable to make the WAMPAC functions per se capable of detecting various anomalies automatically, carrying out adaptive activity adjustments in time and thus staying unimpaired even under attack. Most of the existing research efforts attempt to achieve this by adding novel functional modules, such as model-based anomaly detectors, to the legacy centralized WAMPAC functions. In contrast, this dissertation investigates the application of data-driven algorithms in cyber attack detection and mitigation within a decentralized architecture aiming at improving the situational awareness and self-adaptiveness of WAMPAC. First part of the research focuses on the decentralization of System Integrity Protection Scheme (SIPS) with Multi-Agent System (MAS), within which the data-driven anomaly detection and optimal adaptive load shedding are further explored. An algorithm named as Support Vector Machine embedded Layered Decision Tree (SVMLDT) is proposed for the anomaly detection, which provides satisfactory detection accuracy as well as decision-making interpretability. The adaptive load shedding is carried out by every agent individually with dynamic programming. The load shedding relies on the load profile propagation among peer agents and the attack adaptiveness is accomplished by maintaining the historical mean of load shedding proportion. Load shedding only takes place after the consensus pertaining to the anomaly detection is achieved among all interconnected agents and it serves the purpose of mitigating certain cyber attacks. The attack resilience of the decentralized SIPS is evaluated using IEEE 39 bus model. It is shown that, unlike the traditional centralized SIPS, the proposed solution is able to carry out the remedial actions under most Denial of Service (DoS) attacks. The second part investigates the clustering based anomalous behavior detection and peer-assisted mitigation for power system generation control. To reduce the dimensionality of the data, three metrics are designed to interpret the behavior conformity of generator within the same balancing area. Semi-supervised K-means clustering and a density sensitive clustering algorithm based on Hierarchical DBSCAN (HDBSCAN) are both applied in clustering in the 3D feature space. Aiming to mitigate the cyber attacks targeting the generation control commands, a peer-assisted strategy is proposed. When the control commands from control center is detected as anomalous, i.e. either missing or the payload of which have been manipulated, the generating unit utilizes the peer data to infer and estimate a new generation adjustment value as replacement. Linear regression is utilized to obtain the relation of control values received by different generating units, Moving Target Defense (MTD) is adopted during the peer selection and 1-dimensional clustering is performed with the inferred control values, which are followed by the final control value estimation. The mitigation strategy proposed requires that generating units can communicate with each other in a peer-to-peer manner. Evaluation results suggest the efficacy of the proposed solution in counteracting data availability and data integrity attacks targeting the generation controls. However, the strategy stays effective only if less than half of the generating units are compromised and it is not able to mitigate cyber attacks targeting the measurements involved in the generation control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1979

The effect of wind on the microwave emission from the ocean's surface at 37 GHz

The microwave brightness temperature measurements from the electrically scanned microwave radiometer (frequency = 37 GHz) are compared with oceanic wind measurements from data buoys. It is shown that the brightness temperature can be manipulated to yield a measure of the surface roughening, which can be very well accounted for by a simple geometric optics model. The data of Hollinger (1971) at 1.4, 8, 36, and 19.34 GHz were similarly manipulated and shown to require a surface with less slope variance than that predicted by the Cox and Munk (1955) optical measurements. It is also shown that the surface may be treated as isotropic to an accuracy equivalent to the roughening produced by a 2-m/s wind speed increment.

Wilheit, T. T.↗