Search NASA⌕ Search

SEARCH · Search NASA

Results for “compact data storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Multiresolution With Super-Compact Wavelets

The solution data computed from large scale simulations are sometimes too big for main memory, for local disks, and possibly even for a remote storage disk, creating tremendous processing time as well as technical difficulties in analyzing the data. The excessive storage demands a corresponding huge penalty in I/O time, rendering time and transmission time between different computer systems. In this paper, a multiresolution scheme is proposed to compress field simulation or experimental data without much loss of important information in the representation. Originally, the wavelet based multiresolution scheme was introduced in image processing, for the purposes of data compression and feature extraction. Unlike photographic image data which has rather simple settings, computational field simulation data needs more careful treatment in applying the multiresolution technique. While the image data sits on a regular spaced grid, the simulation data usually resides on a structured curvilinear grid or unstructured grid. In addition to the irregularity in grid spacing, the other difficulty is that the solutions consist of vectors instead of scalar values. The data characteristics demand more restrictive conditions. In general, the photographic images have very little inherent smoothness with discontinuities almost everywhere. On the other hand, the numerical solutions have smoothness almost everywhere and discontinuities in local areas (shock, vortices, and shear layers). The wavelet bases should be amenable to the solution of the problem at hand and applicable to constraints such as numerical accuracy and boundary conditions. In choosing a suitable wavelet basis for simulation data among a variety of wavelet families, the supercompact wavelets designed by Beam and Warming provide one of the most effective multiresolution schemes. Supercompact multi-wavelets retain the compactness of Haar wavelets, are piecewise polynomial and orthogonal, and can have arbitrary order of approximation. The advantages of the multiresolution algorithm are that no special treatment is required at the boundaries of the interval, and that the application to functions which are only piecewise continuous (internal boundaries) can be efficiently implemented. In this presentation, Beam's supercompact wavelets are generalized to higher dimensions using multidimensional scaling and wavelet functions rather than alternating the directions as in the 1D version. As a demonstration of actual 3D data compression, supercompact wavelet transforms are applied to a 3D data set for wing tip vortex flow solutions (2.5 million grid points). It is shown that high data compression ratio can be achieved (around 50:1 ratio) in both vector and scalar data set.

Lee, Dohyung↗

Scalable Incremental Checkpointing using GPU-Accelerated De-Duplication

Writing large amounts of data concurrently to stable storage is a typical I/O pattern of many HPC workflows. This pattern introduces high I/O overheads and results in increased storage space utilization especially for workflows that need to capture the evolution of data structures with high frequency as checkpoints. In this context, many applications, such as graph pattern matching, perform sparse updates to large data structures between checkpoints. For these applications, incremental checkpointing techniques that save only the differences from one checkpoint to another can dramatically reduce the checkpoint sizes, I/O bottlenecks, and storage space utilization. However, such techniques are not without challenges: it is non-trivial to transparently determine what data has changed since a previous checkpoint and assemble the differences in a compact fashion that does not result in excessive metadata. State-of-art data reduction techniques (e.g., compression and de-duplication) have significant limitations when applied to modern HPC applications that leverage GPUs: slow at detecting the differences, generate a large amount of metadata to keep track of the differences, and ignore crucial spatiotemporal checkpoint data redundancy. This paper addresses these challenges by proposing a Merkle tree-based incremental checkpointing method to exploit GPUs' high memory bandwidth and massive parallelism. Experimental results at scale show a significant reduction of the I/O overhead and space utilization of checkpointing compared with state-of-the-art incremental checkpointing and compression techniques.

Tan, Nigel↗

Moisture Effects on Compaction of Fiberboard in a 9975 Shipping Package (Final Report)

Compaction of lower layers in the fiberboard assembly has been observed in 9975 packages that contain elevated moisture. Lab testing has resulted in a better understanding of the relationship between the fiberboard moisture level and compaction of the lower fiberboard assembly, and the behavior of the fiberboard during transport. In laboratory tests of cane fiberboard, higher moisture content has been shown to correspond to higher total compaction, greater rate of compaction, and continued compaction over a longer period of time. In addition, laboratory tests have shown that the application of a dynamic load results in higher fiberboard compaction compared to a static load. The test conditions and sample geometric/loading configurations were chosen to simulate the regulatory requirements for 9975 package input dynamic loading. Dynamic testing was conducted to acquire immediate and cumulative changes in geometric data for various moisture levels. Two sample sets have undergone a complete dynamic test regimen, one set for 27 weeks, and the second set for 47 weeks. The dynamic input, data acquisition, test effects on sample dynamic parameters, and results from this test program are summarized and compared to regulatory specifications for dynamic loading. Compaction of the bottom fiberboard layers due to the accumulation of moisture is one possible cause of an increase in the axial gap at the top of the package. The net compaction of the bottom layers will directly add to the axial gap. The moisture which caused this compaction migrated from the middle region of the fiberboard assembly (which is typically the hottest). This will cause the middle region to shrink axially, which will also contribute directly to the axial gap. Measurement of the axial gap provides a screening tool for identifying significant change in the fiberboard condition. The data in this report provide a basis to evaluate the impact of moisture and fiberboard compaction on 9975 package performance during storage at the Savannah River Site (SRS).

36 MATERIALS SCIENCE↗

Topology-imprinting in nonlinear metasurfaces

Flat optical components, or metasurfaces, have transformed optical imaging, data storage, information processing, and biomedical applications by providing unprecedented control over light-matter interactions. These nano-engineered structures enable compact, multidimensional manipulation of light’s amplitude, phase, polarization, and wavefront, producing scalar and vector beams with unique properties such as orbital angular momentum and knotted topologies. This flexibility has potential applications in optical communication and imaging, particularly in complex environments such as atmospheric turbulence and undersea scattering. However, designing metasurfaces for shorter wavelengths, such as visible and ultraviolet light, remains challenging due to fabrication limitations and material absorption. Here, we introduce an innovative concept called topology imprinting using judiciously designed all-dielectric nonlinear optical metasurfaces to replicate desired waveforms at fundamental and harmonic frequencies, opening promising avenues for advanced photonic applications.

42 ENGINEERING↗

The New Cloud Absorption Radiometer (CAR) Software: One Model for NASA Remote Sensing Virtual Instruments

The Cloud Absorption Radiometer (CAR) instrument has been the most frequently used airborne instrument built in-house at NASA Goddard Space Flight Center, having flown scientific research missions on-board various aircraft to many locations in the United States, Azores, Brazil, and Kuwait since 1983. The CAR instrument is capable of measuring scattered light by clouds in fourteen spectral bands in UV, visible and near-infrared region. This document describes the control, data acquisition, display, and file storage software for the new version of CAR. This software completely replaces the prior CAR Data System and Control Panel with a compact and robust virtual instrument computer interface. Additionally, the instrument is now usable for the first time for taking data in an off-aircraft mode. The new instrument is controlled via a LabVIEW v5. 1.1-developed software interface that utilizes, (1) serial port writes to write commands to the controller module of the instrument, and (2) serial port reads to acquire data from the controller module of the instrument. Step-by-step operational procedures are provided in this document. A suite of other software programs has been developed to complement the actual CAR virtual instrument. These programs include: (1) a simulator mode that allows pretesting of new features that might be added in the future, as well as demonstrations to CAR customers, and development at times when the instrument/hardware is off-location, and (2) a post-experiment data viewer that can be used to view all segments of individual data cycles and to locate positions where 'start' and stop' byte sequences were incorrectly formulated by the instrument controller. The CAR software described here is expected to be the basis for CAR operation for many missions and many years to come.

Roth, Don J.↗

Circuit For Current-vs.-Voltage Tests Of Semiconductors

Circuit designed for measurement of dc current-versus-voltage characteristics of semiconductor devices. Operates in conjunction with x-y pen plotter or digital storage oscilloscope, which records data. Includes large feedback resistors to prevent high currents damaging device under test. Principal virtues: low cost, simplicity, and compactness. Also used to evaluate diodes and transistors.

Huston, Steven W.↗

Efficient hemodynamic event detection utilizing relational databases and wavelet analysis

Development of a temporal query framework for time-oriented medical databases has hitherto been a challenging problem. We describe a novel method for the detection of hemodynamic events in multiparameter trends utilizing wavelet coefficients in a MySQL relational database. Storage of the wavelet coefficients allowed for a compact representation of the trends, and provided robust descriptors for the dynamics of the parameter time series. A data model was developed to allow for simplified queries along several dimensions and time scales. Of particular importance, the data model and wavelet framework allowed for queries to be processed with minimal table-join operations. A web-based search engine was developed to allow for user-defined queries. Typical queries required between 0.01 and 0.02 seconds, with at least two orders of magnitude improvement in speed over conventional queries. This powerful and innovative structure will facilitate research on large-scale time-oriented medical databases.

NASA Discipline Cardiopulmonary↗

Development and flight-testing of modular autonomous cultivation systems for biological plastics upcycling aboard the ISS

Cultivation of microorganisms in space has enormous potential to enable in-situ resource utilization (ISRU) Here, we develop an autonomous payload with fully programmable serial passaging and sample preservation, termed the Modular Open Biological Platform (MOBP), and flight-test the MOBP aboard the International Space Station (ISS) by conducting enzymatic and microbial plastics upcycling experiments. The MOBP is a compact, modular bioreactor system that allows for sustained microbial growth via automated media transfers, such as those for sample collection and storage for terrestrial analyses, and precise data monitoring from integrated sensors. The MOBP was flight-tested with two experiments designed to evaluate biological upcycling of the plastic poly(ethylene terephthalate) (PET). The bioproduct βKA can be polymerized into a nylon-6,6 analog with improved properties for use in the production of a variety of materials. We posit the MOBP will aid in democratizing the execution of synthetic biology in spaceflight towards enabling ISRU.

09 BIOMASS FUELS↗

Holographic storage of multicolor information.

Discussion of the merits of the use of holography for storing multicolor information. Holography is shown capable to provide in a compact, easily duplicated, inexpensive, and readily retrievable manner the storage capacity required for the ever growing amounts of alphanumeric, graphic, continuous tone, color, and black-and-white data generated. Following a definition of the holographic concept, the advantages of holography for multicolor information recording, indexing, registration, and reconstruction are reviewed. Special attention is given to display applications including a multicolor moving-map display, a NASA multifunction display, and an automatic-test-equipment information storage system.

Burton, G. T.↗

SDN-NGenIA, a Software Defined Next Generation Integrated Architecture for HEP and Data Intensive Science

This project aims to enable the LHC and other leading programs in high energy physics and other global science domains funded by the DOE to operate with a new level of efficiency and control, through the development of a Next Generation Integrated Architecture (NGenIA) based on intelligent software defined network (SDN)-driven network systems coupled to high throughput applications. While the initial focus is on the challenging LHC use case, the systems and products being developed are general, and apply to many fields of data intensive science ranging from astrophysical sky surveys to bioinformatics and earth observation, as well as other organizations facing the challenges of extracting knowledge from distributed multi-petabyte data stores. A central concept in this development program is a new paradigm ‘consistent network operations’ among widely distributed computing and storage facilities, where stable high throughput flows, at set rates, cross load-balanced network paths, up to flexible high water marks that are adjusted in real time to accommodate other network traffic. The large smooth flows are launched and managed by SDN services that act in concert with the experiments’ site-resident data distribution and management systems, to meet the expanding needs of the science programs. The technical goals include the construction of autonomous, intelligent site-resident services that interact dynamically with network-resident services, and with the science programs’ principal data distribution and management tools, to request or command network resources in support of high throughput petascale to exascale workflow Specific work items include: 1. Developing compact Data Transfer Nodes (DTNs) with auto-tuning functions that support data transfer rates in the 100 Gbps to the 1 Tbps range when used with high throughput data transfer applications 2. Deep site orchestration among virtualized clusters, storage subsystems and subnets to successfully coschedule CPU, storage and network resources 3. Science-program designed site architectures, operational modes, and policy and resource usage priorities, adjudicated across multiple network domains and virtual organizations, using the orchestration functions and methods 4. Seamlessly extending end-to-end operation across both extra-site and intra-site boundaries through the use of Open vSwitch (OVS), FireQoS + next generation Science DMZs 5. Novel methods of system integration that enable granular control of extreme scale long distance transfers through flow matching of scattered source-destination address pairs to multi-domain dynamic circuits 6. Funneling massive sets of streams to DTNs at the site edge hosting petascale buffer pools configured for flows of 100 Gbps and up, exploiting state of the art data transfers 7. Adaptive scheduling based on pervasive end-to-end monitoring, including DTN or compute-node resident agents providing comprehensive end-system profiling 8. Developing unsupervised and supervised machine learning and modeling methods to optimize the workflow involving terabyte to multi-petabyte datasets.

47 OTHER INSTRUMENTATION↗

Glass Bubbles Insulation for Liquid Hydrogen Storage Tanks

A full-scale field application of glass bubbles insulation has been demonstrated in a 218,000 L liquid hydrogen storage tank. This work is the evolution of extensive materials testing, laboratory scale testing, and system studies leading to the use of glass bubbles insulation as a cost efficient and high performance alternative in cryogenic storage tanks of any size. The tank utilized is part of a rocket propulsion test complex at the NASA Stennis Space Center and is a 1960's vintage spherical double wall tank with an evacuated annulus. The original perlite that was removed from the annulus was in pristine condition and showed no signs of deterioration or compaction. Test results show a significant reduction in liquid hydrogen boiloff when compared to recent baseline data prior to removal of the perlite insulation. The data also validates the previous laboratory scale testing (1000 L) and full-scale numerical modeling (3,200,000 L) of boiloff in spherical cryogenic storage tanks. The performance of the tank will continue to be monitored during operation of the tank over the coming years.

Glass bubble↗

Pressure-induced localisation of the hydrogen-bond network in KOH-VI

Using a combination of ab initio crystal structure prediction and neutron diffraction techniques, we have solved the full structure of KOH-VI at 7 GPa. Rather than being orthorhombic and proton-ordered as had previously be proposed, we find that this high-pressure phase of potassium hydroxide is tetragonal (space group I4/mmm) and proton disordered. It has an unusual hydrogen bond topology, where the hydroxyl groups form isolated hydrogen-bonded square planar (OH){sub 4} units. This structure is stable above 6.5 GPa and, despite being macroscopically proton-disordered, local ice rules enforce microscopic order of the hydrogen bonds. We suggest the use of this novel type of structure to study concerted proton tunneling in the solid state, while the topology of the hydrogen bond network could conceivably be exploited in data storage applications based solely on the manipulations of hydrogen bonds. The unusual localisation of the hydrogen bond network under applied pressure is found to be favored by a more compact packing of the constituents in a distorted cesium chloride structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On-line object feature extraction for multispectral scene representation

A new on-line unsupervised object-feature extraction method is presented that reduces the complexity and costs associated with the analysis of the multispectral image data and data transmission, storage, archival and distribution. The ambiguity in the object detection process can be reduced if the spatial dependencies, which exist among the adjacent pixels, are intelligently incorporated into the decision making process. The unity relation was defined that must exist among the pixels of an object. Automatic Multispectral Image Compaction Algorithm (AMICA) uses the within object pixel-feature gradient vector as a valuable contextual information to construct the object's features, which preserve the class separability information within the data. For on-line object extraction the path-hypothesis and the basic mathematical tools for its realization are introduced in terms of a specific similarity measure and adjacency relation. AMICA is applied to several sets of real image data, and the performance and reliability of features is evaluated.

Ghassemian, Hassan↗

DMSP SSJ4 Data Restoration, Classification, and On-Line Data Access

Compress and clean raw data file for permanent storage We have identified various error conditions/types and developed algorithms to get rid of these errors/noises, including the more complicated noise in the newer data sets. (status = 100% complete). Internet access of compacted raw data. It is now possible to access the raw data via our web site, http://www.jhuapl.edu/Aurora/index.html. The software to read and plot the compacted raw data is also available from the same web site. The users can now download the raw data, read, plot, or manipulate the data as they wish on their own computer. The users are able to access the cleaned data sets. Internet access of the color spectrograms. This task has also been completed. It is now possible to access the spectrograms from the web site mentioned above. Improve the particle precipitation region classification. The algorithm for doing this task has been developed and implemented. As a result, the accuracies improved. Now the web site routinely distributes the results of applying the new algorithm to the cleaned data set. Mark the classification region on the spectrograms. The software to mark the classification region in the spectrograms has been completed. This is also available from our web site.

Wing, Simon↗

Experience with dynamic resource provisioning of the CMS online cluster using a cloud overlay

The primary goal of the online cluster of the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) is to build event data from the detector and to select interesting collisions in the High Level Trigger (HLT) farm for offline storage. With more than 1500 nodes and a capacity of about 850 kHEPSpecInt06, the HLT machines represent similar computing capacity of all the CMS Tier1 Grid sites together. Moreover, it is currently connected to the CERN IT datacenter via a dedicated 160 Gbps network connection and hence can access the remote EOS based storage with a high bandwidth. In the last few years, a cloud overlay based on OpenStack has been commissioned to use these resources for the WLCG when they are not needed for data taking. This online cloud facility was designed for parasitic use of the HLT, which must never interfere with its primary function as part of the DAQ system. It also allows to abstract from the different types of machines and their underlying segmented networks. During the LHC technical stop periods, the HLT cloud is set to its static mode of operation where it acts like other grid facilities. The online cloud was also extended to make dynamic use of resources during periods between LHC fills. These periods are a-priori unscheduled and of undetermined length, typically of several hours, once or more a day. For that, it dynamically follows LHC beam states and hibernates Virtual Machines (VM) accordingly. Finally, this work presents the design and implementation of a mechanism to dynamically ramp up VMs when the DAQ load on the HLT reduces towards the end of the fill.

97 MATHEMATICS AND COMPUTING↗

A parameter estimation subroutine package

Linear least squares estimation and regression analyses continue to play a major role in orbit determination and related areas. A library of FORTRAN subroutines were developed to facilitate analyses of a variety of estimation problems. An easy to use, multi-purpose set of algorithms that are reasonably efficient and which use a minimal amount of computer storage are presented. Subroutine inputs, outputs, usage and listings are given, along with examples of how these routines can be used. The routines are compact and efficient and are far superior to the normal equation and Kalman filter data processing algorithms that are often used for least squares analyses.

Bierman, G. J.↗

Balloon borne optical disk mass storage system

An on-board data recording system for balloon-borne interferometer using a vacuum operable, ruggedized WORM optical drive is presented. This system, as presently under development, provides 320 Mbytes of data storage (or approximately 11 hrs at the 64 kbits/sec telemetry rate of the experiment). It has the capability of recording the unmodified telemetry bit system as transmitted or doing some preprocessing of the data onboard. The system is compact and requires less than 28 watts of battery power to operate.

Vanek, M. D.↗

Optimizing Alabama’s CO 2 Storage in Shelby County (Project OASIS) - Deliverable Task 7: Risk Assessment

The “Optimizing Alabama’s CO 2 Storage in Shelby County: Project OASIS” CarbonSAFE Phase II Project seeks to build on regional data sets that demonstrate that the subsurface within Shelby County, Alabama has the potential to store commercial volumes of CO 2 safely, permanently, and economically. The primary target CO 2 Storage Complex is the deep Ketona Dolomite located within a 140 square mile area of the Valley and Ridge Region of Alabama. This deep saline reservoir is beneath a confining system encompassing at least 6,500 ft of shales and other low permeability sediments. Project OASIS drilled a deep stratigraphic test well to confirm the geological properties of the confining system and storage reservoir(s) within the Storage Complex. The geological data was incorporated into numerical models to establish the areal extent of the CO 2 plume and help design the storage site and its monitoring system. The project is managed by the Southern States Energy Board (SSEB), an interstate compact organization consisting of governors and state legislative leaders from sixteen southern states, Puerto Rico, and the U.S. Virgin Islands, as well as an appointee by the President of the United States. The organizational compact provides it with access to state government organizations and legislatures. The Board also maintains an Associate Members program comprised of energy resource companies, utilities, trade groups, academic R&D science and technology experts and energy consultants. Further, the SSEB staff is experienced in managing and coordinating complex energy and environmental programs, from research programs to full-scale design and demonstrations of new and innovative technologies. Project OASIS is a public-private partnership of six entities with multiple principal investigators (PIs). SSEB’s Lead PI and Co-PI are responsible for all aspects of project performance in accordance with the DOE-NETL Cooperative Agreement. SSEB has issued subgrants to Advanced Resources International, Inc., Alabama A&M University, Auburn University, Crescent Resource Innovation, and Oklahoma State University. Advanced Resources International, Inc., issued subgrants to Baker Hughes and Loudon Technical Services for field services

20 FOSSIL-FUELED POWER PLANTS↗