Search NASASearch

SEARCH · Search NASA

Results for “chunking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Production system chunking in SOAR: Case studies in automated learning

A preliminary study of SOAR, a general intelligent architecture for automated problem solving and learning, is presented. The underlying principles of universal subgoaling and chunking were applied to a simple, yet representative, problem in artificial intelligence. A number of problem space representations were examined and compared. It is concluded that learning is an inherent and beneficial aspect of problem solving. Additional studies are suggested in domains relevant to mission planning and to SOAR itself.

Allen, Robert

Denoising with Three Dimensional Fourier Transform for Three Dimensional Images, Including Image Sequences

A method of mitigating noise in source image data representing pixels of a 3-D image. The "3-D image" may be any type of 3-D image, regardless of whether the third dimension is spatial, temporal, or some other parameter. The 3-D image is divided into three-dimensional chunks of pixels. These chunks are apodized and a three-dimensional Fourier transform is performed on each chunk, thereby producing a three-dimensional spectrum of each chunk. The transformed chunks are processed to estimate a noise floor based on spectral values of the pixels within each chunk. A noise threshold is then determined, and the spectrum of each chunk is filtered with a denoising filter based on the noise threshold. The chunks are then inverse transformed, and recombined into a denoised 3-D image.

DeForest, Craig E.

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher

Characterization of Space Shuttle Thermal Protection System (TPS) Materials for Return-to-Flight following the Shuttle Columbia Accident Investigation

During the Space Shuttle Columbia Accident Investigation, it was determined that a large chunk of polyurethane insulating foam (= 1.67 lbs) on the External Tank (ET) came loose during Columbia's ascent on 2-1-03. The foam piece struck some of the protective Reinforced Carbon-Carbon (RCC) panels on the leading edge of Columbia's left wing in the mid-wing area. This impact damaged Columbia to the extent that upon re-entry to Earth, superheGed air approaching 3,000 F caused the vehicle to break up, killing all seven astronauts on board. A paper after the Columbia Accident Investigation highlighted thermal analysis testing performed on External Tank TPS materials (1). These materials included BX-250 (now BX-265) rigid polyurethane foam and SLA-561 Super Lightweight Ablator (highly-filled silicone rubber). The large chunk of foam from Columbia originated fiom the left bipod ramp of the ET. The foam in this ramp area was hand-sprayed over the SLA material and various fittings, allowed to dry, and manually shaved into a ramp shape. In Return-to-Flight (RTF) efforts following Columbia, the decision was made to remove the foam in the bipod ramp areas. During RTF efforts, further thermal analysis testing was performed on BX-265 foam by DSC and DMA. Flat panels of foam about 2-in. thick were sprayed on ET tank material (aluminum alloys). The DSC testing showed that foam material very close to the metal substrate cured more slowly than bulk foam material. All of the foam used on the ET is considered fully cured about 21 days after it is sprayed. The RTF culminated in the successful launch of Space Shuttle Discovery on 7-26-05. Although the flight was a success, there was another serious incident of foam loss fiom the ET during Shuttle ascent. This time, a rather large chunk of BX-265 foam (= 0.9 lbs) came loose from the liquid hydrogen (LH2) PAL ramp, although the foam did not strike the Shuttle Orbiter containing the crew. DMA testing was performed on foam samples taken fiom a simulated PAL ramp panel. It was found that the smooth rind on the foam facing the cable tray did significantly affect the properties of foam at the PAL ramp surface. The smooth rind increased the storage modulus E' of the foam as much as 20- 40% over a temperature range of -145 to 95 C. Because of foam loss fiom the PAL ramp, future Shuttle flights were grounded indefinitely to allow further testing to better understand foam properties. The decision was also made to remove foam from the LH2 PAL, ramp. Other RTF efforts prior to the launch of Discovery included

Wingard, Doug

Implementing Connected Component Labeling as a User Defined Operator for SciDB

We have implemented a flexible User Defined Operator (UDO) for labeling connected components of a binary mask expressed as an array in SciDB, a parallel distributed database management system based on the array data model. This UDO is able to process very large multidimensional arrays by exploiting SciDB's memory management mechanism that efficiently manipulates arrays whose memory requirements far exceed available physical memory. The UDO takes as primary inputs a binary mask array and a binary stencil array that specifies the connectivity of a given cell to its neighbors. The UDO returns an array of the same shape as the input mask array with each foreground cell containing the label of the component it belongs to. By default, dimensions are treated as non-periodic, but the UDO also accepts optional input parameters to specify periodicity in any of the array dimensions. The UDO requires four stages to completely label connected components. In the first stage, labels are computed for each subarray or chunk of the mask array in parallel across SciDB instances using the weighted quick union (WQU) with half-path compression algorithm. In the second stage, labels around chunk boundaries from the first stage are stored in a temporary SciDB array that is then replicated across all SciDB instances. Equivalences are resolved by again applying the WQU algorithm to these boundary labels. In the third stage, relabeling is done for each chunk using the resolved equivalences. In the fourth stage, the resolved labels, which so far are "flattened" coordinates of the original binary mask array, are renamed with sequential integers for legibility. The UDO is demonstrated on a 3-D mask of O(1011) elements, with O(108) foreground cells and O(106) connected components. The operator completes in 19 minutes using 84 SciDB instances.

UDO

Leveraging STARE for Co-aligned Data Locality with netCDF and Python MPI

We have leveraged STARE indexing to package partitioned data chunks from diverse datasets into netCDF files, distributed them on a cluster of 16 lightweight nodes with their placements spatiotemporally co-aligned, and demonstrated a few integrative analyses using netCDF parallel I/O and Python MPI, with single-user performance and scalability comparable to, or even better than, that of a parallel array database management system (ADBMS) such as SciDB. However, records of the node location and STARE index ranges for each data chunk, similar to the chunk maps of SciDB, must be maintained and consulted by the I/O and analysis code for coordinating the analytic operations in parallel, in order to achieve the good performance and scalability.

Kwo-Sen Kuo

The rings of Saturn - Two-frequency radar observations

Results are reported for a two-frequency dual-polarization radar-echo study of Saturn's rings which involved monostatic operation at a wavelength of 3.5 cm and bistatic operation at 12.6 cm. The radar observations show that the rings effectively depolarize linearly and circularly polarized incident waves at the two wavelengths; that the ring particles are unusually efficient radar reflectors, yielding approximately the same high total cross section at both wavelengths; and that there is an apparent excess of power at the 'central' Doppler shifts when compared with homogeneous scattering models based on the optically observed ring distributions. Several possible explanations for these three radar properties are considered. It is found that a model which hypothesizes a thick cloud of irregular water-ice chunks a few centimeters or larger in radius and a model which postulates a monolayer of multimeter-sized water-frost-coated metallic chunks both seem capable of explaining the first two radar properties. But no consistent explanation is found for the excess low-frequency spectral power.

Goldstein, R. M.

Sputtering of uranium

Results are presented for an experimental study of the sputtering of U-235 atoms from foil targets by hydrogen, helium, and argon ions, which was performed by observing tracks produced in mica by fission fragments following thermal-neutron-induced fission. The technique used allowed measurements of uranium sputtering yields of less than 0.0001 atom/ion as well as yields involving the removal of less than 0.01 monolayer of the uranium target surface. The results reported include measurements of the sputtering yields for 40-120-keV protons, 40-120-keV He-4(+) ions, and 40- and 80-keV Ar-40(+) ions, the mass distribution of chunks emitted during sputtering by the protons and 80-keV Ar-40(+) ions, the total chunk yield during He-4(+) sputtering, and some limited data on molecular sputtering by H2(+) and H3(+). The angular distribution of the sputtered uranium is discussed, and the yields obtained are compared with the predictions of collision cascade theory.

Gregg, R.

Method of purifying metallurgical grade silicon employing reduced pressure atmospheric control

A method in which a quartz tube is charged with chunks of metallurgical grade silicon and/or a mixture of such chunks and high purity quartz sand, and impurities from a class including aluminum, boron, as well as certain transition metals including nickel, iron, and manganese is described. The tube is then evacuated and heated to a temperature within a range of 800 C to 1400 C. A stream of gas comprising a reactant, such as silicon tetrafluoride, is continuously delivered at low pressures through the charge for causing a metathetical reaction of impurities of the silicon and the reactant to occur for forming a volatile halide and leaving a residue of silicon of an improved purity. The reactant which included carbon monoxide gas and impurities such as iron and nickel react to form volatile carbonyls.

Ingle, W. M.

Characterization of Space Shuttle External Tank Thermal Protection System (TPS) Materials in Support of the Columbia Accident Investigation

NASA suffered the loss of the seven-member crew of the Space Shuttle Columbia on February 1, 2003 when the vehicle broke apart upon re-entry to the Earth's atmosphere. The final report of the Columbia Accident Investigation Board (CAIB) determined that the accident was caused by a launch ascent incident-a suitcase-sized chunk of insulating foam on the Shuttle's External Tank (ET) broke off, and moving at almost 500 mph, struck an area of the leading edge of the Shuttle s left wing. As a result, one or more of the protective Reinforced Carbon-Carbon (RCC) panels on the wing leading edge were damaged. Upon re-entry, superheated air approaching 3,000 F breached the wing damage and caused the vehicle breakup and loss of crew. The large chunk of insulating foam that broke off during the Columbia launch was determined to come from the so-called bipod ramp area where the Shuttle s orbiter (containing crew) is attached to the ET. Underneath the foam in the bipod ramp area is a layer of TPS that is a cork-filled silicone rubber composite. In March 2003, the NASA Marshall Space Flight Center (MSFC) in Huntsville, Alabama received cured samples of the foam and composite for testing from the Michoud Assembly Facility (MAF) in New Orleans, Louisiana. The MAF is where the Shuttle's ET is manufactured. The foam and composite TPS materials for the ET have been well characterized for mechanical property data at the super-cold temperatures of the liquid oxygen and hydrogen fuels used in the ET. However, modulus data on these materials is not as well characterized. The TA Instruments 2980 Dynamic Mechanical Analyzer (DMA) was used to determine the modulus of the two TPS materials over a range of -145 to 95 C in the dual cantilever bending mode. Multi-strain, fixed frequency DMA tests were followed by multi-frequency, fixed strain tests to determine the approximate bounds of linear viscoelastic behavior for the two materials. Additional information is included in the original extended abstract.

Wingard, Charles D.

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei

Heating of food in modified atmospheres

Food heating tests were conducted with two model foods; a Carnation turkey salad sandwich spread and frankfurter chunks in a sauce of water and agar. For the first series of tests comparing heating in five different atmospheres, the atmospheres were: (1) air at atmospheric pressure, (2) air at 5 psia, (3) helium at 5 psia, (4) oxygen-nitrogen mixture at 5 psia, and (5) oxygen-helium mixture at 5 psia. No significant differences in heating rates were caused by varying the atmosphere. Initial food temperatures were varied in the next series of tests. Heating times were found to increase with decreasing initial temperatures. There were also differences in heating times between the two foods used.

Sweat, V. E.

Preliminary report of mineralogical and petrographic study of the Luna 16 lunar surface material sample

Unsorted powder and grains larger than 0.5 mm from the L-16-19-118 lunar sample consisted of eight basaltic fragments, four fragments of breccias (of which one was quite light), one white grain (maskelynite), one chondrule, and slagged dark partially glassy chunks. The mineralogical composition of all rounded particles led to the assumption that they are all of lunar origin; but their presence in the regolith indicates formation of chondrulic meteorites. The existence of several grains of pyroxene coated with a thin glassy film merits attention.

Christophe-Michel-levi, M.

Radar observations at 3.5 and 12.6 cm wavelength of asteroid 433 Eros

A study of the asteroid 433 Eros using 3.5 and 12.6 cm radar waves indicates that the surface is very much rougher than any planetary or lunar surface observed by this method. A surface completely covered with sharp edges, pits, subsurface holes, or embedded chunks with scale sizes on the order of our wavelengths seems to be indicated. A model based on a rough rotating triaxial ellipsoid having radii in the rotation equator of 18.6 and 7.9 km agrees well with our data, although a strong wobble in the apparent center frequency of the spectra as rotation progresses indicates that one side may be more reflective than the other, or more likely, that the projected axis of rotation does not equally divide the projected area.

Jurgens, R. F.

Producing silicon continuously

Fluid-bed vaporization followed by chemical vapor deposition generates large, semiconductor-grade silicon particles. Method is economical, high-volume alternative to conventional batch-processing methods. Harvested chunks, extracted in cyclone separator, are about 0.5 to 1.3 centimeters in diameter. Process is not limited to polymer feedstock; it utilizes any halosilane intermediate used in silicon production.

Ingle, W. M.

The narrow rings of Jupiter, Saturn and Uranus

The origin of the newly discovered narrow ring systems around Jupiter, Saturn and Uranus is considered. It is pointed out that both the Uranian and Jovian ring systems have mean orbital radii of 1.8 planetary radii and lie within the Roche zones of their respective planets, and it is suggested that the Jovian ring is the product of the disintegration of a satellite that entered the Roche zone, and that large numbers of small particles are now in horseshoe orbits about the Lagrangian equilibrium points of the remnant chunks. Analysis of the path of a ring particle in a horseshoe orbit is shown to result in ring structures in agreement with those observed for the circular rings of Jupiter and the highly eccentric ring of Uranus. The stability of these ring systems is then considered, and it is suggested that the F ring of Saturn, which lies outside the Roche zone, represents primordial matter not yet accreted by small satellites just inside the Mimas first-order resonances.

Dermott, S. F.

Low cost solar aray project: Experimental process system development unit for producing semiconductor-grade silicon using the silane-to-silicon process

This phase consists of the engineering design, fabrication, assembly, operation, economic analysis, and process support R&D for an Experimental Process System Development Unit (EPSDU). The mechanical bid package was issued and the bid responses are under evaluation. Similarly, the electrical bid package was issued, however, responses are not yet due. The majority of all equipment is on order or has been received at the EPSDU site. The pyrolysis/consolidation process design package was issued. Preparation of process and instrumentation diagram for the free-space reactor was started. In the area of melting/consolidation, Kayex successfully melted chunk silicon and have produced silicon shot. The free-space reactor powder was successfully transported pneumatically from a storage bin to the auger feeder twenty-five feet up and was melted. The fluid-bed PDU has successfully operated at silane feed concentrations up to 21%. The writing of the operating manual has started. Overall, the design phase is nearing completion.

Source record