Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

BioPig: Developing Cloud Computing Applications for Next-Generation Sequence Analysis

Next Generation sequencing is producing ever larger data sizes with a growth rate outpacing Moore's Law. The data deluge has made many of the current sequenceanalysis tools obsolete because they do not scale with data. Here we present BioPig, a collection of cloud computing tools to scale data analysis and management. Pig is aflexible data scripting language that uses Apache's Hadoop data structure and map reduce framework to process very large data files in parallel and combine the results.BioPig extends Pig with capability with sequence analysis. We will show the performance of BioPig on a variety of bioinformatics tasks, including screeningsequence contaminants, Illumina QA/QC, and gene discovery from metagenome data sets using the Rumen metagenome as an example.

59 BASIC BIOLOGICAL SCIENCES↗

Data Storage for HEP Experiments in the Era of High-Performance Computing

As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accordingly. With such large data volumes, next-generation efforts like the HL-LHC and DUNE will rely even more on both high-throughput (HTC) and high-performance (HPC) computing clusters. Full utilization of HPC resources requires scalable and efficient data-handling and I/O. For the last few decades, ROOT has been used by most HEP experiments to store data. However, other storage technologies like HDF5 may perform better in HPC environments. Initial explorations with HDF5 have begun using ATLAS, CMS and DUNE data; the DUNE experiment has also adopted HDF5 for its data-acquisition system. This paper presents the future outlook of the HEP computing and the role of HPC, and a summary of ongoing and future works to use HDF5 as a possible data storage technology for the HEP experiments to use in HPC environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Principal Component Analysis of Thermographic Data

Principal Component Analysis (PCA) has been shown effective for reducing thermographic NDE data. While a reliable technique for enhancing the visibility of defects in thermal data, PCA can be computationally intense and time consuming when applied to the large data sets typical in thermography. Additionally, PCA can experience problems when very large defects are present (defects that dominate the field-of-view), since the calculation of the eigenvectors is now governed by the presence of the defect, not the "good" material. To increase the processing speed and to minimize the negative effects of large defects, an alternative method of PCA is being pursued where a fixed set of eigenvectors, generated from an analytic model of the thermal response of the material under examination, is used to process the thermal data from composite materials. This method has been applied for characterization of flaws.

Winfree, William P.↗

Mitigating Data Center Impact on Grid Stability: A Coordinated Control Strategy Using Verrus StabiliGrid Architecture

Large data centers, which now represent a significant and growing share of the total U.S. grid load, can inadvertently destabilize the electrical grid when they disconnect simultaneously during brief voltage disturbances. The July 10, 2024, Eastern Interconnection incident, in which a sub-100-millisecond transmission fault triggered the cascading loss of approximately 1,500 MW of data center load, illustrates this vulnerability. While commercial battery energy storage systems (BESS) deployed in data centers provide device-level fault ride-through per IEEE 1547, they lack coordination with facility protection logic and uninterruptible power supplies (UPS), limiting their effectiveness as grid-stabilizing assets. This report presents the Verrus StabiliGrid architecture, a coordinated control framework that integrates BESS, UPS, and point-of-interconnection (POI) protection settings to enable data centers to ride through both undervoltage and overvoltage grid contingencies without disconnecting. The four-step strategy encompasses: (1) high-resolution power quality monitoring to detect the grid state during events such as undervoltage, overvoltage, underfrequency, and overfrequency; (2) POI protection settings that allow for extended ride-through and grid-connected operation during grid contingencies; (3) grid state-driven autonomous dispatch of assets to improve grid resilience by reducing power draw during undervoltage or absorbing more power during overvoltage events; and (4) coordinated post-recovery dispatch of data center assets to restore firm load to pre-contingency levels. Validated through controller-hardware-in-the-loop (C-HIL) simulations at the National Laboratory of the Rockies, results show grid import restoration to pre-fault levels within 100 milliseconds of voltage recovery. This work advances the ability of data centers to transition from passive, disturbance-sensitive loads to active participants in grid stability, a capability increasingly required by emerging NERC and ERCOT regulatory frameworks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Fractal image compression

Fractals are geometric or data structures which do not simplify under magnification. Fractal Image Compression is a technique which associates a fractal to an image. On the one hand, the fractal can be described in terms of a few succinct rules, while on the other, the fractal contains much or all of the image information. Since the rules are described with less bits of data than the image, compression results. Data compression with fractals is an approach to reach high compression ratios for large data streams related to images. The high compression ratios are attained at a cost of large amounts of computation. Both lossless and lossy modes are supported by the technique. The technique is stable in that small errors in codes lead to small errors in image data. Applications to the NASA mission are discussed.

Barnsley, Michael F.↗

Improving the Effectiveness of Burst Buffers for Big Data Processing in HPC Systems with Eley

Here, burst buffer is an effective solution for reducing the data transfer time and the I/O interference in HPC systems. Extending Burst Buffers (BBs) to handle Big Data applications is challenging because BBs must account for the large data inputs of Big Data applications and the Quality-of-Service (QoS) of HPC applications which are considered as first-class citizens in HPC systems. Existing BBs focus on only intermediate data of Big Data applications and incur a high performance degradation of both Big Data and HPC applications. We present Eley , a burst buffer solution that helps to accelerate the performance of Big Data applications while guaranteeing the QoS of HPC applications. To achieve this goal, Eley embraces interference-aware prefetching technique that makes reading data input faster while introducing low interference for HPC applications. Evaluations using a wide range of Big Data and HPC applications demonstrate that Eley improves the performance of Big Data applications by up to 30% compared to existing BBs while maintaining the QoS of HPC applications.

97 MATHEMATICS AND COMPUTING↗

Prediction of aircraft sideline noise attenuation

A computational study is made using the recommended ground effect theory by Pao, Wenzel, and Oncley. It is shown that this theory adequately predicts the measured ground attenuation data by Parkin and Scholes, which is the only available large data set. It is also shown, however, that the ground effect theory does not predict the measured lateral attenuations from actual aircraft flyovers. There remain one or more important lateral effects on aircraft noise, such as sideline shielding of sources, which must be incorporated in the prediction methods. Experiments at low elevation angles (0 deg to 10 deg) and low-to-intermediate frequencies are recommended to further validate the ground effect theory.

Zorumski, W. E.↗

Ultraviolet O2 transmittance - AURIC implementation

A new spectrally precise approach to Schumann-Runge synthesis has been devised, employing nine (9) different spectral arrays containing polynomial coefficients. The coefficients were fit to calculated cross sections obtained from a detailed Schumann-Runge model that incorporates the most recent high resolution spectroscopic data for a temperature range between 130 and 500K. This large data base is being used to reexamine the existing parameterizations of UV transmission and photolysis. In addition, it is now possible to extend atmospheric radiance codes further into the ultraviolet. Initial implementation has been accomplished for the MODTRAN code as part of the eventual development of AURIC, the Atmospheric Ultraviolet Radiance Integrated Code.

Anderson, G. P.↗

Large-scale space use of large juvenile and adult smalltooth sawfish Pristis pectinata: implications for management

The smalltooth sawfish Pristis pectinata is an endangered species endemic to the Atlantic Ocean. The only known viable populations occur in the USA along both coasts of Florida and in the western Bahamas. Little is known about habitat use and movement ecology of large juvenile and adult smalltooth sawfish. Although Critical Habitat — a management designation in the USA — has been identified for small juveniles, it has yet to be identified for these life stages. Between May 2016 and April 2019, we used passive acoustic telemetry and 3 large data sharing networks of receivers to track movements of 43 large juvenile and adult smalltooth sawfish. During this study, 24 females and 19 males were implanted with transmitters with estimated 4 or 10 yr battery lives. These tagged individuals were detected off the southeastern USA on 461 receivers ranging from off the coast of Brunswick, Georgia, to the lower Florida Keys, and along the Gulf coast to Apalachee Bay, Florida. Seasonal migrations were undertaken by 58% (43% mature; 57% immature) of the tagged individuals, with the remainder being apparent residents of their tagging locations. Tagged sawfish from both size classes and of both sexes migrated, which indicates that neither sex nor length is a predictor of whether a sawfish will migrate or not. Although both coasts of Florida were used for migration, most individuals consistently used the same coast when they migrated. The areas surrounding Boca Grande, Cape Canaveral, and the lower Florida Keys were heavily visited sites that could be further evaluated as potential Critical Habitat for these life stages. Understanding the movement patterns of this Critically Endangered species is essential for creating policies to protect areas important for promoting growth of the population.

Pristis pectinata Habitat use · Acoustic monitorin↗

Opportunities for an Integrated Web-Based Workbench for Data Access and Analysis - 20244

Management of environmental issues can require integration of multiple types of data and information, conducting data analysis and interpretation, and providing data visualization for effective communications. These data elements are important for site management to support regulator interactions and provide defensibility for remedial decisions. Databases and information repositories are core elements of managing data; however, efficient data access and analysis also enable effective site management. The U.S. Department of Energy (DOE) Hanford Site is an example of a complex site with a voluminous quantity of environmental data and a need for efficient site management. Different tiers of data and information tools have been developed and deployed to address site needs. These tools are configured for ready access via the web site interfaces and meet the rigorous quality requirements for environmental site management. Evolving efforts are focused on an integrated platform to meet site environmental management needs. In this platform, users can access site information at multiple levels of detail based on their need and permissions, so that data and associated analyses are presented within the context of the site mission and the user's management or technical needs. This concept is not only applicable at individual sites like Hanford but also applicable at other sites within the DOE complex. An integrated web-based architecture that links data visualization, data analytics, and management tools can provide holistic access to large data sets, minimize complexity, and maximize interactivity and technical communication. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

AtomSets as a hierarchical transfer learning framework for small and large materials datasets

Abstract Predicting properties from a material’s composition or structure is of great interest for materials design. Deep learning has recently garnered considerable interest in materials predictive tasks with low model errors when dealing with large materials data. However, deep learning models suffer in the small data regime that is common in materials science. Here we develop the AtomSets framework, which utilizes universal compositional and structural descriptors extracted from pre-trained graph network deep learning models with standard multi-layer perceptrons to achieve consistently high model accuracy for both small compositional data (<400) and large structural data (>130,000). The AtomSets models show lower errors than the graph network models at small data limits and other non-deep-learning models at large data limits. They also transfer better in a simulated materials discovery process where the targeted materials have property values out of the training data limits. The models require minimal domain knowledge inputs and are free from feature engineering. The presented AtomSets model framework can potentially accelerate machine learning-assisted materials design and discovery with less data restriction.

Chen, Chi (ORCID:0000000180087043)↗

THE EAST-WEST METHOD: AN EXPOSURE-INDEPENDENT METHOD TO SEARCH FOR LARGE-SCALE ANISOTROPIES OF COSMIC RAYS

The measurement of large-scale anisotropies in cosmic ray arrival directions at energies above 10{sup 13} eV is performed through the detection of extensive air showers (EAS) produced by cosmic ray interactions in the atmosphere. The observed anisotropies are small, so accurate measurements require small statistical uncertainties, i.e., large data sets. These can be obtained by employing ground detector arrays with large extensions (from 10{sup 4} to 10{sup 9} m{sup 2}) and long operation time (up to 20 years). The control of such arrays is challenging and spurious variations in the counting rate due to instrumental effects (e.g., data taking interruptions or changes in the acceptance) and atmospheric effects (e.g., air temperature and pressure effects on EAS development) are usually present. These modulations must be corrected very precisely before performing standard anisotropy analyses, i.e., harmonic analysis of the counting rate versus local sidereal time. In this paper we discuss an alternative method to measure large-scale anisotropies, the 'East-West method'. It was originally proposed in the 1940s to study asymmetries in the flux of solar cosmic rays and later applied by Nagashima et al. to EAS at higher energies. It is a differential method, as it is based on the analysis of the difference of the counting rates in the east and west directions. Besides explaining the principle, we present here its mathematical derivation, showing that the method is largely independent of experimental effects, that is, it does not require corrections for acceptance and/or for atmospheric effects. We explain the use of the method to derive the amplitude and phase of the anisotropy and demonstrate its power under different conditions of detector operation.

79 ASTRONOMY AND ASTROPHYSICS↗

Combining LANDSAT MSS, aerial photographs and ground measurements to estimate rangeland productivity

The production of a vegetation map of over 2.2 million acres with detail down to the plant community level, and the production of estimates of rangeland productivity (pounds of usable forage per acre for cattle) for a 500,000 acre subset of area with a design goal for accuracy and precision of + or - 20% at the 80% confidence level, are considered. The data consist of five groups: maps of area, LANDSAT data, digital terrain data, large scale aerial photography, and ground plots. An outline of the data acquisition and data reduction schemes are presented.

Gialdini, M. J.↗

Analysis and representation of complex structures in separated flows

We discuss our recent work on extraction and visualization of topological information in separated fluid flow data sets. As with scene analysis, an abstract representation of a large data set can greatly facilitate the understanding of complex, high-level structures. When studying flow topology, such a representation can be produced by locating and characterizing critical points in the velocity field and generating the associated stream surfaces. In 3D flows, the surface topology serves as the starting point. The 2D tangential velocity field near the surface of the body is examined for critical points. The tangential velocity field is integrated out along the principal directions of certain classes of critical points to produce curves depicting the topology of the flow near the body. The points and curves are linked to form a skeleton representing the 2D vector field topology. This skeleton provides a basis for analyzing the 3D structures associated with the flow separation. The points along the separation curves in the skeleton are used to start tangent curve integrations. Integration origins are successively refined to produce stream surfaces. The map of the global topology is completed by generating those stream surfaces associated with 3D critical points.

Helman, James↗

Upward Flammability Testing: A Probabilistic Measurement

Examination of NASA-STD-6001 Test 1 data suggests burn length outcome for a given environment has a large statistical variation from run to run. Large data sets show that burn length data form cumulative probability distribution curves, which describe a material's characteristic to burn in a specific environment, suggesting that the current practice of testing three samples at specific conditions is inadequate. Sufficient testing can establish material characteristics probability curves to provide the probability that a material will sustain a burn length of at least 15.24 cm (6.0 in.) or will sustain burning until all material is consumed. A simple pasdfail criterion may not be possible or practical. Future application of flammability data for some material classes may require the engineer to assess risk based on the probability of an occurrence and the probable outcome with different materials as characterized with cumulative burn length distributions for specific use conditions.

Davis, Samuel E.↗

Operations of the Optical Communications Demonstration for the Orion EM-2 Mission

The GSFC implementation of an Optical Communication System to demonstrate an operational optical communication link for Orion EM-2. It will serve as a base for providing an operational optical communications capability for future Orion missions. GSFC plans to maintain a development path for the optical communication flight terminal to allow commercialization and implementation on future Orion missions. The Orion optical module part of the optical communications flight terminal and its control electronics have a common architecture with the ILLUMA-T optical terminal provided by GSFC for use on the ISS. The plan is to flow data from Orion through the Optical Communication Fight Terminal to the Optical Communication Ground Terminal and reverse. NASA's Orion spacecraft is an exploratory vehicle designed for longer-duration flights beyond the Moon. Following Orion's Exploration Mission-1 (EM-1), during which the spacecraft will travel beyond the Moon, enter a distant retrograde orbit around the Moon and return to Earth unmanned, Exploration Mission-2 (EM-2) will see a crewed spacecraft complete a slightly different flight path. First crewed test flight of the Orion spacecraft, currently targeting a June 30, 2022 launch. The mission involves: One revolution in Low Earth Orbit (LEO) parking orbit to verify basic Orion systems functionality and deploy solar arrays. A single 42-hour Highly Elliptical Orbit (HEO) intermediate checkout orbit allows characterization of the Orion vehicle system performance prior to committing to a cis-lunar flight. Trans Lunar Injection (TLI) burn using Orion Service Module (SM) main engine, which sends Orion on a lunar flyby and free return. Skip reentry at lunar return velocities to splashdown off the coast of San Diego. Total mission duration is approximately 10 days. EM-2 is the first crewed mission of the Orion Spacecraft that crew brings more video up/downloads, file transfers, and real-time chats with family back home and high-rate communications enables live HD streaming for Crew conferences, Public Affairs Office (PAO) events, and significant mission events. Also still collecting vehicle data on numerous Orion subsystems via Development Flight Instrumentation (DFI) allows large data volume returns sooner for DFI and future science payloads, as opposed to waiting for end-of-mission. O2O is a demonstration of operational utility system tested as a Developmental Test Objective (DTO) and not required to meet mission requirements/success/ Flight Test Objectives (FTO). EM-2 architecture is as close to future mission operational architecture as possible.Orion subsystems (video, DFI, etc.) expected to generate ~250 GB of data in the first 24 hours of flight. Total data generated over the mission estimated to be more than 400 GBUsing S-Band alone, Orion limited to ~ 6GB of data downlink per day. Because of this limitation, Orion is planning to limit live video downlinks on EM-1 in order to downlink high priority fileswith 1 hour/day of Optical Communication, Orion could downlink ~6x more data per day (~ 36GB/day).The optical communication system is capable of multiple data rates up to at least 80 Mbps downlink for the transfer of Orion data to Earth while Orion is operating in the lunar vicinity.

Optical Communication↗

Enhancement of the NMSU Channel Error Simulator to Provide User-Selectable Link Delays

This is the third in a continuing series of reports describing the development of the Space-to-Ground Link Simulator (SGLS) to be used for testing data transfers under simulated space channel conditions. The SGLS is based upon Virtual Instrument (VI) software techniques for managing the error generation, link data rate configuration, and, now, selection of the link delay value. In this report we detail the changes that needed to be made to the SGLS VI configuration to permit link delays to be added to the basic error generation and link data rate control capabilities. This was accomplished by modifying the rate-splitting VIs to include a buffer the hold the incoming data for the duration selected by the user to emulate the channel link delay. In sample tests of this configuration, the TCP/IP(sub ftp) service and the SCPS(sub fp) service were used to transmit 10-KB data files using both symmetric (both forward and return links set to 115200 bps) and unsymmetric (forward link set at 2400 bps and a return link set at 115200 bps) link configurations. Transmission times were recorded at bit error rates of 0 through 10(exp -5) to give an indication of the link performance. In these tests. we noted separate timings for the protocol setup time to initiate the file transfer and the variation in the actual file transfer time caused by channel errors. Both protocols showed similar performance to that seen earlier for the symmetric and unsymmetric channels. This time, the delays in establishing the file protocol also showed that these delays could double the transmission time and need to be accounted for in mission planning. Both protocols also showed a difficulty in transmitting large data files over large link delays. In these tests, there was no clear favorite between the TCP/IP(sub ftp) and the SCPS(sub fp). Based upon these tests, further testing is recommended to extend the results to different file transfer configurations.

Horan, Stephen↗