Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data analysis methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Optimising the processing and storage of visibilities using lossy compression

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.

Techniques: interferometric↗
DOE OSTI2025

Elliptic multipoles and the modeling of narrow-gap bend magnets in accelerators

We highlight the virtues of 2D elliptic-multipole field expansions in modeling the magnetic fields of narrow-aperture, straight-axis bending magnets with parallel faces, addressing the limitations of the conventional circular multipole series when the beam-orbit sagitta exceeds the magnet's vertical half-gap. The elliptic multipoles provide a convenient way to represent the field in all aspects of the magnet development (design, particle-tracking simulations, measurements). We propose a numerically robust method of data analysis to determine the elliptic (or circular) multipoles from stretched-wire measurements with the wire moving on an arbitrary path.

Venturini, Marco↗
DOE OSTI2024

Measurements of the z > 5 Lyman-α forest flux autocorrelation functions from the extended XQR-30 data set

We present the first observational measurements of the Lyman-α (Ly α) forest flux autocorrelation functions in ten redshift bins from 5.1 ≤ z ≤ 6.0. We use a sample of 35 quasar sightlines at z > 5.7 from the extended XQR-30 data set; these data have signal-to-noise ratios of >20 per spectral pixel. We carefully account for systematic errors in continuum reconstruction, instrumentation, and contamination by damped Ly α systems. With these measurements, we introduce software tools to generate autocorrelation function measurements from any simulation. Our measurements of the smallest bin of the autocorrelation function increase with redshift when normalizing by the mean flux, $\langle{F}\rangle$. This increase may come from decreasing $\langle{F}\rangle$ or increasing mean free path of hydrogen-ionizing photons, λmfp. Recent work has shown that the autocorrelation function from simulations at z > 5 is sensitive to λmfp, a quantity that contains vital information on the ending of reionization. For an initial comparison, we show our autocorrelation measurements with simulation models for recently measured λmfp values and find good agreements. Further work in modelling and understanding the covariance matrices of the data is necessary to get robust measurements of λmfp from this data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Detection of the large-scale tidal field with galaxy multiplet alignment in the DESI Y1 spectroscopic survey

We explore correlations between the orientations of small galaxy groups, or ‘multiplets’, and the large-scale gravitational tidal field. Using data from the Dark Energy Spectroscopic Instrument (DESI) Y1 survey, we detect the intrinsic alignment (IA) of multiplets to the galaxy-traced matter field out to separations of $100\,h^{-1}$ Mpc. Unlike traditional IA measurements of individual galaxies, this estimator is not limited by imaging of galaxy shapes and allows for direct IA detection beyond redshift $z=1$. Multiplet alignment is a form of higher order clustering, for which the scale-dependence traces the underlying tidal field and amplitude is a result of small-scale ($\lt 1h^{-1}$ Mpc) dynamics. Within samples of bright galaxies, luminous red galaxies (LRG) and emission-line galaxies, we find similar scale-dependence regardless of intrinsic luminosity or colour. This is promising for measuring tidal alignment in galaxy samples that typically display no IA. DESI’s LRG mock galaxy catalogues created from the A BACUS S UMMIT N -body simulations produce a similar alignment signal, though with a 33 per cent lower amplitude at all scales. An analytic model using a non-linear power spectrum (NLA) only matches the signal down to 20 $h^{-1}$ Mpc. Our detection demonstrates that galaxy clustering in the non-linear regime of structure formation preserves an interpretable memory of the large-scale tidal field. Multiplet alignment complements traditional two-point measurements by retaining directional information imprinted by tidal forces, and contains additional line-of-sight information compared to weak lensing. This is a more effective estimator than the alignment of individual galaxies in dense, blue, or faint galaxy samples.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Galaxy-multiplet clustering from DESI DR2

We present an efficient estimator for higher-order galaxy clustering using small groups of nearby galaxies, or multiplets. Using the Luminous Red Galaxy (LRG) sample from the Dark Energy Spectroscopic Instrument (DESI) Data Release 2, we identify galaxy multiplets as discrete objects and measure their cross-correlations with the general galaxy field. Our results show that the multiplets exhibit stronger clustering bias as they trace more massive dark matter halos than individual galaxies. When comparing the observed clustering statistics with the mock catalogs generated from the N-body simulation AbacusSummit, we find that the mocks underpredict multiplet clustering despite reproducing the galaxy two-point auto-correlation reasonably well. This discrepancy indicates that the standard Halo Occupation Distribution (HOD) model is insufficient to describe the properties of galaxy multiplets, revealing the greater constraining power of this higher-order statistic on galaxy-halo connection and the possibility that multiplets are specific to additional assembly bias. We demonstrate that incorporating secondary biases into the HOD model improves agreement with the observed multiplet statistics, specifically by allowing galaxies to preferentially occupy halos in denser environments. Our results highlight the potential of utilizing multiplet clustering, beyond traditional two-point correlation measurements, to break degeneracies in models describing the galaxy-dark matter connection.

cosmology↗
DOE OSTI2024

Field Validation of MVA Technology for Offshore CCS: Novel Ultra-High-Resolution 3D Marine Seismic Technology (P-Cable) (Final Report)

The objectives of the proposed study were to deploy and validate a specific monitoring technology, high-resolution 3D marine seismic (HR3D), appropriate for large-demonstration and commercial-scale offshore CCS sites. The project accomplished successful acquisition two HR3D seismic surveys. The first HR3D dataset was over the offshore injection site of the Tomakomai, Japan integrated pilot CCS project, which at the time of survey acquisition was actively injecting CO 2 . The first survey also represented a successful international collaboration between the DOE NETL program and Japan’s national CCS program and was the first successful acquisition and use of HR3D over an active CO 2 injection site (Meckel, Feng et al. 2019). The Tomakomai HR3D survey successfully tested a novel 4-streamer HR3D system array in which, for the first time, no cross-cable (aka “P-Cable”) was utilized and only four GeoEel streamers were used instead of the standard 12-streamer configuration. Consequently, this was not, strictly speaking, a deployment of the “P-Cable” system of (Planke and Berndt 2004) but rather a modified version, thereof, and it is the first known demonstration of the modified system configuration. One very positive outcome from the Japanese collaboration earlier in the project was the ability to learn from the Japanese how they used tail buoys with GPS to determine the position of the seismic source and receivers in time and space. Based on that experience, GCCC designed and built six GPS receivers that could be used to position the streamer receivers and the seismic source via tail buoys. A fundamental advance that was made on the original design, was the ability to directly power the tail buoy GPS units and transfer data through the streamers (i.e., vs. the batteries used at Tomakomai). The bulkiness of the GPS batteries caused drag and episodic surging of the buoys, which affected data quality by lifting up the tail end of the streamers so the receivers were not at the same depth. The units were tested onshore for accuracy and functionality, and the design was subsequently and successfully tested in marine acquisition mode during the SLP survey acquisition. The marine acquisition test and survey satisfied Subtasks 2.2.2, Novel Positioning Technology Selection and Subtask 2.2.3, Novel Positioning Technology Deployment. Results of the novel positioning technology selection (Subtask 2.2.2) were considered successful and will be incorporated in future HR3D seismic acquisition projects to reduce costs, improve deployment safety at sea, and integrate both seismic and data recording via a single data transfer through the streamers to the recording system. The project also established a permitting process through NETL NEPA compliance, which included an Environmental Assessment in a marine setting and is required for conducting these types of surveys using Federal funding. The permitting process charted a “boilerplate,” which can allow future surveys related to other funded projects to move forward more expeditiously. Future improvements that could be considered are more robust seals on the GPS module and stronger materials (especially joints) on tail buoy fabrication. These would increase fixed costs, but would be advisable and probably more economic long-term if multiple HR3D surveys are planned. Project Accomplishments include: • Pre-survey Sensitivity Study • Marine geochemistry methods and data analysis • Successful HR3D seismic dataset acquired @ Tomakomai active CO 2 injection marine site • Developed advanced seismic processing techniques • No NRMS anomalies detected in overburden; Demonstration of containment • Repeatability study • Second survey collected @ San Luis Pass, TX • 4D application using positioning techniques developed in the project for monitoring were successful

3D seismic GPS positioning↗
DOE OSTI2025

Developing ML/AI Methods for High-Throughput Characterization of Multiple-Sensor Streams of Tokamak Dynamics for High-Speed Control (Final Report)

This project evaluated and developed new mathematical and algorithmic techniques capable of handling (in real-time) the growing amounts of data generated by modern fusion research. While existing numerical linear algebra (NLA) methods provide the backbone to classical data analysis and algorithms, these methods fundamentally do not port to distributed architectures nor do they allow low-latency data reduction for control. Motivated by the needs for modern fusion reactors, this project explored and implemented new numerical methods to characterize plasma dynamics, respond in real-time to discharge evolution, and to process massive-scale data accurately and rapidly more fully. This project links expertise in multiple-sensor diagnostics of tokamak plasma dynamics from Columbia University’s Plasma Physics Laboratory with expertise in massive-scale data reduction and extreme data control algorithms at Columbia University’s Data Science Institute. This interdisciplinary project (i) applied machine learning methods, (ii) implemented a properly-trained neural-network for very fast processing of high-speed plasma videography, and (ii) developed the applied mathematical methods, based on randomized-NLA (rNLA) routines, for data analysis, reduction, and real-time control. The Columbia University High Beta Tokamak-Extended Pulse (HBT-EP) facility provided data to test new algorithms and partnership with Columbia University's Data Sciences Institute evaluated the broader use of new algorithms for many challenging control applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1974

Measurements of the spectrum of galactic electrons at very high energies

A counter telescope has been exposed in three balloon flights in 1970 to measure the flux and energy spectrum of cosmic ray electrons between 10 and 1000 GeV. This instrument has been modified by incorporating a large area CsI crystal as well as highly efficient time of flight circuitry, and was flown again twice during 1972. The methods of data analysis are based on extensive accelerator calibrations at SLAC. The resulting electron spectrum fits well to a single power law with an index (gamma) equal to 2.66 over the whole energy region. No obvious steepening can be observed, although statistical uncertainties prohibit definite claims beyond 250 GeV.

Mueller, D.↗
NASA NTRS1975

Far Infrared Spectroscopy of H II Regions

The far infrared spectra of H II regions are investigated. A liquid helium cooled grating spectrometer designed to make observations from the NASA Lear Jet is described along with tests of the instrument. The observing procedure on the Lear Jet telescope is described and the method of data analysis is discussed. Results are presented from a search for the (O III) 88.16 micron line. An upper limit on the emission in this line is obtained and line detection is described. Results are compared to theoretical predictions, and future applications of fine structure line observations are discussed. Coarse resolution results are given along with calibration problems. The spectra obtained are compared to models for dust emission.

Ward, D. B.↗
NASA NTRS1976

Methods for data reduction and loads analysis of Space Shuttle Solid Rocket Booster model water impact tests

The methodology used to predict full scale space shuttle solid rocket booster (SRB) water impact loads from scale model test data is described. Tests conducted included 12.5 inch and 120 inch diameter models of the SRB. Geometry and mass characteristics of the models were varied in each test series to reflect the current SRB baseline configuration. Nose first and tail first water entry modes were investigated with full-scale initial impact vertical velocities of 40 to 120 ft/sec, horizontal velocities of 0 to 60 ft/sec., and off-vertical angles of 0 to plus or minus 30 degrees. The test program included a series of tests with scaled atmospheric pressure.

Source record↗
NASA NTRS1976

Data processing/display design for the space shuttle/spacelab Electromagnetic Environment Experiment (EEE)

Methods for data analysis, data compression including universal coding, storage and retrieval on random access storage devices, and display were developed and implemented on the GSFC Interdata computer. The original 64 bit per frequency band representation was reduced to 10 bits through source coding/universal coding, a compression ratio of 6.4, prior to storage. Rapid encoding/decoding was achieved by the algorithms used so that rapid random access is retained.

Davisson, L. D.↗
NASA NTRS1977

High-energy cosmic-ray electrons - A new measurement using transition-radiation detectors

A new detector for cosmic-ray electrons, consisting of a combination of a transition-radiation detector and a shower detector, has been constructed, calibrated at accelerator beams, and exposed in a balloon flight under 5 g/sq cm of atmosphere. The design of this instrument and the methods of data analysis are described. Preliminary results in the energy range 9-300 GeV are presented. The energy spectrum of electrons is found to be significantly steeper than that of protons, consistent with a long escape lifetime of cosmic rays in the galaxy.

Hartmann, G.↗
NASA NTRS1978

On the physical reality of the millisecond bursts in Cygnus X-1 - Bursts and shot noise

The method of data analysis used to interpret the millisecond temporal structure of Cyg X-1 is discussed. In particular, the effects produced by the shot-noise variability of this source, which occurs on time scales of about 0.5 s, are examined. Taking into account the recent discovery that only about 30% of the flux may be in the shots, it is found that spurious 'millisecond bursts' will be detected. A comparison of the properties of these bursts with currently published experimental data is performed.

Weisskopf, M. C.↗
NASA NTRS1979

Executive summary of Aircraft Icing Specialists Workshop

In a period of escalating development costs for new aircraft, there is growing interest in a renewed and coordinated icing research effort to achieve an updating or modernization of each aspect of the technological issues that are involved. This includes the data base, analysis methods, test techniques, and test facilities.

Beheim, M. A.↗
NASA NTRS1979

Video detection and analysis techniques of transient astronomical phenomena

Low-light-level television systems have been utilized to gain information on meteors, aurorae, and other faint, transient astronomical phenomena. Such phenomena change not only their position as a function of time, but also their photometric and spectral characteristics in as little as 1/60 second, thus requiring unique methods of analysis. Data observed with television systems and recorded on video tape have been analyzed with a system utilizing both analog and digital techniques. Both off-the-shelf equipment and inhouse developments are used to isolate sequences of moving images and to store them in a form suitable for photometric and spectral reduction. Current emphasis of the analysis effort is directed at the measurement of the first-order emission lines of meteor spectra, the results of which will yield important compositional information concerning the nature of the impinging meteoroid.

Clifton, K. S.↗