Search NASA⌕ Search

SEARCH · Search NASA

Results for “data challenges”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Data Analysis for the LISA Pathfinder Mission

The LTP (LISA Technology Package) is the core part of the Laser Interferometer Space Antenna (LISA) Pathfinder mission. The main goal of the mission is to study the sources of any disturbances that perturb the motion of the freely-falling test masses from their geodesic trajectories as well as 10 test various technologies needed for LISA. The LTP experiment is designed as a sequence of experimental runs in which the performance of the instrument is studied and characterized under different operating conditions. In order to best optimize subsequent experimental runs, each run must be promptly analysed to ensure that the following ones make best use of the available knowledge of the instrument ' In order to do this, all analyses must be designed and tested in advance of the mission and have sufficient built-in flexibility to account for unexpected results or behaviour. To support this activity, a robust and flexible data analysis software package is also required. This poster presents two of the main components that make up the data analysis effort: the data analysis software and the mock-data challenges used to validate analysis procedures and experiment designs.

Thorpe, James Ira↗
NASA NTRS2011

A Galactic Binary Detection Pipeline

The Galaxy is suspected to contain hundreds of millions of binary white dwarf systems, a large fraction of which will have sufficiently small orbital period to emit gravitational radiation in band for space-based gravitational wave detectors such as the Laser Interferometer Space Antenna (LISA). LISA's main science goal is the detection of cosmological events (supermassive black hole mergers, etc.) however the gravitational signal from the galaxy will be the dominant contribution to the data - including instrumental noise over approximately two decades in frequency. The catalogue of detectable binary systems will serve as an unparalleled means of studying the Galaxy. Furthermore, to maximize the scientific return from the mission, the data must be "cleansed" of the galactic foreground. We will present an algorithm that can accurately resolve and subtract 2:: 10000 of these sources from simulated data supplied by the Mock LISA Data Challenge Task Force. Using the time evolution of the gravitational wave frequency, we will reconstruct the position of the recovered binaries and show how LISA will sample the entire compact binary population in the Galaxy.

Littenberg, Tyson B.↗
NASA NTRS2011

Simultaneous Planck, Swift, and Fermi Observations of X-Ray and gamma-Ray Selected Blazars

We present simultaneous Planck, Swift, Fermi, and ground-based data for 105 blazars belonging to three samples with flux limits in the soft X-ray, hard X-ray, and -ray bands, and we compare our results to those of a companion paper presenting simultaneous Planck and multi-frequency observations of 104 radio-loud northern active galactic nuclei selected at radio frequencies. While we confirm several previous results, our unique data set has allowed us to demonstrate that the selection method strongly influences the results, producing biases that cannot be ignored. Almost all the BL Lac objects have been detected by Fermi Large Area Telescope (LAT), whereas 30 to 40% of the flat-spectrum radio quasars (FSRQs) in the radio, soft X-ray, and hard X-ray selected samples are still below the gamma ray detection limit even after integrating 27 months of Fermi-LAT data. The radio to sub-millimetre spectral slope of blazars is quite flat, with [alpha] approximately 0 up to about 70 GHz, above which it steepens to [alpha] approximately -0.65. BL Lacs have significantly flatter spectra than FSRQs at higher frequencies. The distribution of the rest-frame synchrotron peak frequency (v(sup IC) (sub (PEAK)), ranges from 10(sup 21) to 10(sup 22) HZ. The distribution of the rest-frame synchrotron peak frequency (v(sup s)(sub peak)) in the spectral energy distribution (SED) of FSRQs is the same in all the blazar samples with (v(sup s)(sub peak) = 10(sup 13:1 plus or minus 0.1) Hz, while the mean inverse-Compton peak frequency,(v(sup IC)(sub peak) ranges from 10(sup 21) to 10(sup 22) Hz. The distributions of v(sup S)(sub peak) and of v(sup IC)(sub peak) of BL Lacs are much broader and are shifted to higher energies than those of FSRQs; their shapes strongly depend on the selection method. The Compton dominance of blazars ranges from less than 0.2 to nearly 100, with only FSRQs reaching values larger than about 3. Its distribution is broad and depends strongly on the selection method, with gamma-ray selected blazars peaking at approximately 7 or more, and radio-selected blazars at values close to 1, thus implying that the common assumption that the blazar power budget is largely dominated by high-energy emission is a selection effect. A comparison of our multi-frequency data with theoretical predictions shows that simple homogeneous SSC models cannot explain the simultaneous SEDs of most of the gamma-ray detected blazars in all samples. The SED of the blazars that were not detected by Fermi-LAT may instead be consistent with SSC emission. Our data challenge the correlation between bolometric luminosity and v(sup S)(sub peak) predicted by the blazar sequence.

Giommi, P.↗
NASA NTRS2012

A Detection Pipeline for Galactic Binaries in LISA Data

The Galaxy is suspected to contain hundreds of millions of binary white dwarf systems, a large fraction of which will have sufficiently small orbital period to emit gravitational radiation in band for space-based gravitational wave detectors such as the Laser Interferometer Space Antenna (LISA). LISA's main science goal is the detection of cosmological events (supermassive black hole mergers) etc.) however the gravitational signal from the galaxy will be the dominant contribution to the data - including instrumental noise - over approximately two decades in frequency. The catalogue of detectable binary systems will serve as an unparalleled means of studying the Galaxy. Furthermore, to maximize the scientific return from the mission, the data must be "cleansed" of the galactic foreground. We will present an algorithm that can accurately resolve and subtract greater than or equal to 10000 of these sources from simulated data supplied by the Mock LISA Data Challenge Task Force. Using the time evolution of the gravitational wave frequency, we will reconstruct the position of the recovered binaries and show how LISA will sample the entire compact binary population in the Galaxy.

Littenberg, Tyson B.↗
NASA NTRS2012

Simultaneous Planck, Swift, and Fermi Observations of X-ray and Gamma-ray Selected Blazars

We present simultaneous Planck, Swift, Fermi, and ground-based data for 105 blazars belonging to three samples with flux limits in the soft X-ray, hard X-ray, and gamma-ray bands, with additional 5 GHz flux-density limits to ensure a good probability of a Planck detection. We compare our results to those of a companion paper presenting simultaneous Planck and multi-frequency observations of 104 radio-loud northern active galactic nuclei selected at radio frequencies. While we confirm several previous results, our unique data set allows us to demonstrate that the selection method strongly influences the results, producing biases that cannot be ignored. Almost all the BL Lac objects have been detected by the Fermi Large Area Telescope (LAT), whereas 30% to 40% of the flat-spectrum radio quasars (FSRQs) in the radio, soft X-ray, and hard X-ray selected samples are still below the gamma-ray detection limit even after integrating 27 months of Fermi-LAT data. The radio to sub-millimetre spectral slope of blazars is quite flat, with (alpha) approx 0 up to about 70GHz, above which it steepens to (alpha) approx -0.65. The BL Lacs have significantly flatter spectra than FSRQs at higher frequencies. The distribution of the rest-frame synchrotron peak frequency (nu(sup s)(sub peak)) in the spectral energy distribution (SED) of FSRQs is the same in all the blazar samples with (nu(sup s)(sub peak)) = 10(exp 13.1 +/- 0.1) Hz, while the mean inverse Compton peak frequency, (nu(sup IC)(sub peak)), ranges from 10(exp 21) to 10(exp 22) Hz. The distributions of nu(sup s)(sub peak) and nu(sup IC)(sub peak) of BL Lacs are much broader and are shifted to higher energies than those of FSRQs; their shapes strongly depend on the selection method. The Compton dominance of blazars. defined as the ratio of the inverse Compton to synchrotron peak luminosities, ranges from less than 0.2 to nearly 100, with only FSRQs reaching values larger than about 3. Its distribution is broad and depends strongly on the selection method, with gamma-ray selected blazars peaking at approx 7 or more, and radio-selected blazars at values close to 1, thus implying that the common assumption that the blazar power budget is largely dominated by high-energy emission is a selection effect. A comparison of our multi-frequency data with theoretical predictions shows that simple homogeneous SSC models cannot explain the simultaneous SEDs of most of the gamma-ray detected blazars in all samples. The SED of the blazars that were not detected by Fermi~LAT may instead be consistent with SSC emission. Our data challenge the correlation between bolometric luminosity and nu(sup s)(sub peak) predicted by the blazar sequence.

Giommi, P.↗
NASA NTRS2012

On Advanced Estimation Techniques for Exoplanet Detection and Characterization using Ground-Based Coronagraphs

The direct imaging of planets around nearby stars is exceedingly difficult. Only about 14 exoplanets have been imaged to date that have masses less than 13 times that of Jupiter. The next generation of planet-finding coronagraphs, including VLT-SPHERE, the Gemini Planet Imager, Palomar P1640, and Subaru HiCIAO have predicted contrast performance of roughly a thousand times less than would be needed to detect Earth-like planets. In this paper we review the state of the art in exoplanet imaging, most notably the method of Locally Optimized Combination of Images (LOCI), and we investigate the potential of improving the detectability of faint exoplanets through the use of advanced statistical methods based on the concepts of the ideal observer and the Hotelling observer. We provide a formal comparison of techniques through a blind data challenge and evaluate performance using the Receiver Operating Characteristic (ROC) and Localization ROC (LROC) curves. We place particular emphasis on the understanding and modeling of realistic sources of measurement noise in ground-based AO-corrected coronagraphs. The work reported in this paper is the result of interactions between the co-authors during a week-long workshop on exoplanet imaging that was held in Squaw Valley, California, in March of 2012.

instrumentation↗
NASA NTRS2021

First Demonstration of Early Warning Gravitational-wave Alerts

Gravitational-wave observations became commonplace in Advanced LIGO-Virgo's recently concluded third observing run. 56 nonretracted candidates were identified and publicly announced in near real time. Gravitational waves from binary neutron star mergers, however, remain of special interest since they can be precursors to high-energy astrophysical phenomena like γ-ray bursts and kilonovae. While late-time electromagnetic emissions provide important information about the astrophysical processes within, the prompt emission along with gravitational waves uniquely reveals the extreme matter and gravity during—and in the seconds following—merger. Rapid communication of source location and properties from the gravitational-wave data is crucial to facilitate multimessenger follow-up of such sources. This is especially enabled if the partner facilities are forewarned via an early warning (pre-merger) alert. Here we describe the commissioning and performance of such a low-latency infrastructure within LIGO-Virgo. We present results from an end-to-end mock data challenge that detects binary neutron star mergers and alerts partner facilities before merger. We set expectations for these alerts in future observing runs.

Ryan Magee↗
NASA NTRS2023

The Magnesium Isotope Composition of Samples Returned From Asteroid Ryugu

The nucleosynthetic isotope composition of planetary materials provides a record of the heterogeneous distribution of stardust within the early solar system. In 2020 December, the Japan Aerospace Exploration Agency Hayabusa2 spacecraft returned to Earth the first samples of a primitive asteroid, namely, the Cb-type asteroid Ryugu. This provides a unique opportunity to explore the kinship between primitive asteroids and carbonaceous chondrites. We report high-precision μ 26 Mg* and μ 25 Mg values of Ryugu samples together with those of CI, CM, CV, and ungrouped carbonaceous chondrites. The stable Mg isotope composition of Ryugu aliquots defines μ 25 Mg values ranging from –160 ± 20 ppm to –272 ± 30 ppm, which extends to lighter compositions relative to Ivuna-type (CI) and other carbonaceous chondrite groups. We interpret the μ 25 Mg variability as reflecting heterogeneous sampling of a carbonate phase hosting isotopically light Mg (μ 25 Mg ∼ –1400 ppm) formed by low temperature equilibrium processes. After correcting for this effect, Ryugu samples return homogeneous μ 26 Mg* values corresponding to a weighted mean of 7.1 ± 0.8 ppm. Thus, Ryugu defines a μ 26 Mg* excess relative to the CI and CR chondrite reservoirs corresponding to 3.8 ± 1.1 and 11.9 ± 0.8 ppm, respectively. These variations cannot be accounted for by in situ decay of 26 Al given their respective 27 Al/ 24 Mg ratios. Instead, it requires that Ryugu and the CI and CR parent bodies formed from material with a different initial 26 Al/ 27 Al ratio or that they are sourced from material with distinct Mg isotope compositions. Thus, our new Mg isotope data challenge the notion that Ryugu and CI chondrites share a common nucleosynthetic heritage.

Solar system evolution↗
DOE OSTI2020

Machine Learning in Nuclear Thermal Hydraulics, Part 2: Opportunities and Perspectives

This paper summarizes the issues in nuclear thermal hydraulics (NTH), mainly from the three named aspects, and illustrates potential opportunities of machine learning (ML) applications in dealing with these issues. These issues are problems in simultaneously realizing computational efficiency and accuracy of system thermal hydraulic (STH) modeling and simulation, uncertainty in the scaling analysis for the best-estimate calculations of transient and accident analysis, and difficulties in optimal data production and usage for the development and assessment of evaluation models. Due to ML uncertainty, data insufficiency, and lack of cognition about how to efficiently incorporate knowledge and data, challenges of adapting ML techniques still exist. Accordingly, several perspectives are proposed to provide insights for ML applications in solving these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1989

Summary of longitudinal stability and control parameters as determined from Space Shuttle Challenger flight test data

Estimates of longitudinal stability and control parameters for the space shuttle were determined by applying a maximum likelihood parameter estimation technique to Challenger flight test data. The parameters for pitching moment coefficient, C(m sub alpha), (at different angles of attack), pitching moment coefficient, C(m sub delta e), (at different elevator deflections) and the normal force coefficient, C(z sub alpha), (at different angles of attack) describe 90 percent of the response to longitudinal inputs during Space Shuttle Challenger flights with C(m sub delta e) being the dominant parameter. The values of C(z sub alpha) were found to be input dependent for these tests. However, when C(z sub alpha) was set at preflight predictions, the values determined for C(m sub delta e) changed less than 10 percent from the values obtained when C(z sub alpha) was estimated as well. The preflight predictions for C(z sub alpha) and C(m sub alpha) are acceptable values, while the values of C(z sub delta e) should be about 30 percent less negative than the preflight predictions near Mach 1, and 10 percent less negative, otherwise.

Suit, William T.↗
DOE OSTI2020

Automatic Classification of Biological Targets in a Tidal Channel Using a Multibeam Sonar

Multibeam sonars are widely used for environmental monitoring of fauna at marine renewable energy sites. However, they can rapidly accrue vast volumes of data, which poses a challenge for data processing. Here, using data from a deployment in a tidal channel with peak currents of 1–2 m s –1 , we demonstrate the data-reduction benefits of real-time automatic classification of targets detected and tracked in multibeam sonar data. First, we evaluate classification capabilities for three machine learning algorithms: random forests, support vector machines, and k-nearest neighbors. For each algorithm, a hill-climbing search optimizes a set of hand-engineered attributes that describe tracked targets. Here, the random forest algorithm is found to be most effective—in postprocessing, discriminating between biological and nonbiological targets with a recall rate of 0.97 and a precision of 0.60. In addition, 89% of biological targets are correctly classified as either seals, diving birds, fish schools, or small targets. Model dependence on the volume of training data is evaluated. Second, a real-time implementation of the model is shown to distinguish between biological targets and nonbiological targets with nearly the same performance as in postprocessing. From this, we make general recommendations for implementing real-time classification of biological targets in multibeam sonar data and the transferability of trained models.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

DOE Cold Climate Heat Pump Challenge Field Validation: Data Collection and Analysis Plan

This document details the data collection, storage, and analysis plan and methodologies for conducting the field validation portion of DOE’s Cold Climate Heat Pump (CCHP) Challenge. The study is focused on validating the in-field heating performance of prototypical CCHPs that have successfully demonstrated that they meet or exceed the Challenge specification in a laboratory setting. The units that have passed laboratory testing will be installed in real homes along with sensors and loggers for monitoring performance over an entire heating season. Data collected through monitoring will be cleaned and stored in a secure database. The data will be analyzed for calculating the key metrics defined by the Challenge including heating capacities at low outdoor air temperatures (below 32 °F), efficiency in terms of the Coefficient of Performance (COP), switchover temperatures and auxiliary heat staging. Demand Response (DR) capabilities will also be tested using specially designed DR events. In most cases, shoulder season and cooling season performance will also be determined and reported.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Utilizing Novel Field and Data Exploration Methods to Explore Hot Moments in High-Frequency Soil Nitrous Oxide Emissions Data: Opportunities and Challenges

Soil nitrous oxide (N 2 O) emissions are an important driver of climate change and are a major mechanism of labile nitrogen (N) loss from terrestrial ecosystems. Evidence increasingly suggests that locations on the landscape that experience biogeochemical fluxes disproportionate to the surrounding matrix (hot spots) and time periods that show disproportionately high fluxes relative to the background (hot moments) strongly influence landscape-scale soil N 2 O emissions. However, substantial uncertainties remain regarding how to measure and model where and when these extreme soil N 2 O fluxes occur. High-frequency datasets of soil N 2 O fluxes are newly possible due to advancements in field-ready instrumentation that uses cavity ring-down spectroscopy (CRDS). Here, we outline the opportunities and challenges that are provided by the deployment of this field-based instrumentation and the collection of high-frequency soil N 2 O flux datasets. While there are substantial challenges associated with automated CRDS systems, there are also opportunities to utilize these near-continuous data to constrain our understanding of dynamics of the terrestrial N cycle across space and time. Finally, we propose future research directions exploring the influence of hot moments of N 2 O emissions on the N cycle, particularly considering the gaps surrounding how global change forces are likely to alter N dynamics in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Real-time data reduction at 100 Tbps: Challenge and opportunity for AI-based data reduction for next-generation large-scale nuclear physics collider experiment

The modern large-scale nuclear physics (NP) experiments in high-energy particle colliders utilize streaming-readout electronics to digitize detector response at O(100) Tbps bandwidth. Prominent examples at Brookhaven National Lab (BNL) include the sPHENIX experiment at Relativistic Heavy Ion Collider (RHIC), which is under construction, and the experiments proposed for the Electron-Ion Collider (EIC), planned for the 2030s . One of the main challenges for these streaming readout systems is to manage the data rate with sufficient data reduction in real time so the end-data fit persistent storage for offline analysis, which is typically at O(1000) times smaller and O(100) Gbps. Such data reduction traditionally is achieved via real-time high level triggers, which select and save a small subset of collisions of interest. Although triggering is applicable to high energy collider experiments such as those at the Large Hardron Collider at CERN, it is insufficient for these nuclear physics experiments which study diverse collision topologies. And traditional triggering approach is inefficient to preserve the max information harvested from the operation of colliders that costs O(100)M per year to DOE. Meanwhile, in recent years, ML-based high-throughput data reduction has emerged as a promising approach to efficiently preserve max information for a given space of persistent storage, e.g. via AI data compression, feature extraction, and noise filtering.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2008

Precision Measurement of Black Hole Binary Dynamics: Analyzing the LISA Data Stream

One of the richest potential sources of insight into fundamental physics that LISA will be capable of observing is the inspiral of supermassive black hole binaries (BHBs). However, the data analysis challenge presented by the LISA data stream is quite unlike the situation for present day gravitational wave detectors. In order to make the precision measurements necessary to achieve LISA's science goals, the BHB signal must be distinguished from a data stream that not only contains instrumental noise, but potentially thousands of other signals as well, so that the "background" we wish to separate out to focus on the BHB signal is likely to be highly nonstationary and nongaussian, as well as being of scientific interest in its own right. In addition, whereas the theoretical templates that we calculate in order to ultimately estimate the parameters can afford to be somewhat inaccurate and still be effective for present day and near future detectors, this is not the case for LISA, and extremely high fidelity of the theoretical templates for high signal-to-noise signals will be required to prevent theoretical errors from dominating the parameter estimates. NVe, will describe efforts in the community of LISA data analysts to address the challenges regarding the specific issue of BHB signals. These efforts include using a Markov Chain Monte Carlo approach with the freedom to model the BHB and the other signals present in the data stream simultaneously, rather than trying to remove other signals and risk biasing the remaining data. The Mock LISA Data Challenge is a community of LISA scientists who generate rounds of simulated LISA noise with increasingly difficult signal content, and invite the LISA data analysis community to exercise their methods, or develop new methods, in an attempt to extract the parameters for the signals embedded in the mock data. In addition to practical approaches such ,is this to assess the level of parameter accuracy, one can apply the Fisher matrix formalism to assess both the statistical errors from noise and the theoretical errors

McWilliams, Sean T.↗
DOE OSTI2025

Combining Observations and Models: A Review of the CARDAMOM Framework for Data‐Constrained Terrestrial Ecosystem Modeling

The rapid increase in the volume and variety of terrestrial biosphere observations (i.e., remote sensing data and in situ measurements) offers a unique opportunity to derive ecological insights, refine process‐based models, and improve forecasting for decision support. However, despite their potential, ecological observations have primarily been used to benchmark process‐based models, as many past and current models lack the capability to directly integrate observations and their associated uncertainties for parameterization. In contrast, data assimilation frameworks such as the CARbon DAta MOdel fraMework (CARDAMOM) and its suite of process‐based models, known as the Data Assimilation Linked Ecosystem Carbon Model (DALEC), are specifically designed for model‐data fusion. This review, motivated by a recent CARDAMOM community workshop, examines the development and applications of CARDAMOM, with an emphasis on its role in advancing ecosystem process understanding. CARDAMOM employs a Bayesian approach, using a Markov Chain Monte Carlo algorithm to enable data‐driven calibration of DALEC parameters and initial states (i.e., carbon pool sizes) through observation operators. CARDAMOM's unique ability to retrieve localized model process parameters from diverse datasets—ranging from in situ measurements to global satellite observations—makes it a highly flexible tool for analyzing spatially variable ecosystem responses to environmental change. However, assimilating these data also presents challenges, including data quality issues that propagate into model skill, as well as trade‐offs between model complexity, parameter equifinality, and predictive performance. We discuss potential solutions to these challenges, such as reducing parameter equifinality by incorporating new observations. This review also offers community recommendations for incorporating emerging datasets, integrating machine learning techniques, strengthening collaboration with remote sensing, field, and modeling communities, and expanding CARDAMOM's relevance for localized ecosystem monitoring and decision‐making. CARDAMOM enables a deep, mechanistic understanding of terrestrial ecosystem dynamics that cannot be achieved through empirical analyses of observational datasets or weakly constrained models alone.

Bayesian inference↗
NASA NTRS2006

From Zero to Integration in Eight Months, the Dawn Ground Data System Engineering Challenge

The Dawn GDS Team met the SC Sim integration challenge in eight months. The GDS System Engineering approach in response to the SC Simintegration challenge, focused on a set of key practices: decomposition of project request into manageable requirements; integration of multiple ground disciplines and experts into a focused team effort; risk management thru management of expectations; and aggregation of intermediate products into a final product. By maintaining a a system-level focus, the overall systems engineering process unified team GDS Team members with a common goal: the success of the ground system as a whole and not just the success of their individual expert contributions. Incorporation of Agile-type development efforts were aligned with a risk strategy based on team-oriented principles and expectations management, thus achieving a more stable baseline solution without compromising the integrity of the GDS design.

Dawn Mission↗