Search NASA⌕ Search

SEARCH · Search NASA

Results for “Dark Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

The Process of Bringing Dark Data to Light: The Rescue of the Early Nimbus Satellite Data

Myriad environmental satellite missions are currently orbiting the earth. The comprehensive monitoring by these sensors provide scientists, policymakers, and the public critical information on the earths weather and climate system. The state of the art technology of our satellite monitoring system is the legacy of the first environment satellites, the Nimbus systems launched by NASA in the mid-1960s. Such early data can extend our climate record and provide important context in longer-term climate changes. However, the data was stowed away and, over the years, largely forgotten. It was nearly lost before its value was recognized and attempts to recover the data were undertaken. This paper covers what it took the authors to recover, navigate and reprocess the data into modern formats so that it could be used as a part of the satellite climate record. The procedures to recover the Nimbus data, from both film and tape, could be used by other data rescue projects, however the algorithms presented will tend to be Nimbus specific. Data rescue projects are often both difficult and time consuming but the data they bring back to the science community makes these efforts worthwhile.

dark↗
DOE OSTI2023

Confronting interacting dark radiation scenarios with cosmological data

Dark radiation (DR) is generally predicted in new physics scenarios that address fundamental puzzles of the Standard Model or tensions in the cosmological data. Cosmological data have the sensitivity to constrain not only the energy density of DR but also whether it is interacting. In this paper, we present a systematic study of five types of interacting DR (free-streaming, fluid, decoupling, instantaneous decoupling, and recoupling DR) and their impact on cosmological observables. We modify the Boltzmann hierarchy to describe all these types of interacting DR under the relaxation time approximation. We, for the first time, robustly calculate the collision terms for recoupling scalar DR and provide a better estimation of the recoupling transition redshift. We demonstrate the distinct features of each type of DR on the cosmic microwave background and matter power spectra. We perform Markov-chain Monte Carlo scans using the Planck 2018 data and baryon acoustic oscillation data. Assuming no new physics in the standard model neutrino sector, we find no statistically significant constraints on the couplings of DR, although there is a slight preference for the fluidlike limit of all the cases. In the case of instantaneous decoupling DR, this limit corresponds to a late transition redshift around recombination. Furthermore, the ΔN eff constraint varies marginally depending on the type of DR.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Bayesian forecasts for dark matter substructure searches with mock pulsar timing data

Dark matter substructure, such as primordial black holes (PBHs) and axion miniclusters, can induce phase shifts in pulsar timing arrays (PTAs) measurements due to gravitational effects. In order to gain a more realistic forecast for the detectability of such models of dark matter with PTAs, we propose a Bayesian inference framework to search for phase shifts generated by PBHs and perform the analysis on mock PTA data. Furthermore, for most PBH masses the constraints on the dark matter abundance agree with previous (frequentist) analyses (without mock data) to $\mathcal{O}$(1) factors. This further motivates a dedicated search for PBHs (and dense small scale structures) in the mass range from 10 -8 M ⊙ to well above 10 2 M ⊙ with the Square Kilometer Array. Moreover, with a more optimistic set of timing parameters, future PTAs are predicted to constrain PBHs down to 10 -11 M ⊙ . Lastly, we discuss the impact of backgrounds, such as Supermassive Black Hole Mergers, on detection prospects, suggesting a future program to separate a dark matter signal from other astrophysical sources.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1995

Using dark current data to estimate AVIRIS noise covariance and improve spectral analyses

Starting in 1994, all AVIRIS data distributions include a new product useful for quantification and modeling of the noise in the reported radiance data. The 'postcal' file contains approximately 100 lines of dark current data collected at the end of each data acquisition run. In essence this is a regular spectral-image cube, with 614 samples, 100 lines and 224 channels, collected with a closed shutter. Since there is no incident radiance signal, the recorded DN measure only the DC signal level and the noise in the system. Similar dark current measurements, made at the end of each line are used, with a 100 line moving average, to remove the DC signal offset. Therefore, the pixel-by-pixel fluctuations about the mean of this dark current image provide an excellent model for the additive noise that is present in AVIRIS reported radiance data. The 61,400 dark current spectra can be used to calculate the noise levels in each channel and the noise covariance matrix. Both of these noise parameters should be used to improve spectral processing techniques. Some processing techniques, such as spectral curve fitting, will benefit from a robust estimate of the channel-dependent noise levels. Other techniques, such as automated unmixing and classification, will be improved by the stable and scene-independence noise covariance estimate. Future imaging spectrometry systems should have a similar ability to record dark current data, permitting this noise characterization and modeling.

Boardman, Joseph W.↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from cosmic shear and robustness to data calibration

This work, together with its companion paper, Secco, Samuroff et al., presents the Dark Energy Survey Year 3 cosmic shear measurements and cosmological constraints based on an analysis of over 100 million source galaxies. With the data spanning 4143 deg 2 on the sky, divided into four redshift bins, we produce the highest significance measurement of cosmic shear to date, with a signal-to-noise of 40. We conduct a blind analysis in the context of the ΛCDM model and find a 3% constraint of the clustering amplitude, S 8 ≡ σ 8 (Ω m /0.3) 0.5 = 0.759$^{+0.025}_{-0.023}$. A ΛCDM-Optimized analysis, which safely includes smaller scale information, yields a 2% precision measurement of S 8 = 0.772$^{+0.018}_{-0.017}$ that is consistent with the fiducial case. The two low-redshift measurements are statistically consistent with the Planck Cosmic Microwave Background result, however, both recovered S 8 values are lower than the high-redshift prediction by 2.3σ and 2.1σ (ρ-values of 0.02 and 0.05), respectively. The measurements are shown to be internally consistent across redshift bins, angular scales and correlation functions. The analysis is demonstrated to be robust to calibration systematics, with the S 8 posterior consistent when varying the choice of redshift calibration sample, the modeling of redshift uncertainty and methodology. Similarly, we find that the corrections included to account for the blending of galaxies shifts our best-fit S 8 by 0.5σ without incurring a substantial increase in uncertainty. We examine the limiting factors for the precision of the cosmological constraints and find observational systematics to be subdominant to the modeling of astrophysics. Specifically, we identify the uncertainties in modeling baryonic effects and intrinsic alignments as the limiting systematics.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2021

The Deep-Time Digital Earth program: data-driven discovery in geosciences

Current barriers hindering data-driven discoveries in deep-time Earth (DE) include: substantial volumes of DE data are not digitized; many DE databases do not adhere to FAIR (findable, accessible, interoperable and reusable) principles; we lack a systematic knowledge graph for DE; existing DE databases are geographically heterogeneous; a significant fraction of DE data is not in open-access formats; tailored tools are needed. These challenges motivate the Deep-Time Digital Earth (DDE) program initiated by the International Union of Geological Sciences and developed in cooperation with national geological surveys, professional associations, academic institutions and scientists around the world. DDE’s mission is to build on previous research to develop a systematic DE knowledge graph, a FAIR data infrastructure that links existing databases and makes dark data visible, and tailored tools for DE data, which are universally accessible. DDE aims to harmonize DE data, share global geoscience knowledge and facilitate data-driven discovery in the understanding of Earth’s evolution.

Chengshan Wang↗
DOE OSTI2024

High-accuracy emulators for observables in ΛCDM, N eff, Σ m ν, and w cosmologies

ABSTRACT We use the emulation framework CosmoPower to construct and publicly release neural network emulators of cosmological observables, including the cosmic microwave background (CMB) temperature and polarization power spectra, matter power spectrum, distance-redshift relation, baryon acoustic oscillation (BAO) and redshift-space distortion (RSD) observables, and derived parameters. We train our emulators on Einstein–Boltzmann calculations obtained with high-precision numerical convergence settings, for a wide range of cosmological models including ΛCDM, wCDM, ΛCDM + Neff, and ΛCDM + Σmν. Our CMB emulators are accurate to better than 0.5 per cent out to ℓ = 104, which is sufficient for Stage-IV data analysis, and our P(k) emulators reach the same accuracy level out to $k=50 \, \, \mathrm{Mpc}^{-1}$, which is sufficient for Stage-III data analysis. We release the emulators via an online repository (CosmoPower Organisation), which will be continually updated with additional extended cosmological models. Our emulators accelerate cosmological data analysis by orders of magnitude, enabling cosmological parameter extraction analyses, using current survey data, to be performed on a laptop. We validate our emulators by comparing them to class and camb and by reproducing cosmological parameter constraints derived from Planck TT, TE, EE, and CMB lensing data, as well as from the Atacama Cosmology Telescope Data Release 4 CMB data, Dark Energy Survey Year-1 galaxy lensing and clustering data, and Baryon Oscillation Spectroscopic Survey Data Release 12 BAO and RSD data.

Astronomy & Astrophysics↗
DOE OSTI2022

Clusters of galaxies up to z = 1.5 identified from photometric data of the Dark Energy Survey and unWISE

ABSTRACT Using photometric data from the Dark Energy Survey and the Wide-field Infrared Survey Explorer, we estimate photometric redshifts for 105 million galaxies using the nearest-neighbour algorithm. From such a large data base, 151 244 clusters of galaxies are identified in the redshift range of 0.1 < z ≲ 1.5 based on the overdensity of the total stellar mass of galaxies within a given photometric redshift slice, among which 76 826 clusters are newly identified and 30 477 clusters have a redshift z > 1. We cross-match these clusters with those in the catalogues identified from the X-ray surveys and the Sunyaev–Zel’dovich (SZ) effect by the Planck, South Pole Telescope and Atacama Cosmology Telescope surveys, and get the redshifts for 45 X-ray clusters and 56 SZ clusters. More than 95 per cent SZ clusters in the sky region have counterparts in our catalogue. We find multiple optical clusters in the line of sight towards about 15 per cent of SZ clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The Dark Energy Survey Data Release 2

In this work, we present the second public data release of the Dark Energy Survey, DES DR2, based on optical/near-infrared imaging by the Dark Energy Camera mounted on the 4 m Blanco telescope at Cerro Tololo Inter-American Observatory in Chile. DES DR2 consists of reduced single-epoch and coadded images, a source catalog derived from coadded images, and associated data products assembled from 6 yr of DES science operations. This release includes data from the DES wide-area survey covering ~5000 deg 2 of the southern Galactic cap in five broad photometric bands, grizY. DES DR2 has a median delivered point-spread function FWHM of g = 1.11'', r = 0.95'', i = 0.88'', z = 0.83'', and Y = 0farcs90, photometric uniformity with a standard deviation of < 3 mmag with respect to Gaia DR2 G band, a photometric accuracy of ~11 mmag, and a median internal astrometric precision of ~27 mas. The median coadded catalog depth for a 1farcs95 diameter aperture at signal-to-noise ratio = 10 is g = 24.7, r = 24.4, i = 23.8, z = 23.1, and Y = 21.7 mag. DES DR2 includes ~691 million distinct astronomical objects detected in 10,169 coadded image tiles of size 0.534 deg2 produced from 76,217 single-epoch images. After a basic quality selection, benchmark galaxy and stellar samples contain 543 million and 145 million objects, respectively. These data are accessible through several interfaces, including interactive image visualization tools, web-based query clients, image cutout servers, and Jupyter notebooks. DES DR2 constitutes the largest photometric data set to date at the achieved depth and photometric precision.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2008

Advanced Land Imager Assessment System

The Advanced Land Imager Assessment System (ALIAS) supports radiometric and geometric image processing for the Advanced Land Imager (ALI) instrument onboard NASA s Earth Observing-1 (EO-1) satellite. ALIAS consists of two processing subsystems for radiometric and geometric processing of the ALI s multispectral imagery. The radiometric processing subsystem characterizes and corrects, where possible, radiometric qualities including: coherent, impulse; and random noise; signal-to-noise ratios (SNRs); detector operability; gain; bias; saturation levels; striping and banding; and the stability of detector performance. The geometric processing subsystem and analysis capabilities support sensor alignment calibrations, sensor chip assembly (SCA)-to-SCA alignments and band-to-band alignment; and perform geodetic accuracy assessments, modulation transfer function (MTF) characterizations, and image-to-image characterizations. ALIAS also characterizes and corrects band-toband registration, and performs systematic precision and terrain correction of ALI images. This system can geometrically correct, and automatically mosaic, the SCA image strips into a seamless, map-projected image. This system provides a large database, which enables bulk trending for all ALI image data and significant instrument telemetry. Bulk trending consists of two functions: Housekeeping Processing and Bulk Radiometric Processing. The Housekeeping function pulls telemetry and temperature information from the instrument housekeeping files and writes this information to a database for trending. The Bulk Radiometric Processing function writes statistical information from the dark data acquired before and after the Earth imagery and the lamp data to the database for trending. This allows for multi-scene statistical analyses.

Chander, Gyanesh↗
DOE OSTI2023

Pathways to Discovery in Astronomy and Astrophysics for the 2020s

We live in an extraordinary period of discovery in astronomy and astrophysics. Six Nobel Prizes have been awarded over the past decade alone for discoveries based on astronomical data (dark energy, gravitational waves, neutrino oscillations, the discovery of exoplanets, cosmology, and supermassive black holes). Many of the ambitious scientific visions of the 2010 New Worlds, New Horizons (Astro2010)1 decadal survey are being fulfilled, but momentum has only grown. We stand on the threshold of new endeavors that will transform not only our understanding of the universe and the processes and physical paradigms that govern it but also humanity’s place in it. This report of the Committee for a Decadal Survey on Astronomy and Astrophysics 2020 (Astro2020) proposes a broad, integrated plan for space- and ground-based astronomy and astrophysics for the decade 2023–2032.2 It also lays the foundations for further advances in the following decade. This is the seventh in a sequence of decadal survey studies in this field from the National Academies of Sciences, Engineering, and Medicine. This survey examines the program of record, providing advice on the major projects from prior surveys that are yet to be completed. It also lays out priorities for future investments driven by scientific opportunities. The recommendations in this report advance foundational activities that support the people who drive innovation and discovery, and that promote the technologies and tools needed to carry out the science. The report also recommends sustaining activities on a broad range of cost and time scales, as well as activities that enable future visionary projects by maturing them scientifically and technically. Last, the recommendations set in motion the construction of frontier facilities that will change the view and understanding of the cosmos. The survey is bounded by plausible budget scenarios based on briefings from the sponsoring agencies— the Department of Energy (DOE), the National Aeronautics and Space Administration (NASA), and the National Science Foundation (NSF). Within these bounds, the survey aims high, reflecting this time of great scientific promise and progress, with opportunities to pursue some of the most compelling scientific quests of our times.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1990

The whole earth telescope - A new astronomical instrument

A new multimirror ground-based telescope for time-series photometry of rapid variable stars, designed to minimize or eliminate gaps in the brightness record caused by the rotation of the earth, is described. A sequence of existing telescopes distributed in longitude, coordinated from a single control center, is used to measure designated target stars so long as they are in darkness. Data are returned by electronic mail to the control center, where they are analyzed in real time. This instrument is the first to provide data of continuity and quality that permit true high-resolution power spectroscopy of pulsating white dwarf stars.

Nather, R. E.↗
DOE OSTI2022

Fast and flexible analysis of direct dark matter search data with machine learning

We present the results from combining machine learning with the profile likelihood fit procedure, using data from the Large Underground Xenon (LUX) dark matter experiment. This approach demonstrates reduction in computation time by a factor of 30 when compared with the previous approach, without loss of performance on real data. We establish its flexibility to capture non-linear correlations between variables (such as smearing in light and charge signals due to position variation) by achieving equal performance using pulse areas with and without position-corrections applied. Its efficiency and scalability furthermore enables searching for dark matter using additional variables without significant computational burden. We demonstrate this by including a light signal pulse shape variable alongside more traditional inputs such as light and charge signal strengths. Furthermore, this technique can be exploited by future dark matter experiments to make use of additional information, reduce computational resources needed for signal searches and simulations, and make inclusion of physical nuisance parameters in fits tractable.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

The Draco Dwarf Spheroidal Galaxy in the First Year of Dark Energy Spectroscopic Instrument Data

We investigate the spatial distribution, kinematics, and metallicity of stars in the Draco dwarf spheroidal galaxy using data from the Dark Energy Spectroscopic Instrument (DESI). We identify 155 high-probability members of Draco using line-of-sight velocity and metallicity information derived from DESI spectroscopy along with Gaia Data Release 3 proper motions. We find a mean line-of-sight velocity of −290.62 ± 0.80 km s −1 with dispersion = $9.57$$^{+0.66}_{–0.62}$ km s −1 and mean metallicity [Fe/H] = −2.10 ± 0.04, consistent with previous results. We also find that Draco has a steep metallicity gradient within the half-light radius, and a metallicity gradient that flattens beyond the half-light radius. We identify eight high-probability members outside the King tidal radius, four of which we identify for the first time. These extratidal stars are not preferentially aligned along the orbit of Draco. We compute an average surface brightness of 34.02 mag arsec –2 within an elliptical annulus from the King tidal radius of 48'.1–81′.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Ultracool dwarfs candidates based on 6 yr of the Dark Energy Survey data

ABSTRACT We present a sample of 19 583 ultracool dwarf candidates brighter than z ≤23 selected from the Dark Energy Survey DR2 coadd data matched to VHS DR6, VIKING DR5, and AllWISE covering ∼ 480 deg2. The ultracool candidates were first pre-selected based on their (i–z), (z–Y), and (Y–J) colours. They were further classified using a method that compares their optical, near-infrared, and mid-infrared colours against templates of M, L, and T dwarfs. 14 099 objects are presented as new L and T candidates and the remaining objects are from the literature, including 5342 candidates from our previous work. Using this new and deeper sample of ultracool dwarf candidates we also present: 20 new candidate members to nearby young moving groups and associations, variable candidate sources and four new wide binary systems composed of two ultracool dwarfs. Finally, we also show the spectra of 12 new ultracool dwarfs discovered by our group and presented here for the first time. These spectroscopically confirmed objects are a sanity check of our selection of ultracool dwarfs and photometric classification method.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Imperial Valley Dark Fiber Project Continuous DAS Data

The Imperial Valley Dark Fiber Project acquired Distributed Acoustic Sensing (DAS) seismic data on a ~28 km segment of dark fiber between the cities of Calipatria and Imperial in the Imperial Valley, Southern California. Dark fiber refers to unused optical fiber cables in telecommunications networks and is repurposed in this project for DAS applications. The objective, which is further detailed in the attached journal article from Ajo-Franklin et al., is to demonstrate dark fiber DAS as a tool for basin-scale geothermal exploration and monitoring. The included DAS data were recorded during two days at the beginning the project. Data is stored in the .h5 (HDF5) file format, readable using various software tools, including the 'h5read' and 'h5info' functions in Matlab. Provided here are examples of methods to read and use the data with the 'h5py' package in Python.

15 GEOTHERMAL ENERGY↗
NASA NTRS2014

Comparing MODIS C6 'Deep Blue' and 'Dark Target' Aerosol Data

The MODIS Collection 6 Atmospheres product suite includes refined versions of both 'Deep Blue' (DB) and 'Dark Target' (DT) aerosol algorithms, with the DB dataset now expanded to include coverage over vegetated land surfaces. This means that, over much of the global land surface, users will have both DB and DT data to choose from. A 'merged' dataset is also provided, primarily for visualization purposes, which takes retrievals from either or both algorithms based on regional and seasonal climatologies of normalized difference vegetation index (NDVI). This poster present some comparisons of these two C6 aerosol algorithms, focusing on AOD at 550 nm derived from MODIS Aqua measurements, with each other and with Aerosol Robotic Network (AERONET) data, with the intent to facilitate user decisions about the suitability of the two datasets for their desired applications.

MODIS Collection 6↗