SEARCH · Search NASA

Results for “data legacy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Photo-zSNthesis: Converting Type Ia Supernova Lightcurves to Redshift Estimates via Deep Learning

Abstract Upcoming photometric surveys will discover tens of thousands of Type Ia supernovae (SNe Ia), vastly outpacing the capacity of our spectroscopic resources. In order to maximize the scientific return of these observations in the absence of spectroscopic information, we must accurately extract key parameters, such as SN redshifts, with photometric information alone. We present Photo- z SNthesis, a convolutional neural network-based method for predicting full redshift probability distributions from multi-band supernova lightcurves, tested on both simulated Sloan Digital Sky Survey (SDSS) and Vera C. Rubin Legacy Survey of Space and Time data as well as observed SDSS SNe. We show major improvements over predictions from existing methods on both simulations and real observations as well as minimal redshift-dependent bias, which is a challenge due to selection effects, e.g., Malmquist bias. Specifically, we show a 61× improvement in prediction bias 〈Δ z 〉 on PLAsTiCC simulations and 5× improvement on real SDSS data compared to results from a widely used photometric redshift estimator, LCFIT+Z. The PDFs produced by this method are well constrained and will maximize the cosmological constraining power of photometric SNe Ia samples.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

The Hawaii Meteorology, Energy and Transmission (MET) Toolkit

Reliable long-term resource adequacy and grid planning in Hawaii require precise, multi-decadal meteorological records. This paper introduces the Hawaii Meteorology, Energy and Transmission (MET) Toolkit, a 26-year (2000-2025) high-fidelity atmospheric dataset developed by the National Laboratory of the Rockies (NLR). We present a validation study of the underlying WRF model configurations, comparing the legacy MYNN PBL scheme against an alternative YSU formulation. Using vertical lidar profiles and surface buoy data, our analysis identified a foundational geometric distortion in the legacy NOW-23 Hawaii dataset caused by an incorrect grid projection. When evaluated on a corrected, zero-distortion grid, the YSU scheme demonstrated superior performance in bias and cRMSE compared to the legacy setup. To address these findings, the MET Toolkit has been re-produced as a unified 26-year record using the optimized YSU setup and corrected geometry. This dataset offers the Hawaii power sector a robust, validated, and homogenous reference for future grid resilience and energy integration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory

The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will image the entire southern sky every three to four days and produce tens of petabytes of raw image data and associated calibration data over the course of the experiment’s run. More than 20 terabytes of data must be stored every night, and annual campaigns to reprocess the entire dataset since the beginning of the survey will be conducted over ten years. The Production and Distributed Analysis (PanDA) system was evaluated by the Rubin Observatory Data Management team and selected to serve the Observatory’s needs due to its demonstrated scalability and flexibility over the years, for its Directed Acyclic Graph (DAG) support, its support for multi-site processing, and its highly scalable complex workflows via the intelligent Data Delivery Service (iDDS). PanDA is also being evaluated for prompt processing where data must be processed within 60 seconds after image capture. This paper will briefly describe the Rubin Data Management system and its Data Facilities (DFs). Finally, it will describe in depth the work performed in order to integrate the PanDA system with the Rubin Observatory to be able to run the Rubin Science Pipelines using PanDA.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Enabling Early Transient Discovery in LSST via Difference Imaging with DECam

We present SLIDE, a pipeline that enables transient discovery in data from the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), using archival images from the Dark Energy Camera as templates for difference imaging. We apply this pipeline to the recently released Data Preview 1 (DP1; the first public release of Rubin commissioning data) and search for transients in the resulting difference images. The image subtraction, photometry extraction, and transient detection are all performed on the Rubin Science Platform. We demonstrate that SLIDE effectively extracts clean photometry by circumventing poor or missing LSST templates. We identified 29 previously unreported transients, 12 of which would not have been detected based on the DP1 DiaObject catalog. SLIDE will be especially useful for transient analysis in the early years of LSST, when template coverage will be largely incomplete or when templates may be contaminated by transients present at the time of acquisition. We present multiband light curves for a sample of known transients, along with new transient candidates identified through our search. Finally, we discuss the prospects of applying this pipeline during the main LSST survey. Our pipeline is broadly applicable and will support studies of all transients with slowly evolving phases.

Dong, Yize 一泽董 [Harvard-Smithsonian Center for Ast↗

DOE OSTI2025

SESAME: ASCII2 File Format

A new ASCII format for SESAME data is explicitly defined and dubbed ASCII2. This format fixes some of the onerous limitations of the legacy ASCII-styled format in addition to relaxing the FORTRAN style fixed-format layout of data tables. With the exception of the multi-tiered indexes of the legacy binary format, the new ASCII2 is more compatible with the binary in that it does not restrict the extent of various integer data (e.g., SESAME material and table numbers) to six digits nor does it restrict the extent or precision of the various floating point data. There will be very limited support of the legacy ASCII-styled formats in the future.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Final Technical Report Wireless Microsensors System for Monitoring Deep Subsurface Operations

This final technical report describes the main findings of the project Wireless Microsensors System for Monitoring Deep Subsurface Operations (FE0031850). The project was part of the U.S. Department of Energy National Energy Technology Laboratory FOA 1998 program to develop new sensor systems for direct observation of parameters associated with CO2 injection and to provide data collection without being disruptive to operations. The overall DOE program was aimed at developing and validating innovative transformational sensor systems, amenable for integration with autonomous intelligent monitoring systems, that are capable of being deployed within the casing annulus and do not have casing perforation or wires/cables in the annulus for installation, power supply, or data transmission needs. Project accomplishments included 1) design and fabrication of a wireless downhole sensor system to monitor parameters for CO2 storage, 2) field testing of the sensor system in two legacy oil & gas wells, and 3) development of an analysis approach that validates the measurements and demonstrates the application of the technology to depict CO2 movement in the subsurface. The project leveraged new sensor technologies along with specialized wellbore telemetry, deployment, and analysis methods designed to address the challenges and risks related to CO2 storage in the subsurface. Results from field testing were a mixture of successes and challenges. The temperature sensor rings, installation procedures in legacy oil & gas wells, wireless powering demonstration, automated data collection, and material compatibility were successful. The wireless data transfer through cement to the wellhead via the sensor relays was not functional beyond the first relay. Consequently, work in the last year of the project included some additional testing of data transmission through different materials along with modeling and analysis of field data for CO2 monitoring applications. This work suggested there are options like polymer cements and open hole annuli that may allow point-to-point transmission along the borehole. The techno-economic analysis suggests that the sensor system is ~40% less expensive than fiber optic distributed temperature system. Modeling of CO2 storage applications suggests temperature can provide an indicator of CO2 saturation but would be best combined with pressure sensors.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

DeepAstroUDA: semi-supervised universal domain adaptation for cross-survey galaxy morphology classification and anomaly detection

Abstract Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features. Therefore, such methods do not generalize well across multiple datasets. We present a universal domain adaptation method, DeepAstroUDA , as an approach to overcome this challenge. This algorithm performs semi-supervised domain adaptation (DA) and can be applied to datasets with different data distributions and class overlaps. Non-overlapping classes can be present in any of the two datasets (the labeled source domain, or the unlabeled target domain), and the method can even be used in the presence of unknown classes. We apply our method to three examples of galaxy morphology classification tasks of different complexities (three-class and ten-class problems), with anomaly detection: (1) datasets created after different numbers of observing years from a single survey (Legacy Survey of Space and Time mock data of one and ten years of observations); (2) data from different surveys (Sloan Digital Sky Survey (SDSS) and DECaLS); and (3) data from observing fields with different depths within one survey (wide field and Stripe 82 deep field of SDSS). For the first time, we demonstrate the successful use of DA between very discrepant observational datasets. DeepAstroUDA is capable of bridging the gap between two astronomical surveys, increasing classification accuracy in both domains (up to 40 % on the unlabeled data), and making model performance consistent across datasets. Furthermore, our method also performs well as an anomaly detection algorithm and successfully clusters unknown class samples even in the unlabeled target dataset.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Rubin Observatory LSST Tutorials

A collection of tutorials -- both Jupyter notebooks and documentation-based --- demonstrating data access, analysis, and visualization techniques for the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). These tutorials are intended for astronomers, educators, and data scientists working with LSST data products.

Vera C. Rubin Observatory, NSF-DOE↗

DOE OSTI2022

DeepZipper: A Novel Deep-learning Architecture for Lensed Supernovae Identification

Large-scale astronomical surveys have the potential to capture data on large numbers of strongly gravitationally lensed supernovae (LSNe). To facilitate timely analysis and spectroscopic follow-up before the supernova fades, an LSN needs to be identified soon after it begins. To quickly identify LSNe in optical survey data sets, we designed ZipperNet, a multibranch deep neural network that combines convolutional layers (traditionally used for images) with long short-term memory layers (traditionally used for time series). We tested ZipperNet on the task of classifying objects from four categories—no lens, galaxy-galaxy lens, lensed Type-Ia supernova, lensed core-collapse supernova—within high-fidelity simulations of three cosmic survey data sets: the Dark Energy Survey, Rubin Observatory’s Legacy Survey of Space and Time (LSST), and a Dark Energy Spectroscopic Instrument (DESI) imaging survey. Among our results, we find that for the LSST-like data set, ZipperNet classifies LSNe with a receiver operating characteristic area under the curve of 0.97, predicts the spectroscopic type of the lensed supernovae with 79% accuracy, and demonstrates similarly high performance for LSNe 1–2 epochs after first detection. We anticipate that a model like ZipperNet, which simultaneously incorporates spatial and temporal information, can play a significant role in the rapid identification of lensed transient systems in cosmic survey experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Fusion and Fission Energy and Science Directorate and Information Technology Services Directorate HPC Cluster Reduction, Consolidation, and Savings in Data Center Space, Power, and Cooling

This report evaluates the benefits of decommissioning six legacy FFESD purchased HPC clusters and consolidating services and workloads into a new HPC cluster named HELIOS. The findings demonstrate significant reductions in the data center power and cooling requirements, data center footprint, and operational overhead, while simultaneously increasing computational capacity.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Large–scale asymmetry in galaxy spin directions: Analysis of galaxies with spectra in DES, SDSS, and DESI Legacy Survey

Multiple previous studies using several different probes have shown considerable evidence for the existence of cosmological–scale anisotropy and a Hubble–scale axis. One of the probes that show such evidence is the distribution of the directions toward which galaxies spin. The advantage of the analysis of the distribution of galaxy spin directions compared to the cosmic microwave background anisotropy is that the ratio of galaxy spin directions is a relative measurement, and therefore less sensitive to background contamination such as Milky Way obstruction. Another advantage is that many spiral galaxies have spectra, and therefore allow to analyze the location of such axis relative to Earth. This paper shows an analysis of the distribution of the spin directions of over 90K galaxies with spectra. That analysis is also compared to previous analyses using the Earth–based Sloan Digital Sky Survey, Panoramic Survey Telescope and Rapid Response System, and Dark Energy Spectroscopic Instrument Legacy Survey, as well as space–based data collected by Hubble Space Telescope. Finally, the results show very good agreement between the distribution patterns observed with the different telescopes. The dipole or quadrupole axes formed by the spin directions of the galaxies with spectra do not necessarily go directly through Earth.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Gravitational waves and galaxies cross-correlations: a forecast on GW biases for future detectors

ABSTRACT Gravitational waves (GWs) have rapidly become important cosmological probes since their first detection in 2015. As the number of detected events continues to rise, upcoming instruments like Einstein Telescope (ET) and Cosmic Explorer (CE) will observe millions of compact binary mergers. These detections, coupled with galaxy surveys by instruments such as the Dark Spectroscopic Energy Instrument (DESI), Euclid, and the Vera Rubin Observatory, will provide unique information on the large-scale structure of the universe by cross-correlating GWs with the distribution of galaxies hosting them. In this paper, we focus on how cross-correlations constrain the clustering bias of GWs emitted by the coalescence of binary black holes (BBHs). This parameter links BBHs to the underlying dark matter distribution, hence informing us how they populate galaxies. Using a multitracer approach, we forecast the precision of these measurements under different survey combinations. Our results indicate that current GW detectors will have limited precision, with measurement errors as high as $\displaystyle \sim 50~{{\ \rm per\ cent}}$. However, third-generation detectors like ET, when cross-correlated with Legacy Survey of Space and Time (LSST) data, can improve clustering bias measurements to within 2.5 per cent. Furthermore, we demonstrate that these cross-correlations can enable a per cent-level measurement of the magnification lensing effect on GWs. Despite this, there is a degeneracy between magnification and evolution biases, which hinders the precision of both. This degeneracy is most effectively addressed by assuming knowledge of one bias or targeting an optimal redshift range of $\displaystyle 1 \lt z \lt 2.5$. Our analysis opens new avenues for studying the distribution of BBHs and testing the nature of gravity through large-scale structure.

Zazzera, Stefano (ORCID:0000000158979221)↗

DOE OSTI2024

Effective Visualization of Radar Data for Users Impacted by Color Vision Deficiency

Color vision deficiency (CVD) is a decreased ability to discern between particular colors. Eight percent of genetic males and half a percent of genetic females have some form of CVD, with many in the radar community falling into this group. When presenting data on a two-dimensional plane, it is common to use colors to represent values via a colormap. Colormap choice in the radar community is influenced by the ability to highlight scientifically interesting features in data, institutional choices, and domain dominance of legacy colormaps. The problem with these current colormaps is that many do not project well for those with CVD (i.e., green next to red). In working with the CVD community to address this problem, multiple colormaps for moments such as equivalent reflectivity factor and Doppler velocity were created for users with forms of CVD such as deuteranomaly, protanomaly, protanopia, and deuteranopia using Python tools such as colorspacious and viscm. We show how these colormaps can improve interpretability for four cases: a mesoscale convective system, a pyrocumulonimbus storm, a wintertime midlatitude cyclone, and widespread storms with a large bird migration. These new radar equivalent reflectivity factor, Doppler velocity, and polarization colormaps are designed to highlight rain, frozen precipitation, nonmeteorological targets, and velocity-based items, are perceptually uniform, and are visually friendly for those with CVD.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

The Most Metal-poor Stars in the Inner Bulge

The bulge is the oldest component of the Milky Way. Since numerous simulations of Milky Way formation have predicted that the oldest stars at a given metallicity are found on tightly bound orbits, the Galaxy’s oldest stars are likely metal-poor stars in the inner bulge with small apocenters (i.e., R {sub apo} ≲ 4 kpc). In the past, stars with these properties have been impossible to find due to extreme reddening and extinction along the line of sight to the inner bulge. We have used the mid-infrared metal-poor star selection of Schlaufman & Casey (2014) on Spitzer/Galactic Legacy Infrared Mid-Plane Survey Extraordinaire data to overcome these problems and target candidate inner bulge metal-poor giants for moderate-resolution spectroscopy with Anglo-Australian Telescope/AAOmega. We used those data to select three confirmed metal-poor giants ([Fe/H] = −3.15, −2.56, −2.03) for follow-up high-resolution Magellan/Magellan Inamori Kyocera Echelle spectroscopy. A comprehensive orbit analysis using Gaia DR2 astrometry and our measured radial velocities confirms that these stars are tightly bound inner bulge stars. We determine the elemental abundances of each star and find high titanium and iron-peak abundances relative to iron in our most metal-poor star. We propose that the distinct abundance signature we detect is a product of nucleosynthesis in the Chandrasekhar-mass thermonuclear supernova of a CO white dwarf accreting from a helium star with a delay time of about 10 Myr. Even though chemical evolution is expected to occur quickly in the bulge, the intense star formation in the core of the nascent Milky Way was apparently able to produce at least one Chandrasekhar-mass thermonuclear supernova progenitor before chemical evolution advanced beyond [Fe/H]∼−3.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Vertical Structure of Local Disk Galaxies Revealed by DESI Imaging Data

The vertical structure of galactic disks is an important probe of the disk assembly history. Here we investigate the vertical structure of a sample of 79 local disk galaxies within 50 Mpc using data from the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys. Vertical luminosity profiles as a function of radius in the g, r, and z bands are extracted and fitted using a single-component sech2 model to determine scale height and its radial variation (i.e., flaring). Our measurements indicate local galactic disks are overall thin with negligible flaring. The median scale heights at 1 R e are 0.21, 0.22, and 0.22 kpc in the g, r, and z bands, respectively, while the median radial gradients of scale height are −0.006, 0.003, and 0.001 in these bands. These values are consistent with that of the geometric thin disk of the Milky Way represented by metal-rich, low-[α/Fe] populations, confirming the weak flaring of the geometric thin disk. A clear positive correlation of scale height with stellar mass is observed down to the low-mass end of 10 7 M ⊙ . These results provide a homogeneous benchmark for the vertical structure of nearby disk galaxies and establish the cosmological representativeness of the Milky Way thin disk.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Probing Physics beyond the Standard Model through Combined Analyses of Next-generation Type Ia Supernova, Cosmic Microwave Background, and Baryon Acoustic Oscillation Surveys

Observations of Type Ia supernovae (SNe Ia), which probe the late Universe, together with baryon acoustic oscillations (BAO) and the cosmic microwave background (CMB), which probe the intermediate and early epochs, provide complementary constraints on the expansion history of the Universe. In this work, we forecast constraints on dark energy and other extensions to the standard cosmological model by combining the SN Ia sample expected from the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), data from current and forthcoming CMB surveys, and BAO measurements from the Dark Energy Spectroscopic Instrument (DESI). For the CMB, we use temperature, polarization, and lensing power spectra (TT/EE/TE/ϕϕ) from the South Pole Telescope, the planned Advanced Simons Observatory, and a CMB-S4–like experiment. We derive constraints on ΛCDM and its extensions involving the dark energy equation-of-state parameters (w 0 , w a ) and the sum of neutrino masses ∑m ν using a Markov Chain Monte Carlo (MCMC) sampling framework. We find that the LSST Year 3 SN Ia sample can improve upon the DES Year 5 dark energy constraints by a factor of 2−2.5×, with the gains driven primarily by the significantly higher SN Ia density in the LSST sample. Similarly, DESI-DR3 shows up to a 1.8× improvement on dark energy parameters over DR2, driven largely by the substantial increase in the low-redshift sample. Combining CMB with LSST-Y3-SN Ia and DESI-DR3-BAO yields σ(w 0 ) = 0.028 and σ(w a ) = 0.11 for w 0 w a CDM cosmology with the results being largely independent of the CMB dataset. The constraints weaken by 10%–30% when freeing ∑m ν and spatial curvature. Moreover, the joint analysis of the three datasets can enable a 2σ–3σ detection of ∑m ν .

Raghunathan, Srinivasan [University of California;↗

DOE OSTI2022

Evaluation of the GaAs displacement damage metric using updated nuclear data

The emerging use of the physics-based athermal recombination-corrected displacement per atom (arc-dpa) model for the displacement damage efficiency has motivated a re-evaluation of the historical empirically-derived GaAs damage response function with the purpose of highlighting needs for future analytical and experimental work. The 1-MeV neutron damage equivalence methodology used in the ASTM E-722 standard for GaAs has been re-evaluated using updated nuclear data. This yielded a higher fidelity representation of the GaAs displacement kerma and, through the use of the refined PKA recoil energy-dependent damage efficiency model, an updated 1-MeV(GaAs) displacement damage function. This re-evaluation included use of the Norgett-Robinson-Torrens (NRT) model for an updated threshold treatment, rather than the sharp-threshold Kinchin-Pease model used in the current ASTM standard. The underlying nuclear data evaluations have been updated to use the ENDF/VIII.0 {sup 75}As and TENDL-2019 {sup 71}Ga/{sup 69}Ga evaluations. The displacement kerma and 1-MeV-equivalent damage responses were calculated using a modified NJOY-2016 code which allowed for refinements in some of the damage models. This paper shows that an updated displacement damage function, based upon the latest nuclear data, is consistent with the experimental data used to develop the current ASTM E-722 GaAs standard. Using a double ratio approach to compare the available experimental data with the calculated response, the average legacy double ratio was found to be 0.97 ± 0.05 and the average updated double ratio was found to be 0.94 ± 0.05. (authors)

36 MATERIALS SCIENCE↗

DOE OSTI2025

Comprehensive Neural Posterior Estimation for Galaxy-Galaxy Strong Lensing

We present a deep learning model based on neural posterior estimation (NPE) for comprehensive extraction of astrophysical parameters from galaxy-scale strong gravitational lenses. The unprecedentedly large amount of galaxy-scale strong lenses expected in future cosmological surveys (${\cal O}(10^5)$) promises to enable valuable statistical constraints in various studies ranging from galaxy formation to the nature of dark matter, but it also poses a significant challenge for traditional modelling pipelines. To this end, our automated model includes several new, state-of-the-art features and approaches leveraging the framework of simulation-based inference (SBI). We infer a total of 20 parameters describing the mass and light profiles of both lens and source galaxies, using simulated raw multi-band data modelled under noise and observing conditions expected by the Legacy Survey of Space and Time (LSST), with its summary statistics generated by a residual network. We examine the efficacy of multi-band data in extracting nearly 20 model parameters simultaneous from strong lensing images including lens light. Finally, We perform a comprehensive set of diagnostics for SBI models, evaluating the model's prediction accuracy, stability, and uncertainty quantification.