Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bloom filter”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Jacobian sparsity detection using Bloom filters

Determining Jacobian sparsity structure is an important step in the efficient computation of sparse Jacobians. We introduce a new method for determining Jacobian sparsity patterns by combining bit vector probing with Bloom filters. In conclusion, we further refine Bloom filter probing by combining it with hierarchical probing to yield a highly effective strategy for Jacobian sparsity pattern determination.

Bloom filter↗

An optical filtering system for remote sensing of phytoplankton and suspended sediment

Aerial photography revealing blue-green Anacystis phytoplankton blooms in the Potomac River is presented. Data scanned were near-IR, green, and yellow nadir radiance; concurrent ground measurements are correlated with these data, including salinity, Secchi disk depth, chlorophyll a concentration, and river depth. In nonbloomed areas, R (radiance) is proportional to the reciprocal of Secchi depth for the green and yellow filters; in bloomed areas, R is constant for the green filter and random for the near-IR and yellow filters.

Bressette, W. E.↗

A chemical perspective on the chiral induced spin selectivity effect

ABSTRACT This review discusses opportunities in chemistry that are enabled by the chiral induced spin selectivity (CISS) effect. First, the review begins with a brief overview of the seminal studies on CISS. Next, we discuss different chiral material systems whose properties can be tailored through chemical means, with a special emphasis on hybrid organic-inorganic layered materials that exhibit some of the largest spin filtering properties to date. Then, we discuss the promise of CISS for chemical reactions and enantioseparation before concluding.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

PhyLM: A Mission Design Concept for an Optical/Lidar Instrument to Measure Ocean Productivity and Aerosols from Space

The Physiology Lidar-Multispectral Mission (PhyLM) is intended to explore the complex ecosystems of our global oceans. New "inversion" methods and improved understanding of marine optics have opened the door to quantifying a range of critical ocean properties. This new information could revolutionize our understanding of global ocean processes, such as phytoplankton growth, harmful algal blooms, carbon fluxes between major pools and the productivity equation. The new science requires new measurements not addressed by currently planned space missions. PhyLM will combine active and advanced passive remote sensing technologies to quantify standing stocks and fluxes of climate-critical components of the Ocean carbon cycle to meet these science providing multispectral bands from the far UV through the near infrared (340 - 1250 nm) at a ground resolution of 250 m. Improved detectors, filters, mirrors, digitization and focal plane design will offer an overall higher-quality data product. The unprecedented accuracy and precision of the absolute water-leaving radiances will support inversion- based quantification of an expanded set of ocean carbon cycle components. The dual- wavelength (532 & 1064 nm) Nd:Yag Lidar will enhance the accuracy and precision of the passive data by providing aerosol profiles for atmospheric correction and coincident active measurements of backscattering. The Lidar will also examine dark-side fluorescence as an additional approach to quantifying phytoplankton biomass in highly productive regions.

Gervin, Janette C.↗

A Two-Dimensional Variational Analysis Method for NSCAT Ambiguity Removal: Methodology, Sensitivity, and Tuning

In this study, we apply a two-dimensional variational analysis method (2d-VAR) to select a wind solution from NASA Scatterometer (NSCAT) ambiguous winds. 2d-VAR determines a "best" gridded surface wind analysis by minimizing a cost function. The cost function measures the misfit to the observations, the background, and the filtering and dynamical constraints. The ambiguity closest in direction to the minimizing analysis is selected. 2d-VAR method, sensitivity and numerical behavior are described. 2d-VAR is compared to statistical interpolation (OI) by examining the response of both systems to a single ship observation and to a swath of unique scatterometer winds. 2d-VAR is used with both NSCAT ambiguities and NSCAT backscatter values. Results are roughly comparable. When the background field is poor, 2d-VAR ambiguity removal often selects low probability ambiguities. To avoid this behavior, an initial 2d-VAR analysis, using only the two most likely ambiguities, provides the first guess for an analysis using all the ambiguities or the backscatter data. 2d-VAR and median filter selected ambiguities usually agree. Both methods require horizontal consistency, so disagreements occur in clumps, or as linear features. In these cases, 2d-VAR ambiguities are often more meteorologically reasonable and more consistent with satellite imagery.

Hoffman, R. N.↗

Normal Mode Initialization

The objective of this research is the development and implementation of normal mode procedures for use with the GLAS analysis/forecast system. Specific tasks of this work include: (1) high latitude filtering of model fields to preserve the GLAS GCM's linear stability during integration; (2) development of nonlinear normal mode initialization (NLNMI) processes, both adiabatic and diabatic. Using NLNMI to initialize GLAS analyses; investigation of the impact of normal mode initialization on the GLAS analysis/forecast system, especially in regard to data assimilation; and (3) diagnosis of the 1-3 day systemic forecast errors of the GLAS GCM.

Bloom, S. C.↗

The Swift-BAT Hard X-Ray Transient Monitor

The Swift/Burst Alert Telescope (BAT) hard X-ray transient monitor provides near real-time coverage of the X-ray sky in the energy range 15-50 keV. The BAT observes 88% of the sky each day with a detection sensitivity of 5.3 mCrab for a full-day observation and a time resolution as fine as 64 s. The three main purposes of the monitor are (1) the discovery of new transient X-ray sources, (2) the detection of outbursts or other changes in the flux of known X-ray sources, and (3) the generation of light curves of more than 900 sources spanning over eight years. The primary interface for the BAT transient monitor is a public Web site. Between 2005 February 12 and 2013 April 30, 245 sources have been detected in the monitor, 146 of them persistent and 99 detected only in outburst. Among these sources, 17 were previously unknown and were discovered in the transient monitor. In this paper, we discuss the methodology and the data processing and filtering for the BAT transient monitor and review its sensitivity and exposure.We provide a summary of the source detections and classify them according to the variability of their light curves. Finally, we review all new BAT monitor discoveries. For the new sources that are previously unpublished, we present basic data analysis and interpretations.

black hole physics↗

File Specification for GEOS-5 FP (Forward Processing)

The GEOS-5 FP Atmospheric Data Assimilation System (GEOS-5 ADAS) uses an analysis developed jointly with NOAA's National Centers for Environmental Prediction (NCEP), which allows the Global Modeling and Assimilation Office (GMAO) to take advantage of the developments at NCEP and the Joint Center for Satellite Data Assimilation (JCSDA). The GEOS-5 AGCM uses the finite-volume dynamics (Lin, 2004) integrated with various physics packages (e.g, Bacmeister et al., 2006), under the Earth System Modeling Framework (ESMF) including the Catchment Land Surface Model (CLSM) (e.g., Koster et al., 2000). The GSI analysis is a three-dimensional variational (3DVar) analysis applied in grid-point space to facilitate the implementation of anisotropic, inhomogeneous covariances (e.g., Wu et al., 2002; Derber et al., 2003). The GSI implementation for GEOS-5 FP incorporates a set of recursive filters that produce approximately Gaussian smoothing kernels and isotropic correlation functions. The GEOS-5 ADAS is documented in Rienecker et al. (2008). More recent updates to the model are presented in Molod et al. (2011). The GEOS-5 system actively assimilates roughly 2 × 10(exp 6) observations for each analysis, including about 7.5 × 10(exp 5) AIRS radiance data. The input stream is roughly twice this volume, but because of the large volume, the data are thinned commensurate with the analysis grid to reduce the computational burden. Data are also rejected from the analysis through quality control procedures designed to detect, for example, the presence of cloud. To minimize the spurious periodic perturbations of the analysis, GEOS-5 FP uses the Incremental Analysis Update (IAU) technique developed by Bloom et al. (1996). More details of this procedure are given in Appendix A. The assimilation is performed at a horizontal resolution of 0.3125-degree longitude by 0.25- degree latitude and at 72 levels, extending to 0.01 hPa. All products are generated at the native resolution of the horizontal grid. The majority of data products are time-averaged, but four instantaneous products are also available. Hourly data intervals are used for two-dimensional products, while 3-hourly intervals are used for three-dimensional products. These may be on the model's native 72-layer vertical grid or at 42 pressure surfaces extending to 0.1 hPa. This document describes the gridded output files produced by the GMAO near real-time operational FP, using the most recent version of the GEOS-5 assimilation system. Additional details about variables listed in this file specification can be found in a separate document, the GEOS-5 File Specification Variable Definition Glossary. Documentation about the current access methods for products described in this document can be found on the GMAO products page: http://gmao.gsfc.nasa.gov/products/.

GSI↗

File Specification for GEOS-5 FP-IT (Forward Processing for Instrument Teams)

The GEOS-5 FP-IT Atmospheric Data Assimilation System (GEOS-5 ADAS) uses an analysis developed jointly with NOAA's National Centers for Environmental Prediction (NCEP), which allows the Global Modeling and Assimilation Office (GMAO) to take advantage of the developments at NCEP and the Joint Center for Satellite Data Assimilation (JCSDA). The GEOS-5 AGCM uses the finite-volume dynamics (Lin, 2004) integrated with various physics packages (e.g, Bacmeister et al., 2006), under the Earth System Modeling Framework (ESMF) including the Catchment Land Surface Model (CLSM) (e.g., Koster et al., 2000). The GSI analysis is a three-dimensional variational (3DVar) analysis applied in grid-point space to facilitate the implementation of anisotropic, inhomogeneous covariances (e.g., Wu et al., 2002; Derber et al., 2003). The GSI implementation for GEOS-5 FP-IT incorporates a set of recursive filters that produce approximately Gaussian smoothing kernels and isotropic correlation functions. The GEOS-5 ADAS is documented in Rienecker et al. (2008). More recent updates to the model are presented in Molod et al. (2011). The GEOS-5 system actively assimilates roughly 2 × 10(exp 6) observations for each analysis, including about 7.5 × 10(exp 5) AIRS radiance data. The input stream is roughly twice this volume, but because of the large volume, the data are thinned commensurate with the analysis grid to reduce the computational burden. Data are also rejected from the analysis through quality control procedures designed to detect, for example, the presence of cloud. To minimize the spurious periodic perturbations of the analysis, GEOS-5 FP-IT uses the Incremental Analysis Update (IAU) technique developed by Bloom et al. (1996). More details of this procedure are given in Appendix A. The analysis is performed at a horizontal resolution of 0.625-degree longitude by 0.5-degree latitude and at 72 levels, extending to 0.01 hPa. All products are generated at the native resolution of the horizontal grid. The majority of data products are time-averaged, but four instantaneous products are also available. Hourly data intervals are used for two-dimensional products, while 3-hourly intervals are used for three-dimensional products. These may be on the model's native 72-layer vertical grid or at 42 pressure surfaces extending to 0.1 hPa. This document describes the gridded output files produced by the GMAO near real-time operational GEOS-5 FP-IT processing in support of the EOS instrument teams. Additional details about variables listed in this file specification can be found in a separate document, the GEOS-5 File Specification Variable Definition Glossary.

3D Var↗

Macromolecular Topography Leaps into the Digital Age

A low-cost, real-time digital topography system is under development which will replace x-ray film and nuclear emulsion plates. The imaging system is based on an inexpensive surveillance camera that offers a 1000x1000 array of 8 im square pixels, anti-blooming circuitry, and very quick read out. Currently, the system directly converts x-rays to an image with no phosphor. The system is small and light and can be easily adapted to work with other crystallographic equipment. Preliminary images have been acquired of cubic insulin at the NSLS x26c beam line. NSLS x26c was configured for unfocused monochromatic radiation. Six reflections were collected with stills spaced from 0.002 to 0.001 degrees apart across the entire oscillation range that the reflections were in diffracting condition. All of the reflections were rotated to the vertical to reduce Lorentz and beam related effects. This particular CCD is designed for short exposure applications (much less than 1 sec) and so has a relatively high dark current leading to noisy raw images. The images are processed to remove background and other system noise with a multi-step approach including the use of wavelets, histogram, and mean window filtering. After processing, animations were constructed with the corresponding reflection profile to show the diffraction of the crystal volume vs. the oscillation angle as well as composite images showing the parts of the crystal with the strongest diffraction for each reflection. The final goal is to correlate features seen in reflection profiles captured with fine phi slicing to those seen in the topography images. With this development macromolecular topography finally comes into the digital age.

Lovelace, J.↗

Computational modes and the Machenauer N.L.N.M.I. of the GLAS 4th order model

An attempt was made to use the GLAS global 4th order shallow water equations to perform a Machenhauer nonlinear normal mode initialization (NLNMI) for the external vertical mode. A new algorithm was defined for identifying and filtering out computational modes which affect the convergence of the Machenhauer iterative procedure. The computational modes and zonal waves were linearly initialized and gravitational modes were nonlinearly initialized. The Machenhauer NLNMI was insensitive to the absence of high zonal wave numbers. The effects of the Machenhauer scheme were evaluated by performing 24 hr integrations with nondissipative and dissipative explicit time integration models. The NLNMI was found to be inferior to the Rasch (1984) pseudo-secant technique for obtaining convergence when the time scales of nonlinear forcing were much smaller than the time scales expected from the natural frequency of the mode.

Navon, I. M.↗

A Morphological Model to Separate Resolved–Unresolved Sources in the DESI Legacy Surveys: Application in the LS4 Alert Stream

Separating resolved and unresolved sources in large imaging surveys is a fundamental step to enable downstream science, such as searching for extragalactic transients in wide-field time-domain surveys. Here we present our method to effectively separate point sources from the resolved, extended sources in the Dark Energy Spectroscopic Instrument (DESI) Legacy Surveys (LS). We develop a supervised machine learning model based on the Gradient Boosting algorithm XGBoost. The features input to the model are purely morphological and are derived from the tabulated LS data products. We train the model using ∼2 × 10 5 LS sources in the COSMOS field with HST morphological labels and evaluate the model performance on LS sources with spectroscopic classification from the DESI Data Release 1 (∼2 × 10 7 objects) and the Sloan Digital Sky Survey Data Release 17 (∼3 × 10 6 objects), as well as on ∼2 × 10 8 Gaia stars. A significant fraction of LS sources are not observed in every LS filter, and we therefore build a “Hybrid” model as a linear combination of two XGBoost models, each containing features combining aperture flux measurements from the “blue” (gr) and “red” (iz) filters. The Hybrid model shows a reasonable balance between sensitivity and robustness, and achieves higher accuracy and flexibility compared to the LS morphological typing. With the Hybrid model, we provide classification scores for ∼3 × 10 9 LS sources, making this the largest ever machine learning catalog separating resolved and unresolved sources. The catalog has been incorporated into the real-time pipeline of the La Silla Schmidt Southern Survey (LS4), enabling the identification of extragalactic transients within the LS4 alert stream.

astrostatistics↗

The La Silla Schmidt Southern Survey

We present the La Silla Schmidt Southern Survey (LS4), a new wide-field, time-domain survey to be conducted with the 1 m ESO Schmidt telescope. The 268 megapixel LS4 camera mosaics 32 2k × 4k fully depleted CCDs, providing a ∼20 deg 2 field of view with 1″ pixel −1 resolution. The LS4 camera will have excellent performance at longer wavelengths: in a standard 45 s exposure the expected 5σ limiting magnitudes in g, i, z are ∼21.5, ∼20.9, and ∼20.3 mag (AB), respectively. The telescope design requires a novel filter holder that fixes different bandpasses over each quadrant of the detector. Two quadrants will have i band, while the other two will be g and z band with color information obtained by dithering targets across the different quadrants. The majority (90%) of the observing time will be used to conduct a public survey that monitors the extragalactic sky at both moderate (3 days) and high (1 day) cadence, as well as focused observations within the Galactic plane and bulge. Alerts from the public survey will be broadcast to the community via established alert brokers. LS4 will run concurrently with the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST). The combination of LS4+LSST will enable detailed holistic monitoring of many nearby transients: high-cadence LS4 observations will resolve the initial rise and peak of the light curve while less-frequent but deeper observations by LSST will characterize the years before and after explosion. Here, we summarize the primary science objectives of LS4 including microlensing events in the Galaxy, extragalactic transients powered by massive black holes or stellar explosions, the search for electromagnetic counterparts to multi-messenger events, and supernova cosmology.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Time-integrated Southern-sky Neutrino Source Searches with 10 yr of IceCube Starting-track Events at Energies Down to 1 TeV

In the IceCube Neutrino Observatory, a signal of astrophysical neutrinos is obscured by backgrounds from atmospheric neutrinos and muons produced in cosmic-ray interactions. IceCube event selections used to isolate the astrophysical neutrino signal often focus on the morphology of the light patterns recorded by the detector. The analyses presented here use the new IceCube Enhanced Starting Track Event Selection (ESTES), which identifies events likely generated by muon–neutrino interactions within the detector geometry, focusing on neutrino energies of 1–500 TeV with a median angular resolution of 1.4°. Selecting for starting-track events filters out not only the atmospheric-muon background but also the atmospheric-neutrino background in the southern sky. This improves IceCube’s muon–neutrino sensitivity to southern-sky neutrino sources, especially for Galactic sources that are not expected to produce a substantial flux of neutrinos above 100 TeV. In this work, the ESTES sample was applied for the first time to search for astrophysical sources of neutrinos, including a search for diffuse neutrino emission from the Galactic plane. No significant excesses were identified from any of the analyses; however, constraining limits are set on the hadronic emission from TeV gamma-ray Galactic plane objects and models of the diffuse Galactic plane neutrino flux.

Abbasi, R. [Loyola University, Chicago, IL (United↗

Pre-training Vision Models for the Classification of Alerts from Wide-field Time-domain Surveys

Modern wide-field time-domain surveys facilitate the study of transient, variable and moving phenomena by conducting image differencing and relaying alerts to their communities. Machine learning tools have been used on data from these surveys and their precursors for more than a decade, and convolutional neural networks (CNNs), which make predictions directly from input images, saw particularly broad adoption through the 2010s. Since then, continually rapid advances in computer vision have transformed the standard practices around using such models. It is now commonplace to use standardized architectures pre-trained on large corpora of everyday images (e.g., ImageNet). In contrast, time-domain astronomy studies still typically design custom CNN architectures and train them from scratch. Here, we explore the effects of adopting various pre-training regimens and standardized model architectures on the performance of alert classification. We find that the resulting models match or outperform a custom, specialized CNN like what is typically used for filtering alerts. Moreover, our results show that pre-training on galaxy images from Galaxy Zoo tends to yield better performance than pre-training on ImageNet or training from scratch. We observe that the design of standardized architectures are much better optimized than the custom CNN baseline, requiring significantly less time and memory for inference despite having more trainable parameters. On the eve of the Legacy Survey of Space and Time and other image-differencing surveys, these findings advocate for a paradigm shift in the creation of vision models for alerts, demonstrating that greater performance and efficiency, in time and in data, can be achieved by adopting the latest practices from the computer vision field.

79 ASTRONOMY AND ASTROPHYSICS↗

ZTF-SEDm Type Ia supernova sample for Twins Embedding spectrophotometric standardization

Aims. This paper has two aims: the first aim is to build a large homogeneous spectrophotometric sample of Type Ia supernovae (SNe Ia) from the second data release of the Zwicky Transient Facility (ZTF DR2). We used the spectrum sample from the low-resolution ( R ∼ 100) SEDmachine (SEDm) Integral Field Spectrograph (IFS) that gathered 3069 spectra. This is one of the largest samples of such collections that can attempt to reproduce the Twins Embedding (TE) spectrophotometric standardization method. This is our second objective. The method was developed based on high-quality spectra from 200 SNe Ia of the Nearby Supernova factory (SNfactory) and led to an exceptionally low value of 0.073 mag for the intrinsic scatter. Methods. As the SEDm is not designed as a spectrophotometric instrument, we first improved the flux-calibration accuracy of the SN Ia spectrum sample using the ZTF photometric data, which were calibrated at the percent level. We corrected the spectra for second-order polynomials, fitted by comparing the synthetic photometry in the ZTF g , r , i filters with the light-curve (LC) data. We then applied the three steps of the TE parameterization to a subset of 783 ZTF SN spectra near maximum light while comparing results from SNfactory and ZTF. We finally analyzed the standardization methods based on the TE parameters. Results. The precision of the phase-correction model, which is the first step of the TE, is estimated at 0.01 mag in g band based on ZTF data. Despite the challenge posed by the spectrum-extraction pipeline associated with the SEDm (flux calibration, leftover host signal, low signal-to-noise ratio, and low resolution), we applied a first standardization in color based on the second step of the TE, called read between the lines (RBTL), to the ZTF sample. We reached a Hubble residual scatter of 0.153 mag, all in normalized median absolute deviation, which is to be compared to the ∼0.11 mag obtained with the SNfactory data. The SALT color and stretch standardization reaches a scatter of 0.164 mag for the same ZTF SN Ia sample, and its host steps are ∼0.1 mag and zero for RBTL. When considering the scatter due to the redshift error and flux calibration error, we estimated a RBTL scatter of ∼0.129 mag for this ZTF sample as an upper limit because we identified an additional contribution from a systematic error in color. We tested the standardization based on the nonlinear TE parameters, and, as expected from the low spectrum quality, it did not improve the overall dispersion. Conclusions. We release 1897 flux calibrated spectra of 1607 SNe Ia with an estimated photometric accuracy of 0.07 mag. We further demonstrate that some amount of spectrophotometric SN Ia standardization can be done with limited-quality spectra. The RBTL standardization is more efficient than that of SALT with one parameter less, and the resulting host steps are consistent with zero. This makes it less prone to astrophysical bias. For future spectroscopic surveys, targeting the extraction pipeline for a thorough flux calibration and good signal-to-noise ratio would enable us to compute the full TE standardization, which would further reduce the scatter in the distance estimate.

Ganot, C↗