Search NASA⌕ Search

SEARCH · Search NASA

Results for “haystack”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fast Bayesian optimization of Needle-in-a-Haystack problems using zooming memory-based initialization (ZoMBI)

Abstract Needle-in-a-Haystack problems exist across a wide range of applications including rare disease prediction, ecological resource management, fraud detection, and material property optimization. A Needle-in-a-Haystack problem arises when there is an extreme imbalance of optimum conditions relative to the size of the dataset. However, current state-of-the-art optimization algorithms are not designed with the capabilities to find solutions to these challenging multidimensional Needle-in-a-Haystack problems, resulting in slow convergence or pigeonholing into a local minimum. In this paper, we present a Zooming Memory-Based Initialization algorithm, entitled ZoMBI, that builds on conventional Bayesian optimization principles to quickly and efficiently optimize Needle-in-a-Haystack problems in both less time and fewer experiments. The ZoMBI algorithm demonstrates compute time speed-ups of 400× compared to traditional Bayesian optimization as well as efficiently discovering optima in under 100 experiments that are up to 3× more highly optimized than those discovered by similar methods.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Finding a needle in a haystack: quantitative HERFD-XRF imaging and HERFD-XANES characterization of trace platinum in gold solidi from the Late Roman and Byzantine Empires

High-Energy Resolution Fluorescence Detection X-Ray Fluorescence (HERFD-XRF) imaging and HERFD X-ray Absorption Near Edge Structure (XANES) spectroscopy are used to quantify and characterize trace platinum (Pt) in gold solidi from the Late Roman and Byzantine Empires. Historically, the elemental analysis of coins has been pivotal in distinguishing authentic artifacts from forgeries, elucidating minting practices, and understanding economic shifts. Notably, a new gold source with high platinum content appeared in the fourth century CE, transforming the Roman economy. Traditional methods struggled to detect platinum due to the overwhelming gold matrix. Here, this study demonstrates the effectiveness of HERFD techniques in resolving this challenge. Three gold solidi, minted between 654 and 659 CE, were analyzed alongside reference gold materials with known Pt concentrations. The HERFD-XRF imaging revealed spatial distributions of platinum, highlighting non-uniformities within the coins. Additionally, HERFD-XANES spectroscopy identified the oxidation states and chemical speciation of platinum. Results demonstrate that platinum in the solidi primarily exists as metallic Pt, with some surface oxidation. The findings align with previous measurements but reveal higher Pt concentrations and significant inhomogeneities. This research confirms the reliability of HERFD methods for quantifying trace elements and provides new insights into the raw material sources and minting techniques of ancient gold coins. The non-destructive nature of this approach allows for extensive analyses, offering valuable data for historical, economic, and archaeological studies. This innovative application of HERFD-XRF imaging and XANES in cultural heritage research underscores the potential for detailed material characterization and conservation, enhancing our understanding of ancient economies and trade patterns.

Van Loon, Lisa L.↗
DOE OSTI2023

CLASS Survey Description: Coronal-line Needles in the SDSS Haystack

Coronal lines are a powerful, yet poorly understood, tool to identify and characterize active galactic nuclei. There have been few large-scale surveys of coronal lines in the general galaxy population in the literature so far. Using a novel preselection technique with a flux-to-rms ratio $\mathcal{F}$, followed by Markov Chain Monte Carlo fitting, we searched for the full suite of 20 coronal lines in the optical spectra of almost 1 million galaxies from the Sloan Digital Sky Survey Data Release 8. We present a catalog of the emission-line parameters for the resulting 258 galaxies with detections. The Coronal Line Activity Spectroscopic Survey includes line properties, host-galaxy properties, and selection criteria for all galaxies in which at least one line is detected. This comprehensive study reveals that a significant fraction of coronal-line activity is missed in past surveys based on a more limited set of coronal lines; ~60% of our sample do not display the more widely surveyed [Fe x] λ6374. In addition, we discover a strong correlation between coronal-line and Wide-field Infrared Survey Explorer W2 luminosities, suggesting that the mid-infrared flux can be used to predict coronal-line fluxes. For each line we also provide a confidence level that the line is present, generated by a novel neural network, trained on fully simulated data. We find that after training the network to detect individual lines using 100,000 simulated spectra, we achieve an overall true-positive rate of 75.49% and a false-positive rate of only 3.96%.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Progress Update from the EV Charging Working Group (#982)

The EV charging working group (#982) was formed in summer 2022 to define the equip, points, relationships, and operational data related to Level 1-2 (AC) and Level 3 (DC) Electric Vehicle Supply Equipment (EVSE). Last year, the working group developed formal EVSE-related equipment definitions, where were merged into the Project Haystack documentation in November 2022. More recently the group has also been working to expand and improve Haystack definitions related to electrical equipment and circuits. This initiative is important both for EV charging related applications and to improve Project Haystack's appeal to other industry verticals such as data centers, commercial building electrification, and more. In this presentation we will share the working group's motivation, progress, and near-term objectives.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗
DOE OSTI2022

Application-Driven Creation of Building Metadata Models with Semantic Sufficiency

Semantic metadata models such as Brick, RealEstateCore, Project Haystack, and BOT promise to simplify and lower the cost of developing software for smart buildings, enabling the widespread deployment of energy efficiency applications. However, creating these models remains a challenge. Despite recent advances in creating models from existing digital representations like point labels and architectural models, there is still no feedback mechanism to ensure that the human input to these methods results in a model that can actually support the desired software. In this paper, we introduce the notion of semantic sufficiency, a practical principle for semantic metadata model creation that asserts that a model is "finished" when it contains the metadata necessary to support a given set of applications. To support semantic sufficiency, we design a standard representation for capturing application metadata requirements and a templating system for generating common metadata model components with limited user input. We then construct an iterative model creation workflow that integrates metadata requirements to direct the model creation effort, and present several novel optimizations that increase the model utility while minimizing the effort by a human operator. These new abstractions for model creation and validation lower model development costs and ensure the utility of the resulting model, thus facilitating the adoption of intelligent building applications.

applications↗
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
DOE OSTI2023

Building a Computational and Experimental Rapid Response Pipeline to Counter the Coronavirus Disease 2019 Outbreak and Emerging Biothreats

The COVID-19 pandemic underscored the promise of monoclonal antibody-based prophylactic and therapeutic drugs, especially where protective candidates can be rapidly identified or developed for emerging biothreats and escape variants. Current cutting-edge technologies for this purpose still rely on pathogen-exposed convalescent volunteers and a large screening effort to find a proverbial needle in a haystack. Computational design of protective antibodies based on pre-existing templates skips those requirements and allows for greater control over the breadth and target epitope, while also co-optimizing for potency and developability or other biophysical characteristics. We approached this problem by building and expanding an in vitro experimental rapid antibody production and characterization pipeline to support development of an autonomous, closed loop, active learning software system based on structural simulation and ground truth experimental data to design and evaluate antibody antigen interactions. Starting from early in the pandemic, we targeted SARS-CoV-2, the causative agent of COVID-19, by re-purposing neutralizing antibodies against SARS-CoV-1 that had been identified in the wake of that outbreak in the early 2000’s. We successfully re-targeted three different anti-SARS-CoV-1 antibodies to neutralize SARS-CoV-2 in vitro, where the antibodies were generated externally and tested through conventional binding and neutralization assays internally or with collaborators. As antibodies were identified from the blood of humans infected with SARS-CoV-2, we shifted to collaborate with academic partners to develop improved versions of their human-derived antibodies. This work reached its most important stage in rapid response to the emergence of the Omicron variant of concern (VOC) in late 2021. In a matter of weeks, enabled by on demand innovation to our screening pipeline, we computationally designed and experimentally characterized derivative antibodies of COV2-2130, one of two antibodies from Vanderbilt that form the basis of the AstraZeneca Evusheld prophylactic drug product. This drug product suffers a serious loss of efficacy against Omicron BA.1 and BA.1.1, the first Omicron strains. Due to tight integration of computational design and experimental evaluation, we were able to identify a pair of designs with potent neutralization of the main targets Omicron BA.1 and BA.1.1; but also the earlier Delta variant, and subsequent Omicron strains including BA.2, BA.4, BA.5, and BA.2.75, demonstrating that our multi-target design process can, by its nature, produce robust antibody designs that strictly improve over the parental antibody. These results, recognized by a 2022 Director’s Science and Technology award, have enabled the follow-on GUIDE program, to commence in FY23. While earlier design campaigns were substantially outsourced, we have engineered better and faster processes internally to better compliment, calibrate, and speed computational designs. As part of the follow-on GUIDE program, we will stand up a rapid and high-throughput antibody production and characterization facility staffed with the expertise and capabilities to foster our current collaboration across PLS and ENG as well as other partnerships toward computational design of biologics.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Soft X-ray Tomography Reveals HSV-1-Induced Remodeling of Human B Cells

Upon infection, viruses hijack the cell machinery and remodel host cell structures to utilize them for viral proliferation. Since viruses are about a thousand times smaller than their host cells, imaging virus-host interactions at high spatial resolution is like looking for a needle in a haystack. Scouting gross cellular changes with fluorescent microscopy is only possible for well-established viruses, where fluorescent tagging is developed. Soft X-ray tomography (SXT) offers 3D imaging of entire cells without the need for chemical fixation or labeling. Here, we use full-rotation SXT to visualize entire human B cells infected by the herpes simplex virus 1 (HSV-1). We have mapped the temporospatial remodeling of cells during the infection and observed changes in cellular structures, such as the presence of cytoplasmic stress granules and multivesicular structures, formation of nuclear virus-induced dense bodies, and aggregates of capsids. Our results demonstrate the power of SXT imaging for scouting virus-induced changes in infected cells and understanding the orchestration of virus-host remodeling quantitatively.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams

Abstract We present Lightcurve Anomaly Identification and Similarity Search ( LAISS ), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly Zwicky Transient Facility (ZTF) Alert Stream via the ANTARES broker, identifying a manageable ∼1–5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host galaxy features within a random forest classifier, tagging transients of rare classes ( spectroscopic anomalies), of uncommon host galaxy environments ( contextual anomalies), and of peculiar or interaction-powered phenomena ( behavioral anomalies). Moreover, we demonstrate the power of a low-latency (∼ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host galaxy environments. We use analogs for data-driven discovery, characterization, (re)classification, and imputation in retrospective and real-time searches. To date, we have identified ∼50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to superluminous supernovae (SLSNe), tidal disruption events, SNe IIn, SNe IIb, SNe I-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018 and 2021 and absent from public catalogs (∼1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the “needle in the haystack” in large-volume data streams. Because of its integration with the ANTARES broker, LAISS is built to detect exciting transients in Rubin data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Domain Knowledge Guided Bayesian Optimization For Autonomous Alignment Of Complex Scientific Instruments

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where rewards are sparse. In such needle-in-a-haystack scenarios, even advanced methods like trust-region BO (TurBO) often lead to unsatisfactory results. We propose a domain knowledge guided Bayesian Optimization approach, which leverages physical insight to fundamentally simplify the search problem by transforming coordinates to decouple input features and align the active subspaces with the primary search axes. We demonstrate this approach's efficacy on a challenging 12-dimensional, 6-crystal Split-and-Delay optical system, where conventional approaches, including standard BO, TuRBO and multi-objective BO, consistently led to unsatisfactory results. When combined with an reverse annealing exploration strategy, this approach reliably converges to the global optimum. The coordinate transformation itself is the key to this success, significantly accelerating the search by aligning input co-ordinate axes with the problem's active subspaces. As increasingly complex scientific instruments, from large telescopes to new spectrometers at X-ray Free Electron Lasers are deployed, the demand for robust high-dimensional optimization grows. Our results demonstrate a generalizable paradigm: leveraging physical insight to transform high-dimensional, coupled optimization problems into simpler representations can enable rapid and robust automated tuning for consistent high performance while still retaining current optimization algorithms.

FOS: Computer and information sciences↗
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
DOE OSTI2026

Spatially resolved polarization swings in the supermassive binary black hole candidate OJ 287 with first Event Horizon Telescope observations

We present the first Event Horizon Telescope 1.3 mm observations of the supermassive binary black hole candidate OJ 287. The observations achieved an unprecedented angular resolution of 18 μas and reveal significant structural and polarization variability over just five days, marking the shortest timescale on which such changes have been directly imaged in this source. The inner jet exhibits a twisted ridgeline structure, with features displaying apparent superluminal motions up to about 22 c. The linear polarization maps reveal three main polarized features whose electric-vector position angles (EVPAs) change substantially over the time span of our observations, including a component with a radial polarization consistent with being produced by a recollimation shock. Most notably, we directly resolved two innermost jet components whose EVPAs rotate in opposite directions. The faster component, moving at 2.4 ± 0.9 μas/day (17.4 ± 6.5 c), exhibits counterclockwise EVPA swings of roughly 3.7° per day, while the slower component, with a proper motion of 1.4 ± 0.3 μas/day (10.2 ± 2.2 c), rotates clockwise at approximately 2.5° per day. Previous studies inferred helical magnetic fields in AGN jets from time-resolved or integrated polarization variability but lacked the angular resolution to directly image this effect. Our results provide spatially resolved evidence that a helical magnetic field threads the jet’s collimation and acceleration zone, ruling out models based on the superposition of unresolved components. Our analysis suggests that propagating shocks interact with a Kelvin–Helmholtz plasma instability, illuminating different phases of the helical magnetic field and producing the observed polarization spatial and temporal variability. Moreover, our model naturally accounts for the more rapid polarization rotation observed in the faster moving component. Our model predicts even more rapid swings in polarization, which could be tested with future observations featuring a more densely sampled time coverage.

OJ 287↗
DOE OSTI2026

Full-polarization millimeter wavelength variability of Sagittarius A * during the 2018 EHT campaign

Context. Sagittarius A* (Sgr A*), the supermassive black hole at the center of the Milky Way, provides a unique laboratory to study accretion dynamics and plasma processes near the event horizon. Aims. We investigated the variability and polarization properties of Sgr A* using ALMA observations during the 2018 Event Horizon Telescope campaign. Methods. We analyzed high-cadence full-polarization light curves from ALMA at millimeter wavelengths, performed time-series analysis, and investigated the temporal behavior during an X-ray flare observed by Chandra on 2018 April 24. The variability characteristics are compared with expectations from standard accretion flow models. Results. We find low variability in total intensity (σ/μ < 10%), but significantly higher variability in linear and circular polarization (∼30% and ∼50%, respectively). A time-series analysis reveals red-noise variability, with power spectral densities between −2 and −3 across all Stokes parameters. Polarized intensity shows stable intra-day timescales, while total intensity exhibits more variable timescales, suggesting distinct emission regions, with polarization likely arising from a coherent structure. On April 24, a statistically significant inter-band delay in polarized intensity coincides with a near-simultaneous X-ray and millimeter peak that deviates from the typical delayed flare scenario. This event also features enhanced millimeter variability and coherent polarization loop evolution. The observed simultaneity challenges standard models of transient synchrotron emission with cooling delays, favoring instead a scenario of continuous energy injection in an optically thin region. Conclusions. Our results offer new constraints on the physical mechanisms driving variability in Sgr A*, and provide key observational input for refining theoretical models of accretion and plasma behavior in the vicinity of supermassive black holes.

Galaxy: center↗
DOE OSTI2026

Locating the missing large-scale emission in the jet of M87* with short EHT baselines

In very-long baseline interferometric arrays, nearly co-located stations probe the largest scales and typically cannot resolve the observed source. In the absence of a large-scale structure, closure phases constructed with these stations are zero and, since they are independent of station-based errors, they can be used to probe data issues. Here, we show how these trivial closure phases become nonzero with a brightness distribution on smaller scales than their short baseline would suggest. When applied to sources that are made up of a bright compact and large-scale diffuse component, the trivial closure phases directly measure the centroid relative to the compact source and higher-order image moments. We present a technique to measure these image moments with minimal model assumptions and validate it on synthetic Event Horizon Telescope (EHT) data. We then apply this technique to 2017 and 2018 EHT observations of M87* and find a weak preference for extended emission in the direction of the large-scale jet. We also apply it to 2021 EHT data and measure the source centroid about 1 mas northwest of the compact ring, which is consistent with the jet observed at lower frequencies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Probing jet base emission of M87* with the 2021 Event Horizon Telescope observations

We investigate the presence and spatial characteristics of the jet base emission in M87* at 230 GHz, enabled by the significantly enhanced (u,v) coverage in the 2021 Event Horizon Telescope (EHT) observations. The integration of the 12−m Kitt Peak Telescope (USA) and NOEMA (France) stations into the array introduces two critical intermediate-length baselines to SMT (USA) and IRAM 30−m (Spain), providing sensitivity to emission structures at spatial scales of ∼250 μas and ∼2500 μas (∼ 0.02 pc and ∼ 0.02 pc). Without these new baselines, previous EHT observations of the source in 2017 and 2018 lacked the capability to constrain emission on large scales, where a “missing flux” of order ∼1 Jy is expected to reside. To probe these scales, we analyzed closure phases–robust against station-based gain calibration errors–and model the jet base emission using a simple Gaussian component offset from the compact ring emission at spatial separations > 100 μas. Our analysis revealed a Gaussian feature centered at (ΔRA ≈ 320 μ as, ΔDec. ≈ 60 μ as), projected separation of ≈ 5500 AU, with an estimated flux density of only ∼60 mJy, implying that most of the missing flux identified in previous EHT studies had to originate from different, larger scales. Brighter emission at the relevant spatial scales is firmly ruled out, and the data do not favor more complex models. This component aligns with the inferred position of the large-scale jet and is therefore physically consistent with the emission of the jet base. While our findings point to detectable jet base emission at 230 GHz, the limited coverage provided by only two intermediate baselines limits our ability to robustly reconstruct its morphology. Consequently, we treated the recovered Gaussian as an upper limit on the jet base flux density. Future EHT observations with expanded intermediate baseline coverage will be essential to constrain the structure and nature of this component with higher precision.

accretion, accretion disks↗
DOE OSTI2024

Higher‐Order Gravity Waves and Traveling Ionospheric Disturbances From the Polar Vortex Jet on 11–15 January 2016: Modeling With HIAMCM‐SAMI3 and Comparison With Observations in the Thermosphere and Ionosphere

Abstract In Vadas et al. (2024, https://doi.org/10.1029/2024ja032521 ), we modeled the atmospheric gravity waves (GWs) during 11–14 January 2016 using the HIAMCM, and found that the polar vortex jet generates medium to large‐scale, higher‐order GWs in the thermosphere. In this paper, we model the traveling ionospheric disturbances (TIDs) generated by these GWs using the HIAMCM‐SAMI3 and compare with ionospheric observations from ground‐based Global Navigation Satellite System (GNSS) receivers, Incoherent Scatter Radars (ISR) and the Super Dual Auroral Radar Network (SuperDARN). We find that medium to large‐scale TIDs are generated worldwide by the higher‐order GWs from this event. Many of the TIDs over Europe and Asia have concentric ring/arc‐like structure, and most of those over North/South America have planar wave structure and occur during the daytime. Those over North/South America propagate southward and are generated by higher‐order GWs from Europe/Asia which propagate over the Arctic. These latter TIDs can be misidentified as arising from geomagnetic forcing. We find that the higher‐order GWs that propagate to Africa and Brazil from Europe may aid in the formation of equatorial plasma bubbles (EPBs) there. We find that the simulated GWs, TIDs and EPBs agree with EISCAT, PFISR, GNSS, and SuperDARN measurements. We find that the higher‐order GWs are concentrated at N at 200 km, in agreement with GOCE and CHAMP data. Thus the polar vortex jet is important for generating TIDs in the northern winter ionosphere via multi‐step vertical coupling through GWs.

Vadas, Sharon L. [Northwest Research Associates Bo↗