Search NASA⌕ Search

SEARCH · Search NASA

Results for “Domain knowledge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Empirical results on scheduling and dynamic backtracking

At the Honeywell Technology Center (HTC), we have been working on a scheduling problem related to commercial avionics. This application is large, complex, and hard to solve. To be a little more concrete: 'large' means almost 20,000 activities, 'complex' means several activity types, periodic behavior, and assorted types of temporal constraints, and 'hard to solve' means that we have been unable to eliminate backtracking through the use of search heuristics. At this point, we can generate solutions, where solutions exist, or report failure and sometimes why the system failed. To the best of our knowledge, this is among the largest and most complex scheduling problems to have been solved as a constraint satisfaction problem, at least that has appeared in the published literature. This abstract is a preliminary report on what we have done and how. In the next section, we present our approach to treating scheduling as a constraint satisfaction problem. The following sections present the application in more detail and describe how we solve scheduling problems in the application domain. The implemented system makes use of Ginsberg's Dynamic Backtracking algorithm, with some minor extensions to improve its utility for scheduling. We describe those extensions and the performance of the resulting system. The paper concludes with some general remarks, open questions and plans for future work.

Boddy, Mark S.↗

Using Science Data and Models for Space Weather Forecasting - Challenges and Opportunities

Space research, and, consequently, space weather forecasting are immature disciplines. Scientific knowledge is accumulated frequently, which changes our understanding or how solar eruptions occur, and of how they impact targets near or on the Earth, or targets throughout the heliosphere. Along with continuous progress in understanding, space research and forecasting models are advancing rapidly in capability, often providing substantially increases in space weather value over time scales of less than a year. Furthermore, the majority of space environment information available today is, particularly in the solar and heliospheric domains, derived from research missions. An optimal forecasting environment needs to be flexible enough to benefit from this rapid development, and flexible enough to adapt to evolving data sources, many of which may also stem from non-US entities. This presentation will analyze the experiences obtained by developing and operating both a forecasting service for NASA, and an experimental forecasting system for Geomagnetically Induced Currents.

Hesse, Michael↗

Errors in determination of soil water content using time-domain reflectometry caused by soil compaction around wave guides

Application of time domain reflectometry (TDR) in soil hydrology often involves the conversion of TDR-measured dielectric permittivity to water content using universal calibration equations (empirical or physically based). Deviations of soil-specific calibrations from the universal calibrations have been noted and are usually attributed to peculiar composition of soil constituents, such as high content of clay and/or organic matter. Although it is recognized that soil disturbance by TDR waveguides may have impact on measurement errors, to our knowledge, there has not been any quantification of this effect. In this paper, we introduce a method that estimates this error by combining two models: one that describes soil compaction around cylindrical objects and another that translates change in bulk density to evolution of soil water retention characteristics. Our analysis indicates that the compaction pattern depends on the mechanical properties of the soil at the time of installation. The relative error in water content measurement depends on the compaction pattern as well as the water content and water retention properties of the soil. Illustrative calculations based on measured soil mechanical and hydrologic properties from the literature indicate that the measurement errors of using a standard three-prong TDR waveguide could be up to 10%. We also show that the error scales linearly with the ratio of rod radius to the interradius spacing.

54 ENVIRONMENTAL SCIENCES↗

Physics-informed KNN milling stability model with process damping effects

This paper describes a k-nearest neighbors, or KNN, model for milling stability including process damping effects. A physics-based, frequency domain milling stability solution is used to generate the training data, but does not incorporate process damping effects. The data set is then updated using limited tests to capture the process damping behavior. A “stair step” approach is used to select the test points, where a first spindle speed-axial depth combination is selected based on the physics-based stability map, subsequent tests are defined using the previous test result, and data points are updated by knowledge of process damping behavior and the test results. Furthermore, the KNN modeling approach demonstrates the ability to predict both stable and unstable results, including process damping behavior.

42 ENGINEERING↗

Annual Report for Los Alamos National Laboratory Technical Area 54, Area G Disposal Facility – Fiscal Year 2011

As a condition to the Disposal Authorization Statement issued to Los Alamos National Laboratory (LANL or the Laboratory) on March 17, 2010, a comprehensive performance assessment and composite analysis maintenance program must be implemented for the Technical Area 54, Area G disposal facility. Annual determinations of the adequacy of the performance assessment and composite analysis are to be conducted under the maintenance program to ensure that the conclusions reached by those analyses continue to be valid. This report summarizes the results of the fiscal year 2011 annual review for Area G. Revision 4 of the Area G performance assessment and composite analysis was issued in 2008 and formally approved in 2009. These analyses are expected to provide reasonable estimates of the long-term performance of Area G and, hence, the disposal facility's ability to comply with Department of Energy (DOE) performance objectives. Annual disposal receipt reviews indicate that smaller volumes of waste will require disposal in the pits and shafts at Area G relative to what was projected for the performance assessment and composite analysis. The future inventories are projected to decrease modestly for the pits but increase substantially for the shafts due to an increase in the amount of tritium that is projected to require disposal. Overall, however, changes in the projected future inventories of waste are not expected to compromise the ability of Area G to satisfy DOE performance objectives. The Area G composite analysis addresses potential impacts from all waste disposed of at the facility, as well as other sources of radioactive material that may interact with releases from Area G. The level of knowledge about the other sources included in the composite analysis has not changed sufficiently to call into question the validity of that analysis. Ongoing environmental surveillance activities are conducted at, and in the vicinity of, Area G. However, the information generated by many of these activities cannot be used to evaluate the validity of the performance assessment and composite analysis models because the monitoring data collected are specific to operational releases or address receptors that are outside the domain of the performance assessment and composite analysis. In general, applicable monitoring data are supportive of some aspects of the performance assessment and composite analysis. Several research and development (R and D) efforts have been initiated under the performance assessment and composite analysis maintenance program. These investigations are designed to improve the current understanding of the disposal facility and site, thereby reducing the uncertainty associated with the projections of the long-term performance of Area G. The status and results of R and D activities that were undertaken in fiscal year 2011 are discussed in this report. Special analyses have been conducted to determine the feasibility of disposing of specific waste streams, to address proposed changes in disposal operations, and to consider the impacts of changes to the models used to conduct the performance assessment and composite analysis. These analyses are described and the results of the evaluations are summarized in this report. The Area G disposal facility consists of Material Disposal Area (MDA) G and the Zone 4 expansion area. To date, all disposal operations at Area G have been confined to MDA G. Material Disposal Area G is scheduled to undergo final closure in 2015; disposal of waste in the pits and shafts is scheduled to end in 2013. In anticipation of the closure of MDA G, plans are being made to ship the majority of the waste generated at LANL to off-site locations for disposal. It is not clear at this time if waste that will be disposed of at LANL will be placed in Zone 4 or if disposal operations will move to a new location at the Laboratory. Separately, efforts to optimize the final cover used in the closure of MDA G are underway; a final cover design different than that adopted for the performance assessment and composite analysis will likely emerge from that investigation. All of these changes will require re-examination of the assumptions upon which the performance assessment and composite analysis are based and, in all likelihood, revision of those analyses.

54 ENVIRONMENTAL SCIENCES↗

Human Factors Research for Space Exploration: Measurement, Modeling, and Mitigation

As part of NASA's Human Research Program, the Space Human Factors Engineering Project serves as the bridge between Human Factors research and Human Spaceflight applications. Our goal is to be responsive to the operational community while addressing issues at a sufficient level of abstraction to ensure that our tools and solutions generalize beyond the point design. In this panel, representatives from four of our research domains will discuss the challenges they face in solving current problems while also enabling future capabilities. Historically, engineering-dominated organizations have tended to view good Human Factors (HF) as a desire rather than a requirement in system design and development. Our field has made significant gains in the past decade, however; the Department of Defense, for example, now recognizes Human-System Integration (HSI), of which HF is a component, as an integral part of their divisions hardware acquisition processes. And our own agency was far more accepting of HF/HSI requirements during the most recent vehicle systems definition than in any prior cycle. Nonetheless, HF subject matter experts at NASA often find themselves in catch up mode... coping with legacy systems (hardware and software) and procedures that were designed with little regard for the human element, and too often with an attitude of we can deal with any operator issues during training. Our challenge, then, is to segregate the true knowledge gaps in Space Human Factors from the prior failures to incorporate best (or even good) HF design principles. Further, we strive to extract the overarching core HF issues from the point-design-specific concerns that capture the operators (and managers) attention. Generally, our approach embraces a 3M approach to Human Factors: Measurement, Modeling, and Mitigation. Our first step is to measure human performance, to move from subjective anecdotes to objective, quantified data. Next we model the phenomenon, using appropriate methods in our field, modifying them to suit the unique aspects of the space environment. Finally, we develop technologies, tools, and procedures to mitigate the decrements in human performance and capabilities that occur in space environments. When successful, we decrease risks to crew safety and to mission success. When extremely successful (or lucky), we devise generalizable solutions that advance the state of our practice. Our panel is composed of researchers from diverse domains of our project... from different boxes, if you will, of the Human Factors Analysis and Classification System (HFACS).

Kaiser, Mary K.↗

DeFault: DEep‐Learning‐Based FAULT Delineation Using the IBDP Passive Seismic Data at the Decatur CO2 Storage Site

Abstract The carbon capture, utilization, and storage (CCUS) framework is an essential component in reducing greenhouse gas emissions, with its success hinging on the comprehensive knowledge of subsurface geology and geomechanics. Passive seismic event relocation and fault detection offer vital insights into subsurface structures and the ability to monitor fluid migration pathways. Accurate identification and localization of seismic events, however, face significant challenges, including the necessity for high‐quality seismic data and advanced computational methods. To address these challenges, we introduce a novel deep learning method, , specifically designed for passive seismic source relocation and fault delineating for passive seismic monitoring projects. By leveraging data domain‐adaptation, allows us to train a neural network with labeled synthetic data and apply it directly to field data. Using , the passive seismic sources are automatically clustered based on their recording time and spatial locations, and subsequently, faults and fractures are delineated accordingly. We demonstrate the efficacy of on a field case study involving injection related microseismic data from Decatur, Illinois area. Our approach accurately and efficiently relocated passive seismic events, identified faults and could aid in potential damage induced by seismicity. Our results highlight the potential of as a valuable tool for passive seismic monitoring, emphasizing its role in ensuring CCUS project safety. This research bolsters the understanding of subsurface characterization in CCUS, illustrating machine learning’s capacity to refine these methods. Ultimately, our work has significant implications for CCUS technology deployment, an essential strategy in combating climate change. Plain Language Summary In our quest to tackle climate change, we use a strategy known as carbon capture, utilization, and storage (CCUS) to keep greenhouse gases out of the atmosphere. This strategy relies heavily on our ability to understand what's happening deep under the earth's surface. To make sure we store super critical safely, we need to accurately map out the geological structure, especially faults, but this is tough without high‐quality data and complex computer programs. We've developed a new tool called “DeFault,” which uses advanced machine learning to improve how we find and map these underground features. “DeFault” is smart enough to learn from numerically simulated data and then apply what it’s learned to real‐world situations. It groups together seismic activity—tiny tremors and shifts in the earth—based on when and where they happen, which helps us spot where there might be cracks or faults. We tested “DeFault” in Illinois, where CO 2 is injected underground, and it successfully pinpointed where these tremors occurred and mapped out the faults, helping to prevent accidents accurately in the future. Our study shows that “DeFault” will be a powerful ally in making CCUS safer and more effective, especially for the Illinois Basin Decatur Project. Key Points Faults and fractures introduced by carbon storage can be monitored by passive seismicity DeFault algorithm enables an automatic process for accurate and efficient passive seismic event locating and clustering

58 GEOSCIENCES↗

Cleavage and polyadenylation specificity factor 30: An RNA-binding zinc-finger protein with an unexpected 2Fe–2S cluster

Cleavage and polyadenylation specificity factor 30 (CPSF30) is a key protein involved in pre-mRNA processing. CPSF30 contains five Cys 3 His domains (annotated as “zinc-finger” domains). Using inductively coupled plasma mass spectrometry, X-ray absorption spectroscopy, and UV-visible spectroscopy, we report that CPSF30 is isolated with iron, in addition to zinc. Iron is present in CPSF30 as a 2Fe–2S cluster and uses one of the Cys 3 His domains; 2Fe–2S clusters with a Cys 3 His ligand set are rare and notably have also been identified in MitoNEET, a protein that was also annotated as a zinc finger. These findings support a role for iron in some zinc-finger proteins. Using electrophoretic mobility shift assays and fluorescence anisotropy, we report that CPSF30 selectively recognizes the AU-rich hexamer (AAUAAA) sequence present in pre-mRNA, providing the first molecular-based evidence to our knowledge for CPSF30/RNA binding. Removal of zinc, or both zinc and iron, abrogates binding, whereas removal of just iron significantly lessens binding. As a result, from these data we propose a model for RNA recognition that involves a metal-dependent cooperative binding mechanism.

59 BASIC BIOLOGICAL SCIENCES↗

Graph-Based Analysis of Nuclear Smuggling Data

Much of the data that is collected and analyzed today is structural, consisting not only of entities but also of relationships between the entities. As a result, analysis applications rely upon automated structural data mining approaches to find patterns and concepts of interest. This ability to analyze structural data has become a particular challenge in many security-related domains. In these domains, focusing on the relationships between entities in the data is critical to detect important underlying patterns. In this study we apply structural data mining techniques to automate analysis of nuclear smuggling data. In particular, we choose to model the data as a graph and use graph-based relational learning to identify patterns and concepts of interest in the data. In this paper, we identify the analysis questions that are of importance to security analysts and describe the knowledge representation and data mining approach that we adopt for this challenge. We analyze the results using the Russian nuclear smuggling event database.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Skeletides: A Modular, Simplified Physical Model of Protein Secondary Structure

Three-dimensional (3D) models are essential for visualization and conceptual understanding of complex architectures such as protein structure. Although there is a plethora of software platforms that allow digital depictions of protein structure at an atomic level in silico, physical models are needed to convey an intuitive understanding of biomolecular architecture. However, it is a challenge to represent all the relevant features of proteins in a single physical model due to their sheer structural complexity. Here, we describe a modular protein model that focuses only on representation of the secondary structure—the underlying structural skeleton. The simplified model consists of amino acid units, which can be linked together to reproduce the two most fundamental structural features of protein secondary structure: the relative positions of the amino acid alpha carbon atoms, and the intra-main chain hydrogen bonding pattern. We use 3D printing and magnets to create a set of three modular amino acid building blocks, which when linked together into a chain, can faithfully represent alpha helices, beta sheets, and turns. These simple to make models can be used to quickly assemble the alpha carbon trace of an entire protein domain, which conveys a tactile experience of the complexity of protein skeletal architecture. These models highlight the modularity of protein structure: where a single structural unit, the amino acid, can be linked together to form a larger, regular secondary structure. These models also have a propensity to spontaneously organize into alpha helices and beta sheets, as demonstrated by their ability to autonomously assemble when placed in a circulating water tank. These models provide a missing educational tool to expand knowledge of protein structure, foster deeper insight into protein folding, and inspire greater interest in biomacromolecular architecture.

36 MATERIALS SCIENCE↗

BrickQA: Bridging the Semantic Gap in Building Operations with Dynamic Graph Exploration

While standardized ontologies like the Brick schema address data heterogeneity in Building Automation Systems (BAS), accessing this semantic data remains a challenge as domain experts often lack the expertise to formulate complex SPARQL queries. To bridge this gap, we present BrickQA, a Large Language Model (LLM)-based framework that translates natural language into executable SPARQL queries through structured query decomposition, dynamic schema exploration, and inline validation. BrickQA utilizes an iterative reasoning agent to actively navigate graph topology through dynamic exploration actions without requiring exhaustive context injection or model fine-tuning. This approach effectively mitigates hallucinations, particularly in large-scale building knowledge graphs. Empirical evaluation on BuildingQA, a standardized benchmark, demonstrates that BrickQA significantly outperforms ReAct baselines, delivering a 0.291–0.355 absolute F1 improvement while achieving 3 × –12.7 × higher token cost-efficiency. Beyond these metrics, the framework maintains structural fidelity across heterogeneous buildings and remains resilient to ambiguous queries without requiring site-specific fine-tuning. Furthermore, a case study on operational analytics validates the framework’s capability to handle temporal and aggregation constraints, effectively transforming abstract semantic models into actionable facility management insights.1

Ko, Yun-Dam↗

Structural basis of glycan specificity of P[19] VP8*: Implications for rotavirus zoonosis and evolution

Recognition of specific cell surface glycans, mediated by the VP8* domain of the spike protein VP4, is the essential first step in rotavirus (RV) infection. Due to lack of direct structural information of virus-ligand interactions, the molecular basis of ligand-controlled host ranges of the major human RVs (P[8] and P[4]) in P[II] genogroup remains unknown. Here, through characterization of a minor P[II] RV (P[19]) that can infect both animals (pigs) and humans, we made an important advance to fill this knowledge gap by solving the crystal structures of the P[19] VP8* in complex with its ligands. Our data showed that P[19] RVs use a novel binding site that differs from the known ones of other genotypes/genogroups. This binding site is capable of interacting with two types of glycans, the mucin core and type 1 histo-blood group antigens (HBGAs) with a common GlcNAc as the central binding saccharide. The binding site is apparently shared by other P[II] RVs and possibly two genotypes (P[10] and P[12]) in P[I] as shown by their highly conserved GlcNAc-interacting residues. These data provide strong evidence of evolutionary connections among these human and animal RVs, pointing to a common ancestor in P[I] with a possible animal host origin. While the binding properties to GlcNAc-containing saccharides are maintained, changes in binding to additional residues, such as those in the polymorphic type 1 HBGAs may occur in the course of RV evolution, explaining the complex P[II] genogroup that mainly causes diseases in humans but also in some animals.

Microbiology↗

Rapid Computational Identification of Therapeutic Targets for Pathogens

Biological threats continue to persist and evolve as an important challenge to national security. There are multiple ways in which novel viral pathogens could emerge to pose a serious threat to human health. This project developed a pathogen target identification tool that can rapidly respond to a novel or emerging viral biological threat. A set of computational tools were developed that provide detailed information on the newly sequenced genes, their protein products and the drug target sites for the proteins that are best suited for biological countermeasure development. Three key innovations were developed in the project. 1) Development of a new extensive database of protein pocket structures with structure-based search algorithms to rapidly link novel protein targets with the complete collection of previously experimentally solved protein structures. 2) A novel clustering pipeline was introduced to group matching structures and associated small-molecule binding ligands into a consensus protein pocket with the associated small-molecule chemotypes predicted to fit in the pocket site. The matching experimentally solved structures were used to inform the value of different target sites. 3) Where there are viral protein targets with pockets structurally matched to similar human proteins, a biological knowledge graph, which links molecular interactions with human disease, was used to further assess the potential negative impact of a viral protein target with similarities to human proteins that could have important off target side effects. In total, the project produced a new resource for rapid and detailed assessment of promising targets for countermeasures, reflecting the ongoing wet lab, clinical, and computational data being collected. These capabilities will improve the ability to respond to a biological threat in multiple domains.

59 BASIC BIOLOGICAL SCIENCES↗

Impacts of Aerosol Direct Effects on the South Asian Climate: Assessment of Radiative Feedback Processes Using Model Simulations and Satellite/Surface Measurements

Current assessment of aerosol radiative effect is hindered by our incomplete knowledge of aerosol optical properties, especially absorption, and our current inability to quantify physical and microphysical processes. In this research, we investigate direct aerosol radiative effect over heavy aerosol loading areas (e.g., Indo-Gangetic Plains, South/East Asia) and its feedbacks on the South Asian climate during the pre-monsoon season (March-June) using the Purdue Regional Climate Model (PRCM) with prescribed aerosol data derived by the NASA Goddard Earth Observing System Model (GEOS-5). Our modeling domain covers South and East Asia (60-140E and 0-50N) with spatial resolutions of 45 km in horizontal and 28 layers in vertical. The model is integrated from 15 February to 30 June 2008 continuously without nudging (i.e., only forced by initial/boundary conditions). Two numerical experiments are conducted with and without the aerosol-radiation effects. Both simulations are successful in reproducing the synoptic patterns on seasonal-to-interannual time scales and capturing a pre-monsoon feature of the northward rainfall propagation over Indian region in early June which shown in Tropical Rainfall Measuring Mission (TRMM) observation. Preliminary result suggests aerosol-radiation interactions mainly alter surface-atmosphere energetics and further result in an adjustment of the vertical temperature distribution in lower atmosphere (below 700 hPa). The modifications of temperature and associated rainfall and circulation feedbacks on the regional climate will be discussed in the presentation.

Wang, Sheng-Hsiang↗

In-situ Characterizations of Microstructural Degradation of Perovskite Solar Cells

Rapid progress has been achieved in perovskite solar cells (PSCs), and their efficiencies have improved from 3.8 % to 24.2 % in less than a decade. With low-cost processing, PSCs have shown exciting photovoltaic (PV) properties, such as effective optical absorption, a long carrier lifetime, and unique defect tolerance. While recent studies demonstrated improved stability up to 100 days, PSC technology is still challenged to meet the stringent industry requirements for commercialization. Despite considerable efforts, the underlying physical mechanisms for the inferior stability of PSCs are not well understood. One reason for this divergence is that many established measurement techniques (e.g., quantum efficiency, photoluminescence) probe the properties on length scales far greater than that of electronic and/or structural inhomogeneity (i.e., < 1 μm near grain boundaries) and therefore characterize convoluted and/or averaged properties. Ion/electron beam-based techniques have been extensively used to access the microstructures of PSCs, enabling atomic/nanoscale structural, chemical, optical, and electrical characterizations. For example, focused ion beam (FIB) milling produces an atomically smooth surface that minimizes the artifacts attributed to the surface roughness. FIB techniques can also create a well-defined cross-section of PSCs without mechanical damage in a physical cleaving sample preparation. While powerful, there are some concerns about possible beam damage of inorganic-organic perovskites via chemical-bond breakage and local heating. This project aims to comprehensively understand how the microstructural/interfacial properties of PSCs (e.g., Methylammonium Lead Iodide [MAPbI 3 ]) are modified under the irradiating ion beams. Specifically, we investigate the sub-surface properties of PSCs before and after Ar-ion beam injections. Kelvin probe force microscopy (KPFM) measures the contact potential differences (CPDs). Photoluminescence (PL) microscopy in conjunction with Finite-Difference Time-Domain (FDTD) simulations infers the formation of a “dead layer” (< 15 nm) on the subsurface of MAPbI 3 during Ar+ milling processes while preserving the initial bulk properties. The x-ray photoemission spectroscopy (XPS) confirms this modified surface is a lead-rich and iodine-deficient surface. We initiate customizing in-situ measurement setup while measuring the local optical and electrical properties of PSC under thermal (cooling, heating) and light stressors. Our results provide in-depth knowledge of the ion-beam impact on metal-halide perovskites and how this modified sub-surface impacts their properties under accelerated stressors of light and heat. Intensive Monte Carlo simulations of an electron beam interacting with PSCs provide the beam energy distribution in PSCs, proposing possible measurement conditions of using e-beam with minimizing beam damage. Our in-situ measurement platform can accommodate the diverse architecture of PSC devices for studying deterioration mechanisms under mixed environmental stressors.

14 SOLAR ENERGY↗

Paranoia.Ada: A diagnostic program to evaluate Ada floating-point arithmetic

Many essential software functions in the mission critical computer resource application domain depend on floating point arithmetic. Numerically intensive functions associated with the Space Station project, such as emphemeris generation or the implementation of Kalman filters, are likely to employ the floating point facilities of Ada. Paranoia.Ada appears to be a valuabe program to insure that Ada environments and their underlying hardware exhibit the precision and correctness required to satisfy mission computational requirements. As a diagnostic tool, Paranoia.Ada reveals many essential characteristics of an Ada floating point implementation. Equipped with such knowledge, programmers need not tremble before the complex task of floating point computation.

Hjermstad, Chris↗

Can or can not? Electronic information sharing influence the participation behavior of the employees

Information sharing refers to information being shared between employees inside or outside an agency, or by providing accessibility of their information and data to other agencies so as to allow effective decision making. Electronic information sharing is a key to effective government. This study is conducted to investigate the factors of electronic information sharing that influence the participation behavior so as to augment it amongst the employees in public organizations. Eleven domains of factors that are considered in this study are benefits, risk, social network, Information stewardship, information quality, trust, privacy, reciprocity. The paper proposes electronic information sharing factors in public sector to increase the participation.

99 GENERAL AND MISCELLANEOUS↗

ScienceSearch: Enabling Search through Automatic Metadata Generation

© 2018 IEEE. Scientific facilities are increasingly generating and handling large amounts of data from experiments and simulations. Next-generation scientific discoveries rely on insights derived from data, especially across domain boundaries. Search capabilities are critical to enable scientists to discover datasets of interest. However, scientific datasets often lack the signals or metadata required for effective searches. Thus, we need formalized methods and systems to automatically annotate scientific datasets from the data and its surrounding context. Additionally, a search infrastructure needs to account for the scale and rate of application data volumes. In this paper, we present ScienceSearch, a system infrastructure that uses machine learning techniques to capture and learn the knowledge, context, and surrounding artifacts from data to generate metadata and enable search. Our current implementation is focused on a dataset from the National Center for Electron Microscopy (NCEM), an electron microscopy facility at Lawrence Berkeley National Laboratory sponsored by the Department of Energy which supports hundreds of users and stores millions of micrographs. In this paper, we describe a) our search infrastructure and model, b) methods for generating metadata using machine learning techniques, and c) optimizations to improve search latency, and deployment on an HPC system. We demonstrate that ScienceSearch is capable of producing valid metadata for NCEM's dataset and providing low-latency good quality search results over a scientific dataset.

Rodrigo, Gonzalo P.↗