Search NASA⌕ Search

SEARCH · Search NASA

Results for “information architectures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Future Homes in Space: Development of Concepts for Exploration Space Habitats

NASA’s Artemis campaign seeks to return humans to the moon and establish a sustained presence on the lunar surface. This session will emphasize how habitation capabilities on the moon and in cislunar space can potentially contribute to the sustainability objectives of Artemis. Habitable elements represent opportunities to enable longer duration stays, increase the number of crew members present, enhance science and utilization activities, drive technology development for future Mars exploration, perform analog missions, and fuel economic opportunities for US industry. Panelists include Paul Kessler (NASA Marshall Space Flight Center, deputy lead for lunar surface habitation); Andrew Choate (NASA Marshall Space Flight Center, Mars habitation lead); Krystofer Dudzinski (NASA Marshall Space Flight Center, a space architect within the MSFC Advanced Concepts Office); and Larry Toups (retired from NASA Johnson Space Center, currently an adjunct professor at University of Houston in space architecture). The panel is moderated by Tracie Prater (NASA Marshall Space Flight Center, Habitation Systems Development Office). The panel will begin with an overview of the history of habitation concepts and an academic perspective on general considerations in space habitat design (Larry Toups). Paul Kessler and Andrew Choate will introduce NASA’s principle of “architecting from the right” to help define objectives for Artemis missions, needs/characteristics, use cases, and functions (as published in the agency’s Architecture Definition Document) and provide perspective on how this principle informs habitation concept development work. NASA panelists will discuss key engineering challenges identified for developing, deploying, and operating habitable assets on the lunar surface and/or in deep space. These may include dust mitigation, outfitting of inflatable softgoods (for concepts which may use softgoods as a primary structural material), survival in lunar darkness, human health and performance considerations, maintenance/repair/sparing, and autonomy. These identified challenges represent risks for habitation systems development and relate closely to capability gaps identified by the agency. While the work of NASA Marshall Space Flight Center’s habitation development office is primarily focused on habitats which are launched from earth pre-integrated (referred to as Class I in the framework previously developed by NASA space architects Kennedy/Cohen) or launched from earth and deployed at the point of use (Class II), there is also extensive work in NASA, academia, and companies on constructed habitats, which would be built on a planetary surface using indigenous resources (Class III habitats). Panelist Krystopher Dudzinski will discuss potential evolutionary pathways from Class I and Class II habitats to Class III habitats, unique and common architectural challenges within each habitat class, and key gaps in implementing Class III habitats from an architectural perspective. NASA panelists and the moderator will also provide an overview of partnership opportunities and avenues for further engagement to advance habitation systems for the SpaceCom audience. NASA is currently developing notional concepts for a lunar surface habitat and Mars transit habitat, which will be discussed during this panel session and used as examples. These concepts represent options for habitation system design and are a point of departure. They do not represent a final plan or formal recommendation on the part of the agency. Based on the most recent analysis cycle, NASA’s lunar surface habitat (SH) concept nominally supports two crew members for 30 days, with the capacity to support four crew during a surge period where crew will swap between the SH and another surface asset, such as a pressurized rover. This example design has a metallic airlock for ingress/egress and the upper portion is an inflatable material system which serves as the habitation module. The notional interior of the habitat is a three-deck layout/configuration which supports all crew mission functions, including exercise, stowage, extravehicular activity (EVA), sleep, hygiene waste collection, maintenance and repair, and meal preparation. Under analysis assumptions for habitation, the Mars Transit Habitat (TH) concept would support four crew on an up to 1,200 day Mars mission. One option for the concept is to initially dock Transit Habitat at Gateway, where it can be used to increase the duration of crew stays in cislunar space and perform shakedown and analog missions prior to a Mars departure. One challenge in longer duration missions which involve both surface exploration and transit is understanding crew adaptation when transitioning between partial gravity and microgravity environments. TH at Gateway offers an opportunity to study this transition and in doing so reduce risks associated with future Mars exploration. Like lunar SH, the most recent analysis cycle concept of a Mars TH is a hybrid structure design, with a metallic section supporting EVAs, axial/radial docking, and Safe Haven capabilities, and an inflatable softgoods structure for the primary habitation function. Interior layouts to optimize crew usability and livability are currently under trade. The panel will include presentation material, but also seeks to engage the audience in a highly interactive conversation regarding the potential role for habitation in future exploration initiatives. Potential topics for discussion include the influence of the crew experience on habitation systems design and livability/usability considerations, the benefits of space habitation development in terrestrial applications, and challenges and opportunities in “feeding forward” lunar surface habitation systems development to Mars exploration.

space habitats↗

Testing of the NASA Exploration Extravehicular Mobility Unit Demonstration (xEMU Demo) Architecture at the Neutral Buoyancy Laboratory (NBL)

Following Z-2 space suit testing that occurred from 2016-2017, the Exploration Extravehicular Mobility Unit (xEMU) Project was tasked with building a demonstration unit of the xEMU space suit to test on the International Space Station (ISS) in 2023. This suit is called xEMU Demonstration Suit (xEMU Demo). Based on feedback from astronauts during the Z-2 NBL test series, design changes were made, resulting in a new prototype suit called the Z-2.5 space suit. The design of the Z-2.5 space suit with an exploration Portable Life Support Systems (xPLSS) mock-up represents the architecture of xEMU Demo. The team is testing Z-2.5 in the NBL to evaluate this architecture and validate changes made from Z-2. The results will inform the xEMU Demo design going forward to its Preliminary Design Review (PDR) in the summer of 2019. This Z-2.5 NBL test series focuses on evaluating the microgravity performance of the suit and the ability to complete ISS-related tasks. The series is comprised of 10 manned runs and an unmanned corn-man run. Six test subjects, including four astronauts, will participate. The test objective is to evaluate ability xEMU Demo architecture to perform ISS microgravity tasks. Each crew members will complete both a familiarization run and a nominal EMU EVA timeline run. Qualitative and quantitative data will be collected to aid the assessment of the suit. Preliminary feedback from astronauts who have completed the test series evaluate the xEMU Demo architecture as acceptable to complete a demonstration mission on the ISS.

Davis, Kristine↗

Information Leakage Analysis using a Co-design-Based Fault Injection Technique on a RISC-V Microprocessor

The RISC-V instruction set architecture open licensing policy has spawned a hive of development activity, making a range of implementations publicly available. The environments in which RISC-V operates have expanded correspondingly, driving the need for a generalized approach to evaluating the reliability of RISC-V implementations under adverse operating conditions or after normal wear-out periods. Fault injection (FI) refers to the process of changing the state of registers or wires, either permanently or momentarily, and then observing execution behavior. The analysis provides insight into the development of countermeasures that protect against the leakage or corruption of sensitive information which might occur because of unexpected execution behavior. In this paper, we develop a hardware-software co-design architecture that enables fast, configurable fault emulation and utilize it for information leakage and data corruption analysis. Modern System-on-chip FPGAs enable building an evaluation platform where control elements run on a processor(s) (PS) simultaneously with the target design running in the programmable logic (PL). Software components of the FI system introduce faults and report execution behavior. A pair of RISC-V FI-instrumented implementations are created and configured to execute the Advanced Encryption Standard and Twister algorithms. Key and plaintext information leakage and degraded pseudo-random sequences are both observed in the output for a subset of the emulated faults.

42 ENGINEERING↗

Technology for the Mission to Planet Earth

Mission to Planet Earth is a concept referring to the endeavor of making long term, space based global observations for the purpose of understanding earth system processes. The Ad Hoc Review Team on Space Technology was formed to determine what technologies must be developed in the near term to support this endeavor. The review team's central finding is that the Office of Aeronautics and Space Technology has identified all the correct technologies to pursue, but that the mission and system architecture has not been developed sufficiently to permit determination of meaningful priorities. Some of the specific recommendations of the review team are as follows: (1) long term, space based investigation of global changes and the earth's systems; (2) studies should begin that include the performance of relative cost-benefit trade-off analyses and development of operations concepts; (3) funding should be increased, especially in research and development; (4) pursue new technology in information processing; (5) improve interagency integration and coordination; and (6) after architecture studies are complete, another team should meet to consider questions of technology priorities, development schedules, and funding allocation.

Graham, Amy↗

A Multi-mission Event-Driven Component-Based System for Support of Flight Software Development, ATLO, and Operations first used by the Mars Science Laboratory (MSL) Project

This paper details an architectural description of the Mission Data Processing and Control System (MPCS), an event-driven, multi-mission ground data processing components providing uplink, downlink, and data management capabilities which will support the Mars Science Laboratory (MSL) project as its first target mission. MPCS is developed based on a set of small reusable components, implemented in Java, each designed with a specific function and well-defined interfaces. An industry standard messaging bus is used to transfer information among system components. Components generate standard messages which are used to capture system information, as well as triggers to support the event-driven architecture of the system. Event-driven systems are highly desirable for processing high-rate telemetry (science and engineering) data, and for supporting automation for many mission operations processes.

Mission Data Processing and Control System (MPCS)↗

A Satellite Data-Driven, Client-Server Decision Support Application for Agricultural Water Resources Management

Water cycle extremes such as droughts and floods present a challenge for water managers and for policy makers responsible for the administration of water supplies in agricultural regions. In addition to the inherent uncertainties associated with forecasting extreme weather events, water planners need to anticipate water demands and water user behavior in a typical circumstances. This requires the use decision support systems capable of simulating agricultural water demand with the latest available data. Unfortunately, managers from local and regional agencies often use different datasets of variable quality, which complicates coordinated action. In previous work we have demonstrated novel methodologies to use satellite-based observational technologies, in conjunction with hydro-economic models and state of the art data assimilation methods, to enable robust regional assessment and prediction of drought impacts on agricultural production, water resources, and land allocation. These methods create an opportunity for new, cost-effective analysis tools to support policy and decision-making over large spatial extents. The methods can be driven with information from existing satellite-derived operational products, such as the Satellite Irrigation Management Support system (SIMS) operational over California, the Cropland Data Layer (CDL), and using a modified light-use efficiency algorithm to retrieve crop yield from the synergistic use of MODIS and Landsat imagery. Here we present an integration of this modeling framework in a client-server architecture based on the Hydra platform. Assimilation and processing of resource intensive remote sensing data, as well as hydrologic and other ancillary information occur on the server side. This information is processed and summarized as attributes in water demand nodes that are part of a vector description of the water distribution network. With this architecture, our decision support system becomes a light weight 'app' that connects to the server to retrieve the latest information regarding water demands, land use, yields and hydrologic information required to run different management scenarios. Furthermore, this architecture ensures all agencies and teams involved in water management use the same, up-to-date information in their simulations.

Agricultural↗

Generating Real-Time Robotics Control Software from SysML

In this paper, we outline an approach for autogenerating real-time robotics control code from hierarchical state machines and hardware configurations encoded in Systems Modeling Language (SysML). We propose a software architecture that provides an abstract SysML layer with access to device state information and a set of primitive device commands, such as move actuator and release brake, allowing a user to build up a complete functional state machine directly in SysML. The SysML diagram is then exported to a standard SCXML file format and subsequently used to auto-generate hardware control code. Once this architecture is in place, the only explicit code elements that need to be written are the primitive device commands, which can be easily unit tested and reused across different systems. The motivation for this work was the need for a test bed that enables the rapid prototyping of mechanisms and control algorithms for a spacecraft that could ultimately be used for preparing Martian rock samples for their return to Earth. To this end, our software system was also designed to allow for the run-time specification of the hardware layout in SysML, with the hardware-level control functions kept agnostic to the specific parameters or communication bus of any particular device. Further, we outline a system for specifying both the state machine and hardware configuration in the MagicDraw IDE in such a way that the system can be simulated before any code is generated. The resultant software system is easy to debug, understand, and allows users to choose how much information is encoded as a visual or text-based representation.

Godart, Peter↗

Engineering Privacy at the Edge: A Practical Guide to Differential Privacy in System Architectures

The rapid expansion of distributed and edge computing platforms—spanning autonomous vehicles, IoT sensors, and healthcare monitors—has heightened concerns about data privacy. Differential Privacy (DP) offers a rigorous mathematical framework to protect sensitive information while retaining analytical utility. This tutorial introduces the foundations of DP for both numerical and categorical datasets and extends the discussion to correlation-aware techniques tailored for structured and high-dimensional data. Hands-on demonstrations will begin with the PETINA (Privacy prEservaTIoN Algorithms) package for numerical data and continue with MIC-DP (Maximum Information Correlated Differential Privacy) for tabular data. Designed for researchers and practitioners in secure systems, embedded architectures, and AI accelerators, the tutorial emphasizes practical and scalable methods for integrating DP into real-world system designs.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

Architecture for Cognitive Networking within NASAs Future Space Communications Infrastructure

Future space mission concepts and designs pose many networking challenges for command, telemetry, and science data applications with diverse end-to-end data delivery needs. For future end-to-end architecture designs, a key challenge is meeting expected application quality of service requirements for multiple simultaneous mission data flows with options to use diverse onboard local data buses, commercial ground networks, and multiple satellite relay constellations in LEO, MEO, GEO, or even deep space relay links. Effectively utilizing a complex network topology requires orchestration and direction that spans the many discrete, individually addressable computer systems, which cause them to act in concert to achieve the overall network goals. The system must be intelligent enough to not only function under nominal conditions, but also adapt to unexpected situations, and reorganize or adapt to perform roles not originally intended for the system or explicitly programmed. This paper describes architecture features of cognitive networking within the future NASA space communications infrastructure, and interacting with the legacy systems and infrastructure in the meantime. The paper begins by discussing the need for increased automation, including inter-system collaboration. This discussion motivates the features of an architecture including cognitive networking for future missions and relays, interoperating with both existing endpoint-based networking models and emerging information-centric models. From this basis, we discuss progress on a proof-of-concept implementation of this architecture as a cognitive networking on-orbit application on the SCaN Testbed attached to the International Space Station.

space networks↗

A research program in advanced information systems

Topics addressed cover: identification of large space structure dynamics; special-purpose architectures for computational fluid dynamics; fault-tolerant processor architectures; data flow techniques; software specification and verification tools; management of software development; software environment for concurrent computing; and parallel algorithms and architectures for the solution of partial differential equations.

Vandervelde, Wallace E.↗

Optically addressable molecular spins for quantum information processing

Spin-bearing molecules are promising building blocks for quantum technologies as they can be chemically tuned, assembled into scalable arrays, and readily incorporated into diverse device architectures. In molecular systems, optically addressing ground-state spins would enable a wide range of applications in quantum information science, as has been demonstrated for solid-state defects. However, this important functionality has remained elusive for molecules. Here, we demonstrate such optical addressability in a series of synthesized organometallic, chromium(IV) molecules. These compounds display a ground-state spin that can be initialized and read out using light and coherently manipulated with microwaves. In addition, through atomistic modification of the molecular structure, we vary the spin and optical properties of these compounds, indicating promise for designer quantum systems synthesized from the bottom-up.

99 GENERAL AND MISCELLANEOUS↗

Testing of Advanced Capabilities to Enable In-time Safety Management and Assurance for Future Flight Operations

In order to refine an initial Concept of Operations, explore Concepts of Use, and expose/validate requirements for future In-Time Aviation Safety Management Systems (IASMS), testing architectures were created, along with a set of capabilities and underlying information exchange protocols. These systems were conceived and developed based on hazards associated with two envisioned urban area flight domains: (1) highly autonomous small uncrewed aerial systems (sUAS) operating at low altitudes, and (2) highly autonomous air taxis. The initial scope of this development is described in [1]; this report provides an update, focusing on the subsequent developments and test activities. As stated in [1], it is important to note that there are many capabilities already in use by the industry (or soon to be in use) that will play critical roles in future IASMS designs. Those reported here were developed to address a gap in the current state-of-the-art regarding specific hazards/risks, and/or to allow for investigation of the interplay between and across hazard types — particularly regarding how overall safety risk can be reduced or managed effectively. Results of testing and development activities are organized by the operational phase wherein a particular capability would be employed (i.e., preflight, in-flight, and post-flight/off-line). Pre-flight: A set of capabilities were developed to help mitigate safety risk prior to flight (e.g., during flight and mission planning). Results of testing summarize (1) validation activities to raise the Technology Readiness Level (TRL) and (2) evaluation activities where the capabilities were applied to flight/mission planning procedures and used by operators/pilots. For the latter, flight plans were automatically assessed, and operators/pilots were notified of hazardous flight segments so as to enable adjustment of the flight plan and re-evaluation, and/or to better inform go/no-go decisions. Capabilities addressed hazards associated with power consumption, third-party risk, wind, navigation system performance, radiofrequency interference, and proximity to geo-spatial threats (e.g., buildings, trees, and no-fly zones). In-flight: Flight experiments tested capabilities that detect and respond to hazards encountered during flight. In the first series, safety hazards were monitored and assessed onboard, and system-generated mitigation maneuvers were recorded (but not acted upon by the vehicle). In the second series, mitigation maneuver commands directed the aircraft in response to safety hazards (i.e., auto-mitigation). The sUAS used for testing is described in full, as is the test architecture, which included commercial avionics, research avionics, and onboard software designed to detect, assess, and respond to hazards. The onboard system was designed as a run-time assurance framework, consistent with [2] and supportive of both supervisory and automated modes. The primary functions included: real-time risk assessment (RTRA), auto-pilot monitoring, constraint monitoring, and contingency select/triggering. RTRA performs integrated risk assessment considering data from several hazard-related monitors (e.g., battery, motors, navigation, communications, population density, and loss-of-control). Post-flight/off-line: Data monitored and recorded during flights can enable IASMS capabilities that execute after flights have completed (or “off-line”). These include: (1) the ability to identify anomalies and trends that may only be observable when comparing data spanning a number of similar flights; (2) the ability to update and validate pre-flight and in-flight capabilities and any underlying models to improve their performance; (3) the ability to report anomalies/off-nominals that may indicate design changes or maintenance actions are needed; and (4) the ability for humans involved in operations to report safety-relevant observations to help in understanding the flight data and/or the operational context of a flight. Progress on three such capabilities is summarized; the first investigates anomaly detection given a limited set of flight logs and applies an approach previously used for space operations. The second explores what could be identified using a larger set of flight logs, including from web-based forums where flight logs are posted by sUAS autopilot users. The third creates a new means of collecting information on UAS incidents and accidents via the Aviation Safety Reporting System (ASRS).

sUAS↗

Physics‐Informed Machine Learning for Inverse Design of Optical Metamaterials

Optical metamaterials manipulate light through various confinement and scattering processes, offering unique advantages like high performance, small form factor and easy integration with semiconductor devices. However, designing metasurfaces with suitable optical responses for complex metamaterial systems remains challenging due to the exponentially growing computation cost and the ill‐posed nature of inverse problems. To expedite the computation for the inverse design of metasurfaces, a physics‐informed deep learning (DL) framework is used. A tandem DL architecture with physics‐based learning is used to select designs that are scientifically consistent, have low error in design prediction, and accurate reconstruction of optical responses. The authors focus on the inverse design of a representative plasmonic device and consider the prediction of design for the optical response of a single wavelength incident or a spectrum of wavelength in the visible light range. The physics‐based constraint is derived from solving the electromagnetic wave equations for a simplified homogenized model. The model converges with an accuracy up to 97% for inverse design prediction with the optical response for the visible light spectrum as input, and up to 96% for optical response of single wavelength of light as input, with optical response reconstruction accuracy of 99%.

Sarkar, Sulagna↗

Strong Correlation Between Superconductivity and Ferromagnetism in an Fe-Chalcogenide Superconductor

The interplay among topology, superconductivity, and magnetism promises to bring a plethora of exotic and unintuitive behaviors in emergent quantum materials. The family of Fe-chalcogenide superconductors FeTe x Se 1–x are directly relevant in this context due to their intrinsic topological band structure, high-temperature superconductivity, and unconventional pairing symmetry. Despite enormous promise and expectation, the local magnetic properties of FeTe x Se 1–x remain largely unexplored, which prevents a comprehensive understanding of their underlying material properties. Exploiting nitrogen vacancy (NV) centers in diamond, here we report nanoscale quantum sensing and imaging of magnetic flux generated by exfoliated FeTe x Se 1–x flakes, demonstrating strong correlation between superconductivity and ferromagnetism in FeTe x Se 1–x . The coexistence of superconductivity and ferromagnetism in an established topological superconductor opens up new opportunities for exploring exotic spin and charge transport phenomena in quantum materials. The demonstrated coupling between NV centers and FeTe x Se 1–x may also find applications in developing hybrid architectures for next-generation, solid-state-based quantum information technologies.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Decoding the protein–ligand interactions using parallel graph neural networks

Abstract Protein–ligand interactions (PLIs) are essential for biochemical functionality and their identification is crucial for estimating biophysical properties for rational therapeutic design. Currently, experimental characterization of these properties is the most accurate method, however, this is very time-consuming and labor-intensive. A number of computational methods have been developed in this context but most of the existing PLI prediction heavily depends on 2D protein sequence data. Here, we present a novel parallel graph neural network (GNN) to integrate knowledge representation and reasoning for PLI prediction to perform deep learning guided by expert knowledge and informed by 3D structural data. We develop two distinct GNN architectures: $$\hbox {GNN}_{\mathrm{F}}$$ GNN F is the base implementation that employs distinct featurization to enhance domain-awareness, while $$\hbox {GNN}_{\mathrm{P}}$$ GNN P is a novel implementation that can predict with no prior knowledge of the intermolecular interactions. The comprehensive evaluation demonstrated that GNN can successfully capture the binary interactions between ligand and protein’s 3D structure with 0.979 test accuracy for $$\hbox {GNN}_{\mathrm{F}}$$ GNN F and 0.958 for $$\hbox {GNN}_{\mathrm{P}}$$ GNN P for predicting activity of a protein–ligand complex. These models are further adapted for regression tasks to predict experimental binding affinities and $$\hbox {pIC}_{\mathrm{50}}$$ pIC 50 crucial for compound’s potency and efficacy. We achieve a Pearson correlation coefficient of 0.66 and 0.65 on experimental affinity and 0.50 and 0.51 on $$\hbox {pIC}_{\mathrm{50}}$$ pIC 50 with $$\hbox {GNN}_{\mathrm{F}}$$ GNN F and $$\hbox {GNN}_{\mathrm{P}}$$ GNN P , respectively, outperforming similar 2D sequence based models. Our method can serve as an interpretable and explainable artificial intelligence (AI) tool for predicted activity, potency, and biophysical properties of lead candidates. To this end, we show the utility of $$\hbox {GNN}_{\mathrm{P}}$$ GNN P on SARS-Cov-2 protein targets by screening a large compound library and comparing the prediction with the experimentally measured data.

59 BASIC BIOLOGICAL SCIENCES↗

El-CID: a filter for gravitational-wave electromagnetic counterpart identification

ABSTRACT As gravitational-wave (GW) interferometers become more sensitive and probe ever more distant reaches, the number of detected binary neutron star mergers will increase. However, detecting more events farther away with GWs does not guarantee corresponding increase in the number of electromagnetic counterparts of these events. Current and upcoming wide-field surveys that participate in GW follow-up operations will have to contend with distinguishing the kilonova (KN) from the ever increasing number of transients they detect, many of which will be consistent with the GW sky-localization. We have developed a novel tool based on a temporal convolutional neural network architecture, trained on sparse early-time photometry and contextual information for Electromagnetic Counterpart Identification (El-CID). The overarching goal for El-CID is to slice through list of new transient candidates that are consistent with the GW sky localization, and determine which sources are consistent with KNe, allowing limited target-of-opportunity resources to be used judiciously. In addition to verifying the performance of our algorithm on an extensive testing sample, we validate it on AT2017gfo – the only EM counterpart of a binary neutron star merger discovered to date – and AT2019npv – a supernova that was initially suspected as a counterpart of the GW event, GW190814, but was later ruled out after further analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Scalable Pattern Matching in Metadata Graphs via Constraint Checking

Pattern matching is a fundamental tool for answering complex graph queries. Unfortunately, existing solutions have limited capabilities: They do not scale to process large graphs and/or support only a restricted set of search templates or usage scenarios. Moreover, the algorithms at the core of the existing techniques are not suitable for today’s graph processing infrastructures relying on horizontal scalability and shared-nothing clusters, as most of these algorithms are inherently sequential and difficult to parallelize. In this article we present an algorithmic pipeline that bases pattern matching on constraint checking. The key intuition is that each vertex and edge participating in a match has to meet a set of constraints implicitly specified by the search template. These constraints can be verified independently and typically are less expensive to compute than searching the full template. The pipeline we propose generates these constraints and iterates over them to eliminate all the vertices and edges that do not participate in any match, thus reducing the background graph to a subgraph that is the union of all template matches—the complete set of all vertices and edges that participate in at least one match. Additional analysis can be performed on this annotated, reduced graph, such as full match enumeration, match counting, or computing vertex/edge centrality. Furthermore, a vertex-centric formulation for constraint checking algorithms exists, and this makes it possible to harness existing high-performance, vertex-centric graph processing frameworks. This technique (i) enables highly scalable pattern matching in metadata (labeled) graphs; (ii) supports arbitrary patterns with 100% precision; (iii) enables tradeoffs between precision and time-to-solution, while always selects all vertices and edges that participate in matches, thus offering 100% recall; and (iv) supports a set of popular data analytics scenarios. We implement our approach on top of HavoqGT, an open-source asynchronous graph processing framework, and demonstrate its advantages through strong and weak scaling experiments on massive scale real-world (up to 257 billion edges) and synthetic (up to 4.4 trillion edges) labeled graphs, respectively, and at scales (1,024 nodes / 36,864 cores), orders of magnitude larger than used in the past for similar problems. This article serves two purposes: First, it synthesises the knowledge accumulated during a long-term project. Second, it presents new system features, usage scenarios, optimizations, and comparisons with related work that strengthen the confidence that pattern matching based on iterative pruning via constraint checking is an effective and scalable approach in practice. The new contributions include the following: (i) We demonstrate the ability of the constraint checking approach to efficiently support two additional search scenarios that often emerge in practice, interactive incremental search and exploratory search. (ii) We empirically compare our solution with two additional state-of-the-art systems, Arabsque and TriAD. (iii) We show the ability of our solution to accommodate a more diverse range of datasets with varying properties, e.g., scale, skewness, label distribution, and match frequency. (iv) We introduce or extend a number of system features (e.g., work aggregation, load balancing, and the ability to cap the generated traffic) and design optimizations and demonstrate their advantages with respect to improving performance and scalability. (v) We present bottleneck analysis and insights into artifacts that influence performance. (vi) We present a theoretical complexity argument that motivates the performance gains we observe.

97 MATHEMATICS AND COMPUTING↗