Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data visualization and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

NREL OpenPATH: An Open-Source, Extensible Platform for Instrumenting Travel Behavior Data

NREL OpenPATH is an open-source, extensible platform that allows communities to instrument their own travel behavior data. The platform consists of a smartphone app, server and analysis pipeline, and enables collection of opt-in, multi-modal, end-to-end travel diaries. It makes the aggregate statistics available via a public dashboard, and allows deployers to download and visualize trip and trajectory data through the admin dashboard. It also allows for customization of the initial demographic survey and the trip-level qualitative information collected. Our goal is to provide an easy-to-use tool that can democratize travel behavior data collection by empower communities of all sizes to recruit participants and obtain a holistic picture of their travel patterns. The platform has been used by close to 40 partners, to collect data from thousands of participants. Upon signing a simple MOU, it is currently available for free to universities, non-profits and public agencies in the United States.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluating long-term model-based scenarios of the energy system

Energy-economic models are used to provide science-based decision support in a variety of contexts. Analyses using these tools often involve defining a “reference” scenario, which serves as a counterfactual against which alternative scenarios are compared. Evaluating scenarios, including reference scenarios, is critical for establishing the credibility of the analyses these models support. We propose a framework for evaluating energy system scenarios which consists of three parts – a qualitative storyline, quantitative metrics, and evaluation criteria. We apply this framework to the reference scenario for GCAM-USA, a version of the global human-Earth system model GCAM (Global Change Assessment Model) with state-level detail in the United States, focusing on the evolution of the electric power sector. We develop new visual analytic tools to facilitate the evaluation of model outcomes in 51 sub-national regions, and demonstrate how scenario performance can be tracked and compared across four quantifications of the GCAM-USA reference scenario.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

End-to-end experiment management in HPC

Experiment management in any domain is challenging. There is a perpetual feedback loop cycling through planning, execution, measurement, and analysis. The lifetime of a particular experiment can be limited to a single cycle although many require myriad more cycles before definite results can be obtained. Within each cycle, a large number of subexperiments may be executed in order to measure the effects of one or more independent variables. Experiment management in high performance computing (HPC) follows this general pattern but also has three unique characteristics. One, computational science applications running on large supercomputers must deal with frequent platform failures which can interrupt, perturb, or terminate running experiments. Two, these applications typically integrate in parallel using MPI as their communication medium. Three, there is typically a scheduling system (e.g. Condor, Moab, SGE, etc.) acting as a gate-keeper for the HPC resources. In this paper, we introduce LANL Experiment Management (LEM), an experimental management framework simplifying all four phases of experiment management. LEM simplifies experiment planning by allowing the user to describe their experimental goals without having to fully construct the individual parameters for each task. To simplify execution, LEM dispatches the subexperiments itself thereby freeing the user from remembering the often arcane methods for interacting with the various scheduling systems. LEM provides transducers for experiments that automatically measure and record important information about each subexperiment; these transducers can easily be extended to collect additional measurements specific to each experiment. Finally, experiment analysis is simplified by providing a general database visualization framework that allows users to quickly and easily interact with their measured data.

97 MATHEMATICS AND COMPUTING↗

DeepLynx Ecosystem 2025

Poor data integration and governance continue to plague complex engineering projects, resulting in missed cost, schedule, and performance targets. Departments operate in isolated systems with manual data exchange, creating fragmented information that compounds errors and leads to significant delays and cost overruns. The DeepLynx ecosystem addresses these challenges through an open-source, modular data management platform that transforms fragmented project data into an integrated digital thread. Built on a federated microservice architecture, the ecosystem comprises seven specialized tools centered around DeepLynx Nexus, a unified data catalog with hierarchical organization and graph-based navigation capabilities. The ecosystem includes: DeepLynx Stream for real-time timeseries data ingestion from industrial sources; DeepLynx Ingest for governed data uploads with formal review workflows; DeepLynx Lattice for ontology-based entity and relationship extraction; DeepLynx Run for workflow orchestration and secure AI/ML compute; DeepLynx Visualize for 3D digital twin visualization; and DeepLynx Insight for AI-assisted document analysis with traceable, grounded responses. Deployable in cloud, on-premise, or hybrid environments using containerized Docker applications and Helm charts, the DeepLynx ecosystem provides flexible infrastructure that adapts to organizational requirements. By consolidating project data into a unified data lake with role-based access controls and OAuth2 authentication, DeepLynx enables digital thread and digital twin capabilities that improve decision-making, reduce risk, and support complex engineering workflows throughout the project lifecycle.

42 - ENGINEERING↗

Rethinking Visual Analytics for Streaming Data Applications

In the age of data science, the use of interactive information visualization techniques has become increasingly ubiquitous. From online scientific journals to the New York Times graphics desk, the utility of interactive visualization for both storytelling and analysis has become ever more apparent. As these techniques have become more readily accessible, the appeal of combining interactive visualization with computational analysis continues to grow. Arising out of a need for scalable, human-driven analysis, primary objective of visual analytics systems is to capitalize on the complementary strengths of human and machine analysis, using interactive visualization as a medium for communication between the two. These systems leverage developments from the fields of information visualization, computer graphics, machine learning, and human-computer interaction to support insight generation in areas where purely computational analyses fall short. Over the past decade, visual analytics systems have generated remarkable advances in many historically challenging analytical contexts. These include areas such as modeling political systems [Crouser et al. 2012], detecting financial fraud [Chang et al. 2008], and cybersecurity [Harrison et al. 2012]. In each of these contexts, domain expertise and human intuition is a necessary component of the analysis. This intuition is essential to building trust in the analytical products, as well as supporting the translation of evidence into actionable insight. In addition, each of these examples also highlights the need for scalable analysis. In each case, it is infeasible for a human analyst to manually assess the raw information unaided, and the communication overhead to divide the task between a large number of analysts makes simple parallelism intractable. Regardless of the domain, visual analytics tools strive to optimize the allocation of human analytical resources, and to streamline the sensemaking process on data that is massive, complex, incomplete, and uncertain in scenarios requiring human judgment.

97 MATHEMATICS AND COMPUTING↗

Consistent Feature Extraction From Vector Fields: Combinatorial Representations and Analysis Under Local Reference Frames

This dissertation presents research on addressing some of the contemporary challenges in the analysis of vector fields—an important type of scientific data useful for representing a multitude of physical phenomena, such as wind flow and ocean currents. In particular, new theories and computational frameworks to enable consistent feature extraction from vector fields are presented. One of the most fundamental challenges in the analysis of vector fields is that their features are defined with respect to reference frames. Unfortunately, there is no single “correct” reference frame for analysis, and an unsuitable frame may cause features of interest to remain undetected, thus creating serious physical consequences. This work develops new reference frames that enable extraction of localized features that other techniques and frames fail to detect. As a result, these reference frames objectify the notion of “correctness” of features for certain goals by revealing the phenomena of importance from the underlying data. An important consequence of using these local frames is that the analysis of unsteady (time-varying) vector fields can be reduced to the analysis of sequences of steady (timeindependent) vector fields, which can be performed using simpler and scalable techniques that allow better data management by accessing the data on a per-time-step basis. Nevertheless, the state-of-the-art analysis of steady vector fields is not robust, as most techniques are numerical in nature. The residing numerical errors can violate consistency with the underlying theory by breaching important fundamental laws, which may lead to serious physical consequences. This dissertation considers consistency as the most fundamental characteristic of computational analysis that must always be preserved, and presents a new discrete theory that uses combinatorial representations and algorithms to provide consistency guarantees during vector field analysis along with the uncertainty visualization of unavoidable discretization errors. Together, the two main contributions of this dissertation address two important concerns regarding feature extraction from scientific data: correctness and precision. The work presented here also opens new avenues for further research by exploring more-general reference frames and more-sophisticated domain discretizations.

97 MATHEMATICS AND COMPUTING↗

NBIC Biofeeds: A Digital Tool for Open Source Biosurveillance across Federal Agencies

The National Biosurveillance Integration Center (NBIC) is developing a scalable, flexible open source data collection, analysis, and dissemination tool to support biosurveillance operations by the U.S. Department of Homeland Security (DHS) and its federal interagency partners. The NBIC integrates, analyzes, and distributes key information about health and disease events to help ensure the nation’s responses are well-informed, save lives, and minimize economic impact. NBIC serves as a bridge between Federal, State, Local, Territorial, and Tribal entities to conduct biosurveillance across human, animal, plant, and environmental domains. The integration of information enables early warning and shared situational awareness of biological events to inform critical decisions directing response and recovery efforts. To meet its mission objectives, NBIC utilizes a variety of datasets, including open source information, to provide comprehensive coverage of biological events occurring across the globe. NBIC Biofeeds is a digital tool designed to improve the efficiency of reviewing and analyzing large volumes of open source reporting by biosurveillance analysts on a daily basis; moreover, the system provides a mechanism to disseminate tailored feeds allowing NBIC to better meet the specific information needs of individual, interagency partners. The tool is currently under development by the Department of Energy (DOE), Pacific Northwest National Laboratory (PNNL)and it is in a testing and evaluation phase supported by NBIC biosurveillance subject matter experts. Integration with the Defense Threat Reduction Agency (DTRA), Biosurveillance Ecosystem(BSVE) is also underway. NBIC Biofeeds Version 1 is expected to be fully operational in Fiscal Year 2017. The PNNL is applying agile methodology to streamline the build of NBIC Biofeeds to specifications required for operational use by NBIC and its federal interagency partners. Biosurveillance, analytics, and system engineering subject matter experts provide guidance on the implementation of features in the tool to ensure functionality aligns with operational workflows and production support. PNNL is leveraging software from a previous government effort to repurpose the technology to meet NBIC needs. NBIC Biofeeds incorporates the open source, document-orientated MongoDB database to capture user- and system-generated metadata on hundreds of thousands of records, in part, to establish baselines to aid prospective and retrospective analysis on emerging biological events. NBIC Biofeeds integrates a biosurveillance taxonomy (uniquely developed by NBIC),which includes input from interagency partners to recognize critical characteristics of a biological event. In NBIC Biofeeds Version1, metadata capture of reported events is done manually by NBIC analysts; however, moving forward in Version 2, the tool will be further automated to flag significant reporting on biological events with a human remaining in the loop to confirm the validity of the system-generated tags. To serve as a one-stop tool for open source biosurveillance, NBIC Biofeeds automatically harvests information from thousands of websites, utilizing third party aggregators, paid subscriptions to data feeds, and scraping of high priority sources. Users can develop desired queries for automatic updating, leverage a unique review and curation mechanism, and further analyze data from topical, geographic, and temporal visualization features in the tool. To meet NBIC’s information sharing needs, the tool allows for design of tailored RSS feeds and electronic message-based delivery of analysis on biological events, intended for recipients in the government with unique missions around human, animal, plant, and environmental health. Through current testing and evaluation – underway by biosurveillance subject matter experts – NBIC Biofeeds is demonstrating value in supporting open source biosurveillance by the Center for more rapid recognition and sharing of key event characteristics. Centralizing access and analysis of this data set into a single system is increasing the efficiency of daily, global biosurveillance, while enhancing the value of information identified through use of the querying, curation, and production support features in the tool.

59 BASIC BIOLOGICAL SCIENCES↗

Towards Net Zero: Modeling Approach to the Right-Sized Facilities

As the concentration of greenhouse gases (GHGs) in the atmosphere increases, the concerns about carbon emissions are growing. Several net-zero initiatives are taking place around the globe to achieve a balance between the GHGs put into the atmosphere and those taken out. While most efforts present a sectorized approach, this paper describes the importance of integrating information across different sectors for effective modeling of carbon emissions and holistic reduction opportunity analysis. Using the Idaho National Laboratory (INL) campus as a test case, this work provides a web-based tool for INL stakeholders to use when engaging in strategic planning to achieve carbon emissions reduction. This net-zero engineering support tool (NEST) uses historical data as foundational information for applying the modeling framework. Prediction of CO 2 emissions throughout project completion integrates various approaches and schedules aimed at energy conservation, fleet decarbonization, and other GHG reduction activities. Using NEST, stakeholders can visualize carbon emissions, electricity consumption, and costs for decision making when planning the pathway for reaching carbon net zero. The INL’s initiative to transition into an EV fleet was used to demonstrate the developed framework and the advantages of using NEST. It was shown that electrifying different fossil-fueled campus vehicles before 2030 with aggressive replacement schedules require high annual capital expenditure (CAPEX), which may not be available. The tool allows decision makers to test different replacement schedules and prioritize those that yield CAPEX below a certain threshold while meeting target milestones. While the demonstration focused on vehicle electrification, the developed framework lays the foundation for further quantitative analysis of other GHG reduction activities.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Power Analysis for Applications and Data Centers

A portion of a chapter for the High Performance Parallelism Pearls 2 book. By using the NWPerf and CView software developed and deployed at PNNL administrators and users can visually see the performance, and power used by jobs running on a super computer in near-time.

Affinity↗

THE SPITZER SURVEY OF STELLAR STRUCTURE IN GALAXIES (S{sup 4}G): MULTI-COMPONENT DECOMPOSITION STRATEGIES AND DATA RELEASE

The Spitzer Survey of Stellar Structure in Galaxies (S{sup 4}G) is a deep 3.6 and 4.5 μm imaging survey of 2352 nearby (<40 Mpc) galaxies. We describe the S{sup 4}G data analysis pipeline 4, which is dedicated to two-dimensional structural surface brightness decompositions of 3.6 μm images, using GALFIT3.0. Besides automatic 1-component Sérsic fits, and 2-component Sérsic bulge + exponential disk fits, we present human-supervised multi-component decompositions, which include, when judged appropriate, a central point source, bulge, disk, and bar components. Comparison of the fitted parameters indicates that multi-component models are needed to obtain reliable estimates for the bulge Sérsic index and bulge-to-total light ratio (B/T), confirming earlier results. Here, we describe the preparations of input data done for decompositions, give examples of our decomposition strategy, and describe the data products released via IRSA and via our web page (www.oulu.fi/astronomy/S4G-PIPELINE4/MAIN). These products include all the input data and decomposition files in electronic form, making it easy to extend the decompositions to suit specific science purposes. We also provide our IDL-based visualization tools (GALFIDL) developed for displaying/running GALFIT-decompositions, as well as our mask editing procedure (MASK-EDIT) used in data preparation. A detailed analysis of the bulge, disk, and bar parameters derived from multi-component decompositions will be published separately.

79 ASTRONOMY AND ASTROPHYSICS↗

Remote visual analysis of large turbulence databases at multiple scales

The remote analysis and visualization of raw large turbulence datasets is challenging. Current accurate direct numerical simulations (DNS) of turbulent flows generate datasets with billions of points per time-step and several thousand time-steps per simulation. Until recently, the analysis and visualization of such datasets was restricted to scientists with access to large supercomputers. The public Johns Hopkins Turbulence database simplifies access to multi-terabyte turbulence datasets and facilitates the computation of statistics and extraction of features through the use of commodity hardware. In this paper, we present a framework designed around wavelet-based compression for high-speed visualization of large datasets and methods supporting multi-resolution analysis of turbulence. By integrating common technologies, this framework enables remote access to tools available on supercomputers and over 230 terabytes of DNS data over the Web. Finally, the database toolset is expanded by providing access to exploratory data analysis tools, such as wavelet decomposition capabilities and coherent feature extraction.

97 MATHEMATICS AND COMPUTING↗

ACDC (Automated Campbell Diagram Code) [SWR-26-042]

This application provides a web-based graphical user interface to generating Campbell Diagrams and visualizing mode shapes for OpenFAST turbine models. Determining the aeroelastic stability and dynamic characteristics of wind turbines is a critical step in turbine design and analysis. Historically, extracting natural frequencies and mode shapes from OpenFAST—the industry-standard whole-turbine simulation code—has been a fragmented and tedious process. It required manual model configuration, command-line linearization execution, and complex post-processing via proprietary scripts to handle rotating-frame dynamics. To address these workflow bottlenecks, we present the Automated Campbell Diagram Code (ACDC), an open-source graphical software tool developed by the National Laboratory of the Rockies (NLR) under the DOE-funded Distributed Wind Aeroelastic Modeling (dWAM) project. ACDC streamlines the end-to-end linearization and stability analysis workflow into a single, intuitive cross-platform application. The software guides users through OpenFAST model configuration, definition of operating points, and the automated execution of steady-state trim and linearization simulations. Under the hood, ACDC automates the complex mathematical post-processing steps required for rotating systems, including Multi-Blade Coordinate (MBC) transformations, eigenanalysis, and advanced modal tracking utilizing the Modal Assurance Criterion (MAC) and spectral clustering. Finally, ACDC processes these results to automatically generate Campbell diagrams and features a robust 3D visualization engine to animate full-system mode shapes. By eliminating the reliance on external post-processing environments and manual data manipulation, ACDC significantly accelerates dynamic analysis and lowers the barrier to entry for wind energy researchers and engineers.

Summerville, Brent [National Laboratory of the Roc↗

Final Project Report: Composition and Realization of Source-to-Sink High-Performance Flows: File Systems, Storage, Hosts, LAN and WAN

A number of Department of Energy (DOE) science applications, involving exascale computing systems and large experimental facilities, are expected to generate large volumes of data, in the range of petabytes to exabytes, which will be transported over wide-area networks for the purpose of storage, visualization, and analysis. The objectives of this proposal are to (1) develop and test the component technologies and their synthesis methods to achieve source-to-sink high-performance flows, and (2) develop tools that provide these capabilities through simple interfaces to users and applications. In terms of the former, we propose to develop (1) optimization methods that align and transition multiple storage flows to multiple network flows on multicore, multibus hosts; and (2) edge and long-haul network path realization and maintenance using advanced provisioning methods including OSCARS and OpenFlow. We also propose synthesis methods that combine these individual technologies to compose high-performance flows using a collection of constituent storage-network flows, and realize them across the storage and local network connections as well as long-haul connections. We propose to develop automated user tools that profile the hosts, storage systems, and network connections; compose the source-to-sink complex flows; and set up and maintain the needed network connections.

97 MATHEMATICS AND COMPUTING↗

Matminer: An open source toolkit for materials data mining

As materials data sets grow in size and scope, the role of data mining and statistical learning methods to analyze these materials data sets and build predictive models is becoming more important. This manuscript introduces matminer, an open-source, Python-based software platform to facilitate data-driven methods of analyzing and predicting materials properties. Matminer provides modules for retrieving large data sets from external databases such as the Materials Project, Citrination, Materials Data Facility, and Materials Platform for Data Science. It also provides implementations for an extensive library of feature extraction routines developed by the materials community, with 47 featurization classes that can generate thousands of individual descriptors and combine them into mathematical functions. Finally, matminer provides a visualization module for producing interactive, shareable plots. These functions are designed in a way that integrates closely with machine learning and data analysis packages already developed and in use by the Python data science community. We explain the structure and logic of matminer, provide a description of its various modules, and showcase several examples of how matminer can be used to collect data, reproduce data mining studies reported in the literature, and test new methodologies.

97 MATHEMATICS AND COMPUTING↗

High-veracity functional imaging in scanning probe microscopy via Graph-Bootstrapping

The key objective of scanning probe microscopy (SPM) techniques is the optimal representation of the nanoscale surface structure and functionality inferred from the dynamics of the cantilever. This is particularly pertinent today, as the SPM community has seen a rapidly growing trend towards simultaneous capture of multiple imaging channels and complex modes of operation involving high-dimensional information-rich datasets, bringing forward the challenges of visualization and analysis, particularly for cases where the underlying dynamic model is poorly understood. To meet this challenge, we present a data-driven approach, Graph-Bootstrapping, based on low-dimensional manifold learning of the full SPM spectra and demonstrate its successes for high-veracity mechanical mapping on a mixed polymer thin film and resolving irregular hydration structure of calcite at atomic resolution. Using the proposed methodology, we can efficiently reveal and hierarchically represent salient material features with rich local details, further enabling denoising, classification, and high-resolution functional imaging.

36 MATERIALS SCIENCE↗

RetSynth: determining all optimal and sub-optimal synthetic pathways that facilitate synthesis of target compounds in chassis organisms

The efficient biological production of industrially and economically important compounds is a challenging problem. Brute-force determination of the optimal pathways to efficient production of a target chemical in a chassis organism is computationally intractable. Many current methods provide a single solution to this problem, but fail to provide all optimal pathways, optional sub-optimal solutions or hybrid biological/non-biological solutions. Here we present RetSynth, software with a novel algorithm for determining all optimal biological pathways given a starting biological chassis and target chemical. By dynamically selecting constraints, the number of potential pathways scales by the number of fully independent pathways and not by the number of overall reactions or size of the metabolic network. This feature allows all optimal pathways to be determined for a large number of chemicals and for a large corpus of potential chassis organisms. Additionally, this software contains other features including the ability to collect data from metabolic repositories, perform flux balance analysis, and to view optimal pathways identified by our algorithm using a built-in visualization module. This software also identifies sub-optimal pathways and allows incorporation of non-biological chemical reactions, which may be performed after metabolic production of precursor molecules. The novel algorithm designed for RetSynth streamlines an arduous and complex process in metabolic engineering. Our stand-alone software allows the identification of candidate optimal and additional sub-optimal pathways, and provides the user with necessary ranking criteria such as target yield to decide which route to select for target production. Furthermore, the ability to incorporate non-biological reactions into the final steps allows determination of pathways to production for targets that cannot be solely produced biologically. With this comprehensive suite of features RetSynth exceeds any open-source software or webservice currently available for identifying optimal pathways for target production.

59 BASIC BIOLOGICAL SCIENCES↗

Elemental analysis of cotton by laser-induced breakdown spectroscopy

Laser-induced breakdown spectroscopy (LIBS) has been applied to the elemental characterization of unprocessed cotton. This research is important in forensic and fraud detection applications to establish an elemental fingerprint of U.S. cotton by region, which can be used to determine the source of the cotton. To the best of our knowledge, this is the first report of a LIBS method for the elemental analysis of cotton. The experimental setup consists of a Nd:YAG laser that operates at the fundamental wavelength as the LIBS excitation source and an echelle spectrometer equipped with an intensified CCD camera. The relative concentrations of elements Al, Ba, Ca, Cr, Cu, Fe, Mg, and Sr from both nutrients and environmental contributions were determined by LIBS. Principal component analysis was used to visualize the differences between cotton samples based on the elemental composition by region in the U.S. Linear discriminant analysis of the LIBS data resulted in the correct classification of >97% of the cotton samples by U.S. region and >81% correct classification by state of origin.

74 ATOMIC AND MOLECULAR PHYSICS↗

COTS Data Analytics Software User Manual: Version 1.0

Large volumes of data are being collected by Sandia National Laboratories as part of an active commercial-off-the-shelf (COTS) part testing and surveillance program. This user manual documents Python-based COTS Data Analytics software that has been developed for standardizing, displaying, visualizing, and analyzing the resulting COTS part testing and surveillance data. It is the objective of these software tools to streamline the analysis of COTS testing and surveillance data and improve the efficiency with which test engineers and data analytics experts can pinpoint possible performance and reliability problems in COTS parts.

42 ENGINEERING↗