Search NASA⌕ Search

SEARCH · Search NASA

Results for “open source tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Supporting information for Few-Shot Learning Enables Population-Scale Analysis of Leaf Traits in Populus trichocarpa

In this work, we use few-shot learning to segment the body and vein architecture of P. trichocarpa leaves from high-resolution scans obtained in the UC Davis common garden. Leaf and vein segmentation are formulated as separate tasks, in which convolutional neural networks (CNNs) are used to iteratively expand partial segmentations until reaching stopping criteria. Our leaf and vein segmentation approaches use just 50 and 8 manually traced images for training, respectively, and are applied to a set of 2,634 top and bottom leaf scans. We show that both methods achieve high segmentation accuracy, in some cases exceeding even human-level segmentation. The leaf and vein segmentations are subsequently used to extract 68 morphological traits using traditional open-source image processing tools, which are validated using real-world physical measurements. For a biological perspective, we perform a genome-wide association study using the vein density trait to discover novel genetic architectures associated with multiple physiological processes relating to leaf development and function. In addition to sharing all of the few-shot learning code (see https://github.com/jlager/few-shot-leaf-segmentation), we are releasing all images, manual segmentations, model predictions, 68 extracted leaf phenotypes, and a new set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes. The data folder includes all images, ground truth segmentations, predicted segmentations, and extracted leaf traits. All images encode the sample ID in the file name by indicating the treatment, block, row, position, and leaf side, respectively. For example, the file, C_1_1_2_bot.jpeg, indicates the control treatment, block 1, row 1, position 2, and the bottom side of the leaf. Tabulated results include position IDs as well as the corresponding genotype IDs. The images folder includes the 2,906 high-resolution leaf scans taken in the field. The leaf_masks folder includes 50 ground truth segmentations used for training the leaf tracing algorithm. The leaf_preds folder includes the 2,906 predicted segmentations from the leaf tracing algorithm. The vein_masks folder includes 8 ground truth segmentations used for training the vein growing algorithm. The vein_preds folder includes the 1,453 predicted segmentations from the vein growing algorithm. The vein_probs folder includes the 1,453 predicted probability maps from the vein growing algorithm before thresholding. The genomes folder includes the set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes with a README file detailing the steps taken. The results folder includes: (i) raw values of the 68 predicted leaf traits in digital_traits.tsv, (ii) manually measured values of petiole length and width in manual_traits.tsv, (iii) thin plate spline (TPS) adjusted values of the vein density trait in vein_density_tps_adj.tsv, (iv) best linear unbiased prediction (BLUP) adjusted values of the vein density trait in vein_density_blups.tsv, and (v) GWAS results for the vein density trait, including chromosome positions and corresponding P values, in gwas_results.csv.

09 BIOMASS FUELS↗

Hindsight logging for model training

In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.

Computer Science↗

The SCEC Unified Community Velocity Model Software Framework

Crustal seismic-velocity models and datasets play a key role in regional 3D numerical earthquake ground-motion simulation, full waveform tomography, and modern physics-based probabilistic earthquake-hazard analysis, as well as in other related fields, including geophysics and earthquake engineering. Most of these models and datasets, often collectively identified as Community Velocity Models (CVMs), synthesize information from multiple sources and are delivered to users in variable formats, including computer applications that allow for interactive querying of material properties, namely P- and S-wave velocities and density ρ. Computational users often require massive and repetitive access to velocity models and datasets, and such access is often unpractical and difficult due to a lack of standardized methods and procedures. To overcome these issues and to facilitate access by the community to these models, the Southern California Earthquake Center developed the Unified CVM (UCVM) software framework, an open-source collection of tools that enables users to access one or more seismic-velocity models, while providing a standard query interface. Here, we describe the research challenges that motivated the development of UCVM, its software design, development approach, and basic capabilities, as well as a few examples of seismic-modeling applications that use UCVM.

Geochemistry & Geophysics↗

Scalable Metadata Management for a Large Multi-Source Seismic Data Repository

In this work, we implemented the key metadata management components of a scalable seismic data ingestion framework to address limitations in our existing system, and to position it for anticipated growth in volume and complexity. We began the effort with an assessment of open source data flow tools from the Hadoop ecosystem. We then began the construction of a layered architecture that is specifically designed to address many of the scalability and data quality issues we experience with our current pipeline. This included implementing basic functionality in each of the layers, such as establishing a data lake, designing a unified metadata schema, tracking provenance, and calculating data quality metrics. Our original intent was to test and validate the new ingestion framework with data from a large-scale field deployment in a temporary network. This delivered somewhat unsatisfying results, since the new system immediately identified fatal flaws in the data relatively early in the pipeline. Although this is a correct result it did not allow us to sufficiently exercise the whole framework. We then widened our scope to process all available metadata from over a dozen online seismic data sources to further test the implementation and validate the design. This experiment also uncovered a higher than expected frequency of certain types of metadata issues that challenged us to further tune our data management strategy to handle them. Our result from this project is a greatly improved understanding of real world data issues, a validated design, and prototype implementations of major components of an eventual production framework. This successfully forms the basis of future development for the Geophysical Monitoring Program data pipeline, which is a critical asset supporting multiple programs. It also positions us very well to deliver valuable metadata management expertise to our sponsors, and has already resulted in an NNSA Office of Defense Nuclear Nonproliferation commitment to a multi-year project for follow-on work.

58 GEOSCIENCES↗

RADIUSS Policies and Guidelines

RADIUSS aims to provide a set of broadly-used open-source libraries and tools used for HPC scientific application development.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Approach to DevOps and Microservices

This report presents work performed in 2017 and is a reissue of the end-of-year report SAND2018-0240, A Proof-of-Concept Approach to DevOps and Microservices, January 2018, modified for unlimited release. This report describes the approach, investigation, and prototyping efforts to create an API management solution and automated deployment pipeline for REST-based microservices. Additionally, it reviews: the microservices created for testing purposes; our experiences and results in using an open-source API management tool; and future plans.

97 MATHEMATICS AND COMPUTING↗

NRAP-Open-IAM Multisegmented Wellbore Reduced-Order Model

Geologic carbon storage is one of the promising strategies to mitigate climate change by reducing the emission of carbon dioxide to the atmosphere. As part of the National Risk Assessment Partnership (NRAP), a systems-level stochastic analysis tool called the open source integrated assessment model, NRAP-Open-IAM, has been developed to estimate and manage the risk of containment loss at a geological carbon sequestration site. NRAP-Open-IAM contains several wellbore leakage model components that estimate the fluid leak rate that may occur through compromised legacy wells due to the increase in pressure resulting from CO 2 injection activities. Coupled to a reservoir component model, these components estimate the leakage of CO 2 and/or brine from a storage reservoir to overlying aquifer layers and the atmosphere through legacy wells. This report presents the theoretical framework and quality testing of the multisegmented wellbore reduced-order model. The model allows for segmenting of the legacy wells passing through the overlying stratigraphy into several intervals to simulate a site’s specific stratigraphic and hydrogeologic properties. For quality assurance, the analytical model is validated against numerical reservoir flow simulations for single and multiple aquifer(s) models. The results indicate that the model accurately predicts the transport of two-phase fluids (brine and injected CO 2 ) through the well over time. A detailed description of the model helps users to understand the model and provides a basis for future improvements.

58 GEOSCIENCES↗

Closing the loop between in-situ stress complexity and EGS fracture complexity

The goal of the project is to employ a combination of high-fidelity simulations and true-triaxial block fracturing tests at high temperature to explore the intricate relationship between in-situ stress and hydraulic fracture patterns and better characterize the in-situ stress at Utah FORGE. Laboratory experiments are used to validate numerical models and better understand the impact of various parameters (e.g., temperature, well orientation, stress, etc) on the hydraulic fracture nucleation process in EGS. The project will have a significant impact as it will (1) improve the characterization of the in-situ stress field at FORGE; (2) demonstrate how high-fidelity modeling tools can be employed to analyze data for EGS; (3) provide a unique set of high-temperature hydraulic fracturing experimental results for EGS to help identifying the most important components for in-situ stress estimation and to validate the current in-situ stress estimation theory and establish a strong foundation for proposing a new one; (4) provide a validated set of numerical tools in an open source simulation framework (GEOS) that can be used to model EGS.

15 GEOTHERMAL ENERGY↗

Design Methods, Tools, and Data for Ceramic Solar Receivers

This report presents the development of tools and methods for evaluating the reliability and performance of ceramic materials in high temperature solar receivers. As Concentrating Solar Power (CSP) technologies aim for higher operating temperatures to enhance efficiency and meet industrial process heat requirements, current high temperature metallic materials face challenges in maintaining structural integrity. This report explores advanced ceramics as a promising alternative, given their superior high temperature strength and lower thermal expansion, compared to metals. To address the need for effective ceramic receiver design tools, this report integrates statistical failure models of ceramics into the existing srlife tool: an open-source software package designed to estimate the life of high temperature CSP components. These failure models account for the inherent variability and flaw distribution in ceramics, as well as the impact of subcritical crack growth under high temperature cyclic loads. The report also presents experimental data collected for a commercially available ceramic material, SiC, and details the process of estimating reliability model parameters from these data. A comparative design analysis is then performed between ceramic (SiC) and metallic (current nickel-based superalloys A740H and A282) receiver. This comparison demonstrates that SiC receivers can achieve service life exceeding 30 years under high incident heat flux conditions, compared to just a few years for metallic receivers.

14 SOLAR ENERGY↗

Probabilistic Multi-Hazard Performance Assessment of Concrete Structures in Nuclear Installations

Concrete structures in nuclear installations are subject to time-dependent degradation mechanisms that can deteriorate their physical and mechanical properties, potentially exacerbating the risk of structural failure under external forces such as a seismic event. Previous research has extensively investigated the seismic response of nuclear concrete structures and the associated risk, as well as their effect on structural components safety margins. However, substantial work is still necessary to incorporate concrete aging effects into such evaluations. In fact, most models in the literature assume pristine concrete conditions and do not account for the impact of aging on the structural components’ fragility curves. This work identifies relevant time-dependent degradation mechanisms and provides simplified models to predict the the evolution of key material properties based on data from the literature. Namely, this work focuses on the aging effects of corrosion, alkali–silica reaction (ASR), and irradiation on reinforced concrete within US Department of Energy (DOE) nuclear facilities and nuclear power plants (NPP) structures. Furthermore, degradation models based on literature data are presented that define the relationship between probabilistic material properties and the concrete’s age. In this work, sampled material properties served as input for a simplified finite element model (FEM) of a critical nuclear structural system, with the output of the FEM being the seismic response for a given ground motion. The results of the FEM were then used within a probabilistic performance assessment with a statistically significant number of samples. The research presented herein addresses the detrimental effects of hazards caused by natural phenomena on deteriorated concrete elements of nuclear installations. This work directly benefits the safety analysis performed on US DOE/ National Nuclear Security Administration (NNSA) nuclear facilities located in areas prone to seismic activity. The results presented herein could aid in the improvement of DOE-STD-1020, the DOE Standard that addresses seismic risk analysis and capacity evaluation in DOE facilities. DOE-STD-1020 refers to the requirements in American Society of Civil Engineers (ASCE) 4-98, now superseded by ASCE 4-16, that shall be met in performing dynamic response analyses and generating in-structure response spectra, provided that such requirements are consistent with the requirements of ASCE/Structural Engineering Institute (SEI) 43-05. Moreover, the results presented herein could also aid in the updating of section C3.1.1. of ASCE 4-16 to account for the effects of aging on the stiffness of reinforced elements and American Concrete Institute (ACI) 349.3R-18, “Report on Evaluation and Repair of Existing Nuclear Safety-Related Concrete Structures.” Ultimately, this work can assist the risk assessment of potential lifetime extension of the existing US commercial nuclear fleet (light water reactors) and the safety analysis of the emerging advanced nuclear reactors. The proposed proof-of-concept methodology employs open-source DOE computational tools and is transferable to commercial software commonly used by engineering firms.

42 ENGINEERING↗

ACDC (Automated Campbell Diagram Code) [SWR-26-042]

This application provides a web-based graphical user interface to generating Campbell Diagrams and visualizing mode shapes for OpenFAST turbine models. Determining the aeroelastic stability and dynamic characteristics of wind turbines is a critical step in turbine design and analysis. Historically, extracting natural frequencies and mode shapes from OpenFAST—the industry-standard whole-turbine simulation code—has been a fragmented and tedious process. It required manual model configuration, command-line linearization execution, and complex post-processing via proprietary scripts to handle rotating-frame dynamics. To address these workflow bottlenecks, we present the Automated Campbell Diagram Code (ACDC), an open-source graphical software tool developed by the National Laboratory of the Rockies (NLR) under the DOE-funded Distributed Wind Aeroelastic Modeling (dWAM) project. ACDC streamlines the end-to-end linearization and stability analysis workflow into a single, intuitive cross-platform application. The software guides users through OpenFAST model configuration, definition of operating points, and the automated execution of steady-state trim and linearization simulations. Under the hood, ACDC automates the complex mathematical post-processing steps required for rotating systems, including Multi-Blade Coordinate (MBC) transformations, eigenanalysis, and advanced modal tracking utilizing the Modal Assurance Criterion (MAC) and spectral clustering. Finally, ACDC processes these results to automatically generate Campbell diagrams and features a robust 3D visualization engine to animate full-system mode shapes. By eliminating the reliance on external post-processing environments and manual data manipulation, ACDC significantly accelerates dynamic analysis and lowers the barrier to entry for wind energy researchers and engineers.

Summerville, Brent [National Laboratory of the Roc↗

Data Access Tools And Services At The Goddard Distributed Active Archive Center (GDAAC)

As one of the largest providers of Earth Science data from the Earth Observing System, GDAAC provides the latest data from the Moderate Resolution Imaging Spectroradiometer (MODIS), Atmospheric Infrared Sounder (AIRS), Solar Radiation and Climate Experiment (SORCE) data products via GDAAC's data pool (50TB of disk cache). In order to make this huge volume of data more accessible to the public and science communities, the GDAAC offers multiple data access tools and services: Open Source Project for Network Data Access Protocol (OPeNDAP), Grid Analysis and Display System (GrADS/DODS) (GDS), Live Access Server (LAS), OpenGlS Web Map Server (WMS) and Near Archive Data Mining (NADM). The objective is to assist users in retrieving electronically a smaller, usable portion of data for further analysis. The OPeNDAP server, formerly known as the Distributed Oceanographic Data System (DODS), allows the user to retrieve data without worrying about the data format. OPeNDAP is capable of server-side subsetting of HDF, HDF-EOS, netCDF, JGOFS, ASCII, DSP, FITS and binary data formats. The GrADS/DODS server is capable of serving the same data formats as OPeNDAP. GDS has an additional feature of server-side analysis. Users can analyze the data on the server there by decreasing the computational load on their client's system. The LAS is a flexible server that allows user to graphically visualize data on the fly, to request different file formats and to compare variables from distributed locations. Users of LAS have options to use other available graphics viewers such as IDL, Matlab or GrADS. WMS is based on the OPeNDAP for serving geospatial information. WMS supports OpenGlS protocol to provide data in GIs-friendly formats for analysis and visualization. NADM is another access to the GDAAC's data pool. NADM gives users the capability to use a browser to upload their C, FORTRAN or IDL algorithms, test the algorithms, and mine data in the data pool. With NADM, the GDAAC provides an environment physically close to the data source. NADM will benefit users with mining or offer data reduction algorithms by reducing large volumes of data before transmission over the network to the user.

Pham, Long↗

Further Development of Verification Check-Cases for Six- Degree-of-Freedom Flight Vehicle Simulations

This follow-on paper describes the principal methods of implementing, and documents the results of exercising, a set of six-degree-of-freedom rigid-body equations of motion and planetary geodetic, gravitation and atmospheric models for simple vehicles in a variety of endo- and exo-atmospheric conditions with various NASA, and one popular open-source, engineering simulation tools. This effort is intended to provide an additional means of verification of flight simulations. The models used in this comparison, as well as the resulting time-history trajectory data, are available electronically for persons and organizations wishing to compare their flight simulation implementations of the same models.

Jackson, E. Bruce↗

Optimizing Trajectories with Dymos

A live demonstration of the Open-Source trajectory analysis tool Dymos is given where it is used to solve a submarine intercept problem.

Falck, Robert D.↗

Concurrent Runtime Verification of Data Rich Events

This paper presents the open source runtime verification tool MESA (MEssage-based System Analysis), implemented in Scala, which supports concurrent monitors using the Actor model. Furthermore, the tool supports indexing (slicing) on the data values occurring in data-carrying events, for each individual monitor. The tool is generic in the sense that any monitoring system can be used for creating monitors. In this paper, we use the internal Scala DSL Daut for programming such in data parameterized state machines and temporal logic. To illustrate MESA/Daut, we present a case study that monitors flights from live U.S. airspace data streams, verifying that they conform to planned routes. With base in the case study, we then perform an extensive empirical study of the potential benefits from monitoring slices of a single property in concurrently executing actors. Due to the overhead of scheduling “small” actors (one for each slice or a small number of slices), it is not obvious that concurrent execution of such is beneficial. However, as a main result, we demonstrate that concurrent monitoring of slices to handle data-carrying events can provide considerable speed gains.

finite state machines↗

Research Report: Building a Wide Reach Corpus for Secure Parser Development

Whether developing from a specification or deriving parsers from samples, LangSec parser developers require widereach corpora of their target file format in order to identify key edge cases or common deviations from the format’s specification. In this work-in-progress paper, we report the details of several methods we’ve used to gather 30 million files, extract features and make these features amenable to search and other analytics. This paper documents opportunities and limitations of some popular open source data and tools and this paper will benefit researchers who need to efficiently gather a large file corpus.

Timmaraju, Virisha↗

Collaborating With Xarray to Enable Reading Hierarchical Data Files

NASA has a lot of expertise, but doesn’t need to write every single piece of code. Pangeo is a fantastic open-source community of tools for geoscience research. Xarray, a Python package, is a widely used part of this ecosystem for accessing and analyzing geoscience data.

Owen Littlejohns↗

JGI Genomic Single-cell Assembly Workflow

JIGSAW is a software package disigned to quality control and assemble genomic DNA sequences from single-cell bacterial and archaeal genomes. Amplification of singel-cell genomes using multiple displacement amplification technology presents challenges that magnify the amount of contaminants in the sample and produce non uniform depth of sequence coverage. these factors pose problems whan assembling the genomic data using currently availible short read assembles. The software addresses these problems by removing contaminants and normalizing the sequence read coverage prior to assemble. A hybrid assembly approach using two different open source genome assembly tools is then applied to piece together the DNA fragments. Additional reporting of QC metrics for the input sample and the genome assembly is provided for further analysis.

Trong, S.↗