Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Driving Next-Generation Workflows from the Data Plane

We observe the emergence of a new generation of scientific workflows that process data produced at a sustained rate by scientific instruments and large scale numerical simulations. This data is consumed by multiple analysis, visualization, or Machine Learning components not only to enable inference and justify the scientific program, but also to monitor and steer the evolution of these experiments. In such workflows, moving intermediate data efficiently is key to performance, more than efficiently scheduling computational tasks. However, most traditional workflow management systems focus on optimizing task scheduling and then deal with data management, assuming a “move little, compute for long” model, which makes them unfit to the efficient management of this new generation of workflows. Therefore, we advocate for a new way to manage scientific workflows. We propose to consider an efficiently and independently managed data plane that can store and stream data. Workflows compute components, in the application plane can then interact with the data plane, abstracted from complexities of data management. Then, the role of a workflow management system would become that of a control plane that allows users to connect services together to execute the workflow and manages connections between the application and data planes. In this position paper, we characterize several next-generation workflow motifs and describe how their interaction with the data plane is a challenge to traditional workflow management systems. Then, we express a set of requirements that a workflow management system should meet to efficiently manage next-generation workflows at different scales. Based on these requirements, we expose our vision of driving next-generation workflows from the data plane and list remaining open challenges.

Suter, Fred↗
DOE OSTI2025

Off-grid Persons and Communities

Shows a vision for using global weather data to help off-grid persons and communities make decisions about buildings and power systems (short 10 min presentation)

Villa, Daniel [Sandia National Laboratories (SNL-N↗
DOE OSTI2022

Affordable Artificial Intelligence-Assisted Machine Supervision System for the Small and Medium-Sized Manufacturers

With the rapid concurrent advance of artificial intelligence (AI) and Internet of Things (IoT) technology, manufacturing environments are being upgraded or equipped with a smart and connected infrastructure that empowers workers and supervisors to optimize manufacturing workflow and processes for improved energy efficiency, equipment reliability, quality, safety, and productivity. This challenges capital cost and complexity for many small and medium-sized manufacturers (SMMs) who heavily rely on people to supervise manufacturing processes and facilities. This research aims to create an affordable, scalable, accessible, and portable (ASAP) solution to automate the supervision of manufacturing processes. The proposed approach seeks to reduce the cost and complexity of smart manufacturing deployment for SMMs through the deployment of consumer-grade electronics and a novel AI development methodology. The proposed system, AI-assisted Machine Supervision (AIMS), provides SMMs with two major subsystems: direct machine monitoring (DMM) and human-machine interaction monitoring (HIM). The AIMS system was evaluated and validated with a case study in 3D printing through the affordable AI accelerator solution of the vision processing unit (VPU).

3D printing↗
DOE OSTI2023

Improvements in Reflected Target Non-intrusive Assessment (ReTNA)

Accurate optical surfaces are a primary driver of concentrated solar power plant performance. Errors in pointing and tracking mirrors, the canting of individual mirror facets, and the surface slope of the mirror itself can be caused by errors during assembly, transportation, wind loading, gravity, and many other sources. The tools that exist to measure these error sources today largely rely on fringe deflectometry (SOFAST, QDec, others), or photogrammetry with targets attached to the mirror surface. In 2022, NREL presented a new indoor optical measurement system to measure fully assembled heliostats during development and on the assembly line for quality assurance purposes, which has undergone significant development in the last year, including the installation of a new, larger laboratory setup. This system, called ReTNA (Reflected Target Non-intrusive Assessment), uses a printed pattern as a deflectometry target. Using printed pattern features as deflectometry targets instead of fringes allows the software to measure the surface slope in two dimensions, eliminating the need to for changing, projected targets. In the last year, NREL's ReTNA tool has been adapted to use a tall, thin target, that only spans one dimension of the mirror, and a camera moving on an automatic track system. We will present these new developments, including the new setup, target patterns, software methodology for fast, automatic optical analysis, and important lessons learned throughout the process. ReTNA results will be compared to established tools, to establish the uncertainty of this new method. ReTNA leverages recent improvements in computer vision and photogrammetry to remove as much careful calibration from the setup process as possible, making the tool low cost, simple, and portable. While it will not achieve the resolution of a fringe deflectometry system, its advantages make it well suited for CSP evaluation, and allow it to fill a different industry need.

concentrating solar power↗
DOE OSTI2024

Insights into Probing the Effect of Molecular Weight of Poly(carboxybetaine methacrylate) on the Performance of Forward Osmosis Desalination

Zwitterionic polymers have proven to be a promising nonfouling material that can be applied in the design of selective layers of thin film composite (TFC) membranes. Extending the permeability and usage of TFC membranes have attracted increasing interest in membrane-based desalination processes since water-flux reduction associated with biofouling nowadays persists as a common challenge. By virtue of its strong hydration, this polymer category is very useful to counteract biofouling in marine and biomedical systems, but the benefits from their application in membrane technology are still emerging. The efficacy of the nonfouling property as a function of the polymer’s molecular weight remains unknown. In pursuit of that vision, this study fosters new scientific insights via probing different molecular weights of poly(carboxybetain methacrylate) (PCBMA) coated on the surface as a selective layer for the prepared TFC membranes. The coated zwitterionic membranes (zM) exhibited excellent performance in preventing water flux decay in a bench-scale forward osmosis system. The prepared zM membranes revealed enhanced hydrophilic properties and retained their operational water flux when compared to the control. Our results suggest that using an intermediate-size molecular weight (PCBMA M n 50,000) will result in the best operational performance. The intermediate size resulted in the lowest flux decline rate (R t ) of 0.01 ± 0.001 (zM-50) when compared to the unmodified control membrane 0.56 ± 0.071 (M0) after using a model BSA foulant solution. Furthermore, all coated membranes exhibited similar trends in the observed reverse salt flux profiles, as well. In conclusion, the constructed zM membranes will serve as a model to develop further selective layers in the construction of TFC membranes.

36 MATERIALS SCIENCE↗
DOE OSTI2022

New Directions for Chemical Engineering

Over the past century, the work of chemical engineers has helped transform societies and the lives of individuals, from the synthetic fertilizers that helped feed the world to the development of novel materials used in fuels, electronics, medical devices, and other products. Chemical engineers' ability to apply systems-level thinking from molecular to manufacturing scales uniquely positions them to address today’s most pressing problems, including climate change and the overuse of resources by a growing population. New Directions for Chemical Engineering details a vision to guide chemical engineering research, innovation, and education over the next few decades. This report calls for new investments in U.S. chemical engineering and the interdisciplinary, cross-sector collaborations necessary to advance the societal goals of transitioning to a low-carbon energy system, ensuring our production and use of food and water is sustainable, developing medical advances and engineering solutions to health equity, and manufacturing with less waste and pollution. The report also calls for changes in chemical engineering education to ensure the next generation of chemical engineers is more diverse and equipped with the skills necessary to address the challenges ahead.

National Academies of Sciences, Engineering, and M↗
DOE OSTI2024

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗
DOE OSTI2020

Infrasound Needs from a Future Geophysical Facility

Since the start of the SAGE/GAGE era, infrasound has become increasingly popular as both dedicated infrasound deplayments or coupled with other geophysical sensors for monitoring and research purposes, with interdisciplinary applications in both Earth and Atmospheric science. Infrasound can be used to study and monitor a variety of hazards that occur at or near the surface, including volcanic eruptions, earthquakes, and rapid gravity-driven mass movements. Because of this, it can help address some of the questions raised by recent community vision initiatives such as SZ4D (increase the understanding of the processes underlying subduction geohazards) and ERUPT (further our understanding of volcanic systems to help inform eruption forecasting). Many of the recommendations included here are topics of focus at workshops and conferences, including most recently at the November 2019 CONVERSE infrasound workshop. As NSF plans the successor to SAGE/GAGE, we advocate including infrasound in addition to the already-supported fields of seismology and geodesy. The two main features that we would like to see in the new facility are: 1) a community pool of infrasound instrumentation, and 2) the continuation and expansion of data management resources provided by the IRIS DMC.

58 GEOSCIENCES↗
DOE OSTI2020

Physics Division Strategic Plan Fiscal Years 2020-2024

The vision of the Physics Division (PHY) at Argonne National Laboratory is to continue enhancing its role as a world-leading institution in basic nuclear physics research and its applications. Key to this vision is for PHY to continue to safely and effectively operate and evolve the capabilities of the Argonne Tandem Linac Accelerator System (ATLAS) facility to best serve its users. ATLAS is the Department of Energy (DOE) accelerator facility for low-energy nuclear physics research. The research carried out by PHY covers many themes in contemporary science but can be distilled into five areas of focus. These themes are interconnected, with continuously evolving synergies between the various groups and facilities in PHY and the broader Laboratory. This five-year strategic plan serves to illustrate our current capabilities and new directions related to these five areas of focus (ATLAS also develops an independent strategic plan): Accelerator research and design. The goal of this theme is to design, fabricate, test, and implement novel accelerator systems, with a focus on high-intensity ion and electron systems. These R&D activities have led to enhancements in the ATLAS accelerator system. Among others, the division’s accelerator systems are in use or planned for use at Fermilab, the Advanced Photon Source, and in a broad variety of applications at the Facility for Rare Isotope Beams (FRIB). Atom trapping and fundamental symmetries. The goal of this theme is to explore and exploit the uses of advanced laser cooling and trapping techniques to manipulate atoms. There are three main areas of focus. First is in the application of the atom trap trace analysis (ATTA) technique for age determination of groundwater and ice by using radio-krypton dating. The next two trapping-based programs involve tests of fundamental symmetries in nature: the cooling and trapping of radium-225 with the aim of determining limits on an observation of its electric dipole moment and precision measurements of the beta decay properties of helium-6 to set limits on the tensor coupling constant. This is complemented by measurements of similar properties in lithium-8 and boron-8. Nuclear astrophysics. The goal of this theme is to enhance our understanding of how elements are created in the universe via explosive nucleosynthesis and how stars evolve. To meet the challenges of this theme, many of the capabilities of ATLAS are being enhanced, including the development of new beams through a new in-flight separator (RAISOR) and the anticipated neutron-generator upgrade of the Californium Rare Isotope Breeder Upgrade facility (nuCARIBU). These are coupled to state-of-the-art instruments such as the Canadian Penning Trap, Helical Orbit Spectrometer, Gammasphere, GRETINA, Multi-Sampling Ionization Chamber, the Fragment Mass Analyzer, and Argonne Gas-filled Fragment Analyzer, and a new low-background experimental area for decay studies. Nuclear structure. The goal of this theme is to understand the structure of nuclei, both stable and radioactive, in terms of single-particle properties, their shapes, and the dynamics governing reactions between them. These include questions such as what are the limits of nuclear stability and what are the properties of super heavy nuclei. As with the nuclear astrophysics theme, the capabilities of ATLAS, guided by the ATLAS user community, are continuously being enhanced to this end. The Division has strategic initiatives to play a leading role in the development of instrumentation and research programs at the FRIB. Quantum chromodynamics (QCD) and hadron physics. The goal of this theme is to lead major research programs focused on revealing the quark and gluon structure of protons, neutrons, nuclei, and short-lived mesons and baryons. These involve major programs at Jefferson Lab, Fermilab, and smaller facilities. They are complemented by theoretical endeavors centered on the question of how hadrons and their properties emerge from QCD. Out of these activities arise strategic initiatives to play a major role in the forthcoming Electron-Ion Collider (EIC).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

FY25 Electric Grid Security Annual Report

Sandia’s Electric Grid Security program advances a national vision of energy dominance and accessibility, while applying our national security -emphasis on ensuring of a secure, resilient, and affordable electric system for all users. Our achievements reflect a strategic approach combining technology development; modeling, simulation, and data analytics; and partnered demonstrations and outreach to further the adoption of advanced grid and storage technologies. Our FY25 efforts leverage the strengths of our partnerships—spanning Sandia’s core science and technology competencies as well as external technology leaders—to develop the solutions today which enable the grid of tomorrow. Key accomplishments in this report that support our strategy span our technical program areas and include: • New open-source analytical tools for systems -level planning and optimization, including significant advances to the QuESt analytical environment; • Further advancement of artificial intelligence and machine learning to enhanced grid operations and planning as we rise to the challenge of new large loads; • Development of solid-state power conversion technologies and a new medium-voltage research lab; • New technologies to assess wildfire vulnerabilities and mitigate potential impacts; • Advanced applications of new cybersecurity technologies with industry partners; • Contributions to understanding the impacts of electromagnetic pulses and geomagnetic disturbances on grid components; and • Digital twin development for hybrid microgrids with multiple generators, storage, and loads. This report indicates key areas of research and engagement and summarizes the impact of Sandia’s contributions through notable accomplishments, journal publications, patents, and technical conferences and presentations. It is provided with the hope that readers discover ways we can further team to create our modern grid and apply the outcomes of our efforts. The bulk of work described herein is funded by several offices within the U.S. Department of Energy (USDOE), including the Office of Electricity (OE); Cybersecurity, Energy Security, and Emergency Response (CESER); former offices such as the Office of Energy Efficiency and Renewable Energy (EERE), the Grid Deployment Office (GDO), the Office of Clean Energy Demonstrations (OCED), and other key programs at USDOE. As we continue to state in these annual reports, the contributors to our successes are too numerous to name here, though our team wishes to express our deep gratitude to the numerous program and project sponsors at the US Department of Energy, who often function equally as technical collaborators; our many partners in industry, academia, utilities, and other national labs; and fellow researchers and business partners at Sandia whose leadership and creativity have enabled the accomplishments described herein.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Graph Neural Networks for Particle Reconstruction in High Energy Physics detectors

Pattern recognition problems in high energy physics are notably different from traditional machine learning applications in computer vision. Reconstruction algorithms identify and measure the kinematic properties of particles produced in high energy collisions and recorded with complex detector systems. Two critical applications are the reconstruction of charged particle trajectories in tracking detectors and the reconstruction of particle showers in calorimeters. These two problems have unique challenges and characteristics, but both have high dimensionality, high degree of sparsity, and complex geometric layouts. Graph Neural Networks (GNNs) are a relatively new class of deep learning architectures which can deal with such data effectively, allowing scientists to incorporate domain knowledge in a graph structure and learn powerful representations leveraging that structure to identify patterns of interest. In this work we demonstrate the applicability of GNNs to these two diverse particle reconstruction problems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

A New Reflected Target Optical Assessment System - Stage 1 Development Results: Preprint

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL's NIO technique. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements on fully assembled heliostats and parabolic trough facets, making it a valuable tool for quality assurance and laboratory measurement of helio-stat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. The measurement system's methodology and an analysis of its uncertainty, sensitivity and comparison with established optical measurement systems is described below.

canting↗
DOE OSTI2022

Roadmap to Automated Mobility Systems: Informing the Planning of a Sustainable, Resilient Transportation Ecosystem for Dallas/Fort Worth International Airport

The National Renewable Energy Laboratory (NREL) developed this report to provide Dallas/Fort Worth International Airport (DFW) assistance toward a vision that considers the maturation and proliferation of mobility automation, electrification, and infrastructure integrated with Internet of Things (IoT) technologies as they present themselves on the path to 2035. In planning ongoing infrastructure investments, DFW has goals to accommodate and leverage these enabling technologies toward greater sustainability and enhanced traveler and employee experiences, ensuring that infrastructure investments are fully utilized into the future. The objective of this document is to assist DFW to anticipate and envision future airport access by travelers, employees, and goods by examining existing needs and exploring opportunities enabled by technology that informs longer-term infrastructure planning. The vast infrastructure of DFW, which includes buildings, roadways, and other physical structures, as well as growing digital and energy network infrastructures, requires long-term planning and strategy to fully leverage technology advancement and avoid abandoning assets due to functional obsolescence.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

GIScience in the era of Artificial Intelligence: a research agenda towards Autonomous GIS

The advent of generative AI exemplified by large language models (LLMs) opens new ways to represent and compute geographic information and transcends the process of geographic knowledge production, driving geographic information systems (GIS) towards autonomous GIS. Leveraging LLMs as the decision core, autonomous GIS can independently generate and execute geoprocessing workflows to perform spatial analysis. In this vision paper, we further elaborate on the concept of autonomous GIS and present a conceptual framework that defines its five autonomous goals, five levels of autonomy, five core functions, and three operational scales. We demonstrate how autonomous GIS could perform geospatial data retrieval, spatial analysis, and map making with four proof-of-concept GIS agents. We conclude by identifying critical challenges and future research directions, including fine-tuning and self-growing decision-cores, autonomous modelling, and examining the societal and practical implications of autonomous GIS. By establishing the groundwork for a paradigm shift in GIScience, this paper envisions a future where GIS moves beyond traditional workflows to autonomously reason, derive, innovate, and advance geospatial solutions to pressing global challenges. Meanwhile, we emphasize that as we design and deploy increasingly intelligent geospatial systems, we carry a responsibility to ensure they are developed in socially responsible ways, serve the public good, and support the continued value of human geographic insight in an AI-augmented future.

Autonomous GI↗
DOE OSTI2021

Encoder–decoder neural network for solving the nonlinear Fokker–Planck–Landau collision operator in XGC

An encoder–decoder neural network has been used to examine the possibility for acceleration of a partial integro-differential equation, the Fokker–Planck–Landau collision operator. This is part of the governing equation in the massively parallel particle-in-cell code XGC, which is used to study turbulence in fusion energy devices. The neural network emphasizes physics-inspired learning, where it is taught to respect physical conservation constraints of the collision operator by including them in the training loss, along with the ℓ 2 loss. In particular, network architectures used for the computer vision task of semantic segmentation have been used for training. A penalization method is used to enforce the ‘soft’ constraints of the system and integrate error in the conservation properties into the loss function. During training, quantities representing the particle density, momentum and energy for all species of the system are calculated at each configuration vertex, mirroring the procedure in XGC. This simple training has produced a median relative loss, across configuration space, of the order of 10 –4 , which is low enough if the error is of random nature, but not if it is of drift nature in time steps. The run time for the current Picard iterative solver of the operator is O(n 2 ), where n is the number of plasma species. As the XGC1 code begins to attack problems including a larger number of species, the collision operator will become expensive computationally, making the neural network solver even more important, especially since its training only scales as O(n). Here, a wide enough range of collisionality has been considered in the training data to ensure the full domain of collision physics is captured. An advanced technique to decrease the losses further will be subject of a subsequent report. Eventual work will include expansion of the network to include multiple plasma species.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Raw_data_Batch_I: Argonne to Shorewood via I-55

Date of collection: May 12, 2023 Location: Interstate 55, DuPage County, IL This data set contains lidar and vision data collected along a round trip between I-55 Exit 273A and Exit 253. The data contains the following Robot Operating System (ROS) topics: - /Central_Camera_blurred – Image flow from coaxial camera heading, vehicle front. - /Left_Camera_blurred – Image flow from left camera, 60° from central camera on the left side. - /Right_Camera_blurred – Image flow from right camera, 60° from central camera on the right side. - /camera0/camera_info – Intrinsic and distortion information of left camera. - /camera0/projection_matrix – Extrinsic matrix of left camera from lidar. - /camera2/camera_info – Intrinsic and distortion information of central camera. - /camera2/projection_matrix – Extrinsic matrix of central camera from lidar. - /camera5/camera_info – Intrinsic and distortion information of right camera. - /camera5/projection_matrix – Extrinsic matrix of right camera from lidar. - /novatel/oem7/bestpos – Latitude, longitude, and elevation information from NovAtel GNSS-INS system. - /points_raw – VLP-32 lidar point cloud. - /tf – Vehicle base frame. The data are organized into a data description file and one or more ROS .bag files, dependent on original file size. The data description file provides information about the data collection date, location, and detailed mapping, while the .bag file(s) contain the actual data. Please note that for the purpose of securing personally identifiable information, all license plates and faces included in this publication have been intentionally blurred during real-time processing. ![argonne shorewood image](argone-shorewood.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Closing transdisciplinary collaboration gaps of food-energy-water nexus research

The nexus of food, energy, and water (FEW) systems is key to ensuring global sustainability in the face of climate change, population growth, and urbanization. To address FEW resources inequity among different regions and countries, transdisciplinary research networking becomes increasingly important for tackling this intractable, complex grand challenge. In contrast to interdisciplinary or multidisciplinary research, transdisciplinary research emphasizes the interactions of scientific, cognitive, and social factors from a top-down view. Intellectual and strategic integrations entail weaving scientific, socioeconomic, and political perspectives together into a new convergence model and fostering a shared vision and comparable assessment, though these goals might not be realistically achievable in the short term. This article summarizes major barriers to transdisciplinary research on FEW nexus grand challenges and possible solutions to be implemented at multiple levels of distinct social systems. Implementation of the solutions relies on not only top-down incentives of governments but also bottom-up initiatives of academic communities and individual researchers. The relevance of shared interests and visions between the research communities and the public is emphasized.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗