SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
On July 12, 2023, the Advanced Information Systems Technology (AIST) program conducted grouped annual reviews of all its Novel Observing Strategies (NOS) projects. This report regroups all these technical presentations.
On September 18, 2023, NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program conducted a mini-workshop that brought together seven experts to survey and discuss "Standards for Interoperable Digital Twins". Since three years, the AIST Program has been developing technologies and prototypes for Earth System Digital Twins (ESDT). During those developments and after the ESDT Workshop held in October 2022, it became clear that standard for ESDT interoperability were needed and should be defined as soon as possible. To address this challenge, the AIST program will survey ongoing development for Digital Twins standards in various domains and the September 18, 2023 Workshop represented the first step towards this understanding. Speakers during this event included: Michael Grieves (Digital Twin Institute), Siri Jodha Singh Khalsa (IEEE GRSS Standards), Trent Tinker (OGC), Ryan Berkheimer (NOAA), John Stone (NVIDIA), Thomas Geenen (ECMWF-DestinE) and Arne Berre (SINTEF-Iliad DTO and EDITO). This presentation regroups all the speakers' presentations.
On September 18, 2023, NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program conducted a mini-workshop that brought together seven experts to survey and discuss "Standards for Interoperable Digital Twins". Since three years, the AIST Program has been developing technologies and prototypes for Earth System Digital Twins (ESDT). During those developments and after the ESDT Workshop held in October 2022, it became clear that standard for ESDT interoperability were needed and should be defined as soon as possible. To address this challenge, the AIST program will survey ongoing development for Digital Twins standards in various domains and the September 18, 2023 Workshop represented the first step towards this understanding. Speakers during this event included: Michael Grieves (Digital Twin Institute), Siri Jodha Singh Khalsa (IEEE GRSS Standards), Trent Tinker (OGC), Ryan Berkheimer (NOAA), John Stone (NVIDIA), Thomas Geenen (ECMWF-DestinE) and Arne Berre (SINTEF-Iliad DTO and EDITO). This movie represents the recording of this event.
NASA AIST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest, dynamic Forecasting models, and Impact Assessment capabilities. In order to define ESDT's benefits to Earth Science, as well as the AIST capabilities required to develop such systems, the AIST Program has been developed 6 science use cases corresponding to 6 of the main Earth Science domains.
"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."
I will present an overview (in French) of the AIST Program with a particular emphasis on Earth system Digital Twins (ESDT) and on the collaborative work the AIST Program is currently conducting with CNES.
NASA’s Earth Science Technology Office (ESTO) has established a new program called Technology Development for support of Wildfire Science, Management, and Disaster Mitigation (FireSense Technology), to develop innovative new technologies and capabilities to better predict, monitor and manage wildfires and their impacts. ESTO’s FireSense Technology program works in collaboration with NASA’s Applied Sciences Wildland Fire Program, the Aeronautics Research Mission Directorate (ARMD), the Space Technology Mission Directorate (STMD), and the Small Business Innovative Research (SBIR) program. The program will also work closely with interagency partners such as the National Oceanic and Atmospheric Administration (NOAA), the U.S. Department of Agriculture Forest Service, the California Department of Forestry and Fire Protection, the National Interagency Fire Center, and others. In this paper we will discuss the program objectives and provide an update on the technological developments to date.
Please download and open the zip folder on your system to view the talks. As part of AI-UK'2024 (organized by UK Turing Institute), Jacqueline Le Moigne and Robert Morris (NASA ARC AIST Associate) were part of a Panel on "Digital Twins of the Environment". We described what Earth System Digital Twins (ESDTs) are, how they could be used in the future, which technologies need to be developed for these ESDTs to become a reality and what the state-of-the-art is. No formal presentations were given but 2 videos were generated during the conference and will be posted on the AI-UK website: https://www.turing.ac.uk/events/ai-uk-2024. The 2 videos cover: (1) a recording of the entire Panel featuring Robert Morris/NASA ARC and Jacqueline Le Moigne/ESTOl; (2) a post-panel interview of Jacqueline Le Moigne.
IEEE SIgnal Processing Society (SPS) and Women in Signal Processing (WiSP) Webinar (https://signalprocessingsociety.org/blog/webinar-wisp-blood-platelets-classification-earth-system-digital-twins-career-computer-vision): Join us for an interactive session with Dr. Jacqueline Le Moigne, Manager of the NASA Science Mission Directorate Earth Science Technology Office’s Advanced Information Systems Technology Program. In this webinar, Dr. Le Moigne will share her journey through academia, the private sector, and her pivotal roles at NASA, emphasizing her work in signal processing, computer vision, and related technologies. The webinar will conclude with an interactive Q&A session, providing attendees the opportunity to engage directly with Dr. Le Moigne about her experiences and insights. Dr. Jacqueline Le Moigne manages NASA's Advanced Information Systems Technology Program, focusing on novel technologies that support Earth Science missions. She previously held roles at NASA Goddard, including Assistant Chief for Technology, and has worked on NASA's Space Technology Research Grants Program and Technology Roadmaps. Before NASA, she was a Research Scientist at the University of Maryland's Computer Vision Laboratory and also gained experience in the private sector. Jacqueline earned her Ph.D. in Computer Science from the University Pierre and Marie Curie in Paris. Her research interests include Image Registration, Computer Vision, Artificial Intelligence, Autonomous Systems, Distributed Spacecraft Missions (DSM), and Earth System Digital Twins (ESDT), as well as high-performance and onboard computing. She has authored over 180 publications, including books and patents, and has received multiple awards, including the NASA Exceptional Service Medal and the Goddard Information Science and Technology Award in 2012.
Explore the source record for details and available documents.
NASA, ESA, NOAA, CNES and several other international organizations have started programs to design and develop Digital Twins of the Earth and/or Earth systems. Earth Systems Digital Twins (ESDTs) are dynamic and interactive information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest (or “What Now”), dynamic Forecasting models (or “What Next”), and Impact Assessment capabilities (or “What If”). ESDTs provide unified, comprehensive representations and predictions that can be utilized for monitoring the health of the Planet, as well as for developing actionable information to support decision making. More generally, Digital Twins will help researchers better understand the fundamental Earth systems that impact everything from wildfires to climate change. This Townhall will provide a status of Destination Earth as well as ESA’s, NASA’s, CNES’s and NOAA’s current independent and common efforts in Digital Twins; then the four organizations will provide information about community building before engaging a dialogue about Digital Twins of the Earth with the IGARSS community.
NASA IST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Earth System Digital Twins (ESDTs) are information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. In order to define ESDT's technologies and architectures that will be needed for developing future operational ESTDs, the IST Program is developing several ESDT prototypes representing various use case domains and technological/architectural needs.
NASA IST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Earth System Digital Twins (ESDTs) are information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. This presentation will address the main technology and architecture challenges that need to be addressed to develop end-to-end ESDTs; along with these challenges, some of the solutions proposed by IST projects will be discussed.
An Earth System Digital Twin (or ESDT) is an Information System for Understanding, Forecasting, and Conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. More specifically, an Earth System Digital Twin is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system, as accurately and timely as possible (i.e., the “What Now”); second allows for computing forecasts of future states under nominal assumptions and based on the current replica (i.e., the “What Next”); and third offers the capability to investigate many hypothetical scenarios under varying impact assumptions (i.e., the “What If”). The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. Since 2020, NASA’s Earth Science Technology’s Intelligent Systems Programs have started defining and investigating ESDTs. After several workshops, more than 15 projects have been funded to develop technologies and components as well as a few prototype ESDT systems. An ESDT architecture framework has been defined, and it is now being used to develop a Coastal Zone Digital Twin (CZ-DT), in coordination with NOAA and CNES. Additional projects have also just been selected to build additional ESDT technologies and prototypes. The details of these Programs will be detailed at the conference.
The NASA Earth Science Enterprise Advanced Technology Initiatives Program is supporting a program for the development of semiconductor laser reference oscillators for application to coherent optical remote sensing from Earth orbit. Local oscillators provide the frequency reference required for active spaceborne optical remote sensing concepts that involve heterodyne (coherent) detection. Two recent examples of such schemes are Doppler wind lidar and tropospheric carbon dioxide measurement by laser absorption spectrometry, both of which are being proposed at a wavelength of 2.05 microns. Frequency-agile local oscillator technology is important to such applications because of the need to compensate for large platform-induced Doppler components that would otherwise interfere with data interpretation. Development of frequency-agile local oscillator approaches has heretofore utilized the same laser material as the transmitter laser (Tm,Ho:YLF in the case of the 2.05-micron wavelength mentioned above). However, a semiconductor laser-based frequency-agile local oscillator offers considerable scope for reduced mechanical complexity and improved frequency agility over equivalent crystal laser devices, while their potentially faster tuning capability suggest the potential for greater scanning versatility. The program we report on here is specifically tasked with the development of prototype novel architecture semiconductor lasers with the power, tunability, and spectral characteristics required for coherent Doppler lidar. The baseline approach for this work is the distributed feedback (DFB) laser, in which gratings are etched into the semiconductor waveguide structures along the entire length of the laser cavity. However, typical DFB lasers at the wavelength of interest have linewidths that exhibit unacceptable growth when driven at the high currents and powers that are required for the Doppler lidar application. Suppression of this behavior by means of corrugation pitch-modulation (using a detuned central section to prevent intensity peaking in the center of the cavity) is currently under investigation to achieve the required performance goals.
Satellite remote sensing technology has contributed to the transformation of multiple earth science domains, putting space observations at the forefront of innovation in earth science. With new satellite missions being launched every year, new types of earth science data are being incorporated into science models and decision-making systems in a broad array of organizations. Policy guidance can influence the degree to which user needs influence mission design and when, and ensure that satellite missions serve both the scientific and user communities without becoming unfocused and overly expensive. By considering the needs of the user community early on in the mission-design process, agencies can ensure that satellites meet the needs of multiple constituencies. This paper describes the mission development process in NASA and ESA and compares and contrasts the successes and challenges faced by these agencies as they try to balance science and applications within their missions.
The Earth science community needs to generate consistent and standard definitions for spatial, spectral, radiometric, and geometric properties describing passive electro-optical Earth observing sensors and their products. The parameters used to describe sensors and to describe their products are often confused. In some cases, parameters for a sensor and for its products are identical; in other cases, these parameters vary widely. Sensor parameters are bound by the fundamental performance of a system, while product parameters describe what is available to the end user. Products are often resampled, edge sharpened, pan-sharpened, or compressed, and can differ drastically from the intrinsic data acquired by the sensor. Because detailed sensor performance information may not be readily available to an international science community, standardization of product parameters is of primary performance. Spatial product parameters described include Modulation Transfer Function (MTF), point spread function, line spread function, edge response, stray light, edge sharpening, aliasing, ringing, and compression effects. Spectral product parameters discussed include full width half maximum, ripple, slope edge, and out-of-band rejection. Radiometric product properties discussed include relative and absolute radiometry, noise equivalent spectral radiance, noise equivalent temperature diffenence, and signal-to-noise ratio. Geometric product properties discussed include geopositional accuracy expressed as CE90, LE90, and root mean square error. Correlated properties discussed include such parameters as band-to-band registration, which is both a spectral and a spatial property. In addition, the proliferation of staring and pushbroom sensor architectures requires new parameters to describe artifacts that are different from traditional cross-track system artifacts. A better understanding of how various system parameters affect product performance is also needed to better ascertain the utility of existing datasets and products as well as to specify the performance of new sensors and products. Examples of simulations performed for the Landsat Data Continuity Mission illustrate how various parameters affect system and product performance. Specific examples include the effects of ground sample distance, MTF, and band-to-band registration on various products.
The presentation describes data management of NASA remote sensing data for Northern Eurasia Earth Science Partnership Initiative (NEESPI). Many types of ground and integrative (e.g., satellite, GIs) data will be needed and many models must be applied, adapted or developed for properly understanding the functioning of Northern Eurasia cold and diverse regional system. Mechanisms for obtaining the requisite data sets and models and sharing them among the participating scientists are essential. The proposed project targets integration of remote sensing data from AVHRR, MODIS, and other NASA instruments on board US- satellites (with potential expansion to data from non-US satellites), customized data products from climatology data sets (e.g., ISCCP, ISLSCP) and model data (e.g., NCEPNCAR) into a single, well-architected data management system. It will utilize two existing components developed by the Goddard Earth Sciences Data & Information Services Center (GES DISC) at the NASA Goddard Space Flight Center: (1) online archiving and distribution system, that allows collection, processing and ingest of data from various sources into the online archive, and (2) user-friendly intelligent web-based online visualization and analysis system, also known as Giovanni. The former includes various kinds of data preparation for seamless interoperability between measurements by different instruments. The latter provides convenient access to various geophysical parameters measured in the Northern Eurasia region without any need to learn complicated remote sensing data formats, or retrieve and process large volumes of NASA data. Initial implementation of this data management system will concentrate on atmospheric data and surface data aggregated to coarse resolution to support collaborative environment and climate change studies and modeling, while at later stages, data from NASA and non-NASA satellites at higher resolution will be integrated into the system.