The Use of Multimodal Remote Sensing Data for NASA's Advanced Information Systems
Explore the source record for details and available documents.
Earth Science Remote Sensing↗
SEARCH · Search NASA
Results for “Earth Science Remote Sensing; Information Systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
NASA Earth Systems Digital Twins (ESDT)
"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."
Earth Science Remote Sensing; Information Systems↗
Earth System Digital Twins (ESDT) Workshop
"The Earth Science Information Partners (ESIP) is hosting an Earth System Digital Twins (ESDT) workshop in collaboration with NASA’s Advanced Information Systems Technology (AIST) Program. The event will bring together science and technology communities to explore the use and benefits of ESDT and their enabling technologies. This workshop is one of the first steps in developing ESDT reference use cases and corresponding technology needs to guide the development of ESDT technologies that will be needed by NASA Earth Science within the next five to ten years. The workshop goals are to: • identify driving Earth science use cases that will benefit from unique ESDT capabilities • identify emerging technologies that will enable such ESDT systems within the next five to ten years • understand opportunities and technologies for federating ESDTs and creating more capable systems"
Earth Science Remote Sensing; Information Systems↗
Information Systems Technology for NASA Earth Systems Digital Twins (ESDT)
The term “Digital Twin” was first used in 2002 for product lifecycle management. Since then, Digital Twin concepts have been proposed in various domains until very recently for Earth Science. For NASA’s Advanced Information Systems Technology (AIST) Program, an Earth System Digital Twin (ESDT) is defined as composed of three components: 1. A Digital Replica, i.e., an integrated picture of the past and current states of Earth systems 2. Forecasting capabilities, providing an integrated picture of how Earth systems will evolve in the future from the current state 3. Impact Assessment capabilities, providing an integrated picture of how Earth systems could evolve under different hypothetical what-if scenarios. Developing such a vision will require technologies related to: integrating continuous observations from various disparate sources; developing frameworks that builds on inter-connected models; improving the speed and accuracy of integrated prediction, analysis and visualization capabilities (e.g., by using machine learning); and utilizing causality and uncertainty quantification to improve our understanding of the evolution of Earth Science systems as a function of their interactions with other Earth and human systems. In addition, AIST is also investigating interoperability standards to federate multiple Digital Twins, as well as computational resources required by those systems.
Earth Science Remote Sensing; Information Systems↗
NASA Earth Observing System Data and Information System (EOSDIS): A U.S. Network of Data Centers Serving Earth Science Data: A Network Member of ICSU WDS
NASA's Earth Observing System Data and Information System (EOSDIS) has been in operation since August 1994, and serving a diverse user community around the world with Earth science data from satellites, aircraft, field campaigns and research investigations. The ESDIS Project, responsible for EOSDIS is a Network Member of the International Council for Sciences (ICSU) World Data System (WDS). Nine of the 12 Distributed Active Archive Centers (DAACs), which are part of EOSDIS, are Regular Members of the ICSUWDS. This poster presents the EOSDIS mission objectives, key characteristics of the DAACs that make them world class Earth science data centers, successes, challenges and best practices of EOSDIS focusing on the years 2014-2016, and illustrates some highlights of accomplishments of EOSDIS. The highlights include: high customer satisfaction, growing archive and distribution volumes, exponential growth in number of products distributed to users around the world, unified metadata model and common metadata repository, flexibility provided to uses by supporting data transformations to suit their applications, near-real-time capabilities to support various operational and research applications, and full resolution image browse capabilities to help users select data of interest. The poster also illustrates how the ESDIS Project is actively involved in several US and international data system organizations.
Earth Science↗
Advanced Information Systems Technology (AIST) Overview & Current and Recent Projects
"NASA's Advanced Information Systems Technology (AIST) Program identifies, develops, and supports adoption of software and information systems, as well as novel computer science technologies expected to be needed by the Earth Science Division in the 5-10-year timeframe. Overall, the AIST Program is focusing on advanced technologies and innovative concepts with three main objectives: O1. Enable new observation measurements and new observing systems design and operations through intelligent, timely, dynamic, and coordinated distributed sensing; O2. Enable agile science analyses that fully utilize the large amount of diverse observations using advanced analytic tools, visualizations, and computing environments, and that interact seamlessly with relevant observing systems; O3. Enable the development of integrated Earth Science frameworks that mirror the Earth with state-of-the-art models (Earth system models and others), timely and relevant observations, and analytic tools. This thrust will provide technology for enabling near- and long-term science and policy decisions (""""science decisions"""" including planning for the acquisition of new measurements; the development of new models or science analysis; the integration of Earth observations in novel ways; applications to inform choices, support decisions, and guide actions for societal benefit; etc.). AIST objectives aim at optimizing Earth Science mission return – NOS from an observation point of view and ACF/ESDT from an information analysis and utilization point of view. The assets and data accessed and utilized in these systems may come from NASA and non-NASA sources. "
Earth Science Remote Sensing; Information Systems↗
2023 Advanced Information Systems Technology (AIST) Novel Observing Strategies (NOS) Grouped Annual Reviews
On July 12, 2023, the Advanced Information Systems Technology (AIST) program conducted grouped annual reviews of all its Novel Observing Strategies (NOS) projects. This report regroups all these technical presentations.
Earth Science Remote Sensing; Information Systems↗
Earth System Digital Twins (ESDT) Definition and Science Use Cases
NASA AIST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest, dynamic Forecasting models, and Impact Assessment capabilities. In order to define ESDT's benefits to Earth Science, as well as the AIST capabilities required to develop such systems, the AIST Program has been developed 6 science use cases corresponding to 6 of the main Earth Science domains.
Earth Science Remote Sensing; Information Systems↗
Artificial Intelligence for Future Earth Science Information Systems and Earth System Digital Twins
NASA's Advanced Information Systems Technology (AIST) Program is one of several Technology programs managed by the Earth Science Technology Office (ESTO) in the Earth Science Division (ESD). The AIST Program focuses on advanced information systems and novel computer science technologies that will be needed by NASA Earth Science in the next 5 to 10 years. The three main thrusts of the AIST Program deal with Novel Observing Strategies (NOS), Analytic Collaborative Frameworks (ACF) and Earth System Digital Twins (ESDT). This presentation summarizes the AIST Program with a special focus on the Artificial Intelligence (AI) and Machine Learning (ML) technologies included in its funded projects.
Earth Science Remote Sensing; Information Systems↗
Towards Earth System Digital Twins (ESDT)
I will present an overview (in French) of the AIST Program with a particular emphasis on Earth system Digital Twins (ESDT) and on the collaborative work the AIST Program is currently conducting with CNES.
Earth Science Remote Sensing; Information Systems↗
Novel Observing Strategies (NOS) and Earth System Digital Twins (ESDT) for Disaster Resilience
"Earth systems have now been observed continuously for more than 50 years, not only from space but also from airplanes, balloons and in-situ sensors. With the addition of commercial remote sensing providers, many more Internet-of-Things sensors and new NASA and international observatories being planned, these incredible amounts of data will soon be augmented by even larger amounts of diverse data and therefore will become more and more difficult to access, integrate, understand and utilize. At the same time, because of climate change and its impacts, in order to predict, manage, and mitigate the effects of extreme science events and disasters, the information produced by all of this data needs to be optimized, organized and analyzed in such a way that it can be utilized by traditional as well as many new non-traditional users. This calls for the development of observing systems that are agile, coordinated and responsive to events of interest, and for information systems to be dynamic, interactive and fast. With these objectives in mind, the Advanced Information Systems Technology (AIST) Program has been developing technologies that will allow for the development of Novel Observing Strategies (NOS) in a distributed, coordinated fashion (i.e., similar to an “Internet-of-Earth-Things”), as well as for the development of novel information systems or Earth System Digital Twins (ESDT) that will build a digital replica of the past and current states of the Earth systems, will derive forecasts of future states under nominal assumptions and will also offer the capability to investigate many hypothetical evolution scenarios under varying impact assumptions. Both NOS and ESDT will be facilitated by the unprecedented advances of Artificial Intelligence technologies, especially Machine Learning (ML), for extracting relevant information from these large amounts of data, for fusing and assimilating diverse data together and for running complex models faster. Together NOS and ESDT will help build the capabilities needed to anticipate, predict and mitigate the effects of future disasters."
Earth Science Remote Sensing; Information Systems↗
NASA Earth System Digital Twins (ESDT) Prototypes
NASA IST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Earth System Digital Twins (ESDTs) are information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. In order to define ESDT's technologies and architectures that will be needed for developing future operational ESTDs, the IST Program is developing several ESDT prototypes representing various use case domains and technological/architectural needs.
Earth Science Remote Sensing↗
Technology for Earth System Digital Twins
NASA IST Program is now designing and developing Digital Twins of the Earth and/or Earth systems. Earth System Digital Twins (ESDTs) are information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. This presentation will address the main technology and architecture challenges that need to be addressed to develop end-to-end ESDTs; along with these challenges, some of the solutions proposed by IST projects will be discussed.
Earth Science Remote Sensing; Information Systems↗
NASA Earth System Digital Twins (ESDT) For a Sustainable Future
An Earth System Digital Twin (or ESDT) is an Information System for Understanding, Forecasting, and Conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. More specifically, an Earth System Digital Twin is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system, as accurately and timely as possible (i.e., the “What Now”); second allows for computing forecasts of future states under nominal assumptions and based on the current replica (i.e., the “What Next”); and third offers the capability to investigate many hypothetical scenarios under varying impact assumptions (i.e., the “What If”). The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. Since 2020, NASA’s Earth Science Technology’s Intelligent Systems Programs have started defining and investigating ESDTs. After several workshops, more than 15 projects have been funded to develop technologies and components as well as a few prototype ESDT systems. An ESDT architecture framework has been defined, and it is now being used to develop a Coastal Zone Digital Twin (CZ-DT), in coordination with NOAA and CNES. Additional projects have also just been selected to build additional ESDT technologies and prototypes. The details of these Programs will be detailed at the conference.
Earth Science Remote Sensing; Information Systems↗
From Blood Platelets Classification to Earth System Digital Twins: A Career in Computer Vision
IEEE SIgnal Processing Society (SPS) and Women in Signal Processing (WiSP) Webinar (https://signalprocessingsociety.org/blog/webinar-wisp-blood-platelets-classification-earth-system-digital-twins-career-computer-vision): Join us for an interactive session with Dr. Jacqueline Le Moigne, Manager of the NASA Science Mission Directorate Earth Science Technology Office’s Advanced Information Systems Technology Program. In this webinar, Dr. Le Moigne will share her journey through academia, the private sector, and her pivotal roles at NASA, emphasizing her work in signal processing, computer vision, and related technologies. The webinar will conclude with an interactive Q&A session, providing attendees the opportunity to engage directly with Dr. Le Moigne about her experiences and insights. Dr. Jacqueline Le Moigne manages NASA's Advanced Information Systems Technology Program, focusing on novel technologies that support Earth Science missions. She previously held roles at NASA Goddard, including Assistant Chief for Technology, and has worked on NASA's Space Technology Research Grants Program and Technology Roadmaps. Before NASA, she was a Research Scientist at the University of Maryland's Computer Vision Laboratory and also gained experience in the private sector. Jacqueline earned her Ph.D. in Computer Science from the University Pierre and Marie Curie in Paris. Her research interests include Image Registration, Computer Vision, Artificial Intelligence, Autonomous Systems, Distributed Spacecraft Missions (DSM), and Earth System Digital Twins (ESDT), as well as high-performance and onboard computing. She has authored over 180 publications, including books and patents, and has received multiple awards, including the NASA Exceptional Service Medal and the Goddard Information Science and Technology Award in 2012.
Computer Vision; Image Processing; Earth Science R↗
TIE02. IGARSS’2024 Townhall on “Digital Twins for Earth Science
NASA, ESA, NOAA, CNES and several other international organizations have started programs to design and develop Digital Twins of the Earth and/or Earth systems. Earth Systems Digital Twins (ESDTs) are dynamic and interactive information systems for understanding, forecasting, and conjecturing the complex interconnections among Earth systems, including anthropomorphic forcings and impacts to humanity. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest (or “What Now”), dynamic Forecasting models (or “What Next”), and Impact Assessment capabilities (or “What If”). ESDTs provide unified, comprehensive representations and predictions that can be utilized for monitoring the health of the Planet, as well as for developing actionable information to support decision making. More generally, Digital Twins will help researchers better understand the fundamental Earth systems that impact everything from wildfires to climate change. This Townhall will provide a status of Destination Earth as well as ESA’s, NASA’s, CNES’s and NOAA’s current independent and common efforts in Digital Twins; then the four organizations will provide information about community building before engaging a dialogue about Digital Twins of the Earth with the IGARSS community.
Earth Science Remote Sensing; Information Systems;↗
NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program: Earth Systems Digital Twins (ESDT) Standards for Interoperable Digital Twins Workshop Presentations
On September 18, 2023, NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program conducted a mini-workshop that brought together seven experts to survey and discuss "Standards for Interoperable Digital Twins". Since three years, the AIST Program has been developing technologies and prototypes for Earth System Digital Twins (ESDT). During those developments and after the ESDT Workshop held in October 2022, it became clear that standard for ESDT interoperability were needed and should be defined as soon as possible. To address this challenge, the AIST program will survey ongoing development for Digital Twins standards in various domains and the September 18, 2023 Workshop represented the first step towards this understanding. Speakers during this event included: Michael Grieves (Digital Twin Institute), Siri Jodha Singh Khalsa (IEEE GRSS Standards), Trent Tinker (OGC), Ryan Berkheimer (NOAA), John Stone (NVIDIA), Thomas Geenen (ECMWF-DestinE) and Arne Berre (SINTEF-Iliad DTO and EDITO). This presentation regroups all the speakers' presentations.
Earth Science Remote Sensing; Information Systems↗
Standards for Interoperable Digital Twins
On September 18, 2023, NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program conducted a mini-workshop that brought together seven experts to survey and discuss "Standards for Interoperable Digital Twins". Since three years, the AIST Program has been developing technologies and prototypes for Earth System Digital Twins (ESDT). During those developments and after the ESDT Workshop held in October 2022, it became clear that standard for ESDT interoperability were needed and should be defined as soon as possible. To address this challenge, the AIST program will survey ongoing development for Digital Twins standards in various domains and the September 18, 2023 Workshop represented the first step towards this understanding. Speakers during this event included: Michael Grieves (Digital Twin Institute), Siri Jodha Singh Khalsa (IEEE GRSS Standards), Trent Tinker (OGC), Ryan Berkheimer (NOAA), John Stone (NVIDIA), Thomas Geenen (ECMWF-DestinE) and Arne Berre (SINTEF-Iliad DTO and EDITO). This movie represents the recording of this event.
Earth Science Remote Sensing↗