Search NASA⌕ Search

Engineering topics

Darren De Zeeuw

Publications and source records attributed to Darren De Zeeuw.

18 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Kamodo: Simplifying Model Data Access and Utilization

To address the lack of user-friendly software needed to simplify the utilization of model data across Heliophysics, the Community Coordinated Modeling Center (CCMC) at NASA’s Goddard Space Flight Center has developed a model-agnostic method via Kamodo for users to easily access and utilize model data in their workflows. By abstracting away the broad range of file formats and the intricacies of interpolation on specialized grids, this approach significantly lowers the barrier to model data access and utilization for the community while adding exciting new capabilities to their tool boxes. This paper describes the direct interfaces to the model data, called model readers, and a basic introduction on how to use them. Additionally, we detail the planned approach for including custom interpolation codes, and include current progress on specialized visualization developments. The CCMC is maintaining Kamodo as an official NASA open-sourced software to enable and encourage community collaboration.

Heliophysics↗
NASA NTRS2022

Kamodo’s Model-Agnostic Satellite Flythrough: Lowering the Utilization Barrier for Heliophysics Model Outputs

Heliophysics model outputs are increasingly accessible, but typically are not usable by the majority of the community unless directly collaborating with the relevant model developers. Prohibitive factors include complex file output formats, cryptic metadata, unspecified and often customized coordinate systems, and non-linear coordinate grids. Some pockets of progress exist, giving interfaces to various simulation outputs, but only for a small set of outputs and typically not with open-source, freely available packages. Additionally, the increasing array of tools built upon these sporadic interfaces are typically model-specific. We present Kamodo’s model-agnostic satellite flythrough capabilities as the solution to the utilization barrier for heliophysics model outputs. Developed at the Community Coordinated Modeling Center, these flythrough capabilities are built in Python upon a network of model-agnostic interfaces developed in collaboration with model developers, providing interpolation results the community can trust. Kamodo’s flythrough capabilities present the user with a growing variety of flythrough tools based upon a rapidly expanding library of heliophysics model outputs in several domains, currently including a variety of Ionosphere-Thermosphere-Mesosphere and global magnetosphere model outputs. Each capability is designed to be easily accessible via simplistic model-agnostic syntax, with the entire package freely available in the cloud on Github. Here, we describe the tools developed, include several sample applications for common science questions, demonstrate interoperability with selected packages, and summarize ongoing developments.

Software↗
NASA NTRS2022

Advocating for Equality of Contribution: The Research Software Engineer (RSE)

Heliophysics depends on RSEs to properly engineer software. However, RSEs receive unequal treatment compared to their science counterparts, resulting in unsustainable talent loss. These restrictions include lack of credit for their contributions and insufficient training. This paper describes what a RSE is and proposes solutions, including implementing appropriate recognition standards.

software↗
NASA NTRSDate not supplied

Kamodo’s Satellite Constellation Mission Planning Tool

Kamodo provides a functional model-agnostic interface to a growing collection of Heliophysics model outputs. The CCMC, in collaboration with the Geospace Dynamics Constellation Science Team, has recently developed Kamodo’s satellite constellation mission planning tool to perform reconstructions in any pair of dimensions, including time. The ‘reconstruction’ tool enables users to fly any 4-dimensional grid of satellites through a given model data set, reconstructing what the given constellation would observe during the mission. This capability facilitates determination of what satellite configuration is best for a given science question, even allowing comparison across multiple models. This tool, written in Python, is built upon Kamodo’s flythrough tool, which in turn depends on a growing network of model-specific interfaces. Since each model interface is designed with model-agnostic syntax, the flythrough tool and the satellite constellation mission planning tool also feature model-agnostic syntax. In this work, we will describe the basic analysis choices available in the tool and provide a variety of sample workflows. The tool is freely available at https://github.com/nasa/Kamodo for the public. We invite the community to use the reconstruction tool and adapt the provided workflows for their mission planning, and to contribute their own workflows to share with others.

software↗
NASA NTRSDate not supplied

Science Workflows using Kamodo

Kamodo is a powerful python software package based on data functionalization. Once a given data set is functionalized, a large variety of capabilities are easily accessible in Kamodo, including unit conversions, custom analysis via function composition, interactive publication quality visualizations, and LaTeX encoding. The entirety of capabilities available in Kamodo are easily applied to both simulated and observed data across the multiple domains of Heliophysics and even in other disciplines. This work includes a variety of science workflows using Kamodo in combination with other resources, including with other python software packages, that expand the utility of Kamodo even further. These workflows include model-data comparisons, ensemble modeling examples, satellite mission planning examples, and other applications, all of which are freely available on CCMC’s Kamodo Github page for the community to adapt to their own uses (https://github.com/nasa/Kamodo). We invite the community to use these workflows and to contribute their own to share.

software↗
NASA NTRSDate not supplied

Using Kamodo for CCMC ITM Output and Beyond

Kamodo is an official NASA open source python software package that functionalizes diverse datasets from models and observations in a consistent way, enabling advanced scientific analysis and visualization with simplistic syntax. Here we demonstrate this ability using several ITM models available through the Community Coordinated Modeling Center (CCMC). Users can now interact directly with model outputs, and satellites can be virtually flown through model output to allow many types of model/model and data/model comparisons. We will also provide information about significant updates and improvements to Kamodo and future plans.

Open Source Software↗
NASA NTRSDate not supplied

SM25C-2002: Kamodo’s Satellite Constellation Mission Planning Tool

Kamodo provides a functional model-agnostic interface to a growing collection of Heliophysics model outputs. The CCMC, in collaboration with the Geospace Dynamics Constellation Science Team, has recently developed Kamodo’s satellite constellation mission planning tool to perform reconstructions in any pair of dimensions, including time. The ‘reconstruction’ tool enables users to fly any 4-dimensional grid of satellites through a given model data set, reconstructing what the given constellation would observe during the mission. This capability facilitates determination of what satellite configuration is best for a given science question, even allowing comparison across multiple models. This tool, written in Python, is built upon Kamodo’s flythrough tool, which in turn depends on a growing network of model-specific interfaces. Since each model interface is designed with model-agnostic syntax, the flythrough tool and the satellite constellation mission planning tool also feature model-agnostic syntax. In this work, we will describe the basic analysis choices available in the tool and provide a variety of sample workflows. The tool is freely available at https://github.com/nasa/Kamodo for the public. We invite the community to use the reconstruction tool and adapt the provided workflows for their mission planning, and to contribute their own workflows to share with others.

python↗
NASA NTRSDate not supplied

Kamodo – An Adaptable Tool to Obtain and Compare Observations and Modeling Results

What is Kamodo? -Official NASA open-source project written in Python. -Building upon the functionalization of datasets. -It is a CCMC developed and maintained software tool for access, interpolation, and visualization of space weather models and data. -It allows model developers to represent simulation results as mathematical functions which may be manipulated directly by end users. -It handles unit conversion transparency and supports interactive science discovery through jupyter notebooks with minimal coding. -All Kamodo tools are accessible through Python, and all source code is publicly available on the Kamodo NASA GitHub repositories. -Kamodo does not generate model outputs. Users need to acquire the desired model outputs before they can be functionalized by Kamodo.

Kamodo↗
NASA NTRSDate not supplied

Increasing Accessibility of the Runs-on-Request Metadata, Data, and Services at the Community Coordinated Modeling Center

Space weather models are essential to our ability to understand and predict space weather events. For over 20 years, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) has been providing transformative tools and platforms for hosting space weather models and associated services, free and open to anyone interested in studying space weather. Runs-on-Request system (ROR) is one of the popular services at CCMC that permits researchers and other end-users to exercise cutting-edge hosted heliophysics and space weather models using a simple web interface, as well as collaborate on an extensive and continuously growing archive of over 28,000 model run results. Similar to other projects at CCMC, ROR has grown as a community project that strives to be open and transparent to its users. In this poster, we discuss some of our recent efforts to further expose ROR data, metadata, and services to the end users through both custom and community-developed access protocols. We also discuss how in-house science support provided by the CCMC team plays a paramount role in making ROR data and services truly accessible by the community.

Maksym Petrenko↗
NASA NTRSDate not supplied

Supporting Space Weather Modelling at the Community Coordinated Modeling Center (CCMC)

Space weather models are essential to our ability to understand and predict space weather events. Nonetheless, some of the most cutting-edge models may struggle to move past the initial research stage, remaining unknown and inaccessible to a wider research audience, thereby hindering validation, intercomparison and adoption of the models. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) closes this gap by providing a convenient platform for hosting space weather models and associated services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, as well as collaborate on a growing archive of model run results. In this presentation, we will discuss current and planned capabilities in some of the model services at CCMC, including Runs-on-Request, Instant Runs, and Real-Time Continuous Runs. We will also review new models added to the extensive collection of space weather models hosted at CCMC. Finally, we will talk about our efforts at streamlining model delivery to CCMC, including support for containerized models and establishment of an open collaborative environment based on Amazon Web Services (AWS).

space weather↗
NASA NTRSDate not supplied

Enabling Collaborative Space Weather Research at the Community Coordinated Modeling Center (CCMC)

Space weather models have been actively developed by the international research community, covering extensive spatial and physical domains. Still, many of the ground-breaking models remain a granular effort, insulated from a wider research audience, particularly that in different domains, and possible end users. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) seeks to remove such barriers to collaboration and coordination by providing a convenient platform for hosting space weather models and associated services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, as well as collaborate on a continuously updated archive of model run results. Moreover, the multi-disciplinary science support team at CCMC facilitates and enables collaboration across domains. In our presentation, we will discuss the space weather model services at CCMC, including Runs-on-Request, Real-Time Continuous Runs, and Instant Runs. We will also review new and updated models added to the extensive collection of space weather models hosted at CCMC. We will focus on trends in model, service, and science support utilization at CCMC as a proxy to the most pressing needs of the collaborative modeling community.

space weather↗
NASA NTRSDate not supplied

Modeling and Visualization of Geomagnetic Storms at the CCMC

The Community Coordinated Modeling Center is greatly expanding activities in geospace in recent years, including the addition of new models or outputs (including WACCM-X, SAMI3-TIEGCM, HYPERS, GAMERA test runs and WAM-IPE real time outputs) that expand the range of available views or analysis activities in geospace during the upcoming Solar Maximum and Heliophysics Big Year. We are now routinely adding to a library of geomagnetic storms using anew request interface for the Space Weather Modeling Framework(SWMF). We are placing continuous run model simulation outputs as run series onto the CCMC web site where look at quick-look graphics, perform online visualization and request outputs for any day covered by the results.We demonstrate examples and results of online visualization and analysis tools that are also placed onto the cloud to support Open Science and collaborative research.

Lutz Rastaetter↗
NASA NTRSDate not supplied

Tracking Magnetic Perturbations, dB/dt and Geomagnetic Indices for Geospace Storms on a Routine Basis at the CCMC

The first comprehensive assessment of geospace model skill to specify magnetic perturbations (delta-B) on the ground and their time derivative (dB/dt) was performed at the Community Coordinated Modeling Center starting in 2010. This study resulted in the addition of the Space Weather Modling Framework to the suite of operational models run by the NOAA Space Weather Prediction Center (SWPC). Since then, magnetic pertubations have been made available on a larger scale for Run-on-Request simulations in geospace at the CCMC. We will demonstrate recent additions to the suite of analysis tools and model results including magnetic perturbations at more stations and on a grid of positions from both, original model outputs (SWMF using preset run configurations) and post-processed calculations using CalcDeltaB and their analysis and visualization using the open-source Kamodo data access and analysis suite and the Comprehensive Assessment of Models and Events using Library tools (CAMEL) application.

Lutz Rastaetter↗
NASA NTRSDate not supplied

Open Science Practices at the Community Coordinated Modeling Center

Open Science is defined as “the principle and practice of making research products and processes available to all, while respecting diverse cultures, maintaining security and privacy, and fostering collaborations, reproducibility, and equity” by Federal Agencies. The CCMC has been practicing open science based on FAIR (Findable, Accessible, Interoperable and Reusable) principle by providing access to the state-of -the art space science and space weather models to users around the world through various simulation services such as Runs-on-Request, Instant Runs, Real time runs on iSWA system. The CCMC also provides a wide range of tools and framework to help users easily utilize modeled data. One of the tools is the official NASA open-sourced software called Kamodo. Kamodo allows users to work with complex space weather models and data with little or no coding experience. Additionally, to support transparent model validation efforts, the CCMC is providing an integrated and flexible framework called CAMEL. CAMEL allows users to seamlessly compare model outputs with observational data sets. Currently, we are working on a user-friendly database of the papers and research that used CCMC services, so that the future users will have open access to previously performed research by other users and its details. In this presentation, we will show the open tools and resources provided by the CCMC. Furthermore, we will share our new efforts to support open data and open science results.

Ja Soon Shim↗
NASA NTRSDate not supplied

Making Heliophysics Research More Open and Accessible at the Community Coordinated Modeling Center (CCMC)

The Space Weather and Heliophysics modeling community seeks to improve our understanding of space weather events and their impact on human activities. The Community Coordinated Modeling Center’s (CCMC, https://ccmc.gsfc.nasa.gov) mission is to support the community by providing a convenient collaborative platform that brings together space weather models, model simulation data, curated datasets of solar events, and associated value-added services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, triage designated R2O models, as well as collaborate on a continuously updated archive of model run results. This presentation reports on CCMC’s ongoing efforts in making Heliophysics models and data more accessible, open, and reproducible. We will also explore interoperability within the ecosystem of CCMC services and how this ecosystem interoperates with external partner services and data streams.

space weather↗
NASA NTRSDate not supplied

Enabling API Access to the Space Weather Services at the Community Coordinated Modeling Center

Over the span of 20 years, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) has been leading a number of community-driven services and applications that provide a free and open access to the cutting-edge space weather and Heliophysics models through a simple web-based interface. CCMC also oversees an open archive of user model simulations and related metadata, maintains space weather-related data streams, curates validation and event datasets, and more. To maximize utility of its complementary services and data holdings, CCMC has been gradually building up an ad-hoc set of interfaces and specifications that facilitate coupling and interconnection within the organization, while also simplifying management and monitoring of the data. As the models continue to grow in maturity and complexity, CCMC is looking to reduce the complexity for its end users by making public some of the internal APIs as well as implementing dedicated interfaces as required by the community. In this presentation, we will overview the current run services at CCMC and will describe our current and near-future efforts in providing interfaces to these services.

space weather↗
NASA NTRSDate not supplied

Lowering Barriers to Science and Space Weather Research at the Community Coordinated Modeling Center (CCMC)

The Space Weather and Heliophysics research and modeling community has been pushing the limits of our ability to understand and predict space weather events. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) supports the community by providing a convenient collaborative platform hosting space weather models, model simulation data, curated datasets of solar events, and associated value-added services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, triage designated R2O models, as well as collaborate on a continuously updated archive of model run results. We will focus on CCMC’s ongoing commitment to the principles and guidelines of the Open Science initiative. Particularly, we will discuss our work towards making our services more transparent and our library of model simulations more accessible, open, and reproducible. We will introduce our recent tools for data discovery and correlative analysis designed to further increase the value of the user-generated data and metadata. We will also present our recent work on making heliophysical models more accessible and open to the community, particularly through simplified user experience and expert domain support. We will report on our progress in establishing an inter-center infrastructure with the ESA Virtual Space Weather Modelling Centre (VSWMC), designed to cross organizational boundaries and provide streamlined access to a joint palette of the models.

space weather↗