Engineering topics

Masha Kuznetsova

Publications and source records attributed to Masha Kuznetsova.

13 records

NASA NTRSDate not supplied

Increasing Accessibility of the Runs-on-Request Metadata, Data, and Services at the Community Coordinated Modeling Center

Space weather models are essential to our ability to understand and predict space weather events. For over 20 years, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) has been providing transformative tools and platforms for hosting space weather models and associated services, free and open to anyone interested in studying space weather. Runs-on-Request system (ROR) is one of the popular services at CCMC that permits researchers and other end-users to exercise cutting-edge hosted heliophysics and space weather models using a simple web interface, as well as collaborate on an extensive and continuously growing archive of over 28,000 model run results. Similar to other projects at CCMC, ROR has grown as a community project that strives to be open and transparent to its users. In this poster, we discuss some of our recent efforts to further expose ROR data, metadata, and services to the end users through both custom and community-developed access protocols. We also discuss how in-house science support provided by the CCMC team plays a paramount role in making ROR data and services truly accessible by the community.

Maksym Petrenko↗

NASA NTRSDate not supplied

Interoperability of Tools at the CCMC

The CCMC has a diverse set of tools in many languages that support utilization of simulation outputs accessible through CCMC interactive archives. Some model output post-processing and analysis tools are delivered to tCCMC by the community. One such model output post-processing/utilization tool developed by the CCMC is the open source Kamodo package. Kamodo is developed primarily in Python (with some C) and has already established strong interoperability with other Python libraries inside PyHC and out. While that interoperability is important, interoperability with other languages and tools is as important. Many models are written in Fortran or C, and their ability to pull in data from a Python tool or export directly to other analysis software in a different language will greatly increase scientific productivity. Interoperability within Python is important, but broader interoperability is just as important.

CCMC↗

NASA NTRSDate not supplied

Supporting Space Weather Modelling at the Community Coordinated Modeling Center (CCMC)

Space weather models are essential to our ability to understand and predict space weather events. Nonetheless, some of the most cutting-edge models may struggle to move past the initial research stage, remaining unknown and inaccessible to a wider research audience, thereby hindering validation, intercomparison and adoption of the models. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) closes this gap by providing a convenient platform for hosting space weather models and associated services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, as well as collaborate on a growing archive of model run results. In this presentation, we will discuss current and planned capabilities in some of the model services at CCMC, including Runs-on-Request, Instant Runs, and Real-Time Continuous Runs. We will also review new models added to the extensive collection of space weather models hosted at CCMC. Finally, we will talk about our efforts at streamlining model delivery to CCMC, including support for containerized models and establishment of an open collaborative environment based on Amazon Web Services (AWS).

space weather↗

NASA NTRSDate not supplied

Enabling Collaborative Space Weather Research at the Community Coordinated Modeling Center (CCMC)

Space weather models have been actively developed by the international research community, covering extensive spatial and physical domains. Still, many of the ground-breaking models remain a granular effort, insulated from a wider research audience, particularly that in different domains, and possible end users. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) seeks to remove such barriers to collaboration and coordination by providing a convenient platform for hosting space weather models and associated services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, as well as collaborate on a continuously updated archive of model run results. Moreover, the multi-disciplinary science support team at CCMC facilitates and enables collaboration across domains. In our presentation, we will discuss the space weather model services at CCMC, including Runs-on-Request, Real-Time Continuous Runs, and Instant Runs. We will also review new and updated models added to the extensive collection of space weather models hosted at CCMC. We will focus on trends in model, service, and science support utilization at CCMC as a proxy to the most pressing needs of the collaborative modeling community.

space weather↗

NASA NTRSDate not supplied

Analyzing Space Weather at Mars with MAVEN

To understand the processes driving Martian atmospheric escape to space, the MAVEN mission has been monitoring solar inputs at Mars since the spacecraft went into orbit in September 2014. MAVEN’s payload provides in situ measurements of solar wind ions and electrons, solar energetic particles, extreme ultraviolet radiation, and magnetic fields. With this comprehensive suite of instruments, the MAVEN team has monitored space weather at Mars for nearly a decade, over various parts of Solar Cycles 24 and 25. MAVEN observations have determined that space weather activity can deposit enough energy into the Martian system to enhance atmospheric escape by an order of magnitude. As the mission continues, monitoring space weather at Mars has become increasingly important to understand the Sun’s influence on the Martian environment. The MAVEN team provides regular reports of space weather activity, such as the occurrence and arrival time of coronal mass ejections as well as flare magnitude and peak times, to the Mars community when predictions suggest that a space weather-impacting event may be directed towards Mars. MAVEN provides observations of solar activity on the ‘far side’ of the Sun when Earth and Mars are near solar conjunction to augment measurements of solar observatories (e.g., SDO, STEREO, GOES, PSP, Solar Orbiter), providing a more global coverage of solar activity. Additionally, MAVEN is working closely with the Community Coordinated Modeling Center (CCMC) and the Moon to Mars (M2M) Space Weather Analysis Office, both located at NASA GSFC, to form the Mars Space Weather Collaboration. This collaboration utilizes MAVEN observations of space weather activity to facilitate model and prediction validation while creating tools that are available to the science community. These activities are in support of future human and robotic exploration as we identify needs to enhance current capabilities for analyzing space weather at Mars.

Gina A DiBraccio↗

NASA NTRSDate not supplied

Tracking Magnetic Perturbations, dB/dt and Geomagnetic Indices for Geospace Storms on a Routine Basis at the CCMC

The first comprehensive assessment of geospace model skill to specify magnetic perturbations (delta-B) on the ground and their time derivative (dB/dt) was performed at the Community Coordinated Modeling Center starting in 2010. This study resulted in the addition of the Space Weather Modling Framework to the suite of operational models run by the NOAA Space Weather Prediction Center (SWPC). Since then, magnetic pertubations have been made available on a larger scale for Run-on-Request simulations in geospace at the CCMC. We will demonstrate recent additions to the suite of analysis tools and model results including magnetic perturbations at more stations and on a grid of positions from both, original model outputs (SWMF using preset run configurations) and post-processed calculations using CalcDeltaB and their analysis and visualization using the open-source Kamodo data access and analysis suite and the Comprehensive Assessment of Models and Events using Library tools (CAMEL) application.

Lutz Rastaetter↗

NASA NTRSDate not supplied

Open Science Practices at the Community Coordinated Modeling Center

Open Science is defined as “the principle and practice of making research products and processes available to all, while respecting diverse cultures, maintaining security and privacy, and fostering collaborations, reproducibility, and equity” by Federal Agencies. The CCMC has been practicing open science based on FAIR (Findable, Accessible, Interoperable and Reusable) principle by providing access to the state-of -the art space science and space weather models to users around the world through various simulation services such as Runs-on-Request, Instant Runs, Real time runs on iSWA system. The CCMC also provides a wide range of tools and framework to help users easily utilize modeled data. One of the tools is the official NASA open-sourced software called Kamodo. Kamodo allows users to work with complex space weather models and data with little or no coding experience. Additionally, to support transparent model validation efforts, the CCMC is providing an integrated and flexible framework called CAMEL. CAMEL allows users to seamlessly compare model outputs with observational data sets. Currently, we are working on a user-friendly database of the papers and research that used CCMC services, so that the future users will have open access to previously performed research by other users and its details. In this presentation, we will show the open tools and resources provided by the CCMC. Furthermore, we will share our new efforts to support open data and open science results.

Ja Soon Shim↗

NASA NTRSDate not supplied

Making Heliophysics Research More Open and Accessible at the Community Coordinated Modeling Center (CCMC)

The Space Weather and Heliophysics modeling community seeks to improve our understanding of space weather events and their impact on human activities. The Community Coordinated Modeling Center’s (CCMC, https://ccmc.gsfc.nasa.gov) mission is to support the community by providing a convenient collaborative platform that brings together space weather models, model simulation data, curated datasets of solar events, and associated value-added services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, triage designated R2O models, as well as collaborate on a continuously updated archive of model run results. This presentation reports on CCMC’s ongoing efforts in making Heliophysics models and data more accessible, open, and reproducible. We will also explore interoperability within the ecosystem of CCMC services and how this ecosystem interoperates with external partner services and data streams.

space weather↗

NASA NTRSDate not supplied

Big Data Challenges at CCMC

Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.

space weather↗

NASA NTRSDate not supplied

Enabling API Access to the Space Weather Services at the Community Coordinated Modeling Center

Over the span of 20 years, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) has been leading a number of community-driven services and applications that provide a free and open access to the cutting-edge space weather and Heliophysics models through a simple web-based interface. CCMC also oversees an open archive of user model simulations and related metadata, maintains space weather-related data streams, curates validation and event datasets, and more. To maximize utility of its complementary services and data holdings, CCMC has been gradually building up an ad-hoc set of interfaces and specifications that facilitate coupling and interconnection within the organization, while also simplifying management and monitoring of the data. As the models continue to grow in maturity and complexity, CCMC is looking to reduce the complexity for its end users by making public some of the internal APIs as well as implementing dedicated interfaces as required by the community. In this presentation, we will overview the current run services at CCMC and will describe our current and near-future efforts in providing interfaces to these services.

space weather↗

NASA NTRSDate not supplied

Lowering Barriers to Science and Space Weather Research at the Community Coordinated Modeling Center (CCMC)

The Space Weather and Heliophysics research and modeling community has been pushing the limits of our ability to understand and predict space weather events. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) supports the community by providing a convenient collaborative platform hosting space weather models, model simulation data, curated datasets of solar events, and associated value-added services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, triage designated R2O models, as well as collaborate on a continuously updated archive of model run results. We will focus on CCMC’s ongoing commitment to the principles and guidelines of the Open Science initiative. Particularly, we will discuss our work towards making our services more transparent and our library of model simulations more accessible, open, and reproducible. We will introduce our recent tools for data discovery and correlative analysis designed to further increase the value of the user-generated data and metadata. We will also present our recent work on making heliophysical models more accessible and open to the community, particularly through simplified user experience and expert domain support. We will report on our progress in establishing an inter-center infrastructure with the ESA Virtual Space Weather Modelling Centre (VSWMC), designed to cross organizational boundaries and provide streamlined access to a joint palette of the models.

space weather↗

NASA NTRSDate not supplied

Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data

The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.

space weather↗

NASA NTRSDate not supplied

Model-Specific Metadata for Enhancing Space Science Models

The Space Weather and Heliophysics modeling community, supported by the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov), provides a collaborative platform for space weather models and data. Flexible metadata is vital for advancing scientific research and fostering collaboration. Our work in expressing complex simulations of the Space Weather Modeling Framework (SWMF), particularly Global Magnetosphere (GM) grid components, in terms of simple metadata records shows great promise in creating searchable and reusable units of knowledge. Such records can be readily utilized to support the process of scientific discovery, closely aligning with the goals outlined in the Open Science initiative. Our primary goal is to show the scalability and benefits of metadata-focused methodologies. This presentation highlights the potential for applying metadata methodologies to other complex models, improving usability, supplying efficient documentation and fostering interdisciplinary research.

space weather↗