Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗

Hybrid Model Based Approaches for Systems Health Management and Prognostics

This is a previously approved and published presentation. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Present achievements of data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. Given models of the current and future system behavior, a general approach of model-based prognostics can solve the prediction problem and further decision-making. In principle, data-driven approaches can replace expensive experimental test-setups as well as reduce the number of simulations needed to explore, e.g., the parametric space of a multi-parameter model. Nonetheless, the limitations of pure data-driven methods came to light rather quickly, at least for some industries. In many industrial applications, data acquisition is costly, and the volume of data that can be collected does not satisfy the requirements for effective model training and cross-validation. Therefore, some recent works in the area of machine learning is focusing on blending physics with data-driven algorithms, thus mitigating the drawbacks of the two approaches and emphasizing respective advantages. Partial physical knowledge of the problem can aid the learning process by “guiding” the algorithm towards efficient solutions that satisfy the physics driving the system behavior. The result is a hybrid modeling approach combining physical knowledge as well data-driven methods to develop a unified hybrid approach. A hybrid framework for fusing information from physics-based performance models along with deep learning algorithms for prognostics of complex safety-critical systems is presented. In this framework, physics-based performance models infer unobservable model parameters related to the system's components health solving a calibration problem in the deep learning approach.

Prognostics↗

Modeling Microgravity Induced Fluid Redistribution Autoregulatory and Hydrostatic Enhancements

Space flight induces a marked cephalad (headward) redistribution of blood and interstitial fluid potentially resulting in a loss of venous tone and reduction in heart muscle efficiency upon introduction into the microgravity environment. Using various types of computational models, we are investigating how this fluid redistribution may induce intracranial pressure changes, relevant to reported reductions in astronaut visual acuity, part of the Visual Impairment and Intracranial Pressure (VIIP) syndrome. Methods: We utilize a lumped parameter cardiovascular system (CVS) model, augmented by compartments comprising the cerebral spinal fluid (CSF) space, as the primary tool to describe how microgravity, and the associated lack of hydrostatic gradient, impacts fluid redistribution. Models of ocular fluid pressures and biomechanics then accept the output of the above model as boundary condition input to allow more detailed, local analysis (see IWS Abstract by Ethier et al.). Recently, we enhanced the capabilities our previously reported CVS model through the implementation of robust autoregulatory mechanisms and a more fundamental approach to the implementation of hydrostatic mechanisms. Modifying the approach of Blanco et al., we implemented auto-regulation in a quasi-static manner, as an averaged effect across the span of one heartbeat. This approach reduced the higher frequency perturbations from the regulatory mechanism and was intended to allow longer simulation times (days) than models that implement within-beat regulatory mechanisms (minutes). A more fundamental approach to hydrostatics was implemented by a quasi-1D approach, in which compartment descriptions include compartment length, orientation and relative position, allowed for modeling of body orientation, relative body positioning and, in the future, alternative gravity environments. At this time the inclusion of hydrostatic mechanisms supplies additional capabilities to train and validate the CVS model with terrestrial data. Results and Conclusions: With the implementation of auto-regulation and hydrostatic modeling capabilities, the model performs as expected in the maintaining the CA (Central Artery) compartment pressure when simulating orientations ranging from supine to standing. The model appears to generally overpredict heart rate and thus cardiac output, possibly indicating sensitivity to the nominal heart rate, which is used as an initial set point of the regulation mechanisms. Despite this sensitivity, the model performs consistently for many hours of simulation time, indicating the success of our quasi-static implementation approach.

biomechanics↗

Strategies for concurrent processing of complex algorithms in data driven architectures

The performance modeling and enhancement for periodic execution of large-grain, decision-free algorithms in data flow architectures is examined. Applications include real-time implementation of control and signal processing algorithms where performance is required to be highly predictable. The mapping of algorithms onto the specified class of data flow architectures is realized by a marked graph model called ATAMM (Algorithm To Architecture Mapping Model). Performance measures and bounds are established. Algorithm transformation techniques are identified for performance enhancement and reduction of resource (computing element) requirements. A systematic design procedure is described for generating operating conditions for predictable performance both with and without resource constraints. An ATAMM simulator is used to test and validate the performance prediction by the design procedure. Experiments on a three resource testbed provide verification of the ATAMM model and the design procedure.

Stoughton, John W.↗

Experimental and analytical investigation of a modified ring cusp NSTAR engine

A series of experimental measurements on a modified laboratory NSTAR engine were used to validate a zero dimensional analytical discharge performance model of a ring cusp ion thruster. The model predicts the discharge performance of a ring cusp NSTAR thruster as a function the magnetic field configuration, thruster geometry, and throttle level. Analytical formalisms for electron and ion confinement are used to predict the ionization efficiency for a given thruster design. Explicit determination of discharge loss and volume averaged plasma parameters are also obtained. The model was used to predict the performance of the nominal and modified three and four ring cusp 30-cm ion thruster configurations operating at the full power (2.3 kW) NSTAR throttle level. Experimental measurements of the modified engine configuration discharge loss compare well with the predicted value for propellant utilizations from 80 to 95%. The theory, as validated by experiment, indicates that increasing the magnetic strength of the minimum closed reduces maxwellian electron diffusion and electrostatically confines the ion population and subsequent loss to the anode wall. The theory also indicates that increasing the cusp strength and minimizing the cusp area improves primary electron confinement increasing the probability of an ionization collision prior to loss at the cusp.

cathodes↗

Solving the Cauchy-Riemann equations on parallel computers

Discussed is the implementation of a single algorithm on three parallel-vector computers. The algorithm is a relaxation scheme for the solution of the Cauchy-Riemann equations; a set of coupled first order partial differential equations. The computers were chosen so as to encompass a variety of architectures. They are: the MPP, and SIMD machine with 16K bit serial processors; FLEX/32, an MIMD machine with 20 processors; and CRAY/2, an MIMD machine with four vector processors. The machine architectures are briefly described. The implementation of the algorithm is discussed in relation to these architectures and measures of the performance on each machine are given. Simple performance models are used to describe the performance. These models highlight the bottlenecks and limiting factors for this algorithm on these architectures. Conclusions are presented.

Fatoohi, Raad A.↗

Implementation of an ADI method on parallel computers

The implementation of an ADI method for solving the diffusion equation on three parallel/vector computers is discussed. The computers were chosen so as to encompass a variety of architectures. They are: the MPP, an SIMD machine with 16K bit serial processors; FLEX/32, an MIMD machine with 20 processors; and CRAY/2, an MIMD machine with four vector processors. The Gaussian elimination algorithm is used to solve a set of tridiagonal systems on the FLEX/32 and CRAY/2 while the cyclic elimination algorithm is used to solve these systems on the MPP. The implementation of the method is discussed in relation to these architectures and measures of the performance on each machine are given. Simple performance models are used to describe the performance. These models highlight the bottlenecks and limiting factors for this algorithm on these architectures. Finally, conclusions are presented.

Fatoohi, Raad A.↗

Implementation and analysis of a Navier-Stokes algorithm on parallel computers

The results of the implementation of a Navier-Stokes algorithm on three parallel/vector computers are presented. The object of this research is to determine how well, or poorly, a single numerical algorithm would map onto three different architectures. The algorithm is a compact difference scheme for the solution of the incompressible, two-dimensional, time-dependent Navier-Stokes equations. The computers were chosen so as to encompass a variety of architectures. They are the following: the MPP, an SIMD machine with 16K bit serial processors; Flex/32, an MIMD machine with 20 processors; and Cray/2. The implementation of the algorithm is discussed in relation to these architectures and measures of the performance on each machine are given. The basic comparison is among SIMD instruction parallelism on the MPP, MIMD process parallelism on the Flex/32, and vectorization of a serial code on the Cray/2. Simple performance models are used to describe the performance. These models highlight the bottlenecks and limiting factors for this algorithm on these architectures. Finally, conclusions are presented.

Fatoohi, Raad A.↗

Implementation of an ADI method on parallel computers

In this paper the implementation of an ADI method for solving the diffusion equation on three parallel/vector computers is discussed. The computers were chosen so as to encompass a variety of architectures. They are the MPP, an SIMD machine with 16-Kbit serial processors; Flex/32, an MIMD machine with 20 processors; and Cray/2, an MIMD machine with four vector processors. The Gaussian elimination algorithm is used to solve a set of tridiagonal systems on the Flex/32 and Cray/2 while the cyclic elimination algorithm is used to solve these systems on the MPP. The implementation of the method is discussed in relation to these architectures and measures of the performance on each machine are given. Simple performance models are used to describe the performance. These models highlight the bottlenecks and limiting factors for this algorithm on these architectures. Finally conclusions are presented.

Fatoohi, Raad A.↗

Development of Numerical Models for Performance Predictions of Single-Photon Avalanche Photodetectors (SPAP) for the 2-Micron Regime

Field dependent drift velocity results are presented for electron transport in bulk Indium Arsenide (InAs) material based on a Monte Carlo model, which includes an analytical treatment of band-to-band impact ionization. Avalanche multiplication and related excess noise factor (F) are computed as a function of device length and applied voltage. A decrease in F with increases in device length is obtained. The results suggest an inherent utility for InAs-based single-photon avalanche detectors, particularly around the 2 microns region of interest for atmospheric remote sensing applications. The dark current response was also evaluated. The role of the various components has been analyzed. For shorter devices, the tunneling component is shown to dominate at low temperatures. Finally, possible structures for enhanced photodetection are proposed for future research.

Joshi, Ravindra P.↗

Integrated Topographic Corrections Improve Forest Mapping Using Landsat Imagery

In mountainous environments, topography strongly affects the reflectance due to illumination effects and cast shadows, which introduce errors in land cover classifications. However, topographic correction is not routinely implemented in standard data pre-processing chains (e.g., Landsat Analysis Ready Data), and there is a lack of consensus whether topographic correction is necessary, and if so, how to conduct it. Furthermore, methods that correct simultaneously for atmospheric and topographic effects are becoming available, but they have not been compared directly. Our objects were to investigate (1) the effectiveness of two topographic correction approaches that integrate atmospheric and topographic correction, (2) improvements in classification accuracy when analyzing topographically corrected single-date imagery (14 July 2016 and 2 October 2016), versus a full Landsat time series from 2014 to 2016, and 3) improvements in classification accuracy when including additional terrain information (i.e., topographic slope, elevation, and aspect). We developed a physical based model and compared it with an enhanced C-correction, both of which integrate atmospheric and topographic correction. We compared classification accuracies with and without topographic correction using combinations of single-date imagery, image composites and spectral-temporal metrics generated from the full Landsat time series, and additional terrain information in the Caucasus Mountains. We found that both the enhanced C-correction and the physical model performed very well and largely eliminated the correlation (Pearson’s correlation coefficient r ranges from 0.06 to 0.24) between surface reflectance and illumination condition, but the physical model performed best (r ranges from 0.05 to 0.11). Both image composites, and spectral-temporal metrics generated from corrected imagery, resulted in significantly (p ≤ 0.05) higher classification accuracies and better forest classifications, especially for the mixed forests. Adding terrain information reduced classification error significantly, but not as much as topographic correction. In summary, topographic correction remains necessary, even when analyzing a full Landsat time series and including a digital elevation model in the classification. We recommend that topographic correction should be applied when analyzing Landsat satellite imagery in mountainous region for forest cover classification.

Atmospheric correction↗

Iterative solution of large, sparse linear systems on a static data flow architecture - Performance studies

The applicability of static data flow architectures to the iterative solution of sparse linear systems of equations is investigated. An analytic performance model of a static data flow computation is developed. This model includes both spatial parallelism, concurrent execution in multiple PE's, and pipelining, the streaming of data from array memories through the PE's. The performance model is used to analyze a row partitioned iterative algorithm for solving sparse linear systems of algebraic equations. Based on this analysis, design parameters for the static data flow architecture as a function of matrix sparsity and dimension are proposed.

Reed, D. A.↗

CFD simulation of coaxial injectors

The development of improved performance models for the Space Shuttle Main Engine (SSME) is an important, ongoing program at NASA MSFC. These models allow prediction of overall system performance, as well as analysis of run-time anomalies which might adversely affect engine performance or safety. Due to the complexity of the flow fields associated with the SSME, NASA has increasingly turned to Computational Fluid Dynamics (CFD) techniques as modeling tools. An important component of the SSME system is the fuel preburner, which consists of a cylindrical chamber with a plate containing 264 coaxial injector elements at one end. A fuel rich mixture of gaseous hydrogen and liquid oxygen is injected and combusted in the chamber. This process preheats the hydrogen fuel before it enters the main combustion chamber, powers the hydrogen turbo-pump, and provides a heat dump for nozzle cooling. Issues of interest include the temperature and pressure fields at the turbine inlet and the thermal compatibility between the preburner chamber and injector plate. Performance anomalies can occur due to incomplete combustion, blocked injector ports, etc. The performance model should include the capability to simulate the effects of these anomalies. The current approach to the numerical simulation of the SSME fuel preburner flow field is to use a global model based on the MSFC sponsored FNDS code. This code does not have the capabilities of modeling several aspects of the problem such as detailed modeling of the coaxial injectors. Therefore, an effort has been initiated to develop a detailed simulation of the preburner coaxial injectors and provide gas phase boundary conditions just downstream of the injector face as input to the FDNS code. This simulation should include three-dimensional geometric effects such as proximity of injectors to baffles and chamber walls and interaction between injectors. This report describes an investigation into the numerical simulation of GH2/LOX coaxial injectors. The following sections will discuss the physical aspects of injectors, the CFD code employed, and preliminary results of a simulation of a single coaxial injector for which experimental data is available. It is hoped that this work will lay the foundation for the development of a unique and useful tool to support the SSME program.

Landrum, D. Brian↗

FACET: Future ATM Concepts Evaluation Tool

FACET (Future ATM Concepts Evaluation Tool) is an Air Traffic Management research tool being developed at the NASA Ames Research Center. This paper describes the design, architecture and functionalities of FACET. The purpose of FACET is to provide E simulation environment for exploration, development and evaluation of advanced ATM concepts. Examples of these concepts include new ATM paradigms such as Distributed Air-Ground Traffic Management, airspace redesign and new Decision Support Tools (DSTs) for controllers working within the operational procedures of the existing air traffic control system. FACET is currently capable of modeling system-wide en route airspace operations over the contiguous United States. Airspace models (e.g., Center/sector boundaries, airways, locations of navigation aids and airports) are available from databases. A core capability of FACET is the modeling of aircraft trajectories. Using round-earth kinematic equations, aircraft can be flown along flight plan routes or great circle routes as they climb, cruise and descend according to their individual aircraft-type performance models. Performance parameters (e.g., climb/descent rates and speeds, cruise speeds) are obtained from data table lookups. Heading, airspeed and altitude-rate dynamics are also modeled. Additional functionalities will be added as necessary for specific applications. FACET software is written in Java and C programming languages. It is platform-independent, and can be run on a variety of computers. FACET has been designed with a modular software architecture to enable rapid integration of research prototype implementations of new ATM concepts. There are several advanced ATM concepts that are currently being implemented in FACET airborne separation assurance, dynamic density predictions, airspace redesign (re-sectorization), benefits of a controller DST for direct-routing, and the integration of commercial space transportation system operations into the U.S. National Airspace System (NAS).

Bilmoria, Karl D.↗

Hydrologic Model Data for the East Fork Poplar Creek Watershed Simulated with the Advanced Terrestrial Simulator (ATS): Streamflow and Network Expansion–Contraction Dynamics

This dataset supports hydrologic modeling and stream network expansion–contraction analysis for the East Fork Poplar Creek (EFPC) Watershed in Tennessee. It includes a Jupyter notebook for model setup, model configuration files, simulation outputs, and derived products used to evaluate model performance and investigate stream dynamics under varying hydrologic conditions. The dataset was generated using the Watershed Workflow Python package and the Advanced Terrestrial Simulator (ATS), enabling integrated surface–subsurface hydrologic simulations using a stream-aligned mesh. Outputs include high-resolution time series of streamflow, active network length, water table depth, and related hydrologic variables. Also included are spatially explicit stream persistency indices and classifications of reaches as perennial or non-perennial. These data facilitate reproducibility and support further research on stream intermittency and variability in network extent.The model data archive is organized in following directories:1) model_setup_inputsContains the Watershed Workflow Jupyter notebooks (accessed through any open source code editor), selected input datasets, and resulting ATS input files, including XML files (access through any open source code editor), computational mesh (.exo files can be viewed using Paraview), and meteorological forcing files (.h5 files can be accessed through h5py python package and HDFView open source software). 2) model_outputsIncludes ATS simulation outputs relevant to this study. Time series of spatially integrated or averaged variables (e.g., streamflow, water table depth) are provided as CSV files. Select spatial fields (e.g., ponded depth and water table depth) are saved as pickled Python objects to reduce file size, and can be accessed through pickle package in Python. Key geometry objects from Watershed Workflow—such as the surface mesh and river tree—are also included to support analysis of streamflow persistency and expansion–contraction dynamics. These files can also be accessed through Watershed Workflow Python package.3) model_evaluationProvides observed streamflow time series and field survey-based flow regime classifications used to evaluate model performance. Jupyter notebooks for processing ATS outputs and comparing model predictions with observations to build confidence in the model prior to scientific analysis are also included.4) Q_L_relationshipsContains workflows for generating time series of discharge, active network length, and related hydrologic variables used in the stream network expansion–contraction analysis. Includes routines for delineating baseflow-dominated periods. For each catchment, notebooks and processed data (as pickled DataFrames accessed through Pandas Python package) are provided. 5) figure_scriptsProvides the Jupyter notebooks used to generate the figures presented in the paper.

54 ENVIRONMENTAL SCIENCES↗

Application of the CALIOP Layer Product to Evaluate the Vertical Distribution of Aerosols Estimated by Global Models: AeroCom Phase I Results

The CALIOP (Cloud-Aerosol Lidar with Orthogonal Polarization) layer product is used for a multimodel evaluation of the vertical distribution of aerosols. Annual and seasonal aerosol extinction profiles are analyzed over 13 sub-continental regions representative of industrial, dust, and biomass burning pollution, from CALIOP 2007-2009 observations and from AeroCom (Aerosol Comparisons between Observations and Models) 2000 simulations. An extinction mean height diagnostic (Z-alpha) is defined to quantitatively assess the models' performance. It is calculated over the 0-6 km and 0-10 km altitude ranges by weighting the altitude of each 100 m altitude layer by its aerosol extinction coefficient. The mean extinction profiles derived from CALIOP layer products provide consistent regional and seasonal specificities and a low inter-annual variability. While the outputs from most models are significantly correlated with the observed Z-alpha climatologies, some do better than others, and 2 of the 12 models perform particularly well in all seasons. Over industrial and maritime regions, most models show higher Z-alpha than observed by CALIOP, whereas over the African and Chinese dust source regions, Z-alpha is underestimated during Northern Hemisphere Spring and Summer. The positive model bias in Z-alpha is mainly due to an overestimate of the extinction above 6 km. Potential CALIOP and model limitations, and methodological factors that might contribute to the differences are discussed.

Aerosols and particles↗

Physics-Based Methods of Failure Analysis and Diagnostics in Human Space Flight

The Integrated Health Management (IHM) for the future aerospace systems requires to interface models of multiple subsystems in an efficient and accurate information environment at the earlier stages of system design. The complexity of modern aeronautic and aircraft systems (including e.g. the power distribution, flight control, solid and liquid motors) dictates employment of hybrid models and high-level reasoners for analysing mixed continuous and discrete information flow involving multiple modes of operation in uncertain environments, unknown state variables, heterogeneous software and hardware components. To provide the information link between key design/performance parameters and high-level reasoners we rely on development of multi-physics performance models, distributed sensors networks, and fault diagnostic and prognostic (FD&P) technologies in close collaboration with system designers. The main challenges of our research are related to the in-flight assessment of the structural stability, engine performance, and trajectory control. The main goal is to develop an intelligent IHM that not only enhances components and system reliability, but also provides a post-flight feedback helping to optimize design of the next generation of aerospace systems. Our efforts are concentrated on several directions of the research. One of the key components of our strategy is an innovative approach to the diagnostics/prognostics based on the real time dynamical inference (DI) technologies extended to encompass hybrid systems with hidden state trajectories. The major investments are into the multiphysics performance modelling that provides an access of the FD&P technologies to the main performance parameters of e.g. solid and liquid rocket motors and composite materials of the nozzle and case. Some of the recent results of our research are discussed in this chapter. We begin by introducing the problem of dynamical inference of stochastic nonlinear models and reviewing earlier results. Next, we present our analytical approach to the solution of this problem based on the path integral formulation. The resulting algorithm does not require an extensive global search for the model parameters, provides optimal compensation for the effects of dynamical noise, and is robust for a broad range of dynamical models. In the following Section the strengths of the algorithm are illustrated illustrated by inferring the parameters of the stochastic Lorenz system and comparing the results with those of earlier research. Next, we discuss a number of recent results in application to the development of the IHM for aerospace system. Firstly, we apply dynamical inference approach to a solution of classical three tank problems with mixed unknown continuous and binary parameters. The problem is considered in the context of ground support system for filling fuel tanks of liquid rocket motors. It is shown that the DI algorithm is well suited for successful solution of a hybrid version of this benchmark problem even in the presence of additional periodic and stochastic perturbation of unknown strength. Secondly, we illustrate our approach by its application to an analysis of the nozzle fault in a solid rocket motor (SRM). The internal ballistics of the SRM is modelled as a set of one-dimensional partial differential equations coupled to the dynamics of the propellant regression. In this example we are specifically focussed on the inference of discrete and continuous parameters of the nozzle blocking fault and on the possibility of an application of the DI algorithm to reducing the probability of "misses" of an on-board FD&P for SRM. In the next section re-contact problem caused by first stage/upper stage separation failure is discussed. The reaction forces imposed on the nozzle of the upper stage during the re-contact and their connection to the nozzle damage and to the thrust vector control (TVC) signal are obtained. It is shown that transient impact induced torquean be modelled as a response of an effective damped oscillator. A possible application of the DI algorithm to the inference of damage parameters and predicting fault dynamics ahead of time using the actuator signal is discussed. Finally, we formulate Bayesian inferential framework for development of the IHM system for in-flight structural health monitoring (SHM) of composite materials. We consider the signal generated by piezoelectric actuator mounted on composite structure generating elastic waves in it. The signal received by the sensor is than compared with the baseline signal. The possibility of damage inference is discussed in the context of development of the SHM.

Smelyanskiy, Vadim N.↗

A Multi-Year Effort to Forward the Validation of Solar Energetic Particle Prediction Models

To enable a consistent and quantitative understanding of solar energetic particle (SEP) model performance, a generalized, automated validation infrastructure, called SPHINX, is being developed by the NASA Space Radiation Analysis Group (SRAG) in close collaboration with the NASA Community Coordinated Modeling Center (CCMC), NASA Moon to Mars Space Weather Analysis Office (M2M), NOAA Space Weather Prediction Center (SWPC), and the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). SPHINX is being developed to evaluate the SEP Scoreboards (https://ccmc.gsfc.nasa.gov/scoreboards/sep/), which are being used by SRAG to support space radiation operations for Mission Control. SPHINX is also being developed through a series of community challenges, which have defined a list of challenge events and a prescribed set of rules of participation. The participation of the research community has enabled the generalization of the infrastructure to validate all the types of outputs being produced by SEP models and fully exercised the framework. The most recent challenge includes 30 SEP events and 33 non-event (quiet) periods and was supported by two dedicated SEPVAL working meetings, one in the US and one in Europe (https://ccmc.gsfc.nasa.gov/community-workshops/ccmc-sepval-2023/). Here, we describe SPHINX and its interactive user interface, SPHINX-VIVID, which will eventually be made available for public use. We present selected results, outcomes, and lessons learned from the SEPVAL working meetings and validation results of the SEP Scoreboards from 2019 to present. These efforts aim to define a set of community standards for SEP model validation and describe the current state-of-the-art of SEP model performance.

Kathryn Whitman↗