Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Initial Results from the GEM Challenge on the Spacecraft Surface Charging Environment

Spacecraft surface charging during geomagnetically disturbed times is one of the most important causes of satellite anomalies. Predicting the surface charging environment is one prevalent task of the geospace environment models. Therefore, the GEM Focus Group “Inner Magnetosphere Cross-energy/Population Interactions” initiated a community-wide challenge study to assess the capability of several inner magnetosphere ring current models in determining surface charging environment for the Van Allen Probes orbits during the March 17, 2013 storm event. The integrated electron flux between 10 and 50 keV is used as the metrics. Various skill scores are applied to quantitatively measure the modeling performance against observations. Results indicate that no model consistently perform the best in all of the skill scores or for both satellites.We find that from these simulations the ring current model with observational flux boundary condition and Weimer electric potential driver generally reproduces the most realistic flux level around the spacecraft. A simple and weaker Volland-Stern electric field is not capable of effectively transporting the same plasma at the boundary towards the Earth. On the other hand, if the ring current model solves the electric field self-consistently and obtains similar strength and pattern in the equatorial plane as the Weimer model, the boundary condition plays another crucial role in determining the electron flux level in the inner region. Finally, when the boundary flux spectra based on MHD model/empirical model deviate from the shape or magnitude of the observed distribution function, the simulation produces poor skill scores along RBSP orbits.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Mesoscale Model Phenomenological Verification Techniques

Forecasters at the Spaceflight Meteorology Group, 45th Weather Squadron, and National Weather Service in Melbourne, FL use mesoscale numerical weather prediction model output in creating their operational forecasts. These models aid in forecasting weather phenomena that could compromise the safety of launch, landing, and daily ground operations and must produce reasonable weather forecasts in order for their output to be useful in operations. Considering the importance of model forecasts to operations, their accuracy in forecasting critical weather phenomena must be verified to determine their usefulness. The currently-used traditional verification techniques involve an objective point-by-point comparison of model output and observations valid at the same time and location. The resulting statistics can unfairly penalize high-resolution models that make realistic forecasts of a certain phenomena, but are offset from the observations in small time and/or space increments. Manual subjective verification can provide a more valid representation of model performance, but is time-consuming and prone to personal biases. An objective technique that verifies specific meteorological phenomena, much in the way a human would in a subjective evaluation, would likely produce a more realistic assessment of model performance. Such techniques are being developed in the research community. The Applied Meteorology Unit (AMU) was tasked to conduct a literature search to identify phenomenological verification techniques being developed, determine if any are ready to use operationally, and outline the steps needed to implement any operationally-ready techniques into the Advanced Weather Information Processing System (AWIPS). The AMU conducted a search of all literature on the topic of phenomenological-based mesoscale model verification techniques and found 10 different techniques in various stages of development. Six of the techniques were developed to verify precipitation forecasts, one to verify sea breeze forecasts, and three were capable of verifying several phenomena. The AMU also determined the feasibility of transitioning each technique into operations and rated the operational capability of each technique on a subjective 1-10 scale: (1) 1 indicates that the technique is only in the initial stages of development, (2) 2-5 indicates that the technique is still undergoing modifications and is not ready for operations, (3) 6-8 indicates a higher probability of integrating the technique into AWIPS with code modifications, and (4) 9-10 indicates that the technique was created for AWIPS and is ready for implementation. Eight of the techniques were assigned a rating of 5 or below. The other two received ratings of 6 and 7, and none of the techniques a rating of 9-10. At the current time, there are no phenomenological model verification techniques ready for operational use. However, several of the techniques described in this report may become viable techniques in the future and should be monitored for updates in the literature. The desire to use a phenomenological verification technique is widespread in the modeling community, and it is likely that other techniques besides those described herein are being developed, but the work has not yet been published. Therefore, the AMIU recommends that the literature continue to be monitored for updates to the techniques described in this report and for new techniques being developed whose results have not yet been published. 111

Lambert, Winifred↗

MODELING THE PERFORMANCE OF THE LSST IN SURVEYING THE NEAR-EARTH OBJECT POPULATION

We have performed a detailed survey simulation of the LSST performance with regards to near-Earth objects (NEOs) using the project’s current baseline cadence. The survey shows that if the project is able to reliably generate linked sets of positions and times (a so-called “tracklet”) using two detections of a given object per night and can link these tracklets into a track with a minimum of three tracklets covering more than a ∼12 day length-of-arc, then they would be able to discover 62% of the potentially hazardous asteroids (PHAs) larger than 140 m in its projected 10 year survey lifetime. This completeness would be reduced to 58% if the project is unable to implement a pipeline using the two detection cadence and has to adopt the four detection cadence more commonly used by existing NEO surveys. When including the estimated performance from the current operating surveys, assuming these would continue running until the start of LSST and perhaps beyond, the completeness fraction for PHAs larger than 140 m would be 73% for the baseline cadence and 71% for the four detection cadence. This result is a lower completeness than the estimate of Ivezić et al.; however, the result is quite close to that of Jones et al., who show ∼70% completeness using the identical survey cadence as used here. We show that the traditional method of using absolute magnitude H<22 mag as a proxy for the population with diameters larger than 140 m results in completeness values that are too high by ∼5%. Our simulation makes use of the most recent models of the physical and orbital properties of the NEO and PHA populations, as well as simulated cadences and telescope performance estimates provided by the LSST project. The consistency of the results presented here when compared to those of Jones et al. demonstrates the robustness of these survey modeling approaches. We also show that while neither LSST nor a space-based IR platform like NEOCam individually can complete the survey for 140 m diameter NEOs, the combination of these systems can achieve that goal after a decade of observation.

79 ASTRONOMY AND ASTROPHYSICS↗

Initial Results from the GEM Challenge on the Spacecraft Surface Charging Environment

Spacecraft surface charging during geomagnetically disturbed times is one of the most important causes of satellite anomalies. Predicting the surface charging environment is one prevalent task of the geospace environment models. Therefore, the Geospace Environment Modeling (GEM) Focus Group "Inner Magnetosphere Crossenergy/Population Interactions" initiated a communitywide challenge study to assess the capability of several inner magnetosphere ring current models in determining surface charging environment for the Van Allen Probes orbits during the 17 March 2013 storm event. The integrated electron flux between 10 and 50 keV is used as the metrics. Various skill scores are applied to quantitatively measure the modeling performance against observations. Results indicate that no model consistently perform the best in all of the skill scores or for both satellites. We find that from these simulations the ring current model with observational flux boundary condition and Weimer electric potential driver generally reproduces the most realistic flux level around the spacecraft. A simple and weaker VollandStern electric field is not capable of effectively transporting the same plasma at the boundary toward the Earth. On the other hand, if the ring current model solves the electric field selfconsistently and obtains similar strength and pattern in the equatorial plane as the Weimer model, the boundary condition plays another crucial role in determining the electron flux level in the inner region. When the boundary flux spectra based on magnetohydrodynamics (MHD) model/empirical model deviate from the shape or magnitude of the observed distribution function, the simulation produces poor skill scores along Van Allen Probes orbits.

Yu, Yiqun↗

High temperature furnace modeling and performance verifications

Analytical, numerical, and experimental studies were performed on two classes of high temperature materials processing sources for their potential use as directional solidification furnaces. The research concentrated on a commercially available high temperature furnace using a zirconia ceramic tube as the heating element and an Arc Furnace based on a tube welder. The first objective was to assemble the zirconia furnace and construct parts needed to successfully perform experiments. The 2nd objective was to evaluate the zirconia furnace performance as a directional solidification furnace element. The 3rd objective was to establish a data base on materials used in the furnace construction, with particular emphasis on emissivities, transmissivities, and absorptivities as functions of wavelength and temperature. A 1-D and 2-D spectral radiation heat transfer model was developed for comparison with standard modeling techniques, and were used to predict wall and crucible temperatures. The 4th objective addressed the development of a SINDA model for the Arc Furnace and was used to design sample holders and to estimate cooling media temperatures for the steady state operation of the furnace. And, the 5th objective addressed the initial performance evaluation of the Arc Furnace and associated equipment for directional solidification. Results of these objectives are presented.

Smith, James E., Jr.↗

Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions

Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.

59 BASIC BIOLOGICAL SCIENCES↗

Distributed Space Mission Design for Earth Observation Using Model-Based Performance Evaluation

Distributed Space Missions (DSMs) are gaining momentum in their application to earth observation missions owing to their unique ability to increase observation sampling in multiple dimensions. DSM design is a complex problem with many design variables, multiple objectives determining performance and cost and emergent, often unexpected, behaviors. There are very few open-access tools available to explore the tradespace of variables, minimize cost and maximize performance for pre-defined science goals, and therefore select the most optimal design. This paper presents a software tool that can multiple DSM architectures based on pre-defined design variable ranges and size those architectures in terms of predefined science and cost metrics. The tool will help a user select Pareto optimal DSM designs based on design of experiments techniques. The tool will be applied to some earth observation examples to demonstrate its applicability in making some key decisions between different performance metrics and cost metrics early in the design lifecycle.

Constellation↗

High Performance Computational Models of Synthetic Jet Actuators for Step Change Improvements in Freight Efficiency

The project presents results of a computational fluid dynamics (CFD) model developed by the Oak Ridge National Laboratory team for a synthetic jet produced by an actuator. Numerical results were compared against experimental data provided by Actasys, Inc. Three CFD packages were used for this work that are Star-CCM+, Nek5000 and OpenFOAM. A sensitivity analysis was performed with Star-CCM+ and provided more insights on how to optimize the design of the actuator. Nek5000 was used to obtain a high-resolution solution of the synthetic jet. In a exploratory stage, a CFD model of the actuator was also developed in OpenFOAM. All CFD models were able to capture the main flow features.

42 ENGINEERING↗

The Virtual Blast Furnace - An Integrated High Performance Computing Modeling, Simulation, and Visualization Capability for Steel Manufacturing (Final Report)

Many manufacturing industries require substantial capital and utilize energy intensive processes that involve complex phenomena. One example of such an industry is the steel industry, which is the fourth largest energy consuming industry in the U.S. By harnessing the power of High-Performance Computing (HPC) to enhance current simulation and visualization methods in the steel industry, it should be possible to increase resolution and/or decrease time of these methods by a factor of 1000. In this way, information can be obtained in a time frame that is useful for making business and engineering decisions, optimizing manufacturing processes and, ultimately, improving the completeness of U.S. industries. For example, if coke usage in blast furnaces were optimized such that the average coke rate was reduced from 797 lb/net tonne of hot metal (NTHM) to 604 lb/NTHM, costs could be reduced by $894 million/year. Additionally, members of the steel industry need the flexibility to efficiently operate blast furnaces at a range of production rates in order to meet fluctuating market demands. Large scale parameter studies can be utilized to discover workable operating parameters at a range of production rates.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A critical examination of compound stability predictions from machine-learned formation energies

Machine learning has emerged as a novel tool for the efficient prediction of material properties, and claims have been made that machine-learned models for the formation energy of compounds can approach the accuracy of Density Functional Theory (DFT). The models tested in this work include five recently published compositional models, a baseline model using stoichiometry alone, and a structural model. By testing seven machine learning models for formation energy on stability predictions using the Materials Project database of DFT calculations for 85,014 unique chemical compositions, we show that while formation energies can indeed be predicted well, all compositional models perform poorly on predicting the stability of compounds, making them considerably less useful than DFT for the discovery and design of new solids. Most critically, in sparse chemical spaces where few stoichiometries have stable compounds, only the structural model is capable of efficiently detecting which materials are stable. The nonincremental improvement of structural models compared with compositional models is noteworthy and encourages the use of structural models for materials discovery, with the constraint that for any new composition, the ground-state structure is not known a priori. This work demonstrates that accurate predictions of formation energy do not imply accurate predictions of stability, emphasizing the importance of assessing model performance on stability predictions, for which we provide a set of publicly available tests.

36 MATERIALS SCIENCE↗

Molecular dynamics simulations of cholesterol-rich membranes using a coarse-grained force field for cyclic alkanes

The architecture of a biological membrane hinges upon the fundamental fact that its properties are determined by more than the sum of its individual components. Studies on model membranes have shown the need to characterize in molecular detail how properties such as thickness, fluidity, and macroscopic bending rigidity are regulated by the interactions between individual molecules in a non-trivial fashion. Simulation-based approaches are invaluable to this purpose but are typically limited to short sampling times and model systems that are often smaller than the required properties. To alleviate both limitations, the use of coarse-grained (CG) models is nowadays an established computational strategy. We here present a new CG force field for cholesterol, which was developed by using measured properties of small molecules, and can be used in combination with our previously developed force field for phospholipids. The new model performs with precision comparable to atomistic force fields in predicting the properties of cholesterol-rich phospholipid bilayers, including area per lipid, bilayer thickness, tail order parameter, increase in bending rigidity, and propensity to form liquid-ordered domains in ternary mixtures. We suggest the use of this model to quantify the impact of cholesterol on macroscopic properties and on microscopic phenomena involving localization and trafficking of lipids and proteins on cellular membranes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Nonlinear modeling and performance analysis of cracked beam microgyroscopes

Cracks constitute a common structural defect in microelectromechanical systems that may arise during manufacturing, mechanical fatigue, or shock loading. Areas weakened by cracks increase the flexibility of the microstructure. Furthermore, depending on the crack severity, the increased flexibility can cause dramatic changes in the static and dynamic behaviors of electrically actuated MEMS. In this study, a numerical investigation of the depth and location of multiple edge cracks on the performance of beam microgyroscopes is conducted. Applying the Griffith strain energy release theorem for an edge crack, the vibrational characteristics of microgyroscopes with multiple cracks including the static deflection, natural frequencies, and mode shapes are studied analytically. Then, the differential quadrature method is employed to model the nonlinear dynamic behaviors of the cracked gyroscope system. Cracks initiated along the driving or sensing directions of the microgyroscope are found to have differing effects on its nonlinear dynamic response. This numerical study reveals that the onset of severe single cracks or a series of multiple cracks can significantly affect the sensitivity of the microgyroscope to base rotations and therefore leads to a degradation in the performance of the damaged MEMS sensor. This study also shows that a potential design approach for broadband microgyroscope systems manufactured with cracks can be proposed.

42 ENGINEERING↗

Design and Performance of Lift-Offset Rotorcraft for Short-Haul Missions

The design and performance of compound helicopters utilizing lift-offset rotors are examined, in the context of short-haul, medium-size civil and military missions. The analysis tools used are the comprehensive analysis CAMRAD II and the sizing code NDARC. Following correlation of the comprehensive analysis with existing lift-offset aircraft flight test data, the rotor performance model for the sizing code was developed, and an initial estimate was made of the rotor size and key hover and cruise flight conditions. The rotor planform and twist were optimized for those conditions, and the sizing code rotor performance model updated. Two models for estimating the blade and hub weight of lift-offset rotors are discussed. The civil and military missions are described, along with the aircraft design assumptions. The aircraft are sized for 30 passengers or 6600 lb payload, with a range of 300 nm. Civil and military aircraft designs are described for each of the rotor weight models. Disk loading and blade loading were varied to optimize the designs, based on gross weight and fuel burn. The influence of technology is shown, in terms of rotor hub drag and rotor weight.

Johnson, Wayne↗

A Surface Radiation Balance Data Set from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

A field campaign at Siple Dome in West Antarctica during the austral summer 2019-2020 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-poweredequipment, includes surface energy balance measurements, meteorology and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model's snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6-micron atmospheric window reveal cloud phase transitions associated with cloud lifecycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations.

cloud remote sensing↗

A Surface Radiation Balance Dataset from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

Abstract A field campaign at Siple Dome in West Antarctica during the austral summer 2019/20 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-powered equipment, includes surface energy balance measurements, meteorology, and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model’s snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6- μ m atmospheric window reveal cloud phase transitions associated with cloud life cycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations. significance statement Antarctica is a critical region for understanding climate change and sea level rise, as the great ice sheets and the ice shelves are subject to increasing risk as global climate warms. Climate models have difficulties over Antarctica, particularly with simulation of cloud properties that regulate snow surface melting or refreezing. Atmospheric and climate-related field work has significant challenges in the Antarctic, due to the small number of research stations that can support state-of-the-art equipment. Here we present new data from a suite of transportable and solar-powered instruments that can be deployed to remote Antarctic sites, including regions where ice shelves are most at risk, and we demonstrate how key components of climate model simulations can be evaluated against these data.

54 ENVIRONMENTAL SCIENCES↗

Comparative Study of Three Reconnection X Line Models at the Earth's Dayside Magnetopause Using in Situ Observations

This work examines the large-scale aspects of magnetic field reconnection at the Earth's dayside magnetopause. We use two sets of reconnection events, which are identified mostly by the in situ detection of accelerated and Alfvenic plasma flows. We intercompare three analytical models that predict the reconnection X line location and orientation, namely, the Trattner et al. (2007) and Swisdak and Drake (2007) models and also a modified version of the component merging model. In the first set of reconnection observations, we show three fortuitous, quasi-simultaneous dayside magnetopause crossing events where two widely separated spacecraft detect reconnection signatures, and the X line location and orientation can be inferred from the observations. We compare X line model predictions to those inferred from observations. These three reconnection events indicate the presence of an extended (greater than 7 Earth radii in length), component-type reconnection X line on Earth's dayside magnetopause connecting and structuring the reconnection signatures at locations far apart. In the second set of reconnection events, we analyze the X line models' performance in predicting the observed reconnection outflow direction, i.e., its north-south and/or east-west senses, in a total of 75 single, rather than multiple and quasi-simultaneous, magnetopause crossing events, where reconnection-associated plasma flows were clearly present. We found that the Swisdak and Drake's (2007) X line model performs slightly better, albeit not statistically significant, when predicting both accelerated plasma flow north-south and east-west components in 73% and 53% of the cases, respectively, as compared to the Trattner et al. (2007) model (70% north-south and 42% east-west) and the modified component merging model (66% north-south and 50% east-west).

Souza, V. M.↗

Experimental Confirmation of Water Column Natural Resonance Migration in a BBDB Device

Experiments were conducted with a Backward Bent Duct Buoy (BBDB) oscillating water column wave energy conversion device with a scaling factor of 50 at HMRC at University College Cork, Ireland. Results were compared to numerical performance models. This work experimentally verified the migration of the natural resonance location of the water column due to hydrodynamic coupling for a floating non- axisymmetric device without a power conversion chain PCC present. In addition, the experimental results verified the performance model with a PCC of the same non- axisymmetric device when both floating and grounded.

42 ENGINEERING↗

High-Performance Computer Modeling of the Cosmos-Iridium Collision

This paper describes the application of a new, integrated modeling and simulation framework, encompassing the space situational awareness (SSA) enterprise, to the recent Cosmos-Iridium collision. This framework is based on a flexible, scalable architecture to enable efficient simulation of the current SSA enterprise, and to accommodate future advancements in SSA systems. In particular, the code is designed to take advantage of massively parallel, high-performance computer systems available, for example, at Lawrence Livermore National Laboratory. We will describe the application of this framework to the recent collision of the Cosmos and Iridium satellites, including (1) detailed hydrodynamic modeling of the satellite collision and resulting debris generation, (2) orbital propagation of the simulated debris and analysis of the increased risk to other satellites (3) calculation of the radar and optical signatures of the simulated debris and modeling of debris detection with space surveillance radar and optical systems (4) determination of simulated debris orbits from modeled space surveillance observations and analysis of the resulting orbital accuracy, (5) comparison of these modeling and simulation results with Space Surveillance Network observations. We will also discuss the use of this integrated modeling and simulation framework to analyze the risks and consequences of future satellite collisions and to assess strategies for mitigating or avoiding future incidents, including the addition of new sensor systems, used in conjunction with the Space Surveillance Network, for improving space situational awareness.

42 ENGINEERING↗