Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building benchmarking models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Predicting Cost/Performance Trade-offs For Whitney: A Commodity Computing Cluster

Recent advances in low-end processor and network technology have made it possible to build a "supercomputer" out of commodity components. We develop simple models of the NAS Parallel Benchmarks version 2 (NPB 2) to explore the cost/performance trade-offs involved in building a balanced parallel computer supporting a scientific workload. By measuring single processor benchmark performance, network latency, and network bandwidth, and using closed form expressions detailing the number and size of messages sent by each benchmark, our models predict benchmark performance to within 30%. A comparison based on total system cost reveals that current commodity technology (200 MHz Pentium Pros with 100baseT Ethernet) is well balanced for the NPBs up to a total system cost of around $ 1,000,000.

Becker, Jeffrey C.↗
NASA NTRS1997

Predicting Cost/Performance Trade-Offs for Whitney: A Commodity Computing Cluster

Recent advances in low-end processor and network technology have made it possible to build a "supercomputer" out of commodity components. We develop simple models of the NAS Parallel Benchmarks version 2 (NPB 2) to explore the cost/performance trade-offs involved in building a balanced parallel computer supporting a scientific workload. We develop closed form expressions detailing the number and size of messages sent by each benchmark. Coupling these with measured single processor performance, network latency, and network bandwidth, our models predict benchmark performance to within 30%. A comparison based on total system cost reveals that current commodity technology (200 MHz Pentium Pros with 100baseT Ethernet) is well balanced for the NPBs up to a total system cost of around $1,000,000.

Becker, Jeffrey C.↗
NASA NTRS1993

Dryden lectureship in research, a perspective on CFD validation

A comprehensive approach to CFD validation is presented. Requirements from computational and experimental perspectives are given. Experimental validation is emphasized because it ultimately determines the accuracy of CFD modeling and its application to complex problems. The concepts of building block and benchmark experiments are introduced. The types of measurements required of these experiments and their accuracy determination are explained. Contributions from such experiments toward the development and validation of CFD are reviewed and examples provided. Future challenges and strategies for validation are discussed.

Marvin, Joseph G.↗
NASA NTRSDate not supplied

Atmospheric Boundary-Layer and Flutter Computations Using CFD Model of the Transonic Dynamics Tunnel

This paper presents two Computational Fluid Dynamics (CFD) models of the flow in the NASA Langley Research Center Transonic Dynamics Tunnel (TDT). The TDT is a continuous-flow, closed circuit wind tunnel with a 16- by 16-foot slotted test section with cropped corners. The tunnel was originally built as the 19-ft Pressure Tunnel in 1938, but it was converted to the current transonic tunnel in the 1950s, with capabilities to use either air or heavy gas as the test medium. The first computational model describes the generation of an atmospheric-boundary-layer (ABL) profile inside the tunnel. An ABL, which includes both a wind profile and turbulence content, is one of the aerodynamic characteristics affecting the occurrence of wind-induced oscillations for a launch vehicle sitting on a pad. The challenging part of this analysis was modeling the turbulent flow inside the tunnel. This is due to the special ABL-generating hardware that was installed at the entrance of the TDT test section in order to change the downstream velocity profile and to introduce velocity fluctuations into the flow. The second CFD model builds on the computational aeroelastic results that were generated in support of the second Aeroelastic Prediction Workshop (AePW) for the NASA Benchmark Supercritical Wing (BSCW) configuration. During the AePW, the wing-only configuration (classical free-air model) was analyzed. In the current study, the flutter computations were conducted on the configuration as it was mounted in the TDT during the experiment. This includes the wing attached to the splitter plate that was attached to the wind-tunnel walls. The preliminary results show that the wind-tunnel walls marginally affect flutter prediction.

Pawel Chwalowski↗
NASA NTRS1995

Performance modeling & simulation of complex systems (A systems engineering design & analysis approach)

Modeling of the Multi-mission Image Processing System (MIPS) will be described as an example of the use of a modeling tool to design a distributed system that supports multiple application scenarios. This paper examines: (a) modeling tool selection, capabilities, and operation (namely NETWORK 2.5 by CACl), (b) pointers for building or constructing a model and how the MIPS model was developed, (c) the importance of benchmarking or testing the performance of equipment/subsystems being considered for incorporation the design/architecture, (d) the essential step of model validation and/or calibration using the benchmark results, (e) sample simulation results from the MIPS model, and (f) how modeling and simulation analysis affected the MIPS design process by having a supportive and informative impact.

Hall, Laverne↗
NASA NTRS2023

Importance of Internal Variability for Climate Model Assessment

Benchmarking climate model simulations against observations of the climate is core to the process of building realistic climate models and developing accurate future projections. However, in many cases, models do not match historical observations, particularly on regional scales. If there is a mismatch between modeled and observed climate features, should we necessarily conclude that our models are deficient? Using several illustrative examples, we emphasize that internal variability can easily lead to marked differences between the basic features of the model and observed climate, even when decades of model and observed data are available. This can appear as an apparent failure of models to capture regional trends or changes in global teleconnections, or simulation of extreme events. Despite a large body of literature on the impact of internal variability on climate, this acknowledgment has not yet penetrated many model evaluation activities, particularly for regional climate. We emphasize that using a single or small ensemble of simulations to conclude that a climate model is in error can lead to premature conclusions on model fidelity. A large ensemble of multidecadal simulations is therefore needed to properly sample internal climate variability in order to robustly identify model deficiencies and convincingly demonstrate progress between generations of climate models.

Climate and Earth system modelling↗
NASA NTRS1998

Microgravity Vibration Control and Civil Applications

Controlling vibration of structures is essential for both space structures as well as terrestrial structures. Due to the ambient acceleration levels anticipated for the International Space Station, active vibration isolation is required to provide a quiescent acceleration environment for many science experiments. An overview is given of systems developed and flight tested in orbit for microgravity vibration isolation. Technology developed for vibration control of flexible space structures may also be applied to control of terrestrial structures such as buildings and bridges subject to wind loading or earthquake excitation. Recent developments in modern robust control for flexible space structures are shown to provide good structural vibration control while maintaining robustness to model uncertainties. Results of a mixed H-2/H-infinity control design are provided for a benchmark problem in structural control for earthquake resistant buildings.

Whorton, Mark Stephen↗
NASA NTRS2010

Toward Establishing a Realistic Benchmark for Airframe Noise Research: Issues and Challenges

The availability of realistic benchmark configurations is essential to enable the validation of current Computational Aeroacoustic (CAA) methodologies and to further the development of new ideas and concepts that will foster the technologies of the next generation of CAA tools. The selection of a real-world configuration, the subsequent design and fabrication of an appropriate model for testing, and the acquisition of the necessarily comprehensive aeroacoustic data base are critical steps that demand great care and attention. In this paper, a brief account of the nose landing-gear configuration, being proposed jointly by NASA and the Gulfstream Aerospace Company as an airframe noise benchmark, is provided. The underlying thought processes and the resulting building block steps that were taken during the development of this benchmark case are given. Resolution of critical, yet conflicting issues is discussed - the desire to maintain geometric fidelity versus model modifications required to accommodate instrumentation; balancing model scale size versus Reynolds number effects; and time, cost, and facility availability versus important parameters like surface finish and installation effects. The decisions taken during the experimental phase of a study can significantly affect the ability of a CAA calculation to reproduce the prevalent flow conditions and associated measurements. For the nose landing gear, the most critical of such issues are highlighted and the compromises made to resolve them are discussed. The results of these compromises will be summarized by examining the positive attributes and shortcomings of this particular benchmark case.

Khorrami, Mehdi R.↗
NASA NTRS2004

Defect measurement and analysis of JPL ground software: a case study

Ground software systems at JPL must meet high assurance standards while remaining on schedule due to relatively immovable launch dates for spacecraft that will be controlled by such systems. Toward this end, the Software Quality Improvement (SQI) project's Measurement and Benchmarking (M&B) team is collecting and analyzing defect data of JPL ground system software projects to build software defect prediction models. The aim of these models is to improve predictability with regard to software quality activities. Predictive models will quantitatively define typical trends for JPL ground systems as well as Critical Discriminators (CDs) to provide explanations for atypical deviations from the norm at JPL. CDs are software characteristics that can be estimated or foreseen early in a software project's planning. Thus, these CDs will assist in planning for the predicted degree to which software quality activities for a project are likely to deviation from the normal JPL ground system based on pasted experience across the lab.

defects↗
NASA NTRS2005

Analysis of Wake VAS Benefits Using ACES Build 3.2.1: VAMS Type 1 Assessment

The FAA and NASA are currently engaged in a Wake Turbulence Research Program to revise wake turbulence separation standards, procedures, and criteria to increase airport capacity while maintaining or increasing safety. The research program is divided into three phases: Phase I near term procedural enhancements; Phase II wind dependent Wake Vortex Advisory System (WakeVAS) Concepts of Operations (ConOps); and Phase III farther term ConOps based on wake prediction and sensing. The Phase III Wake VAS ConOps is one element of the Virtual Airspace Modelling and Simulation (VAMS) program blended concepts for enhancing the total system wide capacity of the National Airspace System (NAS). This report contains a VAMS Program Type 1 (stand-alone) assessment of the expected capacity benefits of Wake VAS at the 35 FAA Benchmark Airports and determines the consequent reduction in delay using the Airspace Concepts Evaluation System (ACES) Build 3.2.1 simulator.

Smith, Jeremy C.↗
NASA NTRS2015

Cloud-Based Numerical Weather Prediction for Near Real-Time Forecasting and Disaster Response

The use of cloud computing resources continues to grow within the public and private sector components of the weather enterprise as users become more familiar with cloud‐computing concepts, and competition among service providers continues to reduce costs and other barriers to entry. Cloud resources can also provide capabilities similar to high‐performance computing environments, supporting multi‐node systems required for near real‐time, regional weather predictions. Referred to as "Infrastructure as a Service", or IaaS, the use of cloud-based computing hardware in an on‐demand payment system allows for rapid deployment of a modeling system in environments lacking access to a large, supercomputing infrastructure. Use of IaaS capabilities to support regional weather prediction may be of particular interest to developing countries that have not yet established large supercomputing resources, but would otherwise benefit from a regional weather forecasting capability. Recently, collaborators from NASA Marshall Space Flight Center and Ames Research Center have developed a scripted, on‐demand capability for launching the NOAA/NWS Science and Training Resource Center (STRC) Environmental Modeling System (EMS), which includes pre‐compiled binaries of the latest version of the Weather Research and Forecasting (WRF) model. The WRF‐EMS provides scripting for downloading appropriate initial and boundary conditions from global models, along with higher‐resolution vegetation, land surface, and sea surface temperature data sets provided by the NASA Short‐term Prediction Research and Transition (SPoRT) Center. This presentation will provide an overview of the modeling system capabilities and benchmarks performed on the Amazon Elastic Compute Cloud (EC2) environment. In addition, the presentation will discuss future opportunities to deploy the system in support of weather prediction in developing countries supported by NASA's SERVIR Project, which provides capacity building activities in environmental monitoring and prediction across a growing number of regional hubs throughout the world. Capacity‐building applications that extend numerical weather prediction to developing countries are intended to provide near real‐time applications to benefit public health, safety, and economic interests, but may have a greater impact during disaster events by providing a source for local predictions of weather‐related hazards, or impacts that local weather events may have during the recovery phase.

Molthan, Andrew↗
NASA NTRS2000

Fixed-Order Mixed Norm Designs for Building Vibration Control

This study investigates the use of H2, mu-synthesis, and mixed H2/mu methods to construct full order controllers and optimized controllers of fixed dimensions. The benchmark problem definition is first extended to include uncertainty within the controller bandwidth in the form of parametric uncertainty representative of uncertainty in the natural frequencies of the design model. The sensitivity of H2 design to unmodeled dynamics and parametric uncertainty is evaluated for a range of controller levels of authority. Next, mu-synthesis methods are applied to design full order compensators that are robust to both unmodeled dynamics and to parametric uncertainty. Finally, a set of mixed H2/mu compensators are designed which are optimized for a fixed compensator dimension. These mixed norm designs recover the H2 design performance levels while providing the same levels of robust stability as the mu designs. It is shown that designing with the mixed norm approach permits higher levels of controller authority for which the H2 designs are destabilizing. The benchmark problem is that of an active tendon system. The controller designs are all based on the use of acceleration feedback.

Whorton, Mark S.↗
NASA NTRS2019

Predicting Transonic Flutter Using Nonlinear Computational Simulations

This paper builds on the computational aeroelastic results published previously and generated in support of the second Aeroelastic Prediction Workshop for the NASA Benchmark Supercritical Wing configuration. The computational results are obtained using FUN3D, an unstructured flow solver developed at the NASA Langley Research Center. Flutter analyses are performed using various aerodynamic models including linear doublet lattice, Euler solutions, Reynolds averaged Navier-Stokes and Delayed Detached Eddy Simulations. The analyses are performed across the transonic Mach range for a range in angle of attack from 0° to 5°, with focus on identifying the transonic dips in the flutter onset boundaries.

Heeg, Jennifer↗
NASA NTRS1992

Execution models for mapping programs onto distributed memory parallel computers

The problem of exploiting the parallelism available in a program to efficiently employ the resources of the target machine is addressed. The problem is discussed in the context of building a mapping compiler for a distributed memory parallel machine. The paper describes using execution models to drive the process of mapping a program in the most efficient way onto a particular machine. Through analysis of the execution models for several mapping techniques for one class of programs, we show that the selection of the best technique for a particular program instance can make a significant difference in performance. On the other hand, the results of benchmarks from an implementation of a mapping compiler show that our execution models are accurate enough to select the best mapping technique for a given program.

Sussman, Alan↗
NASA NTRSDate not supplied

NASA POWER: Providing Analysis-Ready, Cloud-Optimized Data for AI /ML Training and Applications in Earth Science

As global demand for sustainable development grows, the integration of Earth Observation (EO) data into decision making frameworks has become a primary objective for the scientific community. The NASA Prediction of Worldwide Energy Resources (POWER) project serves as a bridge between NASA EO data and the specialized needs of the renewable energy, sustainable infrastructure and agroclimatology communities. In this poster presentation we will present an overview of POWER data products and services along with its use in diverse research to decision-making workflows. By providing over 40 years of high-resolution historical, hourly and daily solar and meteorological data, POWER transforms satellite observations and global model reanalysis into actionable, Analysis-Ready Dataset (ARD). Currently, the project delivers over 250 industry-friendly parameters to the users from different NASA datasets like CERES SYN1Deg, MERRA-2, and IMERG alongside downscaled CMIP6 climate model data, fulfilling over 16 million requests from 50,000 unique users monthly. To ensure data quality and traceability, these parameters are rigorously validated against the ground-based observations from the Baseline Surface Radiation Network (BSRN) and the Global Surface Summary of the Day (GSOD) – these results will be discussed in the presentation. A newly introduced web-based PaRameter Uncertainty ViEwer (PRUVE) tool will be presented that provides an online validation platform to the users that benchmarks satellite-based and assimilation data products against these surface measurements. To reduce technical barriers to data adoption, POWER data is accessible through RESTful APIs, ESRI ArcGIS Image Services, a web-based Data Access Viewer tool, allowing users to visualize, validate and apply the dataset. For efficient data delivery POWER data is cloud-optimized into Zarr datastore accessible through NASA managed Amazon S3 ensures high-performance allowing users to integrate EO directly into operational pipelines. These customized services will be presented. Use cases from application will be presented from the energy sector - such as for design of generation systems, performance monitoring of solar power plants, in infrastructure sector- optimizing building energy efficiency and thermal comfort, in agriculture – such as driving crop simulation and yield forecasting models to enable climate resilient farming. Furthermore, the shift toward machine learning (ML) in EO research that has positioned POWER as a key provider for training datasets which will be discussed. Use-cases will be presented to showcase how NASA data is enabling the development of predictive tools for climate variability and resource management. The poster will present POWER’s future plans including technology development to enhance data traceability and reproducibility and improving I/O performance to support the rapid integration of new EO products, ensuring that POWER remains a robust scalable backend for the evolving landscape of AI-driven Earth Science. Additionally, POWER is developing an AI Agent and an MCP-Server to enable industry AI-Agentic workflows.

Neha Khadka↗
NASA NTRS1992

Model-driven mapping onto distributed memory parallel computers

The author addresses the problem of exploiting the parallelism available in a program to efficiently employ the resources of the target machine in the context of building a mapping compiler for a distributed memory parallel machine. He demonstrates the effectiveness of using execution models to select the best mapping technique from among those available for a given program segment on a particular machine. Through analysis of the execution models for several mapping techniques for one class of programs on a linear processor array, it is shown that selecting the best technique for a particular program instance can make a significant difference in performance. On the other hand, the results of benchmarks from a mapping compiler for the Warp systolic array machine show that the execution models considered are accurate enough to select the best mapping technique for a given program.

Sussman, Alan↗
NASA NTRSDate not supplied

Correlated Electromagnetic Levitation Actuator: A Reaction Sphere Based Attitude Control System

To address problems experienced by current reaction wheels and control moment gyroscopebased attitude control systems (ACS), researchers at NASA’s Marshall Space Flight Center have begun developing a reaction sphere actuator based on correlated electromagnetic levitation that will be immune to destructive bearing friction, momentum saturation, and gimbal lock. The Correlated Electromagnetic Levitation Actuator (CELA) advances the state of the art of reaction sphere ACSs by employing the concept of correlated magnetics. It is a frictionless, direct-drive reaction sphere that harnesses a unique technology with an array of applications across multiple disciplines. Correlated electromagnets function in a manner that is analogous to a matched filter; the convolution of two signals is peaked at the index representing the greatest match. For CELA, the signals are the patterns of magnetic flux density as a function of position. The magnitude of the convolution equates to an attractive or repulsive force, and these forces can be azimuthal or radial. The development of CELA is based in four distinct disciplines: Advanced Manufacturing, Prototype Development, Electromagnetic Modeling, and Controls. We are developing novel manufacturing techniques required to build arrays of permanent and electromagnet dipoles on curved surfaces. To print the permanent magnetic array, we have developed a probe with pyramidal magnets that will reside on a robotic arm to induce localized magnetic fields on a surface. The probe also includes the ability to erase dipole patterns from a permanent magnet by heating the surface to its Curie temperature. A number of test articles and prototypes have been developed using additive manufacturing methods. These prototypes have included hemispherical motors to test the drive algorithm, and a levitation test bed that demonstrates a magnetic bearing method based on attractive magnetic forces and ratiometric Hall effect sensors. We developed an array of electromagnetic dipoles on a printed circuit board (PCB) with individual H-bridges controlling each coil. This device created various flux density patterns and we measured their magnetic fields using a custom Hall effect 3-D probe and a LabVIEW virtual instrument. These data will serve as a benchmark for characterizing the accuracy of future models. Current work is focused on modeling the magnetic fields of our prototype arrays using COMSOL Finite Element Analysis and verifying the model against our test data. Accurate modeling will allow us to quickly test new patterns of electromagnets and their macro behavior. Eventually, the magnetic field models will be implemented in our controls simulations to facilitate precise control of the reaction sphere. Initial model results agree with field measurements to within 1 G (5% of measured flux density). Currently, we are testing different material properties of the electromagnets and their magnetic fields and thermal effects. These results will be used to refine the design of the electromagnetic dipoles. Our control efforts have centered on developing commutation, levitation, and field pattern shaping hardware in the form of breadboards and PCBs with software running on a local microcontroller. In addition, our partners developed MATLAB Simulink models to demonstrate a PID controller thatmitigates disturbance forces resulting from the interaction of drive and levitation magnetics. Finally, we have designed a three-axis test stand that will be used in future work to demonstrate CELA’s orientation control capability.

controls↗
NASA NTRSDate not supplied

Correlated Electromagnetic Levitation Actuator: A Reaction Sphere-Based Attitude Control System

To address problems experienced by current reaction wheels and control moment gyroscopebased attitude control systems (ACS), researchers at National Aeronautics and Space Administration’s (NASA’s) Marshall Space Flight Center (MSFC) have begun developing a reaction sphere actuator based on correlated electromagnetic levitation that will be immune to destructive bearing friction, momentum saturation, and gimbal lock. The Correlated Electromagnetic Levitation Actuator (CELA) advances the state of the art of reaction sphere ACSs by employing the concept of correlated magnetics. It is a frictionless, direct-drive reaction sphere that harnesses a unique technology with an array of applications across multiple disciplines. Correlated electromagnets function in a manner that is analogous to a matched filter; the convolution of two signals is peaked at the index representing the greatest match. For CELA, the signals are the patterns of magnetic flux density as a function of position. The magnitude of the convolution equates to an attractive or repulsive force, and these forces can be azimuthal or radial. The development of CELA is based in four distinct disciplines: Advanced Manufacturing, Prototype Development, Electromagnetic Modeling, and Controls. We are developing novel manufacturing techniques required to build arrays of permanent and electromagnet dipoles on curved surfaces. To print the permanent magnetic array, we have developed a probe with pyramidal magnets that will reside on a robotic arm to induce localized magnetic fields on a surface. We have also used high temperature ovens to erase dipole patterns from a permanent magnet by heating the surface to its Curie temperature. A number of test articles and prototypes have been developed using additive manufacturing methods. These prototypes have included hemispherical motors to test the drive algorithm, and a levitation test bed that demonstrates a magnetic bearing method based on attractive magnetic forces and ratiometric Hall effect sensors. We developed an array of electromagnetic dipoles on a printed circuit board (PCB) with individual H-bridges controlling each coil. This device created various flux density patterns and we measured their magnetic fields using a custom Hall effect 3-D probe and a LabVIEW virtual instrument. These data will serve as a benchmark for characterizing the accuracy of future models. Current work is focused on modeling the magnetic fields of our prototype arrays using COMSOL finite element analysis (FEA) and verifying the model against our test data. Accurate modeling will allow us to quickly test new patterns of electromagnets and their macro behavior. Eventually, the magnetic field models will be implemented in our controls simulations to facilitate precise control of the reaction sphere. Initial model results agree with field measurements to within 1 G (5% of measured flux density). Currently, we are testing different material properties of the electromagnets and their magnetic fields and thermal effects. These results will be used to refine the design of the electromagnetic dipoles. Our control efforts have centered on developing commutation, levitation, and field pattern shaping hardware in the form of breadboards and PCBs with software running on a local microcontroller. In addition, our partners developed MATLAB Simulink models to demonstrate a PID controller that mitigates disturbance forces resulting from the interaction of drive and levitation magnetics. Finally, we have designed a three-axis test stand that will be used in future work to demonstrate CELA’s orientation control capability.

reaction sphere↗