Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Performance assessment of PHITS simulations for the inverse-kinematic p( 7 Li,n) 7 Be reaction based on fast-neutron measurements with a diamond detector

The inverse-kinematics p( 7 Li,n) 7 Be reaction produces forward-focused neutron emission, offering enhanced usable flux and reduced shielding requirements. Reliable simulation of such neutron fields is essential for the development of compact accelerator-based neutron sources. In this study, a PHITS-based simulation framework for the reaction was experimentally assessed using fast-neutron measurements. Forward-directed neutrons were measured with a diamond neutron detector and quantitatively compared with simulations with newly prepared IK-Frag cross-section file based on the proton-induced reaction data in ENDF/B-VIII.1, TENDL-2023, and JENDL-4.0/HE. Measurements and simulations were performed for incident 7 Li 3+ energies ranging from 15.0 to 25.0 MeV using a 50 μm-thick polypropylene target. For all conditions, the PHITS-based simulation framework reproduced the deposited energy spectra at the correct order of magnitude. The comparison of deposited energy spectra in the diamond detector showed high correlation coefficients across all investigated energies, indicating reasonable agreement in spectral shape between simulations and measurements. This work represents an initial step toward establishing a benchmark for PHITS simulations of the inverse kinematic reaction between an incident lithium-ion and a proton target.

43 PARTICLE ACCELERATORS↗

Volumetrically-Derived Global Navigation Satellite System Performance Assessment from the Earths Surface through the Terrestrial Service Volume and the Space Service Volume

NASA is participating in the International Committee on Global Navigation Satellite Systems (GNSS) (ICG)'s efforts towards demonstrating the benefits to the space user from the Earth's surface through the Terrestrial Service Volume (TSV) to the edge of the Space Service Volume (SSV), when a multi-GNSS solution space approach is utilized. The ICG Working Group: Enhancement of GNSS Performance, New Services and Capabilities has started a three phase analysis initiative as an outcome of recommendations at the ICG-10 meeting, in preparation for the ICG-11 meeting. The first phase of that increasing complexity and fidelity analysis initiative was recently expanded to compare nadir-facing and zenith-facing user hemispherical antenna coverage with omnidirectional antenna coverage at different distances of 8,000 km altitude and 36,000 km altitude. This report summarizes the performance using these antenna coverage techniques at distances ranging from 100 km altitude to 36,000 km to be all encompassing, as well as the volumetrically-derived system availability metrics.

Global Positioning System↗

Performance assessment of ensembles of in situ workflows under resource constraints

Summary Scientific breakthroughs in biomolecular methods and improvements in hardware technology have shifted from a long‐running simulation to a large set of shorter simulations running simultaneously, called an ensemble. In an ensemble, simulations are usually coupled with analyses of data produced by the simulations. In situ methods can be used to analyze large volumes of data generated by scientific simulations at runtime (i.e., simulations and analyses are performed concurrently). In this work, we study the execution of ensemble‐based simulations paired with in situ analyses using in‐memory staging methods. Using an ensemble of molecular dynamics in situ workflows with multiple simulations and analyses, we first show that collecting traditional metrics such as makespan, instructions per cycle, memory usage, or cache miss ratio is not sufficient to characterize complex behaviors of ensembles. We propose a method to evaluate the performance of ensembles of workflows that captures multiple resource usage aspects: resource efficiency, resource allocation, and resource provisioning. Experimental results demonstrate that the proposed method can effectively distinguish the performance of different component placements in an ensemble with up to 32 ensemble members. By evaluating different co‐location scenarios, our proposed performance indicators demonstrate benefits of co‐locating simulation and coupled analyses within a compute node.

Do, Tu Mai Anh↗

SEPS comet rendezvous performance assessment

This paper presents an assessment of delivered payload capability for a number of selected rendezvous missions to periodic comets with launch opportunities through the years 1986-1996. These missions are chosen using a selection criteria that considers both expected scientific interest and earth-based sighting considerations. Some 22 mission opportunities are found that satisfies the selection criteria. Spacecraft performance is presented for each mission opportunity based on use of a space shuttle, a twin stage inertial-upper-stage, and a conceptual solar-electric-propulsion-system with a nominal rendezvous 50 days before comet perihelion. Additional trajectory and propulsion enhancements are investigated for several comet rendezvous missions in order to improve spacecraft performance. An indirect transfer trajectory for an Encke mission is shown to offer substantial delivered payload. In addition the use of concentrator solar arrays is considered for several of the more interesting comet missions.

Sauer, C. G., Jr.↗

Trajectory-Based Performance Assessment for Aviation Weather Information

Based on an analysis of aviation decision-makers' time-related weather information needs, an abstraction of the aviation weather decision task was developed, that involves 4-D intersection testing between aircraft trajectory hypertubes and hazardous weather hypervolumes. The framework builds on the hypothesis that hazardous meteorological fields can be simplified using discrete boundaries of surrogate threat attributes. The abstractions developed in the framework may be useful in studying how to improve the performance of weather forecasts from the trajectory-centric perspective, as well as for developing useful visualization techniques of weather information.

Vigeant-Langlois, Laurence↗

Summary of Assessments Performed in FY 21 by SNL QA POC for FY 20 SNL NFCSC Milestone Deliverables

The Sandia National Laboratories (SNL) staff is meeting the requirements of the Nuclear Fuel Cycle and Supply Chain (NFCSC) Quality Assurance Program Document (QAPD). Each of the 5 NFCSC FY 20 packages for SNL were reviewed. None of the 5 packages had incorrect QRL categories. No major corrective actions are assigned. Additional and minor PICS:NE checkbox errors may exist, but none were identified in this assessment. Training is now also geared to encourage WPMs to take credit for optional technical reviews by considering setting the QRL level to 3. This is because when the level is set to 4, the PICS:NE system does not provide fields for review information. Finally, training in the NFCSC QAPD has been delivered as always to WPMs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Performance Assessment of OpenMP Compilers Targeting NVIDIA V100 GPUs

Heterogeneous systems are becoming increasingly prevalent. In order to exploit the rich compute resources of such systems, robust programming models are needed for application developers to seamlessly migrate legacy code from today’s systems to tomorrow’s. Over the past decade and more, directives have been established as one of the promising paths to tackle programmatic challenges on emerging systems. This work focuses on applying and demonstrating OpenMP offloading directives on five proxy applications. We observe that the performance varies widely from one compiler to the other; a crucial aspect of our work is reporting best practices to application developers who use OpenMP offloading compilers. While some issues can be worked around by the developer, there are other issues that must be reported to the compiler vendors. By restructuring OpenMP offloading directives, we gain an 18x speedup for the su3 proxy application on NERSC’s Cori system when using the Clang compiler, and a 15.7x speedup by switching max reductions to add reductions in the laplace mini-app when using the Cray-llvm compiler on Cori.

Davis, Josh↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-28)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications and their role in the overall ECP ecosystem. Our FY22 March/April milestone (ADCD- 504-28) proposed to: Assess the fidelity of proxy applications compared to their respective parents in terms of kernel and I/O behavior, and predictability. Similarity techniques will be applied for quantitative comparison of proxy/parent kernel behavior. MACSio evaluation will continue and support for OpenPMD backends will be explored. The execution time predictability of proxy apps with respect to their parents will be explored through a carefully designed scaling study and code comparisons. Note that in this FY, we also have quantitative assessment milestones that are due in September and are, therefore, not included in the description above or in this report. Another report on these deliverables will be generated and submitted upon completion of these milestones. To satisfy this milestone, the following specific tasks were completed: Study the ability of MACSio to represent I/O workloads of adaptive mesh codes. Re-define the performance counter groups for contemporary Intel and IBM platforms to better match specific hardware components and to better align across platforms (make cross-platform comparison more accurate). Perform cosine similarity study based on the new performance counter groups on the Intel and IBM P9 platforms. Perform detailed analysis of performance counter data to accurately average and align the data to maintain phases across all executions and develop methods to reduce the set of collected performance counters used in cosine similarity analysis. Apply a quantitative similarity comparison between proxy and parent CPU kernels. Perform scaling studies to understand the accuracy of predictability of the parent performance using its respective proxy application. This report presents highlights of these efforts.

97 MATHEMATICS AND COMPUTING↗

Performance Assessment of Baseline Cells for the High Efficiency Space Power Systems Project

The Enabling Technology Development and Demonstration (ETDD) Program High Efficiency Space Power Systems (HESPS) Project, formerly the Exploration Technology Development Program (ETDP) Energy Storage Project is tasked with developing advanced lithium-ion cells for future NASA Exploration missions. Under this project, components under development via various in-house and contracted efforts are delivered to Saft America for scale-up and integration into cells. Progress toward meeting project goals will be measured by comparing the performance to these cells with cells of a similar format with Saft s state-of-the-art aerospace chemistry. This report discusses the results of testing performed on the first set of baseline cells delivered by Saft to the NASA Glenn Research Center. This build is a cylindrical "DD" geometry with a 10 Ah nameplate capacity. Testing is being performed to establish baseline cell performance at conditions relevant to ETDD HESPS Battery Key Performance Parameter (KPP) goals including various temperatures, rates, and cycle life conditions. Data obtained from these cells will serve as a performance baseline for future cell builds containing optimized ETDD HESPSdeveloped materials. A test plan for these cells was developed to measure cell performance against the high energy cell KPP goals. The goal for cell-level specific energy of the high energy technology is 180 Wh/kg at a C/10 discharge rate and 0 C. The cells should operate for at least 2000 cycles at 100 percent DOD with 80 percent capacity retention. Baseline DD cells delivered 152 Wh/kg at 20 C. This number decreased to 143.9 Wh/kg with a 0 C discharge. This report provides performance data and summarizes results of the testing performed on the DD cells.

Schneidegger, Brianne T.↗

Performance assessment of long-legged tightly-baffled divertor geometries in the ARC reactor concept

Extremely intense power exhaust channels are projected for tokamak-based fusion power reactors; a means to handle them remains to be demonstrated. Advanced divertor configurations have been proposed as potential solutions. Recent modelling of tightly baffled, long-legged divertor geometries for the divertor test tokamak concept, ADX, has shown that these concepts may access passively stable, fully detached regimes over a broad range of parameters. The question remains as to how such divertors may perform in a reactor setting. To explore this, numerical simulations are performed with UEDGE for the long-legged divertor geometry proposed for the ARC pilot plant conceptual design - a device with projected heat flux power width (λq||) of 0.4 mm and power exhaust of 93 MW - first for a simplified Super-X divertor configuration (SXD) and then for the actual X-point target divertor (XPTD) being proposed. It is found that the SXD, combined with 0.5% fixed-fraction neon impurity concentration, can produce passively stable, detached divertor regimes for power exhausts in the range of 80-108 MW - fully accommodating ARC's power exhaust. The XPTD configuration is found to reduce the strike-point temperature by a factor of ~10 compared to the SXD for small separations (~1.4λq||) between main and divertor X-point magnetic flux surfaces. Even greater potential reductions are identified for reducing separations to ~1λq|| or less. The power handling response is found to be insensitive to the level of cross-field convective or diffusive transport assumed in the divertor leg. By raising the separatrix density by a factor of 1.5, stable fully detached divertor solutions are obtained that fully accommodate the ARC exhaust power without impurity seeding. To our knowledge, this is the first time an impurity-free divertor power handling scenario has been obtained in edge modelling for a tokamak fusion power reactor with λq|| of 0.4 mm.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance Assessment of Portable Optical Particle Spectrometer (POPS)

Accurate representation of atmospheric aerosol properties is a long-standing problem in atmospheric research. Modern pilotless aerial systems provide a new platform for atmospheric in situ measurement. However, small airborne platforms require miniaturized instrumentation due to apparent size, power, and weight limitations. A Portable Optical Particle Spectrometer (POPS) is an emerged instrument to measure ambient aerosol size distribution with high time and size resolution, designed for deployment on a small unmanned aerial system (UAS) or tethered balloon system (TBS) platforms. This study evaluates the performance of a POPS with an upgraded laser heater and additional temperature sensors in the aerosol pathway. POPS maintains its performance under different environmental conditions as long as the laser temperature remains above 25 °C and the aerosol flow temperature inside the optical chamber is 15 °C higher than the ambient temperature. The comparison between POPS and an Ultra-High Sensitivity Aerosol Spectrometer (UHSAS) suggests that the coincidence error is less than 25% when the number concentration is less than 4000 cm –3 . The size distributions measured by both of them remained unaffected up to 15,000 cm –3 . While both instruments’ sizing accuracy is affected by the aerosol chemical composition and morphology, the influence is more profound on the POPS.

47 OTHER INSTRUMENTATION↗

Performance assessment of 3D printed multi-material energy absorber for automotive bumper: pedestrian lower extremity protection

Designing an energy absorber for automotive bumpers involves balancing low-speed and high-speed impacts to ensure safety, reduce repair costs, and meet regulatory standards. Here, this study explores a novel design using multi-material 3D printing and structural optimization to fabricate a lightweight and cost-efficient energy absorber. The design effectively dissipates energy in low-speed collisions and minimizes force transmission in high-speed pedestrain impacts, helping to meet both safety and performance requirements. The energy absorber design combines 20% carbon fiber-reinforced acrylonitrile butadiene styrene (CF-ABS) and thermoplastic polyurethane (TPU) for optimal stiffness and flexibility. It uses 3D-printed lattice structures optimized through finite element simulations to help meet both low-speed and high-speed impact requirements. Full-scale energy absorbers were 3D-printed using optimized CF-ABS/TPU blends and tested under high-speed impact using the Flexible Pedestrian Legform Impactor (Flex-PLI). For fair comparison, a baseline bumper with a traditional triangular lattice structure, also 3D-printed from the same CF-ABS/TPU materials, was similarly tested. Interestingly, both the optimized and baseline 3D-printed energy absorbers showed nearly identical performance, successfully meeting injury limits. Their performances were also benchmarked against an injection-molded energy absorber. While both 3D-printed and injection-molded designs met injury limits, the 3D-printed absorber exhibited a higher tibia bending moment, indicating an opportunity for further optimization. A Techno-Economic Analysis compared the costs of producing energy absorbers using traditional manufacturing and 3D printing. The analysis highlighted that 3D printing offers cost benefits for low to medium production volumes, with the total cost per energy absorber at ∼ $\$$74, compared to traditional methods that become economical beyond 2000 units.

Additive manufacturing↗

Performance Assessment of a Large Scale Pulsejet- Driven Ejector System

Unsteady thrust augmentation was measured on a large scale driver/ejector system. A 72 in. long, 6.5 in. diameter, 100 lb(sub f) pulsejet was tested with a series of straight, cylindrical ejectors of varying length, and diameter. A tapered ejector configuration of varying length was also tested. The objectives of the testing were to determine the dimensions of the ejectors which maximize thrust augmentation, and to compare the dimensions and augmentation levels so obtained with those of other, similarly maximized, but smaller scale systems on which much of the recent unsteady ejector thrust augmentation studies have been performed. An augmentation level of 1.71 was achieved with the cylindrical ejector configuration and 1.81 with the tapered ejector configuration. These levels are consistent with, but slightly lower than the highest levels achieved with the smaller systems. The ejector diameter yielding maximum augmentation was 2.46 times the diameter of the pulsejet. This ratio closely matches those of the small scale experiments. For the straight ejector, the length yielding maximum augmentation was 10 times the diameter of the pulsejet. This was also nearly the same as the small scale experiments. Testing procedures are described, as are the parametric variations in ejector geometry. Results are discussed in terms of their implications for general scaling of pulsed thrust ejector systems

Paxson, Daniel E.↗

On-Orbit Calibration and Performance Assessments of Terra and Aqua Modis Thermal Emissive Bands

Terra and Aqua MODIS have successfully operated for more than 20 and 18 years, respectively, and far exceeded their designed lifetimes of 6 years. MODIS has 36 spectral bands, among which 16 are the thermal emissive bands (TEB) covering a wavelength range from 3.75 to 14.24 μm. Observations from the MODIS TEB have been used to generate a number of data products, such as surface/cloud/atmospheric temperatures, cloud top altitude, and water vapor properties. To a large extent, the quality of the MODIS L1B radiance product has been maintained through the entirety of each mission via extensive on-orbit calibration and validation efforts. MODIS TEB calibration uses a quadratic algorithm and is referenced to an on-board blackbody with its temperature measurements traceable to the NIST standard. We provide an overview of the MODIS instrument operations, key TEB calibration activities, and algorithms used in the latest L1B data Collection 6.1 (C6.1) and describe the TEB on-orbit performance for both Terra and Aqua MODIS. The TEB gain trends have been stable to within 5% over the Terra mission after 2003 under the same electronic configuration, except for bands 27 to 30, and within 3% over the Aqua mission. The Terra MODIS optical crosstalk correction implemented right after launch has been very effective in removing the ghost images in its photoconductive detector bands 32 to 36. Starting from C6.1, an electronic crosstalk correction algorithm has also been applied to the Terra MODIS photovoltaic detector long-wave infrared bands 27 to 30. The noise characterization performance remains stable with most TEB detectors continuously meeting their design requirements. A gradual loss of the Aqua MODIS radiative cooler margin reached its maximum in 2013 and has been slowly recovering since then. On-orbit changes in TEB response versus scan angle are extremely small based on pitch maneuver observations and assessments using vicarious approaches. The remaining challenges in TEB calibration and proposed improvements for the upcoming data collection with L1B data production and reprocessing are discussed.

Terra↗

Integrated GNC Modifications and Performance Assessments for the Mars Ascent Vehicle, Spin-Stabilized Upper Stage Configuration

The objective of the Mars Ascent Vehicle (MAV), an element of the Mars Sample Return (MSR) campaign, is to successfully transport Martian surface samples from the Martian surface to a stable Low-Martian Orbit. Complete autonomy is required throughout ascent, and orbital insertion is constrained by tight dispersion boundaries. Given mass requirements to merely transport the MAV onto the Martian surface, reducing the total mass of the MAV reduces stress on all other campaign elements. An unguided, spin-stabilized second stage MAV allows for lower overall vehicle mass, at the cost of reduced GNC capability. This paper presents GNC modifications developed and employed to improve the performance of an unguided, spin-stabilized second stage MAV configuration. These updates include a predictive calculation scheme to solve the spin-stabilized attitude necessary for successful orbital insertion, and a spin-stabilized control law for a preliminary low-rate first stage spin-up. Trades were conducted focusing on first and second stage low-rate and high-rate spin rates (and other factors) in MSFC's MANTIS toolkit through 6-degree-of-freedom simulation and Monte Carlo analysis, and are presented here.

Dane Erickson↗

Performance assessment of a real water source heat pump within a hardware-in-the-loop (HIL) testing environment

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while also maintaining the thermal comfort of building occupants. As the pivotal point between building electricity consumption and indoor thermal comfort, high-efficiency electrical vapor-compression heat pumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on heat pump operation and performance when subjected to different weather conditions, building loads, and grid requests calls for investigation and verification via experimental testing with actual heat pumps integrated with real-time building and grid responses. This study introduces a Water-Source Heat Pump (WSHP) Hardware-in-The-Loop (HIL) Test Facility that is the first of its kind. This testbed utilizes a 2-ton variable speed water-to-air heat pump that is capable of interacting with a virtual environment currently comprised of an EnergyPlus (E+) building simulation, an agent-based occupant behavioral model, and a single U-tube ground-loop heat exchanger (GLHE) model. Detailed descriptions of the testbed’s physical design and operation, virtual environment, as well as their mutual communication is provided. An uncertainty analysis is also performed under manufacturer specified heating and cooling design conditions. This analysis shows that the total load across the WSHP’s demand side heat exchanger, i.e., the sum of its latent and sensible components, can be measured with a relative uncertainty of ± 10.4% and ± 3.6% in cooling and heating mode respectively. The WSHP’s coefficient of performance (COP) can be measured with relative uncertainties of ± 10.4% in cooling mode, and ± 3.7% in heating mode. A preliminary 24-h experimental demonstration is then performed utilizing the DOE prototype small commercial office building model in E+. The simulation takes place in Atlanta, GA on the date of 08/26/15 from 12:00 AM to 11:59 PM using TMY3 weather data. Here, the results from this demonstration show that over the course of this experiment the simulated outputs of zone dry-bulb temperature, zone humidity ratio, and WSHP inlet water temperature can be tracked by testbed emulators up to a root mean squared error (RMSE) of ± 0.27 °C, ± 0.376 g/kg, and ± 0.85 °C respectively. The WSHP’s dynamic behavioral characteristics and performance are also captured, and correspond well with the authors’ previous understanding of heat pump efficiency as a function of evaporator and condenser fluid inlet conditions respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Risk-informed Graded Approach for Reliability and Performance Assessment of Sensor and Instrumentation Systems within Advanced Condition Monitoring Technologies

Advanced condition monitoring (ACM) technologies, such as digital twins, are innovative strategies designed to provide real-time health insights, including the remaining useful life of components. The primary goal of ACM is to predict and alert operators to potential functional failures before they occur. ACM systems achieve this by integrating predictive models with various sensor instrumentation, analog-to-digital converters, data warehouses, and data pre-processors. These sensor and instrumentation systems (SIS) are essential for forming a comprehensive understanding of component conditions and ensuring the predictive success of ACM programs. Introducing new technologies like ACM involves varying degrees of risk that can impact plant reliability. Therefore, risk mitigation should be commensurate with the performance and reliability of the developed technology, following a risk-informed graded approach (RIGA). Establishing a RIGA process requires a clear understanding of the hazards and reliability of all subsystems, including their interdependencies and potential impacts on the overall system. Given the critical role of SIS in ACM, this work reviews hazard identification and reliability quantification methods for SIS. It also considers these methods' implications when developing a RIGA process for ACM.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Performance Assessment of the NOAA-20 VIIRS RSB Using Deep Convective Clouds

The Visible Infrared Imaging Radiometer Suite (VIIRS) onboard the NOAA-20 (N20) satellite was launched on November 18, 2017. The N20 VIIRS reflective solar bands (RSBs) are calibrated on-orbit using a solar diffuser. An accurate on-orbit calibration is crucial to the high-quality downstream products facilitating atmosphere, ocean and land applications. In this study, the stability of the Level 1B (L1B) reflectance product is investigated using measurements over deep convective clouds (DCCs) for M-bands M1-M5, M7-M11, and I-bands I1-I3. The methodologies developed previously for Terra and Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) sensors and Suomi National Polar-orbiting Partnership (SNPP) VIIRS are extended and applied to the N20 RSB to derive DCC-based trends. The Collection 2 L1B data produced by NASA Land Science Investigator-led Processing Systems (SIPS) is used to evaluate the performance of the N20 VIIRS RSB calibration. At nadir, the reflectance trends for M1, M5, M8-M11, and I3 are insignificant compared to their corresponding variations (STDs) except for bands M2-M4, M7, and I1-I2, whose trends are larger than or equivalent to their STDs. The reflectance is relatively stable compared to their STDs for all the study RSBs at six aggregation zones across the entire scan angle range. Also discussed in this paper are the detector-to-detector differences and half-angle mirror side differences using the DCCs. Future applications using DCCs, which include an intercomparison with SNPP VIIRS, are also discussed.

N20 VIIRS↗