Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.↗

Digital temperature sensor performance assessment report

Performance assessment data accumulated during exposure of the digital temperature sensor to simulated shuttle flight type environments are presented. The test parameters were specifically designed to check the sensor for its: (1) ability to resolve temperature relative to the design specifications; (2) ability to maintain accuracy after interchanging the temperature probes with each electronics interface assembly; (3) stability (i.e., satisfactory operation and accuracy during and after exposure to flight environments); and (4) repeatability, or its ability to produce the same output on subsequent exposures to the identical stimulus. Equipment list, test descriptions, data summary, and conclusions are included.

Canniff, J. H.↗

A new control score concept for building performance assessment

In buildings, performance assessment often focuses on energy use with metrics such as energy use intensity (EUI) used to benchmark performance. However, energy performance of a building is fundamentally determined by the control system that engages the energy-using systems. There are two aspects of control that are of particular importance: (1) the ability to regulate process variables to their setpoints; and (2) whether the setpoints are at the right levels and/or following desired profiles. Most buildings do not reach their energy efficiency potential due to deficiencies in control performance and operators do not have access to metrics that can illuminate these deficiencies. Here this paper addresses this problem by providing novel techniques that combine these two aspects of control performance into a single standardized score on the scale of 0-10. The concept of a standardized control scores enables all systems in a building to be compared on the same scale and also for scores to be rolled up to different levels in the building and system hierarchy for system-wide analysis. The paper presents the theory for the method, describes a prototype tool for displaying scores, and presents results from application to a large building in Minneapolis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

RANGERS: Modeling Report on Integrity and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

The Engineered Barrier System (EBS) plays an important role in ensuring the long-term safety and containment of high-level waste (HLW) and spent nuclear fuel (SNF) in deep geological repositories in salt formation. As part of a multi-barrier system, the EBS works alongside the natural barrier, which is the salt formation itself and the technical barrier comprising the disposal casks. The primary function of the EBS is to maintain containment during a defined period until the backfill used in the repository made of crushed salt, develops its sealing capacity through compaction. Over the time, the backfill eventually compacts to a state of low porosity and permeability, acting as a long-term seal. However, until this process is complete, the EBS must retain its structural and functional integrity. Regulatory guidelines in Germany currently require the EBS to remain effective for up to next ice age, that is expected in 50,000 years. The significant hydro-geological and topographic changes expected during an ice age could make it impossible to accurately predict the hydro-chemical conditions within the repository system at that time. In response to these challenges, BGE TECHNOLOGY GmbH (BGE TEC) and Sandia National Laboratories (SNL) have jointly developed a comprehensive methodology for the design and safety assessment of engineered barrier systems within the scope of the RANGERS project. This methodology is tailored for repositories in salt formations. The developed methodology provides a structured approach for designing and assessing the performance of the EBS in salt-based repositories. It begins with defining a sealing concept based on the geological characteristics of the selected site and the overall repository design. The entire repository system, comprising the geological site, repository infrastructure, and EBS, is then subjected to a Features, Events, and Processes (FEP) analysis, focusing solely on those FEPs that affect the EBS. The derived FEPs help identify the loads and stresses acting on the EBS, which serve as the foundation for conducting an integrity assessment. This analysis helps predict the EBS’s evolution and performance over the regulatory time frame, feeding into integrated performance assessment simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-11)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: "Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications." To satisfy this milestone, the following specific tasks were completed: Study ability of MACSio to represent I/O workloads of adaptive mesh codes; Prepare report on assessed performance and debugging tools; Perform cosine similarity study on Intel and P9 and submit paper; Complete LDMS/GPU subcontract, complete and receive report; Complete validation of LDMS data collection for GPUs and submit paper; and Perform cosine similarity study on GPUs.

97 MATHEMATICS AND COMPUTING↗

DAG-TM Concept Element 11 CNS Performance Assessment: ADS-B Performance in the TRACON

Distributed Air/Ground (DAG) Traffic Management (TM) is an integrated operational concept in which flight deck crews, air traffic service providers and aeronautical operational control personnel use distributed decision-making to enable user preferences and increase system capacity, while meeting air traffic management (ATM) safety requirements. It is a possible operational mode under the Free Flight concept outlined by the RTCA Task Force 3. The goal of DAG-TM is to enhance user flexibility/efficiency and increase system capacity, without adversely affecting system safety or restricting user accessibility to the National Airspace System (NAS). DAG-TM will be accomplished with a human-centered operational paradigm enabled by procedural and technological innovations. These innovations include automation aids, information sharing and Communication, Navigation, and Surveillance (CNS) / ATM technologies. The DAG-TM concept is intended to eliminate static restrictions to the maximum extent possible. In this paradigm, users may plan and operate according to their preferences - as the rule rather than the exception - with deviations occurring only as necessary. The DAG-TM concept elements aim to mitigate the extent and impact of dynamic NAS constraints, while maximizing the flexibility of airspace operations

Raghavan, Rajesh S.↗

Value of abstraction in performance assessment – When is a higher level of detail necessary?

In this study, different approaches in performance assessment (PA) of the long-term safety of a repository for radioactive waste were examined. This investigation was carried out as part of the DECOVALEX-2023 project, an international collaborative effort for research and model comparison. One specific task of the DECOVALEX-2023 project was the Salt Performance Assessment Modelling task (Salt PA), which aimed at comparing various models and methods employed in the performance assessment of deep geological repositories in salt. In the context of the Salt PA task, three distinct teams from SNL (United States), Quintessa Ltd (United Kingdom), and GRS (Germany) examined the consequences of employing different levels of abstractions when modelling the repository's geometry and implementing various features and processes, using the example of a simple hypothetical repository structure in domal salt. Each team applied their own tools: PFLOTRAN (SNL), QPAC (Quintessa) and LOPOS (GRS). These differ essentially regarding numerical concept and degree of detail in the representation of the underlying physical processes. The discussion focused on when simplifications can be appropriately applied and what consequences result from them. Furthermore, it was explored when and if a higher level of fidelity in geometry or physical processes is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Performance Assessment of Proxy Apps and Parents

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications.

97 MATHEMATICS AND COMPUTING↗

Performance assessment of planetary missions as launched from an orbiting space station

Results presented are intended to assist planners and the mission analysis community in assessing the performance impact (pro or con) of launching planetary missions from an orbiting space station as compared to the usual, ground-based Shuttle launch of such missions. The analyses comprising this assessment include: (1) a basic understanding and description of the space station launch problem; (2) examination of alternative injection strategies and selection of the most appropriate strategy for minimizing performance penalties; and (3) quantitative comparison of station-launched and Shuttle-launched performance over a wide energy/mass range of planetary mission opportunities. Data for each mission covers a full 360 deg of possible nodal location of the space station orbit. The main results are that planetary missions can be launched from a space station within acceptable penalty bounds, and that the station serving as a staging base/propellant depot can benefit some missions requiring large payload mass or high injection energy.

Friedlander, A.↗

Performance Assessment Closure Plan for the Active Low-Level Burial Ground Trenches 31, 34, and 94 at the Hanford Site

This report documents the closure plan for the active trenches within the Low-Level Burial Grounds of the Hanford Site, namely Trenches 31 and 34 in the 200 West Area and Trench 94 in 200 East Area. This closure plan is developed to meet the requirements of DOE O 435.1, Radioactive Waste Management. It is one of the several technical basis documents, along with the performance assessment (DOE/RL-2021-26, Performance Assessment of Active Trenches in 200 East and West Low-Level Burial Grounds at the Hanford Site), which is required for maintaining the Operating Disposal Authorization Statement as described in DOE-STD-5002-2017, Disposal Authorization Statement and Tank Closure Documentation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Working Fluid Characterization and Performance Assessment of Subcritical Organic Rankine Cycles Based on the Lee–Kesler Approach for Energy Recovery

Here, a generalized model using the Lee–Kesler approach based on the corresponding states principle is developed to assess the performance of subcritical Organic Rankine Cycles operating with different working fluids. Each fluid is characterized by five parameters: the acentric factor, critical temperature, critical pressure, molar mass, and the ideal-gas ratio of specific heats at the critical temperature. The model was developed using the compressibility factor modified version of the Benedict–Webb–Rubin equation proposed by Lee and Kesler and the enthalpy and entropy functions to calculate thermodynamic state properties. The model was validated by comparing the results calculated with the model and working fluid thermodynamic properties obtained with the CoolProp database. This comparison was conducted for 91 working fluids, obtaining a relative error below 5% for 88 out of the 91 fluids (∼97%). A generalized parametric study was conducted to determine the influence of the pinch point and each fluid parameter on the performance of Organic Rankine Cycle (ORC) systems. It was found that efficiency increases with critical temperature, ideal-gas ratio of specific heats at the critical temperature, and acentric factor, reaching up to 13%. The developed model enables the evaluation of ORC system performance for existing working fluids. It also allows the formulation and evaluation of new fluids to enhance the performance of the ORC while retrieving energy from any kind of source; and likewise, the methodology can be applied to other power generation cycles.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Performance assessment of the TDRSS Onboard Navigation System (TONS) experiment on EP/EUVE

The National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) is currently developing an operational Tracking and Data Relay Satellite (TDRS) System (TDRSS) Onboard Navigation System (TONS) to provide onboard knowledge of high-accuracy navigation products autonomously to users of TDRSS and its successor, TDRS-2. A TONS experiment has been implemented on the Explorer Platform/Extreme Ultraviolet Explorer (EP/EUVE) spacecraft, launched June 7, 1992, to flight qualify the TONS operational system using TDRSS forward-link communications services. This paper assesses the performance of the TONS flight hardware, an ultrastable oscillator (USO) and Doppler extractor (DE) card in one of the TDRSS user transponders, and the protoype flight software, based on the TONS experiment results. An overview of onboard navigation via TDRSS is also presented for both the EP/EUVE experiment and for future users of TONS. USO and DE short-term and long-term stability performance has been excellent. TONS Flight Software analysis indicates that position accuracies of better than 25 meters root-mean-square are achievable with tracking every one to two orbits, for the EP/EUVE 525-kilometer altitudes, 28.5-degree inclination orbit. The success of the TONS experiment demonstrates the flight readiness of TONS, which is scheduled to provide autonomous navigation for the Earth Observing System (EOS)-AM mission.

Gramling, C. J.↗

Performance Assessment of Two GPS Receivers on Space Shuttle

Space Shuttle STS-69 was launched on September 7, 1995, carrying the Wake Shield Facility (WSF-02) among its payloads. The mission included two GPS receivers: a Collins 3M receiver onboard the Endeavour and an Osborne flight TurboRogue, known as the TurboStar, onboard the WSF-02. Two of the WSF-02 GPS Experiment objectives were to: (1) assess the ability to use GPS in a relative satellite positioning mode using the receivers on Endeavour and WSF-02; and (2) assess the performance of the receivers to support high precision orbit determination at the 400 km altitude. Three ground tests of the receivers were conducted in order to characterize the respective receivers. The analysis of the tests utilized the Double Differencing technique. A similar test in orbit was conducted during STS-69 while the WSF-02 was held by the Endeavour robot arm for a one hour period. In these tests, biases were observed in the double difference pseudorange measurements, implying that biases up to 140 m exist which do not cancel in double differencing. These biases appear to exist in the Collins receiver, but their effect can be mitigated by including measurement bias parameters to accommodate them in an estimation process. An additional test was conducted in which the orbit of the combined Endeavour/WSF-02 was determined independently with each receiver. These one hour arcs were based on forming double differences with 13 TurboRogue receivers in the global IGS network and estimating pseudorange biases for the Collins. Various analyses suggest the TurboStar overall orbit accuracy is about one to two meters for this period, based on double differenced phase residuals of 34 cm. These residuals indicate the level of unmodeled forces on Endeavour produced by gravitational and nongravitational effects. The rms differences between the two independently determined orbits are better than 10 meters, thereby demonstrating the accuracy of the Collins-determined orbit at this level as well as the accuracy of the relative positioning using these two receivers.

Schroeder, Christine A.↗

Performance Assessment of Fluidic Oscillators Tested on the NASA Hump Model

Flow separation control over a wall-mounted hump model was studied experimentally to assess the performance of fluidic oscillators (sweeping jet actuators). An array of fluidic oscillators was used to control flow separation. The results showed that the fluidic oscillators were able to achieve substantial control over the separated flow by increasing the upstream suction pressure and downstream pressure recovery. Using the data available in the literature, the performance of the fluidic oscillators was compared to other active flow control (AFC) methods such as steady blowing, steady suction, and zero-net-mass-flux (ZNMF) actuators. Several integral parameters, such as the inviscid flow comparison coefficient, pressure drag coefficient, and modified normal force coefficient, were used as quality metrics in the performance comparison of the AFC methods. These quality metrics indicated the superiority of the steady suction method, especially at lower excitation amplitudes that is followed by the fluidic oscillators, steady blowing, and the ZNMF actuators, respectively. An aerodynamic figure of merit (AFM) was also constructed using the integral parameters and AFC power usage. The AFM results revealed that, for this study, steady suction was the most efficient AFC method at lower excitation amplitudes. The steady suction loses its efficiency as the excitation amplitude increases, and the fluidic oscillators become the most efficient AFC method. Both the steady suction and the fluidic oscillators have an AFM > 1 for the range tested in this study, indicating that they provide a net benefit when the AFC power consumption is also considered. On the other hand, both the steady blowing and ZNMF actuators were found to be inefficient AFC methods (AFM < 1) for the current configuration. Although they improved the flow field by controlling flow separation, the power requirement was more than their benefit.

Fluidic oscillators↗

A Performance Assessment of Eight Low-Boom High-Speed Civil Transport Concepts

A performance assessment of eight low-boom high speed civil transport (HSCT) configurations and a reference HSCT configuration has been performed. Although each of the configurations was designed with different engine concepts, for consistency, a year 2005 technology, 0.4 bypass ratio mixed-flow turbofan (MFTF) engine was used for all of the performance assessments. Therefore, all original configuration nacelles were replaced by a year 2005 MFRF nacelle design which corresponds to the engine deck utilized. The engine thrust level was optimized to minimize vehicle takeoff gross weight. To preserve the configuration's sonic-boom shaping, wing area was not optimized or altered from its original design value. Performance sizings were completed when possible for takeoff balanced field lengths of 11,000 ft and 12,000 ft, not considering FAR Part 36 Stage III noise compliance. Additionally, an arbitrary sizing with thrust-to-weight ratio equal to 0.25 was performed, enabling performance levels to be compared independent of takeoff characteristics. The low-boom configurations analyzed included designs from the Boeing Commercial Airplane Group, Douglas Aircraft Company, Ames Research Center, and Langley Research Center. This paper discusses the technology level assumptions, mission profile, analysis methodologies, and the results of the assessment. The results include maximum lift-to-drag ratios, total fuel consumption, number of passengers, optimum engine sizing plots, takeoff performance, mission block time, and takeoff gross weight for all configurations. Results from the low-boom configurations are also compared with a non-low-boom reference configuration. Configuration dependent advantages or deficiencies are discussed as warranted.

Baize, Daniel G.↗

Performance assessment for climate intervention (PACI): preliminary application to a stratospheric aerosol injection scenario

As the prospect of exceeding global temperature targets set forth in the Paris Agreement becomes more likely, methods of climate intervention are increasingly being explored. With this increased interest there is a need for an assessment process to understand the range of impacts across different scenarios against a set of performance goals in order to support policy decisions. The methodology and tools developed for Performance Assessment (PA) for nuclear waste repositories shares many similarities with the needs and requirements for a framework for climate intervention. Using PA, we outline and test an evaluation framework for climate intervention, called Performance Assessment for Climate Intervention (PACI) with a focus on Stratospheric Aerosol Injection (SAI). We define a set of key technical components for the example PACI framework which include identifying performance goals, the extent of the system, and identifying which features, events, and processes are relevant and impactful to calculating model output for the system given the performance goals. Having identified a set of performance goals, the performance of the system, including uncertainty, can then be evaluated against these goals. Using the Geoengineering Large Ensemble (GLENS) scenario, we develop a set of performance goals for monthly temperature, precipitation, drought index, soil water, solar flux, and surface runoff. The assessment assumes that targets may be framed in the context of risk-risk via a risk ratio, or the ratio of the risk of exceeding the performance goal for the SAI scenario against the risk of exceeding the performance goal for the emissions scenario. From regional responses, across multiple climate variables, it is then possible to assess which pathway carries lower risk relative to the goals. The assessment is not comprehensive but rather a demonstration of the evaluation of an SAI scenario. Future work is needed to develop a more complete assessment that would provide additional simulations to cover parametric and aleatory uncertainty and enable a deeper understanding of impacts, informed scenario selection, and allow further refinements to the approach.

climate intervention↗