Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.↗

Digital temperature sensor performance assessment report

Performance assessment data accumulated during exposure of the digital temperature sensor to simulated shuttle flight type environments are presented. The test parameters were specifically designed to check the sensor for its: (1) ability to resolve temperature relative to the design specifications; (2) ability to maintain accuracy after interchanging the temperature probes with each electronics interface assembly; (3) stability (i.e., satisfactory operation and accuracy during and after exposure to flight environments); and (4) repeatability, or its ability to produce the same output on subsequent exposures to the identical stimulus. Equipment list, test descriptions, data summary, and conclusions are included.

Canniff, J. H.↗

A new control score concept for building performance assessment

In buildings, performance assessment often focuses on energy use with metrics such as energy use intensity (EUI) used to benchmark performance. However, energy performance of a building is fundamentally determined by the control system that engages the energy-using systems. There are two aspects of control that are of particular importance: (1) the ability to regulate process variables to their setpoints; and (2) whether the setpoints are at the right levels and/or following desired profiles. Most buildings do not reach their energy efficiency potential due to deficiencies in control performance and operators do not have access to metrics that can illuminate these deficiencies. Here this paper addresses this problem by providing novel techniques that combine these two aspects of control performance into a single standardized score on the scale of 0-10. The concept of a standardized control scores enables all systems in a building to be compared on the same scale and also for scores to be rolled up to different levels in the building and system hierarchy for system-wide analysis. The paper presents the theory for the method, describes a prototype tool for displaying scores, and presents results from application to a large building in Minneapolis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

RANGERS: Modeling Report on Integrity and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

The Engineered Barrier System (EBS) plays an important role in ensuring the long-term safety and containment of high-level waste (HLW) and spent nuclear fuel (SNF) in deep geological repositories in salt formation. As part of a multi-barrier system, the EBS works alongside the natural barrier, which is the salt formation itself and the technical barrier comprising the disposal casks. The primary function of the EBS is to maintain containment during a defined period until the backfill used in the repository made of crushed salt, develops its sealing capacity through compaction. Over the time, the backfill eventually compacts to a state of low porosity and permeability, acting as a long-term seal. However, until this process is complete, the EBS must retain its structural and functional integrity. Regulatory guidelines in Germany currently require the EBS to remain effective for up to next ice age, that is expected in 50,000 years. The significant hydro-geological and topographic changes expected during an ice age could make it impossible to accurately predict the hydro-chemical conditions within the repository system at that time. In response to these challenges, BGE TECHNOLOGY GmbH (BGE TEC) and Sandia National Laboratories (SNL) have jointly developed a comprehensive methodology for the design and safety assessment of engineered barrier systems within the scope of the RANGERS project. This methodology is tailored for repositories in salt formations. The developed methodology provides a structured approach for designing and assessing the performance of the EBS in salt-based repositories. It begins with defining a sealing concept based on the geological characteristics of the selected site and the overall repository design. The entire repository system, comprising the geological site, repository infrastructure, and EBS, is then subjected to a Features, Events, and Processes (FEP) analysis, focusing solely on those FEPs that affect the EBS. The derived FEPs help identify the loads and stresses acting on the EBS, which serve as the foundation for conducting an integrity assessment. This analysis helps predict the EBS’s evolution and performance over the regulatory time frame, feeding into integrated performance assessment simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-11)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: "Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications." To satisfy this milestone, the following specific tasks were completed: Study ability of MACSio to represent I/O workloads of adaptive mesh codes; Prepare report on assessed performance and debugging tools; Perform cosine similarity study on Intel and P9 and submit paper; Complete LDMS/GPU subcontract, complete and receive report; Complete validation of LDMS data collection for GPUs and submit paper; and Perform cosine similarity study on GPUs.

97 MATHEMATICS AND COMPUTING↗

Special Analyses for the Hanford Integrated Disposal Facility Performance Assessment - 20102

In 2014, the Department of Energy (DOE) Office of River Protection and its contractors began to develop a performance assessment for the near-surface disposal of low-level and mixed low-level waste at the Hanford Site's Integrated Disposal Facility (IDF). The IDF is a doubly-lined landfill that was constructed between 2004 and 2006 to be the disposal facility for the vitrified low-activity waste that will be produced at the Waste Treatment and Immobilization Plant (WTP). IDF is also expected to receive solid secondary waste produced at the WTP and other solid wastes from site activities. The IDF has been in a preoperational state awaiting authorization from DOE and a RCRA permit modification from the State of Washington Department of Ecology to receive waste. Both the Disposal Authorization Statement and permit modification require a performance assessment demonstrating that the system of engineered and natural features will limit releases of radionuclides and hazardous chemicals from the IDF and be protective of human health and the environment. The simulated duration is 10,000 years. Based on the analyses presented in the 2017 Integrated Disposal Facility Performance Assessment, DOE issued a conditional Operating Disposal Authorization Statement for the IDF in June 2018. The long-term performance of the IDF to be protective of human health and the environment was evaluated under the requirements of DOE Order 435.1, Radioactive Waste Management. Computer simulations were performed to evaluate whether or not the IDF would comply with DOE requirements. In the time that has passed since the performance assessment was approved by DOE, new information has been discovered that had not been considered in the performance assessment. Since this new information has not been evaluated, the potential impact of the changes have not been taken into consideration in DoE's disposal authorization. DOE and its contractors follow a change control process to screen and, when necessary, evaluate new information that could potentially impact the conclusions of the completed performance assessment. This paper will describe the change control process and provide two examples of evaluations performed following the change control process. The first example evaluates a new waste form for liquid secondary waste that was not evaluated in the performance assessment. In the performance assessment, liquid secondary waste was assumed to be solidified with grout. A new recommendation to dispose of the liquid secondary waste after drying it to a powder was evaluated. The second example evaluates inventory implications from changes to the flow sheet that estimates the feed composition to the low-activity waste vitrification facility. The changes result in higher strontium concentrations in the vitrified waste stream. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DAG-TM Concept Element 11 CNS Performance Assessment: ADS-B Performance in the TRACON

Distributed Air/Ground (DAG) Traffic Management (TM) is an integrated operational concept in which flight deck crews, air traffic service providers and aeronautical operational control personnel use distributed decision-making to enable user preferences and increase system capacity, while meeting air traffic management (ATM) safety requirements. It is a possible operational mode under the Free Flight concept outlined by the RTCA Task Force 3. The goal of DAG-TM is to enhance user flexibility/efficiency and increase system capacity, without adversely affecting system safety or restricting user accessibility to the National Airspace System (NAS). DAG-TM will be accomplished with a human-centered operational paradigm enabled by procedural and technological innovations. These innovations include automation aids, information sharing and Communication, Navigation, and Surveillance (CNS) / ATM technologies. The DAG-TM concept is intended to eliminate static restrictions to the maximum extent possible. In this paradigm, users may plan and operate according to their preferences - as the rule rather than the exception - with deviations occurring only as necessary. The DAG-TM concept elements aim to mitigate the extent and impact of dynamic NAS constraints, while maximizing the flexibility of airspace operations

Raghavan, Rajesh S.↗

Development of a Conditioned System-Level Groundwater Model to Evaluate Long-Term Groundwater Impacts within a Performance Assessment - 20115

A preliminary performance assessment (PA) of single-shell tank Waste Management Area (WMA) A-AX located at the U.S. Department of Energy (DOE)'s Hanford Site in southeastern Washington is being conducted to satisfy the requirements of DOE Order 435.1 [1] as it relates to closure of the single-shell radioactive waste tanks in the WMA A-AX tank farms. A PA assesses the fate, transport, and impacts of radionuclides within a low-level radioactive waste disposal facility in its assumed closure configuration and the subsequent potential doses to humans over a 1,000-year compliance period and a 10,000-year performance evaluation period. The WMA A-AX preliminary PA evaluation is structured around the complementary use of process-level and system-level models to calculate the facility performance against established DOE Order 435.1 [1] performance objectives. Process-level models are those that represent a detailed phenomenological representation of processes of concern in the PA. Process models typically only represent one or a few of the components of the PA, such as groundwater flow and transport, and must be integrated with other modeling elements to perform PA calculations. System-level models are those that are abstracted from the process models, retaining the essential features of the process model, while allowing integration of all aspects of the PA in a single modeling framework. System-level models are often characterized by coarser numerical discretization, lower dimensionality, or other similar simplifications compared to the process-level model. Traditionally, a three-dimensional (3-D) process-level model is utilized primarily to evaluate the long-term impact on groundwater and the potential doses to individuals who consume contaminated groundwater. System-level models are also utilized to evaluate the groundwater pathway in PAs. These models typically have reduced dimensionality (1-D) and are conditioned utilizing flow fields (Darcy fluxes) and moisture content distributions that are abstracted from the process level models. The abstraction approach assures that the flow field in both models is consistent for a specific set of input parameters for flow, differing only in the discretization and dimensionality of the two models. The preliminary WMA A-AX PA incorporates a detailed representation of the geological system and hydraulic properties within the 3-D model STOMP{sup C} numerical code so that the effects of relevant features and processes on water flow and radionuclide transport in the subsurface can be evaluated. The complementary system-level model is developed utilizing the GoldSim{sup C} code to implement a simplified, 1-D equivalent model to represent the groundwater pathway. Contaminant transport through the vadose zone and unconfined aquifer for Tc-99 and I-129 were evaluated in each of the models. Adjustments to the saturated portion of the GoldSim{sup C} 1-D model were required to mimic the dispersion effect captured with the 3-D STOMP{sup C} model. Once this conditioning was conducted, highly similar results for the transport of Tc-99 and I-129 were achieved at the point of calculation, located 100 m downgradient from the WMA A-AX fenceline. These radionuclides represent elements that are regarded as primary dose drivers in the PA groundwater pathway analysis. The high degree of conformance between the two models suggests that the use of the equivalent 1-D system model is suitable for evaluating the full suite of radionuclides that will be released from the tank sources within WMA A-AX over the 1,000-year compliance period and over the 10,000-year evaluation period. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Tools Assessing Performance

For the distributed wind industry, it can be challenging to accurately predict the performance and annual energy production of projects prior to their installation. The U.S. Department of Energy’s Tools Assessing Performance (TAP) project aims to improve wind resource characterization, thereby reducing the uncertainty of project performance and financing costs, increasing consumer confidence, and lowering the levelized cost of distributed wind energy. A collaborative effort among DOE National Laboratories, TAP will create a computational framework that provides the distributed wind community with access to newly developed wind resource data and modeling capabilities. These capabilities will allow users to perform timely and accurate performance assessments for distributed wind projects at locations across the United States.

wind, distributed, tools, performance↗

Value of abstraction in performance assessment – When is a higher level of detail necessary?

In this study, different approaches in performance assessment (PA) of the long-term safety of a repository for radioactive waste were examined. This investigation was carried out as part of the DECOVALEX-2023 project, an international collaborative effort for research and model comparison. One specific task of the DECOVALEX-2023 project was the Salt Performance Assessment Modelling task (Salt PA), which aimed at comparing various models and methods employed in the performance assessment of deep geological repositories in salt. In the context of the Salt PA task, three distinct teams from SNL (United States), Quintessa Ltd (United Kingdom), and GRS (Germany) examined the consequences of employing different levels of abstractions when modelling the repository's geometry and implementing various features and processes, using the example of a simple hypothetical repository structure in domal salt. Each team applied their own tools: PFLOTRAN (SNL), QPAC (Quintessa) and LOPOS (GRS). These differ essentially regarding numerical concept and degree of detail in the representation of the underlying physical processes. The discussion focused on when simplifications can be appropriately applied and what consequences result from them. Furthermore, it was explored when and if a higher level of fidelity in geometry or physical processes is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Performance Assessment of Proxy Apps and Parents

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications.

97 MATHEMATICS AND COMPUTING↗

Performance assessment of planetary missions as launched from an orbiting space station

Results presented are intended to assist planners and the mission analysis community in assessing the performance impact (pro or con) of launching planetary missions from an orbiting space station as compared to the usual, ground-based Shuttle launch of such missions. The analyses comprising this assessment include: (1) a basic understanding and description of the space station launch problem; (2) examination of alternative injection strategies and selection of the most appropriate strategy for minimizing performance penalties; and (3) quantitative comparison of station-launched and Shuttle-launched performance over a wide energy/mass range of planetary mission opportunities. Data for each mission covers a full 360 deg of possible nodal location of the space station orbit. The main results are that planetary missions can be launched from a space station within acceptable penalty bounds, and that the station serving as a staging base/propellant depot can benefit some missions requiring large payload mass or high injection energy.

Friedlander, A.↗

Performance Assessment Closure Plan for the Active Low-Level Burial Ground Trenches 31, 34, and 94 at the Hanford Site

This report documents the closure plan for the active trenches within the Low-Level Burial Grounds of the Hanford Site, namely Trenches 31 and 34 in the 200 West Area and Trench 94 in 200 East Area. This closure plan is developed to meet the requirements of DOE O 435.1, Radioactive Waste Management. It is one of the several technical basis documents, along with the performance assessment (DOE/RL-2021-26, Performance Assessment of Active Trenches in 200 East and West Low-Level Burial Grounds at the Hanford Site), which is required for maintaining the Operating Disposal Authorization Statement as described in DOE-STD-5002-2017, Disposal Authorization Statement and Tank Closure Documentation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Preliminary design overview and performance assessment of the ITER low-field side reflectometer

The design of the ITER low-field side reflectometer (LFSR) has matured to a complete end-to-end preliminary design. LFSR will supply three key plasma measurements: (1) electron density profile, (2) electron density fluctuations, and (3) poloidal rotation. Simultaneous measurements of the three quantities are enabled by an array of six monostatic antennas which inject from an equatorial port on the outboard side of the ITER vessel. Low-loss transmission lines, consisting of corrugated, overmoded waveguide and miter bends, transmit the 30–165 GHz, O- and X-mode signals to and from the ITER plasma. Integrated transmission-line components serve a range of purposes, such as protection from high-power stray radiofrequency radiation, accommodation of transmission-line displacement, and simultaneous measurement of reference and plasma phases during the discharge. Broadband transmission signals are realized by full-band microwave transceivers combined with quasi-optical multiplexing. A field-programmable gate array (FPGA) processor demodulates the profile reflectometer signals, enabling real-time density profile measurements for plasma control system feedback. A full-scale transmission line test facility provides an integrated environment to assess the performance of critical LFSR components. Theoretical modeling together with insertion loss measurements provide the basis for a comprehensive power budget, which accounts for transmitted output power, transmission-line losses, antenna coupling, and plasma effects. Results indicate that high signal-to-noise ratios are achievable with the current design. A synthetic reflectometer model, using real design parameters and baseline ITER profiles, has been developed to estimate the return signal. With evolving microwave and data acquisition technologies, full-band, ultrafast sweeps (<1 μs) will be realizable for ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Working Fluid Characterization and Performance Assessment of Subcritical Organic Rankine Cycles Based on the Lee–Kesler Approach for Energy Recovery

Here, a generalized model using the Lee–Kesler approach based on the corresponding states principle is developed to assess the performance of subcritical Organic Rankine Cycles operating with different working fluids. Each fluid is characterized by five parameters: the acentric factor, critical temperature, critical pressure, molar mass, and the ideal-gas ratio of specific heats at the critical temperature. The model was developed using the compressibility factor modified version of the Benedict–Webb–Rubin equation proposed by Lee and Kesler and the enthalpy and entropy functions to calculate thermodynamic state properties. The model was validated by comparing the results calculated with the model and working fluid thermodynamic properties obtained with the CoolProp database. This comparison was conducted for 91 working fluids, obtaining a relative error below 5% for 88 out of the 91 fluids (∼97%). A generalized parametric study was conducted to determine the influence of the pinch point and each fluid parameter on the performance of Organic Rankine Cycle (ORC) systems. It was found that efficiency increases with critical temperature, ideal-gas ratio of specific heats at the critical temperature, and acentric factor, reaching up to 13%. The developed model enables the evaluation of ORC system performance for existing working fluids. It also allows the formulation and evaluation of new fluids to enhance the performance of the ORC while retrieving energy from any kind of source; and likewise, the methodology can be applied to other power generation cycles.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Performance assessment of the TDRSS Onboard Navigation System (TONS) experiment on EP/EUVE

The National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) is currently developing an operational Tracking and Data Relay Satellite (TDRS) System (TDRSS) Onboard Navigation System (TONS) to provide onboard knowledge of high-accuracy navigation products autonomously to users of TDRSS and its successor, TDRS-2. A TONS experiment has been implemented on the Explorer Platform/Extreme Ultraviolet Explorer (EP/EUVE) spacecraft, launched June 7, 1992, to flight qualify the TONS operational system using TDRSS forward-link communications services. This paper assesses the performance of the TONS flight hardware, an ultrastable oscillator (USO) and Doppler extractor (DE) card in one of the TDRSS user transponders, and the protoype flight software, based on the TONS experiment results. An overview of onboard navigation via TDRSS is also presented for both the EP/EUVE experiment and for future users of TONS. USO and DE short-term and long-term stability performance has been excellent. TONS Flight Software analysis indicates that position accuracies of better than 25 meters root-mean-square are achievable with tracking every one to two orbits, for the EP/EUVE 525-kilometer altitudes, 28.5-degree inclination orbit. The success of the TONS experiment demonstrates the flight readiness of TONS, which is scheduled to provide autonomous navigation for the Earth Observing System (EOS)-AM mission.

Gramling, C. J.↗

Performance Assessment of Two GPS Receivers on Space Shuttle

Space Shuttle STS-69 was launched on September 7, 1995, carrying the Wake Shield Facility (WSF-02) among its payloads. The mission included two GPS receivers: a Collins 3M receiver onboard the Endeavour and an Osborne flight TurboRogue, known as the TurboStar, onboard the WSF-02. Two of the WSF-02 GPS Experiment objectives were to: (1) assess the ability to use GPS in a relative satellite positioning mode using the receivers on Endeavour and WSF-02; and (2) assess the performance of the receivers to support high precision orbit determination at the 400 km altitude. Three ground tests of the receivers were conducted in order to characterize the respective receivers. The analysis of the tests utilized the Double Differencing technique. A similar test in orbit was conducted during STS-69 while the WSF-02 was held by the Endeavour robot arm for a one hour period. In these tests, biases were observed in the double difference pseudorange measurements, implying that biases up to 140 m exist which do not cancel in double differencing. These biases appear to exist in the Collins receiver, but their effect can be mitigated by including measurement bias parameters to accommodate them in an estimation process. An additional test was conducted in which the orbit of the combined Endeavour/WSF-02 was determined independently with each receiver. These one hour arcs were based on forming double differences with 13 TurboRogue receivers in the global IGS network and estimating pseudorange biases for the Collins. Various analyses suggest the TurboStar overall orbit accuracy is about one to two meters for this period, based on double differenced phase residuals of 34 cm. These residuals indicate the level of unmodeled forces on Endeavour produced by gravitational and nongravitational effects. The rms differences between the two independently determined orbits are better than 10 meters, thereby demonstrating the accuracy of the Collins-determined orbit at this level as well as the accuracy of the relative positioning using these two receivers.

Schroeder, Christine A.↗