Search NASA⌕ Search

SEARCH · Search NASA

Results for “usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Battery Evaluation Profiles for X-57 and Future Urban Electric Aircraft

Battery energy density is one of the most critical design parameters for sizing all-electric aircraft, however it’s easily overestimated. Establishing the effective, usable energy density is confused by varying degrees of margin needed to account for structural and thermal management between different cell chemistry and pack designs. Therefore, a better methodology is needed to fairly compare emerging battery technologies for electric aircraft. Currently, there is a loss of critical information when vehicle trade studies are performed using “nominal” published cell-level performance metrics. Aircraft power demands rarely match these nominal power profiles, and aircraft designers lack the ability to accurately simulate the battery performance and temperature off-nominally unless the battery chemistry is well established. Conversely, battery suppliers have no generalized reference cases to publish more realistic performance metrics. This can lead to poor assumptions, such as aircraft studies assuming a fixed discharge efficiency of a battery, when in reality the usable energy in a pack is dependent on the power and thermal profile. Information needed to properly assess weight penalties for thermal management is also typically poorly characterized when assessing candidate batteries. This paper serves to better inform battery development, and similarly, provide aircraft designers with more realistic assumptions for applying knockdown margins in their designs. Detailed power and thermal performance estimates are provided, which provide a starting point for sizing power and thermal budgets using experimentally derived battery models. Results show that the X-57 battery-to-shaft efficiency is 77.3% for a particular optimized mission. Considering a 25% reserve on the battery capacity, this means that only roughly half of the original 55.3kWh ‘nominal’ pack energy can be converted to useful work during a mission. Further estimates on a clean-sheet VTOL optimization show an average 82.7% battery-to-shaft efficiency, using 98% peak efficiency inverters and 97.4% peak efficiency motors. Although higher battery efficiencies are possible, the resulting weight penalty negates improvement in vehicle performance. These trade-offs and resulting power profiles are provided as a starting point to better assess future battery designs.

Battery Electric Aircraft↗

Battery Evaluation Profiles for X-57 and Future Urban Electric Aircraft

Battery energy density is one of the most critical design parameters for sizing all-electric aircraft, however it’s easily overestimated. Establishing the effective, usable energy density is confused by varying degrees of margin needed to account for structural and thermal management between different cell chemistry and pack designs. Therefore, a better methodology is needed to fairly compare emerging battery technologies for electric aircraft. Currently, there is a loss of critical information when vehicle trade studies are performed using “nominal” published cell-level performance metrics. Aircraft power demands rarely match these nominal power profiles, and aircraft designers lack the ability to accurately simulate the battery performance and temperature off-nominally unless the battery chemistry is well established. Conversely, battery suppliers have no generalized reference cases to publish more realistic performance metrics. This can lead to poor assumptions, such as aircraft studies assuming a fixed discharge efficiency of a battery, when in reality the usable energy in a pack is dependent on the power and thermal profile. Information needed to properly assess weight penalties for thermal management is also typically poorly characterized when assessing candidate batteries. This paper serves to better inform battery development, and similarly, provide aircraft designers with more realistic assumptions for applying knockdown margins in their designs. Detailed power and thermal performance estimates are provided, which provide a starting point for sizing power and thermal budgets using experimentally derived battery models. Results show that the X-57 battery-to-shaft efficiency is 77.3% for a particular optimized mission. Considering a 25% reserve on the battery capacity, this means that only roughly half of the original 55.3kWh ‘nominal’ pack energy can be converted to useful work during a mission. Further estimates on a clean-sheet VTOL optimization show an average 82.7% battery-to-shaft efficiency, using 98% peak efficiency inverters and 97.4% peak efficiency motors. Although higher battery efficiencies are possible, the resulting weight penalty negates improvement in vehicle performance. These trade-offs and resulting power profiles are provided as a starting point to better assess future battery designs.

Battery↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER’s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use.

99 - GENERAL AND MISCELLANEOUS↗

Scalar Atomic Defect-Based Solid-State Self-calibrating Magnetometer (3SM) for Space Plasma Analysis

The Earth’s magnetosphere is a system of multiple, co-located particle populations interacting via plasma waves. Things to understand are driving processes, radiation belt and ring current issues, auroral physics, internal plasma processes, and magnetosphere-ionosphere mapping issues. These plasma-physics processes enable the Earth’s magnetosphere to evolve in response to temporal changes in the solar wind and they underlie the phenomena of space weather, which impacts spacecraft systems, astronauts, radio communications, and ground based electric-power grids. The objective of 3SM is to measure magnetic field strength and to calibrate the Vector Magnetometer (VM) device to maintain absolute accuracy during a mission. The 3SM features make the instrument preferably suited not only for the traditional role of scalar magnetometers as absolute references for the calibration of the on-board vector instruments, but also for extended operational capacities, such as higher frequency scalar measurements (of potential interest for magnetosphere studies for the low frequency part of the spectrum) or autonomous scalar / vector operations. Diamond has been the solid-state platform of choice for quantum device technologies for some time, however, it suffers from difficulties such as scalability, integration, and cost. While the diamond platform is very useful for quantum technologies, further development is needed to make it viable. The material platform of choice for NASA Glenn’s Quantum Sensing And Spin Physics (Q-SASP) is silicon carbide (SiC). This is due to the much higher industry development of the SiC material platform for high-power and high-temperature electronics. It leverages both the decades-long SiC development expertise and infrastructure at NASA Glenn and its growing capabilities in quantum metrology. To make SiC devices usable for quantum technologies such as quantum sources, a much deeper understanding of defects is needed. Q-SASP is developing quantum metrology capabilities to evaluate the energy structure, defect formation energy, band structure augmentation, generation/recombination rates, and limits of dipole-dipole coupling in non-metal implanted SiC devices. This can be achieved by analysis of zero-field splitting, low-field resonance, and singlet-triplet mixing through various forms of Electrically Detectable Magnetic Resonance (EDMR) and Near-Zero Field Magnetic Resonance (NZFMR) spectroscopy. This work will discuss recent system developments, device developments, computational modeling, and spectroscopy results and analysis of defects created by non-metal implantations in SiC devices. The defect formation energies of V Si ,V C , V C V Si , N C V Si , N Si , N C in 4H-SiC are previously reported values in other research [2]-[3]. The defect formation energies of PSi and PC were calculated in GPAW [fig 1A]. The basic underlying mechanism of the zero-field phenomenon is the mixing of singlet and triplet states [4]-[5]. In most spin-dependent transport, two electron spins are involved, and thus one must consider each of their interactions with the field. We investigated the electronic and magnetic properties of 4H-SiC and 6H-SiC. The defect formation energy helps us determine what types of defects we are observing in the SiC EDMR experiment. They have very low formation energy (it is negative). The phosphorus substitution in 4H-SiC is a very stable defect. The band diagrams provide us with vital information about how the electronic properties of SiC (such as band gap) change as we add non-metal defects. The zero-field splitting parameters allow us to study the inflection point in the NZFMR [fig 1B]. We clearly observed zero-field splitting. We also noted that the zero-field splitting remained constant with changing bias. We aspect it zero-field splitting to remain constant while the hyperfine and exchange interaction perturbations shift under the influence of an external magnetic field. This is the essence of quantum magnetometry and self-calibration.

space plasma↗

Component-Level Inverse Design of Transmon Qubits Using Neural Networks

Designing a superconducting qubit to realize specific Hamiltonian parameters typically requires iterating through a time and compute-intensive forward loop in which the designer chooses a layout geometry, simulates it, extracts circuit parameters such as capacitances, and refines the geometry. We study the inverse version of this task using a neural-network workflow that maps target Hamiltonian parameters directly to component-level layout parameters, which we subsequently demonstrate on a planar transmon layout. During training, we pair the inverse model with a frozen forward surrogate model and evaluate the loss in Hamiltonian space rather than in layout-parameter space. In validation against a conventional EM solver, 97% of generated designs produce usable geometries, and the inverse-plus-surrogate pipeline reaches mean percent errors of 0.73% for qubit frequency and 1.58% for anharmonicity, comparable to or below the fabrication and simulation-to-measurement uncertainty expected for academic-process transmon devices of this type. A single pipeline query takes ~60 ms on CPU, versus ~2 min for a conventional EM capacitance extraction on the same hardware, a speedup of approximately 2,000x. Batching minimizes the AI model inference overhead, reducing the runtime to 3.1 microseconds per sample on CPU and 2.6 microseconds per sample on GPU at a batch size of 2048, resulting in speedups of 3.9 x 10^7 and 4.6 x 10^7, respectively, relative to a single conventional CPU EM extraction. Our results indicate that component-level inverse design usefully extends and complements conventional EM simulation, including for small datasets on the order of 1,000 samples.

Seidel, Olivia [Fermilab; Texas U., Arlington]↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER?s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use. PowerPoint for conference that was reviewed in PRS and LRS PRS/CON-25-05379 and INL/CON-25-82946

99 - GENERAL AND MISCELLANEOUS↗

Electrostatic propulsion using C60 molecules

An evaluation is made of the potential benefits of C60 molecules as a basis for ion propulsion. Because C60 is storable, its use may result in a larger usable propellant fraction than previous methods of cluster ion propulsion. C60 may also relax such engineering constraints as grid spacing, which restrict the performance of noble gas ion propulsion. The behavior of C60 in a plasma discharge environment, as well as various electron impact cross sections of the molecule, will greatly afftect the feasibility of the concept.

Leifer, Stephanie D.↗

Experiences with SYCL on AMD GPUs with Kokkos

With the recent diversification of the hardware landscape in the high-performance computing (HPC) community, performance-portability solutions are becoming more and more important. One of the most popular choices is Kokkos, which recently became a Linux Foundation project. Most of its development is supported by the US Department of Energy and the French Alternative Energies and Atomic Energy Commission. Kokkos is implemented as a C++ library with multiple backends to support CPUs as well as various GPU architectures. These backends include OpenMP, CUDA, HIP, and also SCYL. This approach enables users to leverage the preferred vendor toolchain for the respective platform (e.g. CUDA, ROCm, OneAPI). The SYCL backend is used to target Intel GPUs, in particular to support the Aurora exascale supercomputer. However, SYCL itself also offers a large degree of portability, and in fact Kokkos’ CI for SYCL has been running on NVIDIA hardware due to a lack of access to Intel GPUs. In this report, we describe our experience with using Kokkos SYCL backend on AMD GPUs targeting the Frontier supercomputer at Oak Ridge National Laboratory. The two major SYCL implementations are DPC++ and AdaptiveCpp. While the Kokkos SYCL backend has been implemented using the former, the latter was the first implementation to target AMD GPUs. We will discuss the experience with both of these SYCL implementations in terms of functionality and performance. Using Kokkos to evaluate SYCL toolchains has a number of benefits. Kokkos’ use of SYCL is fairly complex, exercising features such as graphs, relocatable device functions, atomics – including for non-arithmetic types, as well as pinned and page migratable memory allocations. Kokkos also needs to implement capabilities such as Kokkos’ hierarchical parallelism that are not a straight-forward mapping to SYCL capabilities. Furthermore, a large number of libraries and applications that represent diverse use cases are implemented in Kokkos, providing readily available test cases for a toolchain evaluation. Preliminary results show that support for AMD GPUs in DPC++ is much less mature than for NVIDIA GPUs or Intel GPUs. While the situation has improved significantly over the last year, we still encounter many runtime failures, dispatching problems, and code generation issues. With AdaptiveCpp the challenges arise even earlier in the evaluation process. Since Kokkos’ SYCL implementation is largely focused on supporting Intel GPUs, we opted to leverage SYCL extensions which are available in DPC++ but not in AdaptiveCpp. Furthermore, AdaptiveCpp appears to be less conformant with the SYCL2020 standard which Kokkos relies on. In some cases, we are able to work around the lack of feature support, in other cases we have to disable certain Kokkos capabilities to evaluate the toolchain. Our evaluation will leverage Kokkos’ unit tests to establish basic functionality and feature completeness. We then use simple benchmarks for components of a CG implementation as a measure of usability and performance of the SYCL toolchains.

97 MATHEMATICS AND COMPUTING↗

Results from tests, with van-mounted sensor, of magnetic leader cable for aircraft guidance during roll-out and turnoff

Tests were conducted with a van mounted experimental magnetic leader cable sensor to evaluate its potential for measuring aircraft displacement and heading with respect to the leader cable during roll out and turnoff. Test results show that the system may be usable in measuring displacement but the heading measurement contains errors introduced by distortion of the magnetic field by the metal van or aircraft.

Young, J. C.↗

Piloted Simulator Investigation of Techniques to Achieve Attitude Command Response with Limited Authority Servos

The purpose of the study was to develop generic design principles for obtaining attitude command response in moderate to aggressive maneuvers without increasing SCAS series servo authority from the existing +/- 10%. In particular, to develop a scheme that would work on the UH-60 helicopter so that it can be considered for incorporation in future upgrades. The basic math model was a UH-60A version of GENHEL. The simulation facility was the NASA-Ames Vertical Motion Simulator (VMS). Evaluation tasks were Hover, Acceleration-Deceleration, and Sidestep, as defined in ADS-33D-PRF for Degraded Visual Environment (DVE). The DVE was adjusted to provide a Usable Cue Environment (UCE) equal to two. The basic concept investigated was the extent to which the limited attitude command authority achievable by the series servo could be supplemented by a 10%/sec trim servo. The architecture used provided angular rate feedback to only the series servo, shared the attitude feedback between the series and trim servos, and when the series servo approached saturation the attitude feedback was slowly phased out. Results show that modest use of the trim servo does improve pilot ratings, especially in and around hover. This improvement can be achieved with little degradation in response predictability during moderately aggressive maneuvers.

Key, David L.↗

Object Proxy Patterns for Accelerating Distributed Applications

Workflow and serverless frameworks have empowered new approaches to distributed application design by abstracting compute resources. However, their typically limited or one-size-fits-all support for advanced data flow patterns leaves optimization to the application programmer—optimization that becomes more difficult as data become larger. The transparent object proxy, which provides wide-area references that can resolve to data regardless of location, has been demonstrated as an effective low-level building block in such situations. Here we propose three high-level proxy-based programming patterns—distributed futures, streaming, and ownership—that make the power of the proxy pattern usable for more complex and dynamic distributed program structures. We motivate these patterns via careful review of application requirements and describe implementations of each pattern. As a result, we evaluate our implementations through a suite of benchmarks and by applying them in three meaningful scientific applications, in which we demonstrate substantial improvements in runtime, throughput, and memory usage.

Distributed Computing↗

An intelligent robot for helping astronauts

This paper describes the development status of a prototype supervised intelligent robot for space application for purposes of (1) helping the crew of a spacecraft such as the Space Station with various tasks, such as holding objects and retrieving/replacing tools and other objects from/into storage, and (2) for purposes of retrieving detached objects, such as equipment or crew, that have become separated from their spacecraft. In addition to this set of tasks in this low-Earth-orbiting spacecraft environment, it is argued that certain aspects of the technology can be viewed as generic in approach, thereby offering insight into intelligent robots for other tasks and environments. Candidate software architectures and their key technical issues which enable real work in real environments to be accomplished safely and robustly are addressed. Results of computer simulations of grasping floating objects are presented. Also described are characterization results on the usable reduced gravity environment in an aircraft flying parabola (to simulate weightlessness) and results on hardware performance there. These results show it is feasible to use that environment for evaluative testing of dexterous grasping based on real-time vision of freely rotating and translating objects.

Erickson, J. D.↗

A prototype supervised intelligent robot for helping astronauts

The development status is described of a prototype supervised intelligent robot for space application for purposes of (1) helping the crew of a spacecraft such as the Space Station with various tasks such as holding objects and retrieving/replacing tools and other objects from/into storage, and for purposes of (2) retrieving detached objects, such as equipment or crew, that have become separated from their spacecraft. In addition to this set of tasks in this low Earth orbiting spacecraft environment, it is argued that certain aspects of the technology can be viewed as generic in approach, thereby offering insight into intelligent robots for other tasks and environments. Also described are characterization results on the usable reduced gravity environment in an aircraft flying parabolas (to simulate weightlessness) and results on hardware performance there. These results show it is feasible to use that environment for evaluative testing of dexterous grasping based on real-time visual sensing of freely rotating and translating objects.

Erickson, J. D.↗

Evaluation of Pd-Cr Wires for Strain Gage Application

A newly developed alloy, palladium-13 weight percent chromium (Pd13Cr), was identified by United Technologies Research Center under a NASA contract to be the best material for high temperature strain gage applications. An electrical resistance strain gage that can provide accurate static strain measurement to a temperature higher than that of a commercially available gage is urgently needed in aerospace and aeronautics research. A strain gage made of a 25.4 micron (1 mil) diameter Pd13Cr wire has been recently demonstrated to be usable for static strain measurements to 800 C. This compares to the 400 C temperature limit of the commercially available strain gages. The performance of the Pd-Cr gage, however, strongly depends on the quality of the Pd13Cr wire. Four batches of Pd-Cr wires purchased from three different manufacturers were therefore evaluated to determine the best source of the wire for strain gage applications. The three suppliers were Precious Metal Institute in China, Sigmund Cohn Co., and G & S Titanium, Inc. in the United States. Two batches of wires obtained from Previous Metal Institute in 1987 and 1992, respectively are referred to herein as China87 and China92 wires. The mechanical, chemical and electrical properties of these wires, both as-received and after high temperature exposures at 800 C for 50 hours were analyzed. The elastic modulus and the failure strength of the wires were evaluated using a tensile test machine equipped with a laser speckle strain measurement system. The chemical and microstructural properties of the wires were inspected using a plasma atomic emission spectrometer and a scanning electron microscope (SEM) equipped with an energy dispersive X-ray spectroscope (EDS). The electrical stability and repeatability of the wires were determined by measuring the electrical resistance of the wires during three thermal cycles to 1000 C and a ten-hour soak at 1000 C. As a result of this study, the wire which has the highest strength, the least impurities content, the best oxidation resistance and the best electrical stability will be selected for upcoming strain gage applications.

Lei, Jih-Fen↗

Software Engineering Research/Developer Collaborations (C104)

The goal of this collaboration was to produce Flight Software Branch (FSB) process standards for software inspections which could be used across three new missions within the FSB. The standard was developed by Dr. Forrest Shull (Fraunhofer Center for Experimental Software Engineering, Maryland) using the Perspective-Based Inspection approach, (PBI research has been funded by SARP) , then tested on a pilot Branch project. Because the short time scale of the collaboration ruled out a quantitative evaluation, it would be decided whether the standard was suitable for roll-out to other Branch projects based on a qualitative measure: whether the standard received high ratings from Branch personnel as to usability and overall satisfaction. The project used for piloting the Perspective-Based Inspection approach was a multi-mission framework designed for reuse. This was a good choice because key representatives from the three new missions would be involved in the inspections. The perspective-based approach was applied to produce inspection procedures tailored for the specific quality needs of the branch. The technical information to do so was largely drawn through a series of interviews with Branch personnel. The framework team used the procedures to review requirements. The inspections were useful for indicating that a restructuring of the requirements document was needed, which led to changes in the development project plan. The standard was sent out to other Branch personnel for review. Branch personnel were very positive. However, important changes were identified because the perspective of Attitude Control System (ACS) developers had not been adequately represented, a result of the specific personnel interviewed. The net result is that with some further work to incorporate the ACS perspective, and in synchrony with the roll out of independent Branch standards, the PBI approach will be implemented in the FSB. Also, the project intends to continue its collaboration with the technology provider (Dr. Forrest Shull) past the end of the grant, to allow a more rigorous quantitative evaluation.

Shell, Elaine↗

A flight evaluation of VTOL jet transport under visual and simulated instrument conditions

A flight investigation was performed with the Dornier DO-31 VTOL to evaluate the performance, handling qualities, and operating characteristics that are considered to be important in the operation of a commerical VTOL transport in the terminal area. The DO-31, a 20,000 kilogram transport, has a mixed jet propulsion system; main engines with nozzles deflect from a cruise to a hover position, and vertical lift engines operated below 170 knots. This VTOL mode incorporates pitch and roll attitude and yaw rate stabilization. The tests concentrated on the transition, approach, and vertical landing. The mixed jet propulsion system provided a large usable performance envelope that enabled simulated IFR approaches to be made on 7 deg and 12 deg glide slopes. In these approaches management of thrust magnitude and direction was a primary problem, and some form of integrating the controls will be necessary. The handling qualities evaluation pointed out the need for additional research of define flight path criteria. The aircraft had satisfactory control and stability in hover out of ground effect. The recirculation effects in vertical landing were large below 15 meters.

Holzhauser, C. A.↗

A low-cost multiple-channel 12-GHz receiver for satellite television broadcasting

The design of a low-cost FM-microwave satellite-ground-station receiver is described. It is capable of accepting 12 contiguous color-television equivalent-bandwidth channels in the 11.72-12.2-GHz band using a wide-band FM format and frequency division multiplexing (FDM) of the channels. Each channel has 36 MHz of usable bandwidth with a 4-MHz guard band and provides a CATV compatible output. The overall system specifications are first discussed. Then consideration is given to the design, fabrication, and evaluation of the different subsystems in the receiver.

Risch, C. O.↗

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the preflight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented.

UAV display↗