Search NASA⌕ Search

SEARCH · Search NASA

Results for “Usability evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

150 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Misr: Miniature Ignition Screening Rapid Compression Machine for Kinetic Measurements of Novel Fuels (Final Report)

High throughput ignition screening would be useful for evaluating fuels before scaled production. One method for doing this involves generating a map of ignition delay times over different conditions for each fuel blend. Constant condition ignition delay time maps can be used to estimate ignition for engines in prescribed thermodynamic trajectories. A Miniaturized Ignition Screening Rapid Compression Machine (MISR) has been developed and built at the University of Illinois Chicago (UIC) intending to generate those constant condition ignition delay time maps for low temperature chemistry relevant conditions. Some design features include a bellows-actuated driver section, which is lighter compared to other RCM designs, an adjustable brake section, and full optical access. The setup was designed to achieve reaction conditions (T > 600K and P < 100 bar with repetition rates of about 8 seconds per experiment). These conditions were meant to be relevant to low-to-intermediate temperature auto-ignition and for generation of data for developing relevant chemical kinetics models or ignition maps. Because of the compression characteristics and the heat loss characteristics of the MISR, the apparatus currently tests higher temperatures over shorter test times than what would be desirable, however there are some pathways to improved compression characteristics as detailed in this report. A detailed description of the MISR design and its operating mechanism is discussed. The team faced several challenges and setbacks in the construction and commissioning of the MISR, and those are highlighted, along with the modifications that were performed to get the MISR operational. To demonstrate the performance characteristics of the MISR, limited ignition delay experiments were conducted for ethanol fuel at different equivalence ratios (Φ), and those results were usable, but again test a higher temperature and shorter ignition delay time than initially intended.

02 PETROLEUM↗
DOE OSTI2025

Preliminary Evaluation of Joint Electricity-Hydrogen Concept of Operations

An initial thermal power dispatch (TPD) concept of operations was evaluated that couples a nuclear power plant to a nearby hydrogen production plant. GSE Systems’ generic pressurized water reactor full-scope simulator was modified with a TPD model comprised of a thermal power extraction and delivery system. A prototype human-system interface (HSI) was developed to interact with the TPD model and allow participants to execute the basic operating scenarios for normal operations. Four retired operators performed the evaluation, and due to COVID-19 travel restrictions, the original in-person experimental design was restructured to support a remote participator evaluation using a web meeting platform. Data from operator feedback, observations from the research team, and quantitative survey responses revealed that the initial TPD concept of operations is feasible. The operators were comfortable with the engineered system and HSI and could manage it without adverse impacts to reactor power, plant safety, or equipment. Findings are discussed in terms of both the TPD system design and HSI performance.

human factors↗
DOE OSTI2021

Windowed multipole representation of R -matrix cross sections

Nuclear cross sections are basic inputs to any nuclear computation. Campaigns of experiments are fitted with the parametric R-matrix model of quantum nuclear interactions, and the resulting cross sections are documented—both pointwise and as resonance parameters (with uncertainties)—in standard evaluated nuclear data libraries (ENDF, JEFF, BROND, JENDL, CENDL, TENDL): these constitute our common knowledge of fundamental low-energy nuclear cross sections. In the past decade, a collaborative effort has been deployed to establish a new nuclear cross-section library format—the Windowed Multipole Library—with the goal of considerably reducing the computational cost of cross-section calculations in nuclear transport simulations. This work lays the theoretical foundations underpinning these efforts. From general R-matrix scattering theory, we derive the windowed multipole representation of nuclear cross sections. Though physically and mathematically equivalent to R-matrix cross sections, the windowed multipole representation is particularly well suited for subsequent temperature treatment of angle-integrated cross sections, in particular Doppler broadening, which is the averaging of cross sections over the thermal motion of the target atoms. Doppler broadening is of critical importance in neutron transport applications, as it ensures the stability of many nuclear reactors (negative thermal reactivity). Yet, Doppler broadening of nuclear cross sections has been a considerable bottleneck for nuclear transport computations, often requiring memory-costly pretabulations. We show that the windowed multipole representation can perform accurate Doppler broadening analytically (up to the first reaction threshold), from which we derive cross-section temperature derivatives to any order—all computable on the fly (without precalculations stored in memory). Furthermore, we here establish a way of converting the R-matrix resonance parameters uncertainty (covariance matrices) into windowed multipole parameters uncertainty. We show that generating stochastic nuclear cross sections by sampling from the resulting windowed multipole covariance matrix can reproduce the cross-section uncertainty in the original nuclear data file. The windowed multipole representation is therefore a novel nuclear physics formalism able to generate Doppler broadened stochastic nuclear cross sections on the fly, unlocking breakthrough computational gains for nuclear computations. Through this foundational paper, we hope to make the windowed multipole representation accessible, reproducible, and usable for the nuclear physics community, as well as provide the theoretical basis for future research on expanding its capabilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
DOE OSTI2023

High-Nickel Cathode Materials for High-Energy, Long-Life, Low-Cost Lithium-Ion Batteries (Final Report)

The overall goal of this project is to produce Li-ion cells, which deliver at least 600 Wh kg -1 at the cathode level with usable lifetimes of at least 1,000 cycles or 15 years of storage (calendar life). A secondary goal of this project is to minimize the use of cobalt in the cathode, with the ultimate goal of eliminating cobalt entirely. To develop such a cathode, the University of Texas at Austin (UT Austin) team extensively investigated the structural, physical, and chemical properties of layered oxide materials. A panel of dopant elements were surveyed with an emphasis on identifying those, which impart electrochemical and thermal stability. Of those tested, Al and Mg showed the greatest performance improvements while still being easily incorporated into the cathode through simple alterations of the precursor coprecipitation method. Other dopants, such as Ta, Nb, B, and F significantly improved cathode performance, yet their mode of incorporation required additional processing which negated their use under scaled-up conditions. From this work, a first-generation cathode LiNi 0.85 Mn 0.075 Co 0.05 Al 0.02 Mg 0.005 O 2 (NMCAM-85) was produced and an initial set of 2 Ah cells was fabricated by Tesla Inc. These cells delivered 650 Wh kg -1 and a cycle life of just over 700 cycles. Further improvements were garnered through careful study of electrolyte additives. A tailored, ethylene carbonate (EC)-free electrolyte was developed, which improved capacity retention from 60% to 82% after 500 cycles in model LiNi 0.9 Mn 0.05 Al 0.05 O 2 (NMA-90) full cells. This study identified the additives fluoroethylene carbonate (FEC) and lithium difluorophosphate (LiPO 2 F 2 ) as beneficial additives, which were included in the electrolyte for the end-of-project cells. The UT Austin team developed a high-Ni layered oxide cathode LiNi 0.85 Mn 0.1 Al 0.05 Mg 0.005 O 2 (NMAM-85) capable of meeting the project goals. This cathode was synthesized in kilogram quantities and delivered to Tesla for fabrication into 2 Ah pouch cells for DOE testing. These large-format cells achieved 630 Wh kg -1 at the cathode level under the designated testing parameters, meeting the project goal with a completely cobalt-free cathode. The large-format cells are currently undergoing cycle life and calendar life evaluation at Idaho National Lab.

25 ENERGY STORAGE↗
DOE OSTI2020

Evaluating the Effectiveness of an Ultrasonic Acoustic Deterrent in Reducing Bat Fatalities at Wind Energy Facilities

This project was designed to use thermal video cameras and fatality monitoring to evaluate the effectiveness of an ultrasonic acoustic deterrent (UAD) on bat activity and mortality, respectively. Our goals were to redesign the UAD device and installation infrastructure, determine the placement on wind turbines to optimize safety, compatibility and functionality, and to compare the mortality among the following conditions: Control (deterrents off and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Deterrent (deterrents on and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Curtailment (deterrents off and turbines feathered up to 5/ m/s), and combination (deterrents on and turbines feathered up to 5 m/s). The project was divided into a Feasibility Study and Comparative Study. The objectives for the Feasibility Study were to develop an installation strategy, redesign a previous iteration of a UAD to improve performance and weatherization, and test the effectiveness of the deterrents on bat activity. The Feasibility Study was intended to work out potential issues using a relatively small number of devices prior to manufacturing and installing numerous devices for a larger-scale comparative study. The division of the project into these separate studies was based on previous experience and the challenges of assessing the capabilities of an untested UAD. During the initial development and manufacturing of the UAD, NRG Systems decided to use a piezoelectric transducer rather than an electrostatic transducer, which was used by a previous device (i.e. Deaton UAD). NRG Systems conducted lab testing (i.e., IP67 or Ingress Protection) to ensure no water or dust ingress. In addition, shock/drop trials and variations in temperature exposure were conducted as part of the reliability testing. NRG Systems also developed a communications system to allow for continuous performance monitoring of the UADs. For the Feasibility Study, we installed 6 UADs on each of 2 Gamesa G90 2-MW wind turbines (Turbine 14 and 8) at the South Chestnut Wind Energy Facility, Pennsylvania and monitored activity under control and treatment (i.e. Deterrent) conditions using thermal video monitoring. There are two major sources of variation in bat activity (beyond the anticipated treatment effect): 1) environment around the turbines might inherently favor more activity at one than the other; 2) weather conditions on any given night or within season difference (e.g., migration later during the study period) might favor more activity on some nights than on other nights. Because we could only monitor two turbines on any night, we sought to control the potential influences of these two sources by alternating the turbine on which deterrents were activated each night. If there were no loss of data due to technical failures, this design would result in an equal number of deterrent and control nights at each turbine through the monitoring period, balancing the effects of both sources of variation. We compared the time bats spent and the number of events that occurred in overlapping cameras FOV as an indicator of risk, since 80% of the overlapping FOV of the cameras was in the RSA. Equipment failures, majority due to lightning, resulted in only 17 nights with useable data, with unbalanced treatment assignment within turbines and uneven distribution of treatment assignment throughout the observational period. This resulted in a confounding of treatment assignment and seasonal change. Deterrent treatment was measured at Turbine 14 on only 2 of the first 8 usable nights (spanning the period from 8/18-9/17), whereas 6 times on Turbine 8. From 9/18-927, deterrent was on at Turbine 14 on 6 of the remaining 10 nights, and 4 on Turbine 8. We recorded a total of 1,057 bats and observed a reduction in number of events and duration of events at the UAD-activated turbine when it was Turbine 14. When Turbine 8 had the UAD activated, we observed no difference in number or duration of events. Variation between turbines is not unusual and can cause issues when study designs have no true replication, i.e., multiple turbines per treatment. Within-turbine differences suggested a trend for reduced activity when UADs were activated, particularly for Turbine 14. These results may be caused by the overall higher bat activity at Turbine 8 and confounding of treatment assignment and seasonal trends. We mapped 58 bat events in 3-dimensional space (3D), 30 and 28 events during control and treatment conditions, respectively. We observed bats crossing the rotor plane under both control and treatment conditions and observed a total of 40 confirmed or near-collisions (i.e., target close to blade but no visual confirmation of a strike) out of a total of 1,491 medium and high confidence bat observations (880 control, 611 at treatment). Twice as many collisions/possible collisions were observed during control conditions. Given the challenges with the equipment and potential confounding of the data (i.e., different activity levels at the two wind turbines), we were unable to determine whether this initial turbine placement and orientation was optimal. Given no new information on how best to install the devices, we elected to use the same placement and orientation for the comparative study. For the Comparative Study, the objectives were to investigate the relative mortality rates among 4 treatments. We searched the area within 90 m of each turbine daily to recover the highest number of fresh fatalities possible. We were unable to detect a clear reduction in mortality from deterrents alone for any individual species. Surprisingly, mortality rate of the eastern red bat (Lasiurus borealis) was estimated to be 1.3–4.2 times as much when turbines were operating normally and UADs were on than when UADs were off. Reduction in mortality of all bat species combined due to curtailment of turbines was estimated to be between 0%–38%. This effect was nullified when, in addition to curtailment, UADs were on, with 95% confidence interval ranging from a 45% reduction to a 36% increase in mortality. This was likely due to the large proportion of eastern red bats in the total carcass population. Mortality of all low-frequency echolocating bats combined (i.e. hoary bat [L. cinereus], big brown bat [Eptesicus fuscus], silver-haired bat [Lasionycteris noctivagans]) relative to control was lower when curtailed (95% CI: 0%–74%), but the addition of UADs had no detectable effect (95%CI: 13%–79%). The combined treatment reduced mortality in silver-haired bats relative to control by 11%–99%, compared to curtailment (81% reduction–67% increase) or deterrent (82% reduction–67% increase) alone. Because silver-haired bats comprised a large proportion of low-frequency calling bats found during this study, a similar effect was seen for that group. The higher mortality observed for eastern red bats at UAD compared to control could have been caused by several factors, such as the effective range of the UAD, particularly at higher frequencies, behavior, positioning of the devices on the nacelle, or a combination of these. We used 3D thermal videography to compare control and UAD bat behavior from two turbines using a total of 203 3D bat-tracks across 34 nights. We recorded a similar number of bat-tracks between treatment groups, with 51% and 49% for control and UAD, respectively. Due to potential differences in bat behavior around spinning vs stationary turbine blades, we examined UAD effectiveness separately for non-operating turbines (feathered below cut-in speed of 3.5 m/s) and operating (normal operation above wind speed of 3.5 m/s). We found a higher proportion of bat-tracks at operating turbines (82%) compared to non-operating turbines (18%), although this does not account for overall time turbines were operating versus not. At non-operating turbines the UAD appears to be effective at reducing the amount of time, flight length, and number of passes through the rotor plane, compared to control. In addition, we found bats approached turbines similarly between control and treatment turbines, with 61% of control and 63% of UAD bat-tracks originating leeward of the hub. In contrast, at operating turbines, we saw little change in bat behavior in response to UADs. For example, we found an increase in the average duration of bat-tracks between non-operating and operating turbines for UAD but at control turbines we found average duration decreased once turbines became operational. Both control and UAD had a high proportion of bat-tracks that crossed the rotor plane (i.e., collision risk) originate from the windward side when turbines were operational 65% to 92%, respectively. Given that the UAD devices closest to the blades were orientated parallel to the blades, its possible bats were not exposed to the signal until they were close to the turbine blades, as suggested by the slightly higher mean duration within 5 meters of the blades for UAD turbines. Future research should consider concentrating UAD intensity on the areas of risk (i.e. blades) with enough buffer to allow bats to react to the sound before entering the rotor-swept area (RSA). In addition, investigating the potential of installing UAD units windward of the turbine blades (e.g. a hub-mounted UAD), particularly since even under control conditions, a relatively high proportion (65%) of crosses through the blade plane originated windward. 3D thermal videography provided valuable information on future testing strategies (e.g. device placement, UAD orientation) to improve UAD effectiveness when bats are at risk (i.e., operating wind turbines). Across the entire project we experienced issues with the operation and communication with the UADs. Most of the issues occurred during the Feasibility Study and were resolved prior to the Comparability Study. Additional challenges surfaced during the Comparability Study but were remedied immediately and are thought to have little impact on the results. We had logistical constraints at the project that limited our ability use traditional methods in our camera calibration. Several calibrations showed inaccurate scales, which may have been related to inadequate spatial coverage of “points” in the camera calibration volume. Because we were using actual video recordings of bats at a wind turbine, the behavior of bats could have concentrated “points” in specific areas of the turbine (i.e. leeward of nacelle), and limited “points” in other areas, resulting in camera calibration issues. We have plans to address these inconsistencies and improving the software and related methodologies by early 2020.

17 WIND ENERGY↗