Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Integrated Propulsion Data System Public Web Site

The Integrated Propulsion Data System's (IPDS) focus is to provide technologically-advanced philosophies of doing business at SSC that will enhance the existing operations, engineering and management strategies and provide insight and metrics to assess their daily impacts, especially as related to the Propulsion Test Directorate testing scenarios for the 21st Century.

Hamilton, Kimberly↗

NASA's Space Launch System: Deep-Space Delivery for Smallsats

Designed for human exploration missions into deep space, NASA's Space Launch System (SLS) represents a new spaceflight infrastructure asset, enabling a wide variety of unique utilization opportunities. While primarily focused on launching the large systems needed for crewed spaceflight beyond Earth orbit, SLS also offers a game-changing capability for the deployment of small satellites to deep-space destinations, beginning with its first flight. Currently, SLS is making rapid progress toward readiness for its first launch in two years, using the initial configuration of the vehicle, which is capable of delivering 70 metric tons (t) to Low Earth Orbit (LEO). On its first flight test of the Orion spacecraft around the moon, accompanying Orion on SLS will be small-satellite secondary payloads, which will deploy in cislunar space. The deployment berths are sized for "6U" CubeSats, and on EM-1 the spacecraft will be deployed into cislunar space following Orion separate from the SLS Interim Cryogenic Propulsion Stage. Payloads in 6U class will be limited to 14 kg maximum mass. Secondary payloads on EM-1 will be launched in the Orion Stage Adapter (OSA). Payload dispensers will be mounted on specially designed brackets, each attached to the interior wall of the OSA. For the EM-1 mission, a total of fourteen brackets will be installed, allowing for thirteen payload locations. The final location will be used for mounting an avionics unit, which will include a battery and sequencer for executing the mission deployment sequence. Following the launch of EM-1, deployments of the secondary payloads will commence after sufficient separation of the Orion spacecraft to the upper stage vehicle to minimize any possible contact of the deployed CubeSats to Orion. Currently this is estimated to require approximately 4 hours. The allowed deployment window for the CubeSats will be from the time the upper stage disposal maneuvers are complete to up to 10 days after launch. The upper stage will fly past the moon at a perigee of approximately 100km, and this closest approach will occur about 5 days after launch. The limiting factor for the latest deployment time is the available power in the sequencer system. Several NASA Mission Directorates were involved in the development of programs for the competition, selection, and development of EM-1 payloads that support directorate priorities. CubeSat payloads on EM-1 will include both NASA research experiments and spacecraft developed by industry, international and potentially academia partners. The Human Exploration and Operations Mission Directorate (HEOMD) Advanced Exploration Systems (AES) Division was allocated five payload opportunities on the EM-1 mission. Near Earth Asteroid (NEA) Scout is designed to rendezvous with and characterize a candidate NEA. A solar sail, an innovation the spacecraft will demonstrated for the CubeSat class, will provide propulsion. Lunar Flashlight will use a green propellant system and will search for potential ice deposits in the moon's permanently shadowed craters. BioSentinel is a yeast radiation biosensor, planned to measure the effects of space radiation on deoxyribonucleic acid (DNA). Lunar Icecube, a collaboration with Morehead State University, will prospect for water in ice, liquid, and vapor forms as well as other lunar volatiles from a low-perigee, highly inclined lunar orbit using a compact Infrared spectrometer. Skyfire, a partnership with Lockheed Martin, is a technology demonstration mission that will perform a lunar flyby, collecting spectroscopy, and thermography data to address questions related to surface characterization, remote sensing, and site selection. NASA's Space Technology Mission Directorate (STMD) was allocated three payload opportunities on the EM-1 mission. These slots will be filled via the Centennial Challenges Program, NASA's flagship program for technology prize competitions, which directly engages the public, academia, and industry in open prize competitions to stimulate innovation. The NASA Science Mission Directorate (SMD) was allocated two payload opportunities on the EM-1 mission. The CubeSat Mission to Study Solar Particles (CuSP) payload will study the sources and acceleration mechanisms of solar and interplanetary particles in near-Earth orbit, support space weather research by determining proton radiation levels during Solar Energetic Particle (SEP) events and identifying suprathermal properties that could help predict geomagnetic storms. The LunaH-Map payload will help scientists understand the quantity of H-bearing materials in lunar cold traps (~10 km), determine the concentration of H-bearing materials with 1m depth, and constrain the vertical distribution of H-bearing materials. The final three payload opportunities for the EM-1 mission were allocated for NASA's international space agency counterparts. The flight opportunities are intended to benefit the international space agency and NASA as well as further the collective space exploration goals. ArgoMoon is sponsored by ESA/ASI and will fly along with the ICPS on its disposal trajectory to perform proximity operations with the ICPS post-disposal, take external imagery of engineering and historical significance, and perform an optical communications demonstration. EQUULEUS, sponsored by JAXA, will fly to a libration orbit around the Earth-Moon L2 point and demonstrate trajectory control techniques within the Sun-Earth- Moon region for the first time by a nano spacecraft. The mission will also contribute to the future human exploration scenario by understanding the radiation environment in geospace and deep space, characterizing the flux of impacting meteors on the far side of the moon, and demonstrating the future deep space exploration scenario using the "deep space port" at Lagrange points. OMOTENASHI, also sponsored by JAXA, will land the smallest lunar lander to date on the lunar surface to demonstrate the feasibility of the hardware for distributed cooperative exploration system. Small landers will enable multi-point exploration, which is complimentary with large-scale human exploration. Once on the lunar surface, the OMOTENASHI spacecraft will observe the radiation and soil environments of the lunar surface by active radiation measurements and soil shear measurements. Following EM-1, Space Launch System will evolve to the more-powerful Block 1B configuration, which uses a new Exploration Upper Stage to increase the vehicle's LEO payload capability from 70 t to 105 t. With that transition, the Orion Stage Adapter, which will carry the secondary payloads on EM-1, will be phased out, and a new Universal Stage Adapter will be introduced, creating opportunities for flying larger secondary payloads. This paper will provide a brief status of SLS progress toward first launch; an overview of smallsat accommodations, integration, and operations on EM-1; information about the specific payloads flying on that launch; and a discussion of future accommodations and opportunities for secondary payloads on SLS for Exploration Mission-2 and beyond.

Robinson, Kimberly F.↗

NASA's Space Launch System: Deep-Space Opportunities for SmallSats

Designed for human exploration missions into deep space, NASA's Space Launch System (SLS) represents a new spaceflight infrastructure asset, enabling a wide variety of unique utilization opportunities. While primarily focused on launching the large systems needed for crewed spaceflight beyond Earth orbit, SLS also offers a game-changing capability for the deployment of small satellites to deep-space destinations, beginning with its first flight. Currently, SLS is making rapid progress toward readiness for its first launch in two years, using the initial configuration of the vehicle, which is capable of delivering 70 metric tons (t) to Low Earth Orbit (LEO). On its first flight test of the Orion spacecraft around the moon, accompanying Orion on SLS will be small-satellite secondary payloads, which will deploy in cislunar space. The deployment berths are sized for "6U" CubeSats, and on EM-1 the spacecraft will be deployed into cislunar space following Orion separate from the SLS Interim Cryogenic Propulsion Stage. Payloads in 6U class will be limited to 14 kg maximum mass. Secondary payloads on EM-1 will be launched in the Orion Stage Adapter (OSA). Payload dispensers will be mounted on specially designed brackets, each attached to the interior wall of the OSA. For the EM-1 mission, a total of fourteen brackets will be installed, allowing for thirteen payload locations. The final location will be used for mounting an avionics unit, which will include a battery and sequencer for executing the mission deployment sequence. Following the launch of EM-1, deployments of the secondary payloads will commence after sufficient separation of the Orion spacecraft to the upper stage vehicle to minimize any possible contact of the deployed cubesats to Orion. Currently this is estimated to require approximately 4 hours. The allowed deployment window for the cubesats will be from the time the upper stage disposal maneuvers are complete to up to 10 days after launch. The upper stage will fly past the moon at a perigee of approximately 100km, and this closest approach will occur about 5 days after launch. The limiting factor for the latest deployment time is the available power in the sequencer system. Several NASA Mission Directorates were involved in the development of programs for the competition, selection, and development of EM-1 payloads that support directorate priorities. CubeSat payloads on EM-1 will include both NASA research experiments and spacecraft developed by industry, international and potentially academia partners. The Human Exploration and Operations Mission Directorate (HEOMD) Advanced Exploration Systems (AES) Division was allocated five payload opportunities on the EM-1 mission. Near Earth Asteroid (NEA) Scout is designed to rendezvous with and characterize a candidate NEA. A solar sail, an innovation the spacecraft will demonstrated for the CubeSat class, will provide propulsion. Lunar Flashlight will use a green propellant system and will search for potential ice deposits in the moon's permanently shadowed craters. BioSentinel is a yeast radiation biosensor, planned to measure the effects of space radiation on deoxyribonucleic acid (DNA). Lunar Icecube, a collaboration with Morehead State University, will prospect for water in ice, liquid, and vapor forms as well as other lunar volatiles from a low-perigee, highly inclined lunar orbit using a compact Infrared spectrometer. Skyfire, a partnership with Lockheed Martin, is a technology demonstration mission that will perform a lunar flyby, collecting spectroscopy, and thermography data to address questions related to surface characterization, remote sensing, and site selection. NASA's Space Technology Mission Directorate (STMD) was allocated three payload opportunities on the EM-1 mission. These slots will be filled via the 2 Centennial Challenges Program, NASA's flagship program for technology prize competitions, which directly engages the public, academia, and industry in open prize competitions to stimulate innovation. The NASA Science Mission Directorate (SMD) was allocated two payload opportunities on the EM-1 mission. The CubeSat Mission to Study Solar Particles (CuSP) payload will study the sources and acceleration mechanisms of solar and interplanetary particles in near-Earth orbit, support space weather research by determining proton radiation levels during Solar Energetic Particle (SEP) events and identifying suprathermal properties that could help predict geomagnetic storms. The LunaH-Map payload will help scientists understand the quantity of H-bearing materials in lunar cold traps (~10 km), determine the concentration of H-bearing materials with 1m depth, and constrain the vertical distribution of H-bearing materials. The final three payload opportunities for the EM-1 mission were allocated for NASA's international space agency counterparts. The flight opportunities are intended to benefit the international space agency and NASA as well as further the collective space exploration goals. ArgoMoon is sponsored by ESA/ASI and will fly along with the ICPS on its disposal trajectory to perform proximity operations with the ICPS post-disposal, take external imagery of engineering and historical significance, and perform an optical communications demonstration. EQUULEUS, sponsored by JAXA, will fly to a libration orbit around the Earth-Moon L2 point and demonstrate trajectory control techniques within the Sun-Earth-Moon region for the first time by a nano spacecraft. The mission will also contribute to the future human exploration scenario by understanding the radiation environment in geospace and deep space, characterizing the flux of impacting meteors on the far side of the moon, and demonstrating the future deep space exploration scenario using the "deep space port" at Lagrange points. OMOTENASHI, also sponsored by JAXA, will land the smallest lunar lander to date on the lunar surface to demonstrate the feasibility of the hardware for distributed cooperative exploration system. Small landers will enable multi-point exploration, which is complimentary with large-scale human exploration. Once on the lunar surface, the OMOTENASHI spacecraft will observe the radiation and soil environments of the lunar surface by active radiation measurements and soil shear measurements. Following EM-1, Space Launch System will evolve to the more-powerful Block 1B configuration, which uses a new Exploration Upper Stage to increase the vehicle's LEO payload capability from 70 t to 105 t. With that transition, the Orion Stage Adapter, which will carry the secondary payloads on EM-1, will be phased out, and a new Universal Stage Adapter will be introduced, creating opportunities for flying larger secondary payloads. This paper will provide a brief status of SLS progress toward first launch; an overview of smallsat accommodations, integration, and operations on EM-1; information about the specific payloads flying on that launch; and a discussion of future accommodations and opportunities for secondary payloads on SLS for Exploration Mission-2 and beyond.

Robinson, Kimberly F.↗

Autogenous Pressurization of a Cryogenic Tank Using Computational Fluid Dynamics

Well-validated simulation tools can be used to predict long-term storage and transfer of cryogenic propellants, which are essential to NASA’s mission plan to return to the Moon and continue to Mars. Autogenous pressurization of propellant tanks is used to supply rocket engine turbopumps with pressurized liquid fuel and oxidizer, preventing cavitation. Additionally, autogenous pressurization can be used to pressurize propellant tanks to support on-orbit propellant transfer. In lieu of expensive tests conducted on-orbit, accurate predictive computational models of these processes can be used to reduce system and propellant mass as well as mission risk. Using simulation tools also reduces the cost of analyzing and developing this technology. This study presents a multiphase computational fluid dynamics model capable of simulating autogenous pressurization of a large cryogenic tank using the commercial code STAR-CCM+. Experimental data from a full-scale tank pressurization test under terrestrial gravity is compared to simulation results using transient error metrics. Comparisons show good agreement and give confidence in using these and other validated simulation tools to develop cryogenic pressurization systems.

Cryogenics↗

Autogenous Pressurization of a Cryogenic Tank using Computational Fluid Dynamics

Well-validated simulation tools can be used to predict long-term storage and transfer of cryogenic propellants, which are essential to NASA’s mission plan to return to the Moon and continue to Mars. Autogenous pressurization of propellant tanks is used to supply rocket engine turbopumps with pressurized liquid fuel and oxidizer, preventing cavitation. Additionally, autogenous pressurization can be used to pressurize propellant tanks to support on-orbit propellant transfer. In lieu of expensive tests conducted on-orbit, accurate predictive computational models of these processes can be used to reduce system and propellant mass as well as mission risk. Using simulation tools also reduces the cost of analyzing and developing this technology. This study presents a multiphase computational fluid dynamics model capable of simulating autogenous pressurization of a large cryogenic tank using the commercial code STAR-CCM+. Experimental data from a full-scale tank pressurization test under terrestrial gravity is compared to simulation results using transient error metrics. Comparisons show good agreement and give confidence in using these and other validated simulation tools to develop cryogenic pressurization systems. Note: There is no audio file included or available for this presentation.

cryogenics↗

Fighting Flicker

Thanks in part to the rapid emergence of LED lighting, the phenomenon of flicker has been getting increased attention. All conventional light sources modulate luminous flux and intensity to some degree, usually as a consequence of drawing power from AC mains sources. But whereas conventional light sources have somewhat delayed responses to changes in electrical current – which serves to “cushion” them to some degree against flickering – the LED and its driver respond instantly to such changes, which can result in stark fluctuations in light output. And while these fluctuations may not be noticeable to everyone, they can still result in health and task performance problems. Understanding and countering flicker is essential to the success of high-efficiency lighting technology. That’s why the U.S. Department of Energy (DOE) Solid-State Lighting Program conducts flicker research and is supporting a number of industry committees (CIE 1-83: Visual Aspects of Time-Modulated Lighting Systems; CIE 2-89: Measurement of Temporal Light Modulation of Light Sources and Lighting Systems; and the IES Testing Procedures Committee) that are developing flicker standards for measurement, acceptability, and metrics. A wide variety of technical resources on flicker can be found at https://www.energy.gov/eere/ssl/flicker.

lighting, flicker, flicker meters, Flicker metrics↗

Evaluation of CMIP6 GCMs Over the CONUS for Downscaling Studies

Despite the necessity of Global Climate Models (GCMs) sub-selection in downscaling studies, an objective approach for their selection is currently lacking. Building on the previously established concepts in GCMs evaluation frameworks, we develop a weighted averaging technique to remove the redundancy in the evaluation criteria and rank 37 GCMs from the sixth phase of the Coupled Models Intercomparison Project over the contiguous United States. GCMs are rated based on their average performance across 66 evaluation measures in the historical period (1981–2014) after each metric is weighted between zero and one, depending on its uniqueness. The robustness of the outcome is tested by repeating the process with the empirical orthogonal function analysis in which each GCM is ranked based on its sum of distances from the reference in the principal component space. The two methodologies work in contrasting ways to remove the metrics redundancy but eventually develop similar GCMs rankings. A disparity in GCMs' behavior related to their sensitivity to the size of the evaluation suite is observed, highlighting the need for comprehensive multi-variable GCMs evaluation at varying timescales for determining their skillfulness over a region. The sub-selection goal is to use a representative set of skillful models over the region of interest without substantial overlap in their future climate responses and modeling errors in representing historical climate. Additional analyses of GCMs' independence and spread in their future projections provide the necessary information to objectively select GCMs while keeping all aspects of necessity in view.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Saccadic Component Measure on Smooth Pursuit Tests

ABSTRACT Introduction Despite the advancement of eye-tracking technology for smooth pursuit (SP) eye movement evaluation, qualitative observation offers much information that is not captured by computers; hence, both objective and qualitative information should be utilized to evaluate SP. This study examined the consistency among our clinicians when evaluating SP using normal (N), grossly normal (GN), mildly abnormal (MA), and abnormal (AB) as classifications. We then evaluated the effect of combining GN and MA into a single subclinical (SUBC) category. We also evaluated the computerized percent saccade (PS) metric by determining its sensitivity and specificity in classifying SP. Materials and Methods Retrospective horizontal and vertical SP test videos and numerical data for 70 participants were obtained from the Neuro Kinetics Neuro-Otologic Test Center and de-identified. From this, eye-tracking videos, time plots of eye-tracking positional data, and tables of SP eye-tracking performance data were generated for 0.1, 0.3, and 0.5 Hz in both horizontal and vertical planes, totaling 6 tests per subject. Three clinicians rated each subject’s SP performance as N, GN, MA, or AB for a total of 6 ratings (3 frequencies, horizontal and vertical). This process was repeated using N, SUBC, and AB as rating categories. Clinicians also provided an overall SP rating for each plane as follows: AB if the results were abnormal for 2 or more frequencies tested. Alternatively, if fewer than 2 frequencies presented with a rating of AB, then an overall rating of MA, GN, or N was determined at the respective clinician’s discretion. Results When the 3 clinicians were tasked with classifying SP videos using 4 clinical categories, fair overall agreement was demonstrated. However, when MA and GN categories were combined into an SUBC category, the overall agreement for the 3 clinicians improved slightly for both horizontal SP (HSP) and vertical SP (VSP). This pattern of agreement did not differ considerably when comparing HSP versus VSP, and good consistency and reliability was observed across clinicians. Again, inter-rater consistency was smaller for VSP versus HSP despite the reduction in clinical categories. Cut-off values were generated for the PS metric and demonstrated good specificity and sensitivity when they were exceeded for 2 or more frequencies in a particular plane when evaluating a subject’s SP test. Conclusions

General & Internal Medicine↗

1- by 1-Foot Supersonic Wind Tunnel Sidewall Flowfield Compression Plate Study

A method for locally increasing the dynamic pressure in the test section of a supersonic wind tunnel is investigated from a theoretical, computational and experimental perspective, culminating in a reduced-scale, proof-of-concept test at Mach 3.44. Symmetric, variable-angle compression plates along the test section sidewalls generate oblique shockwaves to elevate the test section dynamic pressure (q). The experimental effort utilizes boundary-layer pitot rakes to sample the incoming flow near the floor, pitot and static rakes to measure the high-q core flow and numerous surface taps to map out the static pressure distribution along the floor, ceiling and sidewalls. A reliable and robust starting procedure is developed to establish supersonic flow in the test section and behind the compression plates. A characterization of the incoming floor boundary layer reveals previously documented features (such as a bulge toward the centerline) and an unexpected (and as-yet-unexplained) thickening of the boundary layer with increasing Reynolds number around total pressures of 40–60 psia. The high-q core flow is characterized for eight compression plate angles (4.0–8.0°), eight tunnel total pressures (20–139 psia) and three axial stations (24.95–27.35 inches). The peak dynamic pressure rise exceeds expectations. At conditions relevant to full-scale testing (6.0° and 139 psia), the dynamic pressure increases by a factor of 1.73, the Mach number becomes 2.85 and the total pressure drops imperceptibly. Basic distortion metrics show transverse non-uniformity of less than 5 %. Limited spatial resolution in the static rake measurements warrants additional, higher fidelity testing or computational analysis. Surface-mounted, fast-response instrumentation suggests minimal unsteadiness in the flow, less than a few percent of the mean (comparable to the sensor accuracy).

Wind tunnel testing, test techniques/methods, dyna↗

Technical Advice and Support for the Joint Integrated Non-Intrusive Inspection (JINII) Program Task 2.2 Transmission Digital Radiography (DR)

The Cargo Advanced Automated Radiography System (CAARS) program aims to utilize advanced radiographic systems to detect radiological and nuclear threats. Validation of initial design and testing concepts is a precondition for prototype system development and large-scale deployment. As expected, Depleted Uranium (DU) is a valid surrogate for Special Nuclear Materials (SNM) in CAARS Advanced Technology Demonstration (ATD) performance field-tests of transmission radiography systems. Dual-energy transmission measurements of DU are nearly identical to SNM, and are distinct from lower Z materials, provided the samples are matched to equal areal density. Results from an alternative method, using samples of equal thickness, showed sample discrimination by material density, rather than by atomic number (Z). The transmission measurements of DU and SNM were made with equipment that is nearly identical to current field systems. X-ray source beams at endpoint energies of 5.4 MeV and 9.6 MeV were used to measure transmission through the selected sample materials. The ratio of the x-ray linear attenuation coefficient times length ({micro}L) at 5.4 MeV, to {micro}L at 9.6 MeV is a metric for atomic number based discrimination of materials. The measured ratios were compared with computed values based on LLNL photon cross section data and LLNL developed models of x-ray detector characteristics. Measured ratios for DU differed from HEU by an average of 0.25%, and from WGPu by 0.08%, which is within the noise level of 0.4 to 0.5%. For comparison, measured ratios for Sn differed from HEU by 3.2%, and from WGPu by 3.6%, well beyond the measurement noise. Measured ratios for W differed from HEU by 0.01%, and from WGPu by 0.32%. The measured ratio values presented in Table 1 demonstrate the feasibility of using a threshold ratio to discriminate low-Z (Z < 72) from high-Z (Z {ge} 72) materials (as defined by CAARS specification). In the case of our test system, a threshold ratio of 1.08 would be suitable based on the measured results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SU-F-T-312: Identifying Distinct Radiation Therapy Plan Classes Through Multi-Dimensional Analysis of Plan Complexity Metrics

Purpose: To determine whether body site-specific treatment plans form unique “plan class” clusters in a multi-dimensional analysis of plan complexity metrics such that a single beam quality correction determined for a representative plan could be universally applied within the “plan class”, thereby increasing the dosimetric accuracy of a detector’s response within a subset of similarly modulated nonstandard deliveries. Methods: We collected 95 clinical volumetric modulated arc therapy (VMAT) plans from four body sites (brain, lung, prostate, and spine). The lung data was further subdivided into SBRT and non-SBRT data for a total of five plan classes. For each control point in each plan, a variety of aperture-based complexity metrics were calculated and stored as unique characteristics of each patient plan. A multiple comparison of means analysis was performed such that every plan class was compared to every other plan class for every complexity metric in order to determine which groups could be considered different from one another. Statistical significance was assessed after correcting for multiple hypothesis testing. Results: Six out of a possible 10 pairwise plan class comparisons were uniquely distinguished based on at least nine out of 14 of the proposed metrics (Brain/Lung, Brain/SBRT lung, Lung/Prostate, Lung/SBRT Lung, Lung/Spine, Prostate/SBRT Lung). Eight out of 14 of the complexity metrics could distinguish at least six out of the possible 10 pairwise plan class comparisons. Conclusion: Aperture-based complexity metrics could prove to be useful tools to quantitatively describe a distinct class of treatment plans. Certain plan-averaged complexity metrics could be considered unique characteristics of a particular plan. A new approach to generating plan-class specific reference (pcsr) fields could be established through a targeted preservation of select complexity metrics or a clustering algorithm that identifies plans exhibiting similar modulation characteristics. Measurements and simulations will better elucidate potential plan-class specific dosimetry correction factors.

60 APPLIED LIFE SCIENCES↗

Semi-dynamical perturbations of unified dark energy

Linear cosmological perturbations of a large class of modified gravity and dark energy models can be unified in the effective field theory of cosmic acceleration, encompassing Horndeski scalar-tensor theories and beyond. The fully available model space inherent to this formalism cannot be constrained by measurements in the quasistatic small-scale regime alone. To facilitate the analysis of modifications from the concordance model beyond this limit, we introduce a semi-dynamical treatment extrapolated from the evolution of perturbations at a pivot scale of choice. At small scales, and for Horndeski theories, the resulting modifications recover a quasistatic approximation but account for corrections to it near the Hubble scale. For models beyond Horndeski gravity, we find that the velocity field and time derivative of the spatial metric potential can generally not be neglected, even in the small-scale limit. We test the semi-dynamical approximation against the linear perturbations of a range of dark energy and modified gravity models, finding good agreement between the two.

79 ASTRONOMY AND ASTROPHYSICS↗

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗

Automated Segmentation of Twin Boundaries in TRISO Silicon Carbide Using Deep Neural Networks

Coated particle fuels, such as the tristructural isotropic (TRISO) fuel particle, are essential for high-temperature gas reactor (HTGR) applications due to their efficiency and stability under normal and off-normal conditions. However, widespread commercialization and deployment of this technology for next-generation nuclear applications require robust quality assurance and quality control (QA/QC) methods linking fabrication, properties, and performance. Of the many important metrics for TRISO QA/QC, quantification of the silicon carbide (SiC) microstructure is critical because it correlates with fission product retention during irradiation. Previous work has shown extensive twinning of the SiC microstructure, which strongly affects microstructural metrics; however, twin grain boundaries are not expected play a significant role in fission product diffusion. This report summarizes the initial development, training, and testing of a machine learning image processing algorithm to detect twin grain boundaries in a backscattered electron image, which can be removed so that microstructural metrics can be recalculated for legacy data. Further development and deployment of this model will provide automated, scalable improvement of potential QA/QC methods for the SiC layer of TRISO particles.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Emulating climate extreme indices

We use simple pattern scaling and time-shift to emulate changes in a set of climate extreme indices under future scenarios, and evaluate the emulators' accuracy. We propose a metric for the error in emulation in the context of initial condition ensembles, to specifically characterize the role of internal variability in the emulation performance. Our metric separates systematic emulation errors from unavoidable discrepancies between emulated and target values due to internal variability. We compute the metricis at grid-point scale, and we show geographically resolved results, or aggregate them at global scale. We demonstrate the use of our error metric in the emulation of a suite of temperature and precipitation extreme indices. We test and compare simple pattern scaling and time-shift using a range of trajectories spanning targets inspired by the Paris agreement -- warming to 1.5C and 2.0C from the pre-industrial baseline -- and two of the longer-established trajectories, RCP4.5 and RCP8.5. With this suite of scenarios we can test the effects on the performance of the size of the temperature gap between emulation origin and target. We find that for most indices emulation the dominant source of discrepancy is internal variability. For at least one index, however, counting exceedances of a high temperature threshold, significant portions of the globally aggregated discrepancy and its regional pattern originate from the systematic emulation error. This error exceeds internal variability of both the target and the emulated quantities in large coherent regions at low latitudes, and the explanation can be found in the differential behavior of temperature distributions across latitudes. The metric also highlights a fundamental difference in the two methods related to the simulation of internal variability, which is dampened significantly by simple pattern scaling. This aspect is of consequence when using these methods for specific applications, where preserving variability for uncertainty quantification is deemed important. With this study we offer our metric as a diagnostic tool, facilitating the formulation of scientific hypotheses on the reasons for the error. In the meantime, we show that for many impact relevant indices by now traditional emulation techniques can be accurate within the variations unavoidably introduced by internal variability, establishing the fundamental condition for using their emulation in impact modeling.

54 ENVIRONMENTAL SCIENCES↗

Diablo Test Suite: Code Coverage Analysis

An analysis of the Diablo source code covered by its Software Quality Assurance test suite was performed. Intel’s code coverage tool was used to determine the percentage of covered files, blocks, and functions. Excluding non-functional legacy files and single use developer-only files, the code coverage tool showed that 55% of blocks, the most applicable metric and closest to lines of code, are covered. For a large software code, 70-80% coverage is generally considered a reasonable target.A significant percentage of the uncovered code can be categorized as features that are not practical to test, duplicate/unused legacy code, and niche features only used by select individuals. Additionally, large segments of code dedicated to debugging and error handling are untested, as the test problems do not error out. The remaining untested code can be considered general purpose for use by the analyst/user community. These untested general purpose features are identified in the document and should be prioritized when new testing is added. Suggestions for additional test problems that would have the biggest impact on increasing the code coverage metric are presented. Finally, it is important to note that the single biggest way to increase the overall coverage metric is to delete old and unused code. While admittedly tedious to perform, future code development would also benefit markedly from this. Deleting unused code would likely push the coverage metric north of 60%, which is not too far off the 70-80% target. Overall, the current test suite covers the majority of commonly used features in Diablo, but there remains significant room for improvement. These areas for improvement have been identified.

97 MATHEMATICS AND COMPUTING↗

Physics-based modeling and information-theoretic sensor and settings selection for tool wear detection in precision machining

Precision machining of metals is an energy intensive process with applications and impacts across the manufacturing industry. The energy efficiency, product yield, and maintenance of the precision machine require a digital twin that can assist with prognostics and health management. In this report a physics-based model is developed and validated against face milling data, and then used for the timely and precise inference of machining faults that cannot be measured directly. Computer numerical control (CNC) measurements of power and force are used through this physics-based machining model to predict deviations of the outputs of power consumption and cutting forces during normal operation. A model-based fault detection and isolation methodology is applied to determine the optimal (traditional and available) sensor suite and the test settings (admissible input values) that improve the inference of tool wear in face milling. The optimal sensor suite and input test settings are obtained by solving a mixed integer non-linear program that optimizes information-theoretic metrics relevant to the detection and isolation of tool wear from steady-state or transient machining measurements. Dynamic time warping and k—NN classification are then used to validate the robustness of the optimal design for fault detection test design, including the optimal sensor suite.

42 ENGINEERING↗