Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing and evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Metabolic flux optimization of iterative pathways through orthogonal gene expression control: Application to the β-oxidation reversal

Balancing relative expression of pathway genes to minimize flux bottlenecks and metabolic burden is one of the key challenges in metabolic engineering. This is especially relevant for iterative pathways, such as reverse β-oxidation (rBOX) pathway, which require control of flux partition at multiple nodes to achieve efficient synthesis of target products. Here, we develop a plasmid-based inducible system for orthogonal control of gene expression (referred to as the TriO system) and demonstrate its utility in the rBOX pathway. Leveraging effortless construction of TriO vectors in a plug-and-play manner, we simultaneously explored the solution space for enzyme choice and relative expression levels. Remarkably, varying individual expression levels led to substantial change in product specificity ranging from no production to optimal performance of about 90% of the theoretical yield of the desired products. We obtained titers of 6.3 g/L butyrate, 2.2 g/L butanol and 4.0 g/L hexanoate from glycerol in E. coli, which exceed the best titers previously reported using equivalent enzyme combinations. Since a similar system behavior was observed with alternative termination routes and higher-order iterations, we envision our approach to be broadly applicable to other iterative pathways besides the rBOX. Here, considering that high throughput, automated strain construction using combinatorial promoter and RBS libraries remain out of reach for many researchers, especially in academia, tools like the TriO system could democratize the testing and evaluation of pathway designs by reducing cost, time and infrastructure requirements.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Shaker-structure interaction modeling and analysis for nonlinear force appropriation testing

Nonlinear force appropriation is an extension of its linear counterpart where sinusoidal excitation is applied to a structure with a modal shaker and phase quadrature is achieved between the excitation and response. While a standard practice in modal testing, modal shaker excitation has the potential to alter the dynamics of the structure under test. Previous studies have been conducted to address several concerns, but this work specifically focuses on a shaker-structure interaction phenomenon which arises during the force appropriation testing of a nonlinear structure. Under pure-tone sinusoidal forcing, a nonlinear structure may respond not only at the fundamental harmonic but also potentially at sub- or superharmonics, or it can even produce aperiodic and chaotic motion in certain cases. Shaker-structure interaction occurs when the response physically pushes back against the shaker attachment, producing non-fundamental harmonic content in the force measured by the load cell, even for pure tone voltage input to the shaker. This work develops a model to replicate these physics and investigates their influence on the response of a nonlinear normal mode of the structure. Experimental evidence is first provided that demonstrates the generation of harmonic content in the measured load cell force during a force appropriation test. This interaction is replicated by developing an electromechanical model of a modal shaker attached to a nonlinear, three-mass dynamical system. Several simulated experiments are conducted both with and without the shaker model in order to identify which effects are specifically due to the presence of the shaker. Finally, the results of these simulations are then compared to the undamped nonlinear normal modes of the structure under test to evaluate the influence of shaker-structure interaction on the identified system’s dynamics.

42 ENGINEERING↗
DOE OSTI2026

Taste Perception of Branched Maltooligosaccharides

Oral processing of starch generates linear and branched maltooligosaccharides (MOS). This study investigates the impact of branching and the degree of polymerization (DP) on MOS taste detection. Three branched MOS samples (A−C) were enzymatically prepared from gelatinized waxy corn starch and characterized using reducing-end assays, MALDI-TOF MS, β-amylase hydrolysis, and GC-MS linkage analysis. Samples A, B, and C had average DPs of 6, 10, and 18, respectively, with α-1,6 branch points comprising 9−13% of glycosidic bonds; linear MOS were negligible. In triangle tests, participants evaluated MOS samples and a maltose control at 75 mM, with and without lactisole, a sweet receptor inhibitor. All samples were detectable without lactisole (d′ = 1.81−2.9; p < 0.05), but not with lactisole (d′ = 0−0.61; p > 0.05). These findings demonstrate that α-1,6 branching enables MOS detection via the sweet receptor, not the putative “starchy” receptor, underscoring the importance of glycosidic structure in carbohydrate taste perception.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A gated graph transformer for protein complex structure quality assessment and its performance in CASP15

Abstract Motivation Proteins interact to form complexes to carry out essential biological functions. Computational methods such as AlphaFold-multimer have been developed to predict the quaternary structures of protein complexes. An important yet largely unsolved challenge in protein complex structure prediction is to accurately estimate the quality of predicted protein complex structures without any knowledge of the corresponding native structures. Such estimations can then be used to select high-quality predicted complex structures to facilitate biomedical research such as protein function analysis and drug discovery. Results In this work, we introduce a new gated neighborhood-modulating graph transformer to predict the quality of 3D protein complex structures. It incorporates node and edge gates within a graph transformer framework to control information flow during graph message passing. We trained, evaluated and tested the method (called DProQA) on newly-curated protein complex datasets before the 15th Critical Assessment of Techniques for Protein Structure Prediction (CASP15) and then blindly tested it in the 2022 CASP15 experiment. The method was ranked 3rd among the single-model quality assessment methods in CASP15 in terms of the ranking loss of TM-score on 36 complex targets. The rigorous internal and external experiments demonstrate that DProQA is effective in ranking protein complex structures. Availability and implementation The source code, data, and pre-trained models are available at https://github.com/jianlin-cheng/DProQA.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Square Kilometre Array Science Data Challenge 1: analysis and results

ABSTRACT As the largest radio telescope in the world, the Square Kilometre Array (SKA) will lead the next generation of radio astronomy. The feats of engineering required to construct the telescope array will be matched only by the techniques developed to exploit the rich scientific value of the data. To drive forward the development of efficient and accurate analysis methods, we are designing a series of data challenges that will provide the scientific community with high-quality data sets for testing and evaluating new techniques. In this paper, we present a description and results from the first such Science Data Challenge 1 (SDC1). Based on SKA MID continuum simulated observations and covering three frequencies (560, 1400, and 9200 MHz) at three depths (8, 100, and 1000 h), SDC1 asked participants to apply source detection, characterization, and classification methods to simulated data. The challenge opened in 2018 November, with nine teams submitting results by the deadline of 2019 April. In this work, we analyse the results for eight of those teams, showcasing the variety of approaches that can be successfully used to find, characterize, and classify sources in a deep, crowded field. The results also demonstrate the importance of building domain knowledge and expertise on this kind of analysis to obtain the best performance. As high-resolution observations begin revealing the true complexity of the sky, one of the outstanding challenges emerging from this analysis is the ability to deal with highly resolved and complex sources as effectively as the unresolved source population.

Bonaldi, A.↗
DOE OSTI2024

Agora : Multicomponent simulation for cross-survey science

ABSTRACT Next-generation cosmological surveys will observe large portions of the sky, with significant overlap between them. Multi-wavelength observations will enable us to analyse the same large-scale structure from different angles using a variety of tracers and astrophysical effects. The complex interplay between these observables calls for a model that can accurately and coherently describe their collective behaviour, posing a challenge that can only be met through the use of simulations. In this work, a suite of simulated extragalactic skies is presented, including maps and/or catalogues of cosmic microwave background (CMB) lensing, thermal and kinetic Sunyaev–Zel’dovich (tSZ/kSZ) effects, cosmic infrared background (CIB), radio sources, galaxy overdensity and galaxy weak lensing. Each of these probes is implemented in the lightcone using halo catalogues and/or particles from the Multidark-Planck2 ($\small {MDPL2}$) N-body simulation, and the modelling is calibrated using hydrodynamic simulations and publicly available data. The auto and cross-spectra of the individual probes, as well as the cross-spectra between the observables, are shown to be consistent with theoretical models and measurements from data. The simulation is shown to have a wide range of applications, including forecasting, pipeline testing, and evaluating astrophysical biases in cross-correlation measurements. It is further demonstrated that the simulation products produced in this work have sufficient accuracy to recover the input cosmology when subjected to a full cosmological analysis and are ready for application in real-world analyses for ongoing and future surveys. The simulation products presented in this work can be accessed at: https://yomori.github.io/agora/index.html.

Astronomy & Astrophysics↗
DOE OSTI2024

Autonomous Electrochemistry Platform with Real-Time Normality Testing of Voltammetry Measurements Using ML

Electrochemistry workflows utilize various instruments and computing systems to execute workflows consisting of electrocatalyst synthesis, testing and evaluation tasks. The heterogeneity of the software and hardware of these ecosystems makes it challenging to orchestrate a complete workflow from production to characterization by automating its tasks. We propose an autonomous electrochemistry computing platform for a multi-site ecosystem that provides the services for remote experiment steering, real-time measurement transfer, and AI/ML-driven analytics. We describe the integration of a mobile robot and synthesis workstation into the ecosystem by developing custom hub-networks and software modules to support remote operations over the ecosystem’s wireless and wired networks. We describe a workflow task for generating I-V voltammetry measurements using a potentiostat, and a machine learning framework to ensure their normality by detecting abnormal conditions such as disconnected electrodes. We study a number of machine learning methods for the underlying detection problem, including smooth, non-smooth, structural and statistical methods, and their fusers. We present experimental results to illustrate the effectiveness of this platform, and also validate the proposed ML method by deriving its rigorous generalization equations.

Alnajjar, Anees↗
DOE OSTI2021

Scalable Distributed Reachability Analysis for Cyber-Physical Networked Microgrids with Communication Latency

Due to the high penetration of power-electronic-interfaced distributed energy resources (DERs), a microgrid's inertia is significantly reduced, making it sensitive to cyberand physical operational changes. When multiple microgrids are interconnected to form networked microgrids for improving system's resilience, the changes of one microgrid can quickly escalate to the overall system. In cyber-physical networked microgrids, the communication latency varies a lot. To efficiently quantify the impact of the communication latency on the dynamics of networked microgrids, a scalable distributed reachability analysis approach is presented in this paper. Reachable sets are calculated for each microgrid and then composited for the overall system dynamics evaluation. Extensive tests in the full paper will demonstrate the influence of communication latency on system dynamics and validate reachable sets can bound a system's all dynamic trajectories subject to latency changes. The test results also offer an insight into designing and managing the communication network for enhancing the system's resilience.

Li, Yan↗
DOE OSTI2026

“One Table to Rule Them All”: How a Single Table can Enable Extensive Insights, Analytics and Assessment on Human Mobility Data

While much research has been conducted in Human Mobility Science, most studies on the analytics/insights part generally focus on one of the following: processing and analytics on human stop-trip behavior, design of individual mobility metrics (often in silos), calculation and characterization of only a handful (typically 5-6) of human mobility metrics on geospatial-temporal human mobility data of interest. Although human mobility research offers a vast and diverse array of available metrics, most individual studies typically compute only a small subset of five or six metrics at a time when analyzing trajectory datasets of human mobility across different areas of interest. This paper is motivated by the critical need to repeatedly compute an extensive array of human mobility metrics across several trajectory datasets and perform individual metric-level benchmarking to establish a new, standardized Test and Evaluation (T&E) suite for the field of Human Mobility Science. We first present our findings on the minimal yet sufficient pre-processing required to reliably and efficiently compute a wide range of human mobility metrics. The key findings are specifically related to the proposed Composite Stop Locations table, which serves as a core pre-processing data layer. Subsequently, we present a case study demonstrating how the Composite Stop Locations table facilitates computation of at least 14 distinct human mobility metrics (unlike 5-6 different set of metrics used for studies in the literature) using the popular and open-source OpenPFLOW dataset. Finally, we have also presented an example of our benchmarking methodology to evaluate the quality and performance of the trajectory dataset of interest, assessed across multiple human mobility metrics.

De, Debraj [ORNL] (ORCID:0000000233630020)↗
DOE OSTI2019

Development of a Host-Based Intrusion Detection and Control Device for Industrial Field Control Devices

Industrial control systems contain a multitude of devices deployed into the field to observe and control a physical process. Currently, most of these devices lack common host-based cybersecurity features, which can lead them to be seen as vulnerable targets. The Cymbiote device was developed to address this problem by examining multiple streams of data to determine what might indicate a potential threat, and to evaluate and execute appropriate response actions. This paper discusses the evolution of the Cymbiote device in response to evaluation and testing done on real-world hardware. Experimental results are discussed, as are the new developments that have been made to the device in response to the findings. In addition, we describe future research directions for this approach along with the experimental setup changes in response to the requirements for statistical rigor.

Rice, Theora R.↗
DOE OSTI2020

Bringing Automated Fault Detection and Diagnostics Tools for HVAC&R Into the Mainstream

Heating, ventilation, and air-conditioning (HVAC) systems consume over 5 quads of energy annually, representing 30% of energy consumption in the U.S. commercial buildings. Additionally, commercial refrigeration (R) systems add about 1 quad to commercial buildings energy consumption. Most HVAC systems operate with one or more faults that result in increased energy consumption. Fault detection and diagnostics (FDD) tools have been developed to address this national issue, and many tools are commercially available. FDD tools have the potential to save considerable energy for an existing commercial rooftop unit (RTU) and refrigeration systems. These devices can be used for both retro commissioning and, when faults are addressed, continuous commissioning. However, there appears to be multiple market barriers for this technology. Although there are efforts to develop FDD tool standards, currently there are no standards and methods to define functions, capabilities, accuracy, and reliability of FDD tools in the field. Moreover, most of the commercial FDD tools have not been verified in the field independently. This paper presents a comprehensive approach for bringing HVAC FDD tools into the mainstream. The approach involves demonstrating ten commercially available FDD tools installed at ten different sites, independent testing and evaluation of the FDD tools, communication with various stakeholders, identifying and assessing market barriers, creating a process evaluation methodology, and assisting utility companies in developing incentive programs. Furthermore, the preliminary baseline results from the case study demonstrate how the use of an independent monitoring system (IMS) can be used for ground-truth in evaluating FDD tools in the field.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

From CAN to ROS: A Monitoring and Data Recording Bridge

The Controller Area Network (CAN) bus protocol is used in modern vehicles for sharing messages between several control units within a vehicle. CAN bus messages are encoded with unknown scheme and decoding these messages provide unlimited access to valuable information that is used in many autonomous vehicles applications. This paper proposes a ROS based package (CAN-to-ROS) for monitoring, recording, and real-time and offline decoding of CAN bus messages. The package is developed in the ROS framework to add modularity and ease of integration with other software, and it is written in C++ to guarantee speed of the execution during run-time. For realtime decoding of CAN bus data, CAN-to-ROS package used in conjunction with other library called Libpanda that provide access to CAN bus message from a vehicle. The package was evaluated and tested on a Raspberry Pi with real CAN bus data from a Toyota RAV4. The results confirm the capabilities of CAN-to-ROS package and resulted in using the package in other research projects.

Elmadani, Safwan↗
DOE OSTI2023

Experiences Readying Applications for Exascale

The advent of Exascale computing invites an assessment of existing best practices for developing application readiness on the world's largest supercomputers. This work details observations from the last four years in preparing scientific applications to run on the Oak Ridge Leadership Computing Facility's (OLCF) Frontier system. This paper addresses a range of topics in software including programmability, tuning, and portability considerations that are key to moving applications from existing systems to future installations. A set of representative workloads provides case studies for general system and software testing. We evaluate the use of early access systems for development across several generations of hardware. Finally, we discuss how best practices were identified and disseminated to the community through a wide range of activities including user-guides and trainings. We conclude with recommendations for ensuring application readiness on future leadership computing systems.

exascale↗
DOE OSTI2023

Real-Sim Flexible Interface for X-in-the-loop Simulation (FIXS)

Real-Sim is a multi-resolution X-in-the-loop simulation framework to support inclusive testing and evaluation of CAVs before actual implementation in the real world. Real-Sim framework connects different simulation components and integrates various traffic and vehicle simulation tools, virtual environments, and XIL systems through a Flexible Interface for XIL Simulation (FIXS). Connections among different tools are transparent to users and handled by the interface behind the scenes. Co-simulation of various vehicle and traffic simulation tools with different XIL systems can be easily achieved and become a transparent "plug-and-play" process to users.

Shao, Yunli (0000000185287925)↗
DOE OSTI2024

Assessment of Electric Grid Transmission System Simulator for Human Factors Research

Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.

Li, Ruixuan↗
DOE OSTI2024

Feedstock/pretreatment screening for bioconversion of sugar and lignin streams via deacetylated disc-refining

Recent publications have shown the benefits of deacetylation disc-refining (DDR) as a pretreatment process to deconstruct biomass into sugars and lignin residues. Major advantages of DDR pretreatment over steam and dilute acid pretreatment are the removal of acetyl and lignin during deacetylation. DDR does not generate hydroxymethylfurfural (HMF) and furfural which are commonly produced from steam and dilute acid pretreatments. Acetate, lignin, HMF, and furfural are known inhibitors during enzymatic hydrolysis and fermentation. Another advantage of deacetylation is the production of lignin-rich black liquor, which can be upgraded to other bioproducts. Furthermore, due to the lack of sugar degradation during deacetylation, DDR has significantly less sugar loss than other pretreatment methods. Previous studies for DDR have primarily focused on corn stover, but lacked the investigative studies of other feedstocks. This study was designed to screen various DDR process conditions at pilot scale using three different feedstocks, including corn stover, poplar, and switchgrass. The impact of the pretreatment conditions was evaluated by testing hydrolysates for bioconversion to 2,3-butanediol. Pretreatment of biomass by DDR showed high-conversion-yields and 2,3-BDO fermentation production yields. Techno-economic analysis (TEA) of the pretreatment for biomass to sugar was also developed based on NREL’s Aspen Model. This study shows that the cellulose and hemicellulose in poplar was more recalcitrant than herbaceous feedstocks which ultimately drove up the sugar cost. Switchgrass was also more recalcitrant than corn stover but less than poplar.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Deployment of the HFIRCON transport and depletion tool for plutonium-238 production studies

Irradiation of {sup 237}Np-bearing targets in Oak Ridge National Laboratory's (ORNL) High Flux Isotope Reactor (HFIR) results in the efficient production of {sup 238}Pu, which, in the form of heat source PuO{sub 2}, is used as a reliable power source for deep-space and planetary NASA missions. A technology demonstration subproject was initiated at ORNL in 2011 to develop and implement the technology required to establish a {sup 238}Pu supply chain. A systematic progression of NpO{sub 2}/Al cermet (20 vol.% NpO{sub 2}) activities to date has successfully demonstrated target fabrication, irradiation, and chemical recovery processes. Recent program tasks have included the development of the HFIRCON transport and depletion tool for efficient reactor physics analyses and the evaluation of increased NpO{sub 2} loadings (i.e., beyond 20 vol.%) and NpN-based targets. This paper documents the deployment of the HFIRCON code to assess various Np concentrations in NpO{sub 2}- and NpN-based targets in HFIR's inner small vertical experiment facilities. Results indicate that {sup 238}Pu production and quality can be enhanced with increased Np loadings; however, target conversion rates are reduced. The results recorded in this paper, thermal and material balance evaluations, and testing requirement planning will be used to determine whether increased NpO{sub 2} loadings or NpN-based targets will be further considered. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Design and Evaluation of a Ring Tension Test Grip for Remote Mechanical Testing of Irradiated Tubular Specimens

Here, the ring tension test (RTT) is a mechanical testing method for determining bulk mechanical behavior in the circumferential or hoop direction for tubular materials. The test is especially useful for testing materials with anisotropic mechanical properties, such as zirconium alloys, which are commonly used as nuclear fuel cladding. Anisotropy requires direction-specific testing to determine the hoop strength. Historically, several RTT methods and grips have been used, each method has its strengths and weaknesses, and, in all cases, the measured strength is subject to uncertainty due to variations of the testing geometry and experimental tolerances. Recent analysis has shown that grips with a hemicylindrical mandrel configuration are recommended as the most robust configuration. The two strictest aspects to be controlled are the ability to determine gage region orientation and closely matching the size of the mandrels to the test specimen. This last requirement is particularly challenging when the dimensions of the specimen vary because of environmental effects such as dimensional changes due to irradiation. This paper presents a new RTT grip designed to incorporate this mandrel shape, hold the gage at the desired orientation, be suitable for remote operation in a hot-cell environment, and be adaptable for different sizes or variations in the specimen size. The general description and the unique design features of the test specimen and grips are given in detail. The performance of the grips in mechanical testing, including in a remote hot-cell environment, is also provided.

42 ENGINEERING↗