Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Thermal Desktop Modeling of 2016 CRYOTE-2 Tank Chill and Fill Testing

The storing and transfer of cryogenic propellants is an enabling technology for NASA and industry as civilization moves to expand future missions into low Earth orbit and beyond. Several ground propellant transfer tests have been conducted in past decades examining various tank chilldown and fill methods. Creating accurate models using these historical datasets is a vital step toward developing appropriate modeling tools to form pre-test predictions for subsequent ground and flight propellant transfers. This paper presents model validation of Thermal Desktop using data from the 2016 CRYOTE-2 liquid nitrogen transfer experiments whose purpose was to demonstrate the chill and fill process in a spherical receiver tank. Tank pressure, fill level, and wall temperature were all modeled and compared with 8 test cases using two modeling methods, Mass Controlled, and Pressure Controlled. This test series is the hardest Thermal Desktop tank chill and fill validation case to-date, yet the model was able to accurately predict each of these metrics for the 2016 tests within 28%, 10%, 20% respectively, for pressure, fill level, and wall temperature using the Mass Controlled model, and 29%, 79%, and 12%, respectively for the Pressure Controlled model.

Cryogenic Tank Chilldown↗

Image Distinguishability Analysis Testing Through Principal Components and Its Application to Hot Spot Scale Invariance

Hot spots are spatial regions of intense energy localization that govern initiation of secondary high explosives. Studies that characterize or compare simulated hot spots are frequently either qualitatively descriptive or resort to quantitative distribution functions that neglect stochastic variations and spatial correlations—effects that are also neglected in common comparison tests like the Kolmogorov–Smirnov test. To this end, we develop an image distinguishability analysis (IDA) test based on principal component (PC) analysis that makes pixel-by-pixel comparisons between small, for example, O(<10), image data sets. The IDA test makes comparisons through a generalized distance metric in the PC space and a test statistic that is derived to calculate mathematical equation-values. Here, we derive a statistical distribution and criticality criterion to determine whether images are distinguishable from established baselines. We apply the IDA test on images generated from molecular dynamics simulations of hot spots from pore collapse in TATB to assess scale invariance in the complex patterns of hot spots that form in a representative high explosive crystal. The IDA test shows that TATB hot spot spatial temperature fields and their derived temperature histograms exhibit scale-invariant features over specific intervals of shock orientation, strength, and initial pore diameter. However, the IDA test also shows that qualitatively different conclusions regarding invariance can be reached depending on whether the hot spot is treated as a spatially correlated field as opposed to a distribution function that lacks spatial information.

organic↗

The Triple Catalytic Action of Tertiary Nitrogen Catalysts in Recyclable Epoxy-Anhydride Thermosets

The thermosetting polymer matrix in fiber reinforced composites is an important component for energy related applications, such as the lightweighting of vehicles or their use in wind and waterpower turbine blades, due to their ability to provide superior adhesion, stiffness, and applicability to a wide range of manufacturing processes. Despite these benefits, today's thermosets are widely considered to be unrecyclable; thus, there is a large interest in redesigning these materials to be inherently recyclable so that energy intensive production of fibers and monomers can be circumvented, bolstering composite manufacture supply chains. Polyester covalent adaptable networks (PECANs) are one such promising alternative to the incumbent, nonrecyclable epoxy-amine thermosets. PECANs can be formed from the ring-opening co-polymerization (ROCOP) of epoxy-anhydride monomer mixtures and subsequent curing at mild temperatures to exhibit similar performance to conventional epoxies while also possessing unique dynamic chemistries along the ester-hydroxyl backbone that are capable of transesterification and thus reprocessability. While significant advancements have been made in formulating these materials for improved mechanical properties or optimizing solvolysis and reprocessing strategies, less attention has been placed on the impact of the residing amine catalyst used to generate the polyester network. In this work, we evaluated the triple-catalytic efficacy of 12 tertiary amines that act as a curing (bulk ROCOP), a transesterification (internal bond exchange), and a deconstruction (methanolysis) catalyst for PECAN thermosets. Specifically, we first distinguish between chain-growth and step-growth polymerization mechanisms for epoxy-amine and epoxy-anhydride mechanisms. We also utilized density functional theory (DFT) to estimate the basicity (pKb) of each catalyst. Of the tested catalysts, the ROCOP of the studied PECAN network can be completed between 95 and 247 min (at 80 degrees C), with variable gelation phenomena. Additionally, the stress relaxation (transesterification metric) efficiency of the tested PECAN networks with alternative embedded catalysts ranged from 95% to 15% reduction in stress after 5 h at 200 degrees C, and the depolymerization efficacy ranged from 2.5% to 9.8% deconstruction after 36 h at 130 degrees C. Overall, the nitrogen-based moieties were demonstrated to influence polymerization kinetics, catalyze the dynamic transesterification exchange mechanism, and aid in the solvolysis of the thermosets at end-of-life.

36 MATERIALS SCIENCE↗

COTS Ceramic Chip Capacitors: An Evaluation of the Parts and Assurance Methodologies

Commercial-Off-The-Shelf (COTS) multilayer ceramic chip capacitors (MLCCs) are continually evolving to reduce physical size and increase volumetric efficiency. Designers of high reliability aerospace and military systems are attracted to these attributes of COTS MLCCs and would like to take advantage of them while maintaining the high standards for long-term reliable operation they are accustomed io when selecting military qualified established reliability (MIL-ER) MLCCs. However, MIL-ER MLCCs are not available in the full range of small chip sizes with high capacitance as found in today's COTS MLCCs. The objectives for this evaluation were to assess the long-term performance of small case size COTS MLCCs and to identify effective, lower-cost product assurance methodologies. Fifteen (15) lots of COTS X7R dielectric MLCCs from four (4) different manufacturers and two (2) MIL-ER BX dielectric MLCCs from two (2) of the same manufacturers were evaluated. Both 0805 and 0402 chip sizes were included. Several voltage ratings were tested ranging from a high of 50 volts to a low of 6.3 volts. The evaluation consisted of a comprehensive screening and qualification test program based upon MIL-PRF-55681 (i.e., voltage conditioning, thermal shock, moisture resistance, 2000-hour life test, etc.). In addition, several lot characterization tests were performed including Destructive Physical Analysis (DPA), Highly Accelerated Life Test (HALT) and Dielectric Voltage Breakdown Strength. The data analysis included a comparison of the 2000-hour life test results (used as a metric for long-term performance) relative to the screening and characterization test results. Results of this analysis indicate that the long-term life performance of COTS MLCCs is variable -- some lots perform well, some lots perform poorly. DPA and HALT were found to be promising lot characterization tests to identify substandard COTS MLCC lots prior to conducting more expensive screening and qualification tests. The results indicate that lot- specific screening and qualification are still recommended for high reliability applications. One significant and concerning observation is that MIL- type voltage conditioning (100 hours at twice rated voltage, 125 C) was not an effective screen in removing infant mortality parts for the particular lots of COTS MLCCs evaluated.

Brusse, Jay A.↗

Multi-version software reliability through fault-avoidance and fault-tolerance

A number of experimental and theoretical issues associated with the practical use of multi-version software to provide run-time tolerance to software faults were investigated. A specialized tool was developed and evaluated for measuring testing coverage for a variety of metrics. The tool was used to collect information on the relationships between software faults and coverage provided by the testing process as measured by different metrics (including data flow metrics). Considerable correlation was found between coverage provided by some higher metrics and the elimination of faults in the code. Back-to-back testing was continued as an efficient mechanism for removal of un-correlated faults, and common-cause faults of variable span. Software reliability estimation methods was also continued based on non-random sampling, and the relationship between software reliability and code coverage provided through testing. New fault tolerance models were formulated. Simulation studies of the Acceptance Voting and Multi-stage Voting algorithms were finished and it was found that these two schemes for software fault tolerance are superior in many respects to some commonly used schemes. Particularly encouraging are the safety properties of the Acceptance testing scheme.

Vouk, Mladen A.↗

SLS Integrated Modal Test Uncertainty Quantification using the Hybrid Parametric Variation Method

Uncertainty in structural loading during launch is a significant concern in the development of spacecraft and launch vehicles. Small variations in launch vehicle and payload mode shapes and their interaction can result in significant variation in system loads. In many cases involving large aerospace systems it is difficult, not economical, or impossible to perform a system modal test. However, it is still vital to obtain test results that can be compared with analytical predictions to validate models. Instead, the “Building Block Approach” is used in which system components are tested individually. Component models are correlated and updated to agree as best they can with test results. The Space Launch System consists of a number of components that are assembled into a launch vehicle. Finite element models of the components are developed, reduced to Hurty/Craig-Bampton models and assembled to represent different phases of flight. The only opportunity to obtain modal test data from an assembled Space Launch System will be during the Integrated Modal Test. There is always uncertainty in every model, which flows into uncertainty in predicted system results. Uncertainty Quantification is used to determine statistical bounds on prediction accuracy based on model uncertainty. For the Space Launch System, model uncertainty is at the Hurty/Craig-Bampton component level. Uncertainty in the Hurty/Craig-Bampton components is quantified using the hybrid parametric variation approach that combines parametric and nonparametric uncertainty. Uncertainty in model form is one of the biggest contributors to uncertainty in complex built-up structures. This type of uncertainty cannot be represented by variations infinite element model input parameters and thus cannot be included in a parametric approach. However, model-form uncertainty can be modeled using a nonparametric approach based on random matrix theory. The hybrid parametric variation method requires the selection of dispersion values for the Hurty/Craig-Bampton fixed-interface eigenvalues, and the Hurty/Craig-Bampton stiffness matrices. Component test/analysis frequency error is used to identify the fixed-interface eigenvalue dispersions, while test/analysis cross-orthogonality is used to identify stiffness dispersion values. The hybrid parametric variation uncertainty quantification approach is applied to the Space Launch System Integrated Modal Test configuration. Monte Carlo analysis is performed, and statistics are determined for modal correlation metrics, frequency response from Integrated Modal Test shakers to selected accelerometers, as well as other metrics for determining how well target modes are excited and identified. If the predicted uncertainty envelopes future Integrated Modal Test results, then there will be increased confidence in the utility of the component-based hybrid parametric variation uncertainty quantification approach.

Uncertainty Quantification↗

Software unit testing in Ada environment

A validation procedure for the Ada binding of the Graphical Kernel System (GKS) is being developed. PRIOR Data Sciences is also producing a version of the GKS written in Ada. These major software engineering projects will provide an opportunity to demonstrate a sound approach for software testing in an Ada environment. The GKS/Ada validation capability will be a collection of test programs and data, and test management guidelines. These products will be used to assess the correctness, completeness, and efficiency of any GKS/Ada implementation. The GKS/Ada developers will be able to obtain the validation software for their own use. It is anticipated that this validation software will eventually be taken over by an independent standards body to provide objective assessments of GKS/Ada implementations, using an approach similar to the validation testing currently applied to Ada compilers. In the meantime, if requested, this validation software will be used to assess GKS/Ada products. The second project, implementation of GKS using the Ada language, is a conventional software engineering tasks. It represents a large body of Ada code and has some interesting testing problems associated with automatic testing of graphics routines. Here the normal test practices which include automated regression testing, independent quality assistance, test configuration management, and the application of software quality metrics will be employed. The software testing methods emphasize quality enhancement and automated procedures. Ada makes some aspects of testing easier, and introduces some concerns. These issues are addressed.

Warnock, Glenn↗

Experimental constraints on metric and non-metric theories of gravity

Experimental constraints on metric and non-metric theories of gravitation are reviewed. Tests of the Einstein Equivalence Principle indicate that only metric theories of gravity are likely to be viable. Solar system experiments constrain the parameters of the weak field, post-Newtonian limit to be close to the values predicted by general relativity. Future space experiments will provide further constraints on post-Newtonian gravity.

Will, Clifford M.↗

Power Prediction of Airborne Wind Energy Systems Using Multivariate Machine Learning

Kites can be used to harvest wind energy at higher altitudes while using only a fraction of the material required for conventional wind turbines. In this work, we present the kite system of Kyushu University and demonstrate how experimental data can be used to train machine learning regression models. The system is designed for 7 kW traction power and comprises an inflatable wing with suspended kite control unit that is either tethered to a fixed ground anchor or to a towing vehicle to produce a controlled relative flow environment. A measurement unit was attached to the kite for data acquisition. To predict the generated tether force, we collected input–output samples from a set of well-designed experimental runs to act as our labeled training data in a supervised machine learning setting. We then identified a set of key input parameters which were found to be consistent with our sensitivity analysis using Pearson input–output correlation metrics. Finally, we designed and tested the accuracy of a neural network, among other multivariate regression models. The quality metrics of our models show great promise in accurately predicting the tether force for new input/feature combinations and potentially guide new designs for optimal power generation.

17 WIND ENERGY↗

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗

Software development predictors, error analysis, reliability models and software metric analysis

The use of dynamic characteristics as predictors for software development was studied. It was found that there are some significant factors that could be useful as predictors. From a study on software errors and complexity, it was shown that meaningful results can be obtained which allow insight into software traits and the environment in which it is developed. Reliability models were studied. The research included the field of program testing because the validity of some reliability models depends on the answers to some unanswered questions about testing. In studying software metrics, data collected from seven software engineering laboratory (FORTRAN) projects were examined and three effort reporting accuracy checks were applied to demonstrate the need to validate a data base. Results are discussed.

Basili, Victor↗

Prioritizing Off-gas Metrics

Off-gas research within the Material Recovery and Waste Form Development (MRWFD) team is dispersed among four national laboratories and multiple universities and small businesses. Ensuring research is conducted consistently and in a manner conducive to direct comparison is a nontrivial task. The team assembled to realign goals and expectations by identifying distinct R&D phases, prioritizing crucial metrics, and outlining standardized tests specifically associated with Kr, Xe, and I capture.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluating Synthetic Smart Meter Locations For Communication System Modeling

An important part of good communication models for smart grid applications, particularly when wireless protocols are used, is the location information of the nodes. We’ve developed metrics to assist in evaluating whether a given model with such information is representative of feeders found in the world. These metrics are applied to a set of feeder models with known good location information for the smart meter locations and compared to a set of feeder models with similar location information that is not expected to be representative of real-world feeders. The comparison reveals that the suspect models do not pass statistical tests utilizing the developed metrics, providing initial validation of the analysis technique.

smart meter, feeder model, GridLAB-D↗

A building performance-based approach to determining energy resilience for grocery stores in the event of a power outage

Evaluating progress toward a built environment that is best equipped to serve communities during a regional power outage will require metrics that capture the energy resilience of the unique buildings and businesses most crucial to the well-being of those nearby. We focused on grocery stores as key buildings for which access, and thus energy resilience, is critical during a disaster when power is unavailable. We evaluated the energy resilience of these buildings by offering and testing building-scale metrics that assess business continuity potential during a power outage. Metrics proposed in this study are calculated based on the unique power loads characteristic to grocery stores, primarily refrigeration and maintaining safe indoor environmental conditions. Building simulations based on varying levels of backup power were carried out against occupant safety and comfort parameters to apply these metrics, with additional criteria imposed on grocery stores to capture the inventory and sales loss from food spoilage resulting from a lack of refrigeration power. Findings from this study demonstrate the feasibility of our proposed metrics and methodology to serve as a low-data burden means for stakeholders to evaluate the energy resilience of grocery stores, with greater implications in helping to understand the impact on community-scale energy resilience.

Siegel, Lino Sanchez↗

Advances in Integrally Formed Metallic Structures

NASA Langley Research Center (LaRC) is applying flow forming technology to aerospace aluminum alloys for the manufacture of integrally stiffened cylinders that meet aircraft fuselage or launch vehicle specifications. High-strength 2xxx series alloys, in various temper/product form conditions, are being compared with medium-strength, very formable AA 6061 as the benchmark. Screening of candidate materials traditionally relies on empirical forming trials, but more recently on metrics derived from constant nominal strain rate tensile testing. In this work, the established hierarchy of formability metrics is adopted as the baseline; tensile area reduction, work hardening exponent, and modulus of resilience. The suite of metrics can be expanded based on phenomenological and mechanistic considerations of plastic flow instabilities to incorporate anisotropy ratio, rate of work hardening, and dynamic strain aging effects. Separate research thrusts at LaRC are aimed at formulating a protocol for scalable production of fully formed, defect-free components: 1) quantifying the extended set of formability metrics from constant and jump strain rate tensile tests with digital image correlation (DIC); 2) using statistically designed experiments on a vertical spin/flow forming facility (WF VUD-600®) to isolate the effect of convenient process variables, such as axial feed rate and thickness reduction; and 3) predicting the effect of feed ratio (roller translation relative to mandrel rotation speeds) on material response via process modeling using the DEFORM® simulation software. Current results will be discussed in terms of correlating intrinsic material properties with the bulk workability characteristics to successfully fabricate cylinders with complex cross-sections.

Aluminum↗

Development of an All-Aqueous Thermally Regenerative Redox Flow Battery to Support Fossil Fuel Assets

Low-temperature thermal energy, a largely untapped resource, holds significant promise for large-scale electrical power generation globally. Various stationary sources, including industrial entities and thermal power plants, emit considerable low-temperature heat that currently remains unutilized. This energy is often overlooked because its low temperature renders it unsuitable for efficient power generation using conventional methods. However, current research is exploring diverse technologies capable of converting low-temperature heat into grid-scale power, aiming to enhance grid efficiency, further decarbonization initiatives, and facilitate a shift toward more decentralized power systems. One such innovative technology is the thermally regenerative battery (TRB), noted for its high power and energy densities compared to similar technologies, positioning it as a potential game-changer in power generation. TRBs integrate two scalable and well-established unit operations: a redox flow battery and a distillation column. This integration suggests that once an effective TRB chemistry is established, the pathway to commercialization could be expedited. The copper-based thermally regenerative ammonia battery (Cu aq -TRAB) stands out as the first TRB that circumvents electrodeposition/dissolution reactions, stabilizing Cu(I) and Cu(II) within the electrolyte and maintaining stability of all electroactive species in an aqueous phase. This stabilization has led to improvements in coulombic efficiency, open circuit potential, and copper solubility, thereby enhancing power density, energy density, and overall energy efficiency. Preliminary tests were conducted to determine the effects of various electrolyte species on the performance metrics of the battery, both theoretically and experimentally. These tests revealed that the solubility of copper in the Cu aq -TRAB electrolyte was constrained by the Cu(I)-NH 3 complex. Adjusting the background electrolyte to 5 M NH4Br and the ligand concentration to 4 M NH 3 enabled the copper concentration to reach a maximum of 0.6 M. This modification led to an estimated theoretical maximum energy density of 9.5 Wh L -1 for the Cu aq -TRAB. Additionally, full cell testing indicated a tradeoff between peak power and energy density with varying copper and ammonia concentrations. Increasing the applied current density during discharge linearly raised the average power output, with a minimal reduction in energy density due to a balance between higher ohmic overpotential and reduced time for undesirable ammonia crossover. Furthermore, a comprehensive numerical sensitivity analysis of the complete Cu aq -TRAB system was performed. This analysis aimed to assess how the battery and the distillation column responded to changes in system input parameters, providing insights into optimal research directions for enhancing system performance. The analysis revealed that at room temperature, battery power was significantly more sensitive to ohmic losses than to mass transfer, with reaction rates having minimal impact. This trend continued even at higher temperatures. Also, the thermal energy required for ammonia separation was studied, showing that increased temperatures generally reduced energy requirements, except in low-pressure scenarios above 65 °C. An investigation into membrane performance in the Cu aq -TRAB was undertaken, given the significant impact of ammonia transport control and ohmic losses on system performance. Various membranes were evaluated to identify key performance metrics. Among the tested membranes, Selemion CMVN exhibited the highest performance, with a peak power density of 84 mW cm -2 and average values of 26 ± 6.8 mW cm -2 for power density and 2.9 Wh L -1 for energy density at an applied current density of 50 mA cm -2 . An economic assessment indicated a levelized cost of storage at $410 per MWh under optimal conditions, highlighting the commercial potential of the Cu aq -TRAB when utilizing cost-effective, readily available materials.

25 ENERGY STORAGE↗

Optimal Transport for e/$\pi^0$ Particle Classification in LArTPC Neutrino Experiments

Separation of electron signals from $\pi^0$ backgrounds is crucial for neutrino oscillation measurements and searches for Beyond Standard Model (BSM) physics in current and future Liquid Argon Time Projection Chamber (LArTPC) experiments. e/$\pi^0$ separation has been a reconstruction challenge since both e and $\pi^0$ present as electromagnetic showers, and often only one out of the two showers produced by $\pi^0$ is reconstructed correctly. This research aims to improve the performance of e/$\pi^0$ separation using optimal transport (OT), by leveraging on the topological differences in the showers produced by the two particles. OT is a method which compares two distributions by finding the most efficient way to transform, or “move” from one to the other. This work uses the MicroBooNE open samples public dataset to test the e/$\pi^0$ separation performance of the method on events which incorporate realistic modeling of LArTPC detector response. Reconstructed 3D energy deposits are projected onto a plane perpendicular to the primary shower, allowing OT to better detect the topological differences between the two types of particles without the need to separately reconstruct all the showers in the events. Different distance metrics for OT are tested and preliminary results on e/$\pi^0$ separation are presented.

43 PARTICLE ACCELERATORS↗

Automated Testcase Generation for Numerical Support Functions in Embedded Systems

We present a tool for the automatic generation of test stimuli for small numerical support functions, e.g., code for trigonometric functions, quaternions, filters, or table lookup. Our tool is based on KLEE to produce a set of test stimuli for full path coverage. We use a method of iterative deepening over abstractions to deal with floating-point values. During actual testing the stimuli exercise the code against a reference implementation. We illustrate our approach with results of experiments with low-level trigonometric functions, interpolation routines, and mathematical support functions from an open source UAS autopilot.

Metrics↗