Search NASA⌕ Search

SEARCH · Search NASA

Results for “Design Methods Modeling and Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Large space structure model reduction and control system design based upon actuator and sensor influence functions

A model reduction procedure based on aggregation with respect to sensor and actuator influences rather than modes is presented for large systems of coupled second-order differential equations. Perturbation expressions which can predict the effects of spillover on both the aggregated and residual states are derived. These expressions lead to the development of control system design constraints which are sufficient to guarantee, to within the validity of the perturbations, that the residual states are not destabilized by control systems designed from the reduced model. A numerical example is provided to illustrate the application of the aggregation and control system design method.

Yam, Y.↗

Ground Shake Test of the Boeing Model 360 Helicopter Airframe

Boeing Helicopters, together with other U.S. Helicopter manufacturers, is engaged in a finite element applications program designed to emplace in the U.S. a superior capability to utilize finite element analysis models in support of helicopter airframe structurel design. This program was given the acronym DAMVIBS (Design Analysis Methods for VIBrationS). The test plan is reviewed and results are presented for a shake test of the Boeing Model 360 helicopter. Results of the test will serve as the basis for validation of a finite element vibration model of the helicopter.

Reed, D. A.↗

Computational Materials: Modeling and Simulation of Nanostructured Materials and Systems

The paper provides details on the structure and implementation of the Computational Materials program at the NASA Langley Research Center. Examples are given that illustrate the suggested approaches to predicting the behavior and influencing the design of nanostructured materials such as high-performance polymers, composites, and nanotube-reinforced polymers. Primary simulation and measurement methods applicable to multi-scale modeling are outlined. Key challenges including verification and validation of models are highlighted and discussed within the context of NASA's broad mission objectives.

Gates, Thomas S.↗

Testing and Model Correlation of Sublimator Driven Coldplate Coupons

The Sublimator Driven Coldplate (SDC) is a unique piece of thermal control hardware that has several advantages over a traditional thermal control scheme. The principal advantage is the possible elimination of a pumped fluid loop, potentially saving mass, power, and complexity. Because this concept relies on evaporative heat rejection techniques, it is primarily useful for short mission durations. Additionally, the concept requires a conductive path between the heat-generating component and the heat rejection device. Therefore, it is mostly a relevant solution for a vehicle with a relatively low heat rejection requirement. Coupon level tests were performed at NASA's Johnson Space Center to better understand the basic operational principles and to validate the analytical methods being used for the SDC development. This paper outlines the results of the SDC coupon tests, the subsequent thermal model correlation, and a description of the SDC Engineering Development Unit design.

Sheth, Rubik↗

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗

$\mathrm{CROPSR}$: an automated platform for complex genome-wide $\mathrm{CRISPR}$ g$\mathrm{RNA}$ design and validation

CRISPR/Cas9 technology has become an important tool to generate targeted, highly specific genome mutations. The technology has great potential for crop improvement, as crop genomes are tailored to optimize specific traits over generations of breeding. Many crops have highly complex and polyploid genomes, particularly those used for bioenergy or bioproducts. The majority of tools currently available for designing and evaluating gRNAs for CRISPR experiments were developed based on mammalian genomes that do not share the characteristics or design criteria for crop genomes. We have developed an open source tool for genome-wide design and evaluation of gRNA sequences for CRISPR experiments, CROPSR. The genome-wide approach provides a significant decrease in the time required to design a CRISPR experiment, including validation through PCR, at the expense of an overhead compute time required once per genome, at the first run. To better cater to the needs of crop geneticists, restrictions imposed by other packages on design and evaluation of gRNA sequences were lifted. A new machine learning model was developed to provide scores while avoiding situations in which the currently available tools sometimes failed to provide guides for repetitive, A/T-rich genomic regions. We show that our gRNA scoring model provides a significant increase in prediction accuracy over existing tools, even in non-crop genomes. CROPSR provides the scientific community with new methods and a new workflow for performing CRISPR/Cas9 knockout experiments. CROPSR reduces the challenges of working in crops, and helps speed gRNA sequence design, evaluation and validation. We hope that the new software will accelerate discovery and reduce the number of failed experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hybrid Cyber-attack Detection in Photovoltaic Farms

Here, to address the cyber-physical security in PV farms, a hybrid cyber-attack detection is proposed in this manuscript. To secure PV farms, the proposed method integrates model-based and data-driven methods by fusing the detection score at the device and system levels. First, a model-based cyber-attack detection method is developed for each PV inverter. A residual between the estimation of the Kalman filter and measurement is calculated. By leveraging the calculated residual from all inverters, a squared Mahalanobis distance is developed for device detection score generation. At the system level, a convolutional neural network (CNN) is proposed to detect cyber-attack using the waveform data at the point of common coupling (PCC) in PV farms. To improve the CNN detection accuracy, a set of well-designed features are extracted from the raw waveform data. Finally, a weighted detection score fusion method is proposed to combine device and system detection scores by using their complementary strength. The feasibility and robustness of the proposed method are validated by testing cases and a comparative experiment.

14 SOLAR ENERGY↗

Validation and Verification for INL Modelica-based TEDS models Via Experimental Results

This report provides an overview on the verification and validation (V&V) of the Thermal Energy Distribution System (TEDS) model developed in the Modelica process modeling ecosystem using experimental data. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Energy Systems Laboratory (ESL) at Idaho National Laboratory (INL). The model was then used during the preconstruction phase of the experimental effort to inform experimental design (e.g., insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit: a 200kW Chromalox heater; a single-tank packed-bed thermal energy storage system filled with 0.125-inch alumina (Al2O3) beads; an ethylene-glycol-to-Therminol-66 heat exchanger; system piping; five control valves; and all associated temperature, pressure, and volumetric flow sensors. Using the Institute of Electrical and Electronics Engineers (IEEE) V&V methodologies, considered the gold standard in the engineering field, the model was verified using a combination of static analysis, spatial convergence, and regression tests. Then using dynamic time warping (DTW) initial runs to validate and tune the TEDS model versus the experiment were conducted. This tuning method was accomplished using the INL Risk Analysis Virtual ENvironment (RAVEN) software package. Tuning is required to account for physical phenomena that are less understood within the empirical heat transfer correlations. Through the commencement of this work, a systems-level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model was utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Then, initial experimental startup and operational data were used to demonstrate the validation and tuning methodology. This process demonstrates the classical two-step approach of a model informing experimental design followed by the experiment validation and tuning the model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Design and Scoping Tests on Alloy 617 Using Notched Specimen Geometry to Validate Methods for Multiaxial Stress Relaxation

In FY 2022, a development effort was initiated at the US Department of Energy’s Oak Ridge National Laboratory (ORNL) to examine the multiaxial stress-relaxation behavior and multiaxial stress-state effect on the creep-fatigue (CF) performance for Alloy 617 at elevated temperatures. This effort supported the development of the design rules in the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5. In this work, two types of the notch specimen geometries were designed. An inelastic constitutive model was used to investigate the stress triaxiality and elastic follow-up effects on the notch specimens under CF deformation in the finite element (FE) simulations. The numerical study demonstrated that the stress triaxiality and elastic follow-up caused by the notches both play significant roles in the stress-relaxation behavior. In addition, Alloy 617 CF experiments were designed, and the testing on the notch specimens is ongoing. CF test failure data will be generated on the specimens with notches under various conditions in FY 2023, and the results will be used to validate methods for accounting for the multiaxial stress relaxation effect in the design code.

36 MATERIALS SCIENCE↗

Contact dynamics testing of automated three-point docking mechanism

An evaluation of an OMV docking mechanism, based on an adaptation of the Shuttle Flight Support System Pallet Berthing Mechanism was completed. The mechanism uses automatically actuated motorized latches to engage towel bars on the target satellite. LED sensors establish the towel bar position within the capture envelope and the latch capture commands are issued. Then, locking pawls engage the bar, locking and pre-loading the mechanism. Two series of tests were conducted to test nominal and failure mode captures and to evaluate design parameters such as LED sensor locations, automatic closure algorithms, latch closure velocity, position/velocity entry envelopes, and closure method. The first test series involved single latch testing on the Flat Floor Facility, the 6 DOF Facility, and an analytic simulation model. The intent was to compare results in order to validate the various facilities. Reasonably good agreement was achieved. The second test series repeated the single latch testing on the refurbished 6 DOF Facility to validate the facility modifications. The individual latches were tested under free-drift conditions for functionality and performance. Next, the three-latch configuration underwent parametric testing. Test results validated the improved fidelity of the 6 DOF Facility and verified successful docking at the required entry velocity. The tests determined the 'best' design parameter definitions and concluded that the locking pawls should not lock until all three latches completely close.

Rourke, Kenneth H.↗

Multiobjective Multidisciplinary Optimization of Low-Boom Supersonic Transports Using Multifidelity Models

A multidisciplinary optimization (MDO) method has been developed to design a computational fluid dynamics (CFD) based low-boom configuration that can be obtained from a Pareto solution of a low-fidelity multiobjective MDO problem with mission constraints. This paper refines the developed MDO method using multifidelity models for CFD-based multiobjective MDO. The refined MDO method can generate a low-boom configuration that satisfies the mission requirements, has the lowest takeoff gross weight and the longest range for the low-boom mission, trims the low-boom cruise flight with fuel redistributions, and has a reversed equivalent area distribution closely matching a low-boom target with ground noise level below 70 PLdB. The validity of the refined MDO method is demonstrated by a design study of a low-boom supersonic transport that carries 40 passengers, flies a low-boom mission with cruise Mach of 1.7 and range of 3500 nm, and cruises overwater at Mach 1.8 with range of 3882 nm. Moreover, the refined MDO method eliminates the difference between the assumed cruise weight for CFD-based low-boom inverse design optimization and the estimated cruise weight of the optimal inverse design solution with respect to the mission requirements.

multidisciplinary optimization↗

An adaptive adversarial domain adaptation approach for corn yield prediction

Recently, statistical machine learning and deep learning methods have been widely explored for corn yield prediction. Though successful, machine learning models generated within a specific spatial domain often lose their validity when directly applied to new regions. To address this issue, we designed an unsupervised adaptive domain adversarial neural network (ADANN). Specifically, through domain adversarial training, the ADANN model reduced the impact of domain shift by projecting data from different domains into the same subspace. Also, the ADANN model was designed to be trained in an adaptive way, which guaranteed the model can learn the domain-invariant features and perform accurate yield prediction simultaneously. Informative variables including time-series vegetation indices and sequential weather observations were first collected from multiple data sources and aggregated to the county level. Then, we trained the ADANN model with the extracted features and corresponding reported county-level corn yield from the U.S. Department of Agriculture (USDA). Finally, the trained model was evaluated in four testing years 2016–2019. The U.S. corn belt was used as the study area and counties under study were grouped into two diverse ecological regions. Overall, the experimental results showed that the developed ADANN model had better performance than three other state-of-the-art machine learning models in both local experiments (train and test in the same region) and transfer experiments (train and test in different regions). As the first study using adversarial learning for crop yield prediction, this research demonstrates a novel solution for improving model transferability on crop yield prediction.

59 BASIC BIOLOGICAL SCIENCES↗

Pervaporative Dehydration of 2,3-Butanediol by Dense Poly(vinylidene fluoride) Hollow Fiber Membranes: Parameter Estimation, Process Design, and Technoeconomic Evaluation under Uncertainty

Pervaporation, combined with other separation processes, can effectively remove water from fermentation product streams, making it highly suitable for purifying alcohols like 2,3-butanediol (BDO). In this study, a dense poly(vinylidene fluoride) (PVDF) hollow fiber membrane module prototype was fabricated for BDO dehydration, achieving >0.2 LMH total flux and >95% BDO rejection. With a Markov chain Monte Carlo (MCMC) approach, Bayesian inference was used to quantify the uncertainty of the permeance parameters. A membrane cascade model was developed to scale up a process that purifies a preconcentrated BDO feed (70 wt %) to high purity (90 wt %). Through propagation of the uncertainty of the parameters and sensitivity analyses of the process variables, a cascade design was recommended. Despite data and model limitations, the framework enabled a reliable system analysis and economic evaluation, validated through tight confidence intervals in key process metrics, establishing the foundation for future applications of Bayesian methods in membrane-based processes.

Animal feed↗

The Source Physics Experiment (SPE) Science Plan

The Source Physics Experiment (SPE) series is a long-term NNSA research and development effort designed to improve U.S. arms control and nuclear nonproliferation verification and monitoring capabilities. The findings from the SPE will advance the United States’ nuclear explosion monitoring capabilities, particularly with respect to detection, discrimination and determination of yields associated with small nuclear explosions that can be lost amid the noisy seismo-acoustic background from other sources. The data generated from the SPE, a series of well-designed and recorded chemical explosions, will contribute to the development and validation of first-principles explosive source generated seismo-acoustic modeling codes. These codes will then facilitate the update of semi-empirical methods, currently based on historic test site data, such that key explosion observables can be reproduced, thus improving confidence in nuclear test monitoring in new areas and/or under novel emplacement conditions. The overall SPE project is comprised of both the development of the new explosion simulation codes and the chemical explosion test series. The chemical explosion test series will generate the empirical data required to both develop and validate the new simulation codes.

58 GEOSCIENCES↗

Comparison of Modal Analysis Methods Applied to a Vibro-Acoustic Test Article

Modal testing of a vibro-acoustic test article referred to as the Aluminum Testbed Cylinder (ATC) has provided frequency response data for the development of validated numerical models of complex structures for interior noise prediction and control. The ATC is an all aluminum, ring and stringer stiffened cylinder, 12 feet in length and 4 feet in diameter. The cylinder was designed to represent typical aircraft construction. Modal tests were conducted for several different configurations of the cylinder assembly under ambient and pressurized conditions. The purpose of this paper is to present results from dynamic testing of different ATC configurations using two modal analysis software methods: Eigensystem Realization Algorithm (ERA) and MTS IDEAS Polyreference method. The paper compares results from the two analysis methods as well as the results from various test configurations. The effects of pressurization on the modal characteristics are discussed.

Pritchard, Jocelyn↗

Geometry-complete diffusion for 3D molecule generation and optimization

Abstract Generative deep learning methods have recently been proposed for generating 3D molecules using equivariant graph neural networks (GNNs) within a denoising diffusion framework. However, such methods are unable to learn important geometric properties of 3D molecules, as they adopt molecule-agnostic and non-geometric GNNs as their 3D graph denoising networks, which notably hinders their ability to generate valid large 3D molecules. In this work, we address these gaps by introducing the Geometry-Complete Diffusion Model (GCDM) for 3D molecule generation, which outperforms existing 3D molecular diffusion models by significant margins across conditional and unconditional settings for the QM9 dataset and the larger GEOM-Drugs dataset, respectively. Importantly, we demonstrate that GCDM’s generative denoising process enables the model to generate a significant proportion of valid and energetically-stable large molecules at the scale of GEOM-Drugs, whereas previous methods fail to do so with the features they learn. Additionally, we show that extensions of GCDM can not only effectively design 3D molecules for specific protein pockets but can be repurposed to consistently optimize the geometry and chemical composition of existing 3D molecules for molecular stability and property specificity, demonstrating new versatility of molecular diffusion models. Code and data are freely available on GitHub .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian optimized collection strategies for fatigue strength testing

Abstract A statistical framework is presented enabling optimal sampling and analysis of constant life fatigue data. Protocols using Bayesian maximum entropy sampling are built based on conventional staircase and stress step methods, reducing the requirement of prior knowledge for data collection. The Bayesian Staircase method shows improved parameter estimation efficiency, and the Bayesian Stress Step method shows equal accuracy to the standard method at larger step size allowing experimentalists to lessen concerns of loading history. Statistical methods for determining model suitability are shown, highlighting the influence of protocol. Experimental validation is performed, showing the applicability of the methods in laboratory testing.

36 MATERIALS SCIENCE↗

Challenges in Qualification of Thermal Protection Systems in Extreme Entry Environments

Planetary entry vehicles employ ablative TPS materials to shield the aeroshell from entry aeroheating environments. To ensure mission success, it must be demonstrated that the heat shield system, including local features such as seams, does not fail at conditions that are suitably margined beyond those expected in flight. Furthermore, its thermal response must be predictable, with acceptable fidelity, by computational tools used in heat shield design. Mission assurance is accomplished through a combination of ground testing and material response modelling. A material's robustness to failure is verified through arcjet testing while its thermal response is predicted by analytical tools that are verified against experimental data. Due to limitations in flight-like ground testing capability and lack of validated high-fidelity computational models, qualification of heat shield materials is often achieved by piecing together evidence from multiple ground tests and analytical simulations, none of which fully bound the flight conditions and vehicle configuration. Extreme heating environments (>2000 W/sq. cm heat flux and >2 atm pressure), experienced during entries at Venus, Saturn and Ice Giants, further stretch the current testing and modelling capabilities for applicable TPS materials. Fully-dense Carbon Phenolic was the material of choice for these applications; however, since heritage raw materials are no longer available, future uses of re-created Carbon Phenolic will require re-qualification. To address this sustainability challenge, NASA is developing a new dual-layer material based on 3D weaving technology called Heat shield for Extreme Entry Environments (HEEET). Regardless of TPS material, extreme environments pose additional certification challenges beyond what has been typical in recent NASA missions. Scope of this presentation: This presentation will give an overview of challenges faced in verifying TPS performance at extreme heating conditions. Examples include: (1) Bounding aeroheating parameters (heat flux, pressure, shear and enthalpy) in ground facilities. How to certify TPS if environments can't be bounded or aeroheating parameters can't be simultaneously achieved. (2) Higher uncertainties in ground test environments (facility calibration and analytical predictions) at extreme conditions. (3) Testing in flows similar to planetary atmosphere composition (H2/He for Gas and Ice Giants). (4) Test sample size limitations for qualifying seam designs. (5) Lack of computational tools capable of simulating all significant aspects of TPS performance (including initiation and propagation of failures). This presentation will provide recommendations on how the EDL community can address these challenges and mitigate some of the risks involved in flying TPS materials at extreme conditions. Examples include: (1) Dedicated activity to understanding TPS failure modes. Develop computational tools capable of modelling fluid interaction with material's thermostructural response. Validate these tools through failure testing. A better understanding of failure mechanisms may eliminate the need to fully bound all aeroheating parameters in ground testing. (2) Enhancements to current testing facilities to simulate flight-like ablation mechanism (ex. testing in Nitrogen at Ames Interaction Heating Facility to limit oxidation in favor of more sublimation). (3) Improved characterization of test conditions with new diagnostic methods and determination of environment uncertainty through rigorous statistical analysis of available data. (4) Design margin policies that are directly tied to uncertainties in ground test environments and modelling fidelity

Mahzari, Milad↗