Results for “Design Methods and Validation” — Page 12

DOE OSTI2025

Evaluation of Seismic Artificial Intelligence with Uncertainty

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still a lack of robust evaluation frameworks for evaluating and comparing DLMs. Here, we address this gap by designing an evaluation framework that jointly incorporates two crucial aspects: performance uncertainty and learning efficiency. To target these aspects, we meticulously construct the training, validation, and test splits using a clustering method tailored to seismic data and enact an expansive training design to segregate performance uncertainty arising from stochastic training processes and random data sampling. The framework’s ability to guard against misleading declarations of model superiority is demonstrated through the evaluation of PhaseNet (Zhu and Beroza, 2018), a popular seismic phase picking DLM, under three training approaches. Our framework helps practitioners choose the best model for their problem and set performance expectations by explicitly analyzing model performance with uncertainty at varying budgets of training data.

58 GEOSCIENCES↗

DOE OSTI2025

Data Compilation and Analysis from the Sirius-1 Experiment at TREAT for Transient Simulation Validation

This report assembles comprehensive data from the Sirius-1 experiment conducted by Idaho National Laboratory in collaboration with the National Aeronautics and Space Administration. The primary goal is to provide a robust data set that external users can utilize for the validation of computational methods for transient multiphysics simulations. By compiling all relevant data, including experiment design calculations, detailed engineering drawings for the experiment and data from reactor and fuel specimen measurement, this report is intended to serves as a reference for researchers and engineers working on the development and validation of computational models for transient nuclear behavior.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

NASA NTRS1994

The Application of the FDTD Method to Millimeter-Wave Filter Circuits Including the Design and Analysis of a Compact Coplanar

The finite difference time domain (FDTD) method is applied to the analysis of microwave, millimeter-wave and submillimeter-wave filter circuits. In each case, the validity of this method is confirmed by comparison with measured data. In addition, the FDTD calculations are used to design a new ultra-thin coplanar-strip filter for feeding a THz planar-antenna mixer.

Millimeter-wave filter Coplanar-Strip filter↗

NASA NTRS2010

Validating Human Performance Models of the Future Orion Crew Exploration Vehicle

NASA's Orion Crew Exploration Vehicle (CEV) will provide transportation for crew and cargo to and from destinations in support of the Constellation Architecture Design Reference Missions. Discrete Event Simulation (DES) is one of the design methods NASA employs for crew performance of the CEV. During the early development of the CEV, NASA and its prime Orion contractor Lockheed Martin (LM) strived to seek an effective low-cost method for developing and validating human performance DES models. This paper focuses on the method developed while creating a DES model for the CEV Rendezvous, Proximity Operations, and Docking (RPOD) task to the International Space Station. Our approach to validation was to attack the problem from several fronts. First, we began the development of the model early in the CEV design stage. Second, we adhered strictly to M&S development standards. Third, we involved the stakeholders, NASA astronauts, subject matter experts, and NASA's modeling and simulation development community throughout. Fourth, we applied standard and easy-to-conduct methods to ensure the model's accuracy. Lastly, we reviewed the data from an earlier human-in-the-loop RPOD simulation that had different objectives, which provided us an additional means to estimate the model's confidence level. The results revealed that a majority of the DES model was a reasonable representation of the current CEV design.

Wong, Douglas T.↗

NASA NTRS2001

Turbofan Duct Propagation Model

The CDUCT code utilizes a parabolic approximation to the convected Helmholtz equation in order to efficiently model acoustic propagation in acoustically treated, complex shaped ducts. The parabolic approximation solves one-way wave propagation with a marching method which neglects backwards reflected waves. The derivation of the parabolic approximation is presented. Several code validation cases are given. An acoustic lining design process for an example aft fan duct is discussed. It is noted that the method can efficiently model realistic three-dimension effects, acoustic lining, and flow within the computational capabilities of a typical computer workstation.

Lan, Justin H.↗

NASA NTRS1985

Optimal design of a thermally stable composite optical bench

The Lidar Atmospheric Sensing Experiment will be performed aboard an ER-2 aircraft; the lidar system used will be mounted on a lightweight, thermally stable graphite/epoxy optical bench whose design is presently subjected to analytical study and experimental validation. Attention is given to analytical methods for the selection of such expected laminate properties as the thermal expansion coefficient, the apparent in-plane moduli, and ultimate strength. For a symmetric laminate in which one of the lamina angles remains variable, an optimal lamina angle is selected to produce a design laminate with a near-zero coefficient of thermal expansion. Finite elements are used to model the structural concept of the design, with a view to the optical bench's thermal structural response as well as the determination of the degree of success in meeting the experiment's alignment tolerances.

Gray, C. E., Jr.↗

NASA NTRSDate not supplied

High-precision predictions of properties of chemically disordered crystals

Multiple scattering theory (MST) combined with density functional theory (DFT) allows to predict properties of chemically disordered materials from the first principles. However, such predictions often suffer from the systematic errors, which depend on crystal geometry. Each computed property of a particular crystal structure typically has a relatively small random error and a larger systematic error. Cancellation of systematic errors allows more accurate predictions. We propose a computational methodology based on the subtraction of the systematic errors in MST. To exemplify it, we apply it to the precipitated alloys. Considering precipitation strengthening in Ni superalloys, we compute the relative enthalpies of the competing Ni3(Al,Ti)1 crystal structures with a chemical disorder on the Al+Ti sublattice. Such predicted composition-structure-property dependencies are useful for the guided design of the next-generation alloys with improved strength. Our predictions are validated by comparison with the results of other DFT methods (having a higher computational cost) and with experiment. We acknowledge funding of the guided design of stronger superalloys for airspace by NASA Aeronautics Research Mission Directorate (ARMD) via Transformational Tools and Technologies (TTT) Project.

Computational↗

DOE OSTI2021

Chemometric optimisation of pressurised liquid extraction for the determination of alliin and S‐allyl‐cysteine in giant garlic ( Allium ampeloprasum L.) by liquid chromatography tandem mass spectrometry

Abstract Introduction Giant garlic is a functional food that contains different kinds of bioactive molecules with beneficial effects on chronic noncommunicable diseases like diabetes and cardiovascular conditions. Considering biosynthesis pathways, abundance, and biological activity, alliin and S‐allyl‐cysteine were used as chemical markers of organosulphur compounds present in giant garlic. Objective To establish a chemometric optimisation of pressurised liquid extraction for the determination of alliin and S‐allyl‐cysteine in giant garlic by liquid chromatography tandem mass spectrometry (LC–MS/MS). Methodology Samples were blanched (ca. 90°C for 10 min) to inactivate alliinase and γ‐glutamyl transpeptidase enzymes and then freeze‐dried. Chemometric optimisation was performed via response surface methodology based on central composite design (CCD). Organosulphur compound yields were determined applying a validated LC–MS/MS method in multiple reaction monitoring (MRM) mode using the following transitions: for alliin m/z 178 → 74 and for S‐allyl‐cysteine m/z 162 → 41. Results According to CCD results, under constant conditions of pressure (1500 psi) and time (20 min), the optimal conditions for pressurised liquid extraction of alliin and S‐allyl‐cysteine were 70.75 and 68.97% v/v of ethanol in extraction solvent and 76.45 and 98.88°C as extraction temperature, respectively. Multiple response optimisation for the simultaneous extraction of both organosulphur compounds was established via desirability function. Under these conditions, 2.70 ± 0.27 mg g −1 dry weight (DW) of alliin and 2.79 ± 0.22 mg g −1 DW of S‐allyl‐cysteine were extracted. Conclusions These results clearly demonstrated that pressurised liquid extraction is an efficient green technique to extract bioactive organosulphur compounds from giant garlic. Extraction yields were significantly ( p < 0.05) higher than those obtained with conventional ultra‐turrax extraction.

Peterssen‐Fonseca, Darlene↗

DOE OSTI2024

Question-answering system extracts information on injection drug use from clinical notes

Background. Injection drug use (IDU) can increase mortality and morbidity. Therefore, identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients’ electronic health records (EHR) is difficult because there is no other structured data available, such as International Classification of Disease (ICD) codes, and IDU is most often documented in unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. Methods. Here, to address this gap in clinical information, we design a question-answering (QA) framework to extract information on IDU from clinical notes for use in clinical operations. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We use 2323 clinical notes of 1145 patients curated from the US Department of Veterans Affairs (VA) Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model’s ability to extract IDU-related information from temporally out-of-distribution data. Results. Here, we show that for a strict match between gold-standard and predicted answers, the QA model achieves a 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains a 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. Conclusions. Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1980

The Landsat-D/Global Positioning System experiment

The paper presents data requirements, tests, and operational procedures to validate the receiver/processor assembly (R/PA) data to the 150 meter level and to calibrate the full capability of the R/PA to the 10 meter level for the Landsat-D/Global Positioning System experiment. Current work includes designing the software for the validation and calibration processes, determining the best methods of calibration using the Ground Space Tracking Data Network (GSTDN), and determining the tracking schedule for GSTDN data to obtain best orbital accuracy.

Wooden, W. H., II↗

NASA NTRS1986

Calibration of photon counting imaging microchannel plate detectors for EUV astronomy

The calibration of photon counting imaging detectors for satellite based EUV astronomy is a complex process designed to ensure the validity of the data received 'in orbit'. The methods developed to accomplish calibration of microchannel plate detectors for the Extreme Ultraviolet Explorer are described and illustrated. The characterization of these detectors can be subdivided into three categories: stabilization, performance tests, and environmental tests.

Siegmund, O. H. W.↗

NASA NTRS1996

Novel Composites for Wing and Fuselage Applications: Novel Wing Design Concepts - Task 1

Design trade studies were conducted to arrive at advanced wing designs that integrated new material forms with innovative structural concepts and cost-effective fabrication methods. A representative spar was selected for design, fabrication, and test to validate the predicted performance. Textile processes, such as knitting, weaving and stitching, were used to produce fiber preforms that were later fabricated into composite span through epoxy Resin Transfer Molding (RTM), Resin Film Infusion (RFI), and consolidation of commingled thermoplastic and graphite tows. The target design ultimate strain level for these innovative structural design concepts was 6000 mu in. per in. The spars were subjected to four-point beam bending to validate their structural performance. The various material form /processing combination Y-spars were rated for their structural efficiency and acquisition cost. The acquisition cost elements were material, tooling, and labor.

Suarez, J. A.↗

NASA NTRS1997

Simulation of a Controlled Airfoil with Jets

Numerical simulations of a two-dimensional airfoil, controlled by an applied moment in pitch and an airfoil controlled by jets, were investigated. These simulations couple the Reynolds-averaged Navier-Stokes equations and Euler's equations of rigid body motion, with an active control system. Controllers for both systems were designed to track altitude commands and were evaluated by simulating a closed-loop altitude step response using the coupled system. The airfoil controlled by a pitching moment used an optimal state feedback controller. A closed-loop simulation, of the airfoil with an applied moment, showed that the trajectories compared very well with quasi-steady aerodynamic theory, providing a measure of validation. The airfoil with jets used a controller designed by robust control methods. A linear plant model for this system was identified using open-loop data generated by the nonlinear coupled system. A closed-loop simulation of the airfoil with jets, showed good tracking of an altitude command. This simulation also showed oscillations in the control input as a result of dynamics not accounted for in the control design. This research work demonstrates how computational fluid dynamics, coupled with rigid body dynamics, and a control law can be used to prototype control systems in problematic nonlinear flight regimes.

Allan, Brian G.↗

NASA NTRS1989

Control Structures Interaction (CSI) Technology

Control Structures Interaction (CSI) technology for control of space structures is being developed cooperatively by JPL, LaRC and MSFC for NASA OAST/RM. The mid-'90s goal of JPL's CSI program is to demonstrate with analysis, ground and flight tests, the super quiet structures needed for large diffraction-limited instruments such as optical stellar interferometers and large advanced successors to the Hubble Space Telescope. Microprecision CSI technology is intended as a new "building block" for use by the designers of large optical systems. The thrust of the microprecision CSI technology effort is to achieve nanometer-levels of space structure stability/accuracy with designs which employ otherwise conventional spacecraft technologies. JPL design experiences have indicated the following CSI technology development areas are especially applicable to large optical system projects: (1) Active structural members; (2) Control/structures design methods; (3) Microdynamic effects characterization; and (4) Ground and flight test validation of CSI methods.

Layman, W. E.↗

NASA NTRS2002

Induced Moment Effects of Formation Flight Using Two F/A-18 Aircraft

Previous investigations into formation flight have shown the possibility for significant fuel savings through drag reduction. Using two F/A-18 aircraft, NASA Dryden Flight Research Center has investigated flying aircraft in autonomous formation. Positioning the trailing airplane for best drag reduction requires investigation of the wingtip vortex effects induced by the leading airplane. A full accounting of the vortex effect on the trailing airplane is desired to validate vortex-effect prediction methods and provide a database for the design of a formation flight autopilot. A recent flight phase has mapped the complete wingtip vortex effects at two flight conditions with the trailing airplane at varying distances behind the leading one. Force and moment data at Mach 0.56 and an altitude of 25,000 ft and Mach 0.86 and an altitude of 36,000 ft have been obtained with 20, 55, 110, and 190 ft of longitudinal distance between the aircraft. The moments induced by the vortex on the trailing airplane were well within the pilot's ability to control. This report discusses the data analysis methods and vortex-induced effects on moments and side force. An assessment of the impact of the nonlinear vortex effects on the design of a formation autopilot is offered.

Hansen, Jennifer L.↗

NASA NTRS2015

Real Time Fatigue Damage Growth Assessment of a Composite Three-Stringer Panel Using Passive Thermography

Fatigue testing of advanced composite structures is critical to validate both structural designs and damage prediction models. In-situ inspection methods are necessary to track damage onset and growth as a function of load cycles. Passive thermography is a large area, noncontact inspection technique that is used to detect composite damage onset and growth in real time as a function of fatigue cycles. The thermal images are acquired in synchronicity to the applied compressive load using a dual infrared camera acquisition system for full (front and back) coverage. Image processing algorithms are investigated to increase defect contrast areas. The thermal results are compared to non-immersion ultrasound inspections and acoustic emission data.

Zalameda, Joseph N.↗

NASA NTRS2023

Modeling and Simulation of the Angel Upper Limb Offload Device: Branching Into New Methods

BACKGROUND: The Active Response Gravity Offload System (ARGOS) provides an analog environment for extravehicular activity (EVA) testing and training. Discomfort has been observed during longer suited test sessions. While the subject’s core is offloaded during surface EVA evaluations, his/her arms experience full Earth gravity and can become overly fatigued, especially during suited tests which involve reaching and prolonged arm extensions. A device (ARGOS Negation of Gravitational Effects on the Limbs: ANGEL) to offload the weight of the arms and suit sleeves is being developed by JSC’s Flight Systems Branch of the Software, Robotics, and Simulation Division. Previously we have shared preliminary modeling of that device and kinematics based on motion capture data. Here we present an alternative approach to determine device kinematics by calculating ANGEL component angles with an OpenSim plugin. We compare calculated angles to inverse kinematics (IK) derived ones with the goal of validating the model. This new method can be further informative for device design and analytically testing different configurations to achieve desired reduced gravity conditions (e.g., lunar gravity (Lg) or Martian gravity (Mg)). We have compared calculated angles with IK-derived angles in tests with a shirt-sleeve subject positioned in a test stand with a Mark-III Hard Upper Torso (HUT) and Portable Life Support System (PLSS) mockup and arm weights to emulate the weight of the suit sleeve as well as a suited subject in ARGOS with a Mark-III suit. A variety of upper body tasks were completed in the former and full-body tasks in the latter. METHODS AND RESULTS: To model the offload device, we augment the OpenSim human model topology with the offload mechanism components and joints, using CAD models to represent the mechanism graphically. The joint angles of the device are calculated in the OpenSim plugin by modeling how the components configure themselves under the offloading spring tension given a particular IK-derived arm position. There are four ANGEL components with a total of 5 degrees of freedom (DOFs), each component has a single DOF except for the cuff which is modeled as 2 DOFs. The sickle/yaw bracket and cuff rotation angles are determined statically based on the assumptions that the sickle will track the attachment point of the cuff and that the cuff will rotate such that the attachment point is at its highest point. The cuff tilt, linker and V-bracket angles are then determined by optimizing their positions to approach a mechanical equilibrium. The calculated linker angle is compared to three different methods of determining the linker line-of-force kinematically (from V-bracket to center-cuff, cuff highest point or marker-derived position). Given the joint angles of the device, the spring force and resulting force on the arm is computed by the plugin and applied as an external load in inverse dynamics (ID) to enable study of overall shoulder joint torques as well as offload achieved. We verify the calculated joint angles by using the inverse kinematic data. The average difference in angles is the smallest for the V-bracket and linker, around 1 to 5 degrees for most trials. The resulting offload and shoulder torque are comparable between calculated and IK-derived angles. In summary, we have developed a method to calculate the joint angles of an exoskeleton-like upper limb offloading device currently in development. We have also developed a custom plugin which will be a valuable tool to optimize device configurations for a desired gravitational environment, probe the offload achieved for motions recorded outside of our test suite, and inform future design improvements.

L B Nilsson↗

NASA NTRS2023

Modeling and Simulation of The Angel Upper Limb Offload Device: Branching into New Methods

BACKGROUND: The Active Response Gravity Offload System (ARGOS) provides an analog environment for extravehicular activity (EVA) testing and training. Discomfort has been observed during longer suited test sessions. While the subject’s core is offloaded during surface EVA evaluations, his/her arms experience full Earth gravity and can become overly fatigued, especially during suited tests which involve reaching and prolonged arm extensions. A device (ARGOS Negation of Gravitational Effects on the Limbs: ANGEL) to offload the weight of the arms and suit sleeves is being developed by JSC’s Flight Systems Branch of the Software, Robotics, and Simulation Division. Previously we have shared preliminary modeling of that device and kinematics based on motion capture data. Here we present an alternative approach to determine device kinematics by calculating ANGEL component angles with an OpenSim plugin. We compare calculated angles to inverse kinematics (IK) derived ones with the goal of validating the model. This new method can be further informative for device design and analytically testing different configurations to achieve desired reduced gravity conditions (e.g., lunar gravity (Lg) or Martian gravity (Mg)). We have compared calculated angles with IK-derived angles in tests with a shirt-sleeve subject positioned in a test stand with a Mark-III Hard Upper Torso (HUT) and Portable Life Support System (PLSS) mockup and arm weights to emulate the weight of the suit sleeve as well as a suited subject in ARGOS with a Mark-III suit. A variety of upper body tasks were completed in the former and full-body tasks in the latter. METHODS AND RESULTS: To model the offload device, we augment the OpenSim human model topology with the offload mechanism components and joints, using CAD models to represent the mechanism graphically. The joint angles of the device are calculated in the OpenSim plugin by modeling how the components configure themselves under the offloading spring tension given a particular IK-derived arm position. There are four ANGEL components with a total of 5 degrees of freedom (DOFs), each component has a single DOF except for the cuff which is modeled as 2 DOFs. The sickle/yaw bracket and cuff rotation angles are determined statically based on the assumptions that the sickle will track the attachment point of the cuff and that the cuff will rotate such that the attachment point is at its highest point. The cuff tilt, linker and V-bracket angles are then determined by optimizing their positions to approach a mechanical equilibrium. The calculated linker angle is compared to three different methods of determining the linker line-of-force kinematically (from V-bracket to center-cuff, cuff highest point or marker-derived position). Given the joint angles of the device, the spring force and resulting force on the arm is computed by the plugin and applied as an external load in inverse dynamics (ID) to enable study of overall shoulder joint torques as well as offload achieved. We verify the calculated joint angles by using the inverse kinematic data. The average difference in angles is the smallest for the V-bracket and linker, around 1 to 5 degrees for most trials. The resulting offload and shoulder torque are comparable between calculated and IK-derived angles. In summary, we have developed a method to calculate the joint angles of an exoskeleton-like upper limb offloading device currently in development. We have also developed a custom plugin which will be a valuable tool to optimize device configurations for a desired gravitational environment, probe the offload achieved for motions recorded outside of our test suite, and inform future design improvements.

L B Nilsson↗