Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

Sound speed determination in copper shock compressed to 190 GPa

Sound speed measurements in shock compressed solids have long been valuable for the development of equations of state at extreme conditions, shock-induced phase transformations, and a comprehensive characterization of the thermophysical response of high-pressure standards. We present results from plate impact experiments to 190 GPa to determine the longitudinal sound speed in copper—an important high-pressure standard. Surprisingly, the sound speeds determined using the two most common experimental techniques—the front surface impact (FSI) approach and the release wave overtake (RWO) approach—diverge significantly for stresses greater than ~100 GPa. Further analyses, including numerical simulations, show that the FSI experiments provide the correct sound speeds and that fundamental assumptions underlying the RWO method are likely violated due to the complex release response of shock compressed copper. The sound speeds determined using the FSI approach provide for a more accurate high-pressure description of copper in dynamic compression experiments. The present findings are in contrast to the results for shock compressed silver [Wallace et al., Phys. Rev. B 104, 214106 (2021)], where both methods provided consistent sound speed results. Thus, the findings presented here demonstrate the need to experimentally verify the validity of the RWO method on a case-by-case basis. Finally, we note that even at the high stresses in the present work, the copper unloading response shows a time-dependent, quasielastic response often observed in metals at lower stresses.

36 MATERIALS SCIENCE↗

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗

SU-F-T-218: Validation of An In-Vivo Proton Range Verification Method for Reducing the Risk of Permanent Alopecia in the Treatment of Pediatric Medulloblastoma

Purpose: The clinical commissioning of a workflow for pre-treatment range verification/adjustment for the head treatment of pediatric medulloblastoma patients, including dose monitoring during treatment. Methods: An array of Si-diodes (DIODES Incorporated) is placed on the patient skin on the opposite side to the beam entrance. A “scout” SOBP beam, with a longer beam range to cover the diodes in its plateau, is delivered; the measured signal is analyzed and the extracted water equivalent path lengths (WEPL) are compared to the expected values, revealing if a range correction is needed. Diodes stay in place during treatment to measure dose. The workflow was tested in solid water and head phantoms and validated against independent WEPL measurements. Both measured WEPL and skin doses were compared to computed values from the TPS (XiO); a Markus chamber was used for reference dose measurements. Results: The WEPL accuracy of the method was verified by comparing it with the dose extinction method. It resulted, for both solid water and head phantom, in the sub-millimeter range, with a deviation less than 1% to the value extracted from the TPS. The accuracy of dose measurements in the fall-off part of the dose profile was validated against the Markus chamber. The entire range verification workflow was successfully tested for the mock-treatment of head phantom with the standard delivery of 90 cGy per field per fraction. The WEPL measurement revealed no need for range correction. The dose measurements agreed to better than 4% with the prescription dose. The robustness of the method and workflow, including detector array, hardware set and software functions, was successfully stress-tested with multiple repetitions. Conclusion: The performance of the in-vivo range verification system and related workflow meet the clinical requirements in terms of the needed WEPL accuracy for pretreatment range verification with acceptable dose to the patient.

60 APPLIED LIFE SCIENCES↗

Verification and Validation of Flow Confinement Modeling using OpenFAST Source Panel Method

Blockage or flow confinement effects in scale wind and water turbine testing in experimental facilities, including wind and water tunnels and tow tanks, can significantly alter incident aerodynamic and hydrodynamic loads, turbine performance (thrust, torque, power output), and wake dynamics compared to unconfined conditions. As scale model tests are key sources of OpenFAST model validation measurements, directly modeling flow confinement and its effects in OpenFAST enables improved model validat

Kim, Dongyoung [Sandia National Laboratories (SNL-↗

Implementation and Validation of an Impedance Eduction Technique

Implementation of a pressure gradient method of impedance eduction in two NASA Langley flow ducts is described. The Grazing Flow Impedance Tube only supports plane-wave sources, while the Curved Duct Test Rig supports sources that contain higher-order modes. Multiple exercises are used to validate this new impedance eduction method. First, synthesized data for a hard wall insert and a conventional liner mounted in the Grazing Flow Impedance Tube are used as input to the two impedance eduction methods, the pressure gradient method and a previously validated wall pressure method. Comparisons between the two results are excellent. Next, data measured in the Grazing Flow Impedance Tube are used as input to both methods. Results from the two methods compare quite favorably for sufficiently low Mach numbers but this comparison degrades at Mach 0.5, especially when the hard wall insert is used. Finally, data measured with a hard wall insert mounted in the Curved Duct Test Rig are used as input to the pressure gradient method. Significant deviation from the known solution is observed, which is believed to be largely due to 3-D effects in this flow duct. Potential solutions to this issue are currently being explored.

Watson, Willie R.↗

SU-F-T-352: Development of a Knowledge Based Automatic Lung IMRT Planning Algorithm with Non-Coplanar Beams

Purpose: To improve the robustness of a knowledge based automatic lung IMRT planning method and to further validate the reliability of this algorithm by utilizing for the planning of clinical cases with non-coplanar beams. Methods: A lung IMRT planning method which automatically determines both plan optimization objectives and beam configurations with non-coplanar beams has been reported previously. A beam efficiency index map is constructed to guide beam angle selection in this algorithm. This index takes into account both the dose contributions from individual beams and the combined effect of multiple beams which is represented by a beam separation score. We studied the effect of this beam separation score on plan quality and determined the optimal weight for this score.14 clinical plans were re-planned with the knowledge-based algorithm. Significant dosimetric metrics for the PTV and OARs in the automatic plans are compared with those in the clinical plans by the two-sample t-test. In addition, a composite dosimetric quality index was defined to obtain the relationship between the plan quality and the beam separation score. Results: On average, we observed more than 15% reduction on conformity index and homogeneity index for PTV and V{sub 40}, V{sub 60} for heart while an 8% and 3% increase on V{sub 5}, V{sub 20} for lungs, respectively. The variation curve of the composite index as a function of angle spread score shows that 0.6 is the best value for the weight of the beam separation score. Conclusion: Optimal value for beam angle spread score in automatic lung IMRT planning is obtained. With this value, model can result in statistically the “best” achievable plans. This method can potentially improve the quality and planning efficiency for IMRT plans with no-coplanar angles.

60 APPLIED LIFE SCIENCES↗

SUNSPOT AND STARSPOT LIFETIMES IN A TURBULENT EROSION MODEL

Quantitative models of sunspot and starspot decay predict the timescale of magnetic diffusion and may yield important constraints in stellar dynamo models. Motivated by recent measurements of starspot lifetimes, we investigate the disintegration of a magnetic flux tube by nonlinear diffusion. Previous theoretical studies are extended by considering two physically motivated functional forms for the nonlinear diffusion coefficient D : an inverse power-law dependence D ∝ B {sup −ν} and a step-function dependence of D on the magnetic field magnitude B . Analytical self-similar solutions are presented for the power-law case, including solutions exhibiting “super fast” diffusion. For the step-function case, the heat-balance integral method yields approximate solutions, valid for moderately suppressed diffusion in the spot. The accuracy of the resulting solutions is confirmed numerically, using a method which provides an accurate description of long-time evolution by imposing boundary conditions at infinite distance from the spot. The new models may allow insight into the differences and similarities between sunspots and starspots.

79 ASTRONOMY AND ASTROPHYSICS↗

Standardization of Spore Inactivation Method for PMA-PhyloChip Analysis

In compliance with the Committee on Space Research (COSPAR) planetary protection policy, National Aeronautics and Space Administration (NASA) monitors the total microbial burden of spacecraft as a means for minimizing the inadvertent transfer of viable contaminant microorganisms to extraterrestrial environments (forward contamination). NASA standard assay-based counts are used both as a proxy for relative surface cleanliness and to estimate overall microbial burden as well as to assess whether forward planetary protection risk criteria are met for a given mission, which vary by the planetary body to be explored and whether or not life detection missions are present. Despite efforts to reduce presence of microorganisms from spacecraft prior to launch, microbes have been isolated from spacecraft and associated surfaces within the extreme conditions of clean room facilities using state of the art molecular technologies. Development of a more sensitive method that will better enumerate all viable microorganisms from spacecraft and associated surfaces could support future life detection missions. Current culture-based (NASA standard spore assay) and nucleic-acid-based polymerase chain reaction (PCR) methods have significant shortcomings in this type of analysis. The overall goal of this project is to evaluate and validate a new molecular method based on the use of a deoxyribonucleic acid (DNA) intercalating agent propidium monoazide (PMA). This is used in combination with DNA microarray (PhyloChip) which has been shown to identify very low levels of organisms on spacecraft associated surfaces. PMA can only penetrate the membrane of dead cells. Once penetrated, it intercalates the DNA and, upon photolysis using visible light it produces stable DNA monoadducts. This allows DNA to be unavailable for further PCR analysis. The specific aim of this study is to standardize the spore inactivation method for PMA-PhyloChip analysis. We have used the bacterial spores Bacillus subtilis 168 (standard laboratory isolate) as a test organism.

spore inactivation↗

Optimal Control Prediction Method for Control Allocation

This paper proposes a novel prediction method for online optimal control allocation that extends the volume of moments achievable with the Moore-Penrose generalized inverse to the entire Attainable Moment Set. This method formulates the control allocation problem using selected basis vectors and associated gains which reduces the optimization problem dimensions and provides physical insight into the resulting optimal solutions. The proposed algorithm finds the entire family of unique optimal control solutions along the desired moment vector from the origin to the boundary of the Attainable Moment Set. Numerical results for the Moore-Penrose prediction method show that the unique minimal controls obtained yield the desired moment with near machine precision accuracy while maintaining control effectors within specified position limits. This method has been fully validated against the unique solution obtained on the boundary of the Attainable Moment Set using the Durham Direct Allocation method. Minimal control solutions obtained for moments in the interior of the Attainable Moment Set, similarly yield the desired moment to near machine precision while providing control solutions that are smaller (i.e. 2-norm) than solutions found with traditional control allocation algorithms (e.g. interior point methods) applied to the minimal control problem. Numerical simulations using a Matlab® autocoded executable (MEX) for the representative real world problem of 3-moments with 20 individual control effectors and prescribed control position limits show a mean computation speed of approximately 125 Hz which is sufficient to enable real-time flight allocation.

Acheson, Michael J.↗

Crop Stem Width Estimation in Highly Cluttered Field Environment

We present two methods for estimation of crop stem width on small mobile robots. Stem width is an important phenotype needed by breeders and plant-biologists to measure plant growth, however, its manual measurement is cumbersome, in-accurate, and inefficient. The presented methods use a common image processing core that is designed to extract the foreground in the presence of significant leaf and stem clutter, view of other rows, and varying lighting, from a side-facing USB camera mounted on a small mobile robot. Using the extracted foreground, one approach uses estimates of robot velocity from wheel encoders and dense optical flow to estimate depth, while the other employs filtering of the LIDAR 2-D point cloud to estimate the depth. Both methods have been exhaustively validated against available hand-measurements on biomass sorghum (Sorghum bicolor) in real experimental fields. Experiments indicate that both methods are also applicable to other crops with cylindrical stems without significant modifications. The width estimation match on sorghum is 92.5% (using vision) and 98.2% (using vision and LIDAR) when compared against manual measurements by trained agronomists. Thus, our results clearly establish the feasibility of using small robots for stem-width estimation in realistic field settings. Furthermore, the techniques presented here can be utilized for automating other phenotypic measurements.

Choudhuri, Anwesa↗

Nondestructive Evaluation of Carbon Fiber Reinforced Polymers

The American Society of Mechanical Engineers Boiler and Pressure Vessel Code requires repair and replacement of safety-related piping materials to meet the original Construction Code; however, no construction criteria currently exist for carbon fiber reinforced polymer (CFRP) materials in the nuclear industry. Although nondestructive examination (NDE) techniques for cast and wrought ferritic and austenitic steels are well established, licensees are increasingly deploying novel materials such as CFRP for which assessment of the use of NDE is required, as the inspectability of such materials and the influence of manufacturing processes on inspectability remain insufficiently understood. To address these gaps, Pacific Northwest National Laboratory (PNNL) evaluated the fabrication of several CFRP repair mockups and the effectiveness of NDE methods to support regulatory review of CFRP repairs in nuclear power plant applications. Representative flat-plate mockups containing realistic fabrication defects were manufactured and inspected using manual and automated tap testing, dynamic response spectroscopy (DRS), and ultrasonic testing (UT). The study identified significant fabrication variability, particularly in controlling defect size and epoxy thickness, which strongly influenced defect detectability by NDE methods. Tap testing was effective for shallow defects in thin epoxy configurations but unreliable for thicker repairs and deeper flaws. DRS demonstrated higher sensitivity to dry spots but produced unconfirmed indications for thicker plates, requiring further validation. Conventional UT, particularly at 1.0 MHz, showed the strongest overall capability for detecting a range of defects, although performance degraded with increasing repair thickness and complexity. The results highlight the need to better define critical defect sizes, develop reliable mockup fabrication methods, and validate NDE methods needed to support CFRP repairs.

36 MATERIALS SCIENCE↗

Mechanisms of noise control inside a finite cylinder

Preliminary results are presented for a simple elastic cylinder/acoustic cavity model. The validity of the mode matching method, which was used to couple the shell vibrations to the interior acoustic response, has been validated by comparison with Junger's (1985) method. In addition, the importance of both structural and acoustic damping in the medium response was shown to be dramatic.

Lester, H. C.↗

Simulation verification techniques study

Results are summarized of the simulation verification techniques study which consisted of two tasks: to develop techniques for simulator hardware checkout and to develop techniques for simulation performance verification (validation). The hardware verification task involved definition of simulation hardware (hardware units and integrated simulator configurations), survey of current hardware self-test techniques, and definition of hardware and software techniques for checkout of simulator subsystems. The performance verification task included definition of simulation performance parameters (and critical performance parameters), definition of methods for establishing standards of performance (sources of reference data or validation), and definition of methods for validating performance. Both major tasks included definition of verification software and assessment of verification data base impact. An annotated bibliography of all documents generated during this study is provided.

Schoonmaker, P. B.↗

Adaptive Stress Testing of Collision Avoidance Systems for Small UASs with Deep Reinforcement Learning

The next-generation Airborne Collision Avoidance System for smaller UASs (ACAS sXu) is currently being developed and tested by the Federal Aviation Administration (FAA) to provide detect-and-avoid capability for small unmanned aircraft operating beyond line-of-sight. Due to the complexity and safety-critical nature of the system, safety validation is important not only for the certification of the final system, but also for informing changes during the iterative development process. In this paper, we analyze a prototype of ACAS sXu in simulated aircraft encounters to discover scenarios of small near mid-air collisions (sNMACs), an important safety event in which two aircraft come closer than 50 feet horizontally and 15 feet vertically. Due to the size and complexity of the system as well as rarity of sNMAC events, traditional methods such as Monte Carlo testing often require informed setup and targeting to elicit failures. However, such a dependence on domain knowledge can be incompatible with the independent verification and validation (IV&V) process, the aim of which is to discover unforeseen issues. To address these challenges, we apply an accelerated validation method called adaptive stress testing (AST) to find the most likely sNMAC scenarios without reliance on system introspection. AST uses reinforcement learning to adapt the search towards the most promising areas of the search space as it progresses. We use a state-of-the-art deep reinforcement learning algorithm, proximate policy optimization, to more efficiently search the large and continuous state space. We find that this approach significantly improves the performance of AST compared to a prior approach based on Monte Carlo tree search. We perform experiments using AST to find sNMAC events under various encounter configurations, varying parameters pertaining to dynamics and coordination. Our experiments show AST to be very effective at finding sNMAC scenarios. We summarize our findings, presenting high-level categories of discovered sNMACs and specific examples of encounters in each category.

aircraft collision avoidance↗

Subscale Validation of the Subsurface Active Filtration of Exhaust (SAFE) Approach to the NTP Ground Testing

Nuclear thermal propulsion (NTP) has been recognized as an enabling technology for missions to Mars and beyond. However, one of the key challenges of developing a nuclear thermal rocket is conducting verification and development tests on the ground. A number of ground test options are presented, with the Sub-surface Active Filtration of Exhaust (SAFE) method identified as a preferred path forward for the NTP program. The SAFE concept utilizes the natural soil characteristics present at the Nevada National Security Site to provide a natural filter for nuclear rocket exhaust during ground testing. A validation method of the SAFE concept is presented, utilizing a non-nuclear sub-scale hydrogen/oxygen rocket seeded with detectible radioisotopes. Additionally, some alternative ground test concepts, based upon the SAFE concept, are presented. Finally, an overview of the ongoing discussions of developing a ground test campaign are presented.

Nuclear Rocket Engines↗

SCALE capabilities for high temperature gas-cooled reactor analysis

The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of the Pulmonary Function System for Use on the International Space Station

Aerobic deconditioning occurs during long duration space flight despite the use of exercise countermeasures (Convertino, 1996). As a part of International Space Station (ISS) medical operations, periodic tests designed to estimate aerobic capacity are performed to track changes in aerobic fitness and to determine the effectiveness of exercise countermeasures. These tests are performed prior to, during, and after missions of greater than 30 days in duration. Crewmembers selected for missions aboard the ISS perform a graded exercise test on a cycle ergometer approximately 270 days prior to their scheduled launch date in order to measure peak oxygen consumption (VO2PK) and peak heart rate (HRpk). Approximately 30 to 45 days prior to launch, crewmembers perform a submaximal cycle ergometer test at work rates set to elicit 25, 50 and 75% of their pre-flight VO2PK. This test, known as the Periodic Fitness Evaluation (PFE), serves as a baseline measure to which subsequent in-and post-flight exercise tests are compared. While onboard the ISS, crewmembers are normally scheduled to perform the PFE beginning with flight day (FD) 14 and every 30 days thereafter. The PFE is also conducted 5 and 30 days following flight. Using PFE data, aerobic fitness is estimated by quantifying the VO2 vs. HR relationship using linear regression and calculating the VO2 that would occur at the crewmember s previously measured HRpk. Currently, for data collected during flight, this technique assumes that the pre- vs. in-flight oxygen consumption per given cycle workload is similar. However, the validity of this assumption is based upon a sparse amount of data collected during the Skylab era (Michel, et al. 1977). The method of using heart rate and cycle ergometer work rates has been used to estimate aerobic fitness in normal gravity (Astrand and Ryhming, 1954; Lee, 1993). Due to spaceflight induced physiological alterations, such as shifts in extracellular fluid (e.g. plasma) volume, this method may not be valid during space flight. In addition, the ergometer onboard ISS is vibration-isolated and moves with the astronaut s application of force into the pedals. The effect of this movement on the VO2 of cycle exercise on ISS has not been quantified.

McCleary, Frank A.↗

Evaluation of ride quality prediction methods for operational military helicopters

The results of a simulator study conducted to compare and validate various ride quality prediction methods for use in assessing passenger/crew ride comfort within helicopters are presented. Included are results quantifying 35 helicopter pilots' discomfort responses to helicopter interior noise and vibration typical of routine flights, assessment of various ride quality metrics including the NASA ride comfort model, and examination of possible criteria approaches. Results of the study indicated that crew discomfort results from a complex interaction between vibration and interior noise. Overall measures such as weighted or unweighted root-mean-square acceleration level and A-weighted noise level were not good predictors of discomfort. Accurate prediction required a metric incorporating the interactive effects of both noise and vibration. The best metric for predicting crew comfort to the combined noise and vibration environment was the NASA discomfort index.

Leatherwood, J. D.↗