Search NASA⌕ Search

SEARCH · Search NASA

Results for “response surface methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Bayesian probability of agreement for comparing the similarity of response surfaces

For a variety of linear and generalized linear models, there may be interest in evaluating whether the expected response values in two different populations are sufficiently similar to be considered practically equivalent. The probability of agreement has been introduced as a strategy for quantifying the similarity between two groups. We propose a Bayesian version of the probability of agreement to quantify the similarity between linear and generalized linear response surfaces. The proposed methodology is based on Markov chain Monte Carlo estimation and it allows for an intuitive interpretation based directly on population parameters. As demonstrated, the methodology can be flexibly applied to a variety of different models. We illustrate its use with three examples for which the response depends on predictor variables through a linear, logistic, or Poisson regression model. The computation associated with this approach has been automated with a freely available R Shiny app.

97 MATHEMATICS AND COMPUTING↗

Response Surface Methods for Spatially-Resolved Optical Measurement Techniques

Response surface methods (or methodology), RSM, have been applied to improve data quality for two vastly different spatial ly-re solved optical measurement techniques. In the first application, modern design of experiments (MDOE) methods, including RSM, are employed to map the temperature field in a direct-connect supersonic combustion test facility at NASA Langley Research Center. The laser-based measurement technique known as coherent anti-Stokes Raman spectroscopy (CARS) is used to measure temperature at various locations in the combustor. RSM is then used to develop temperature maps of the flow. Even though the temperature fluctuations at a single point in the flowfield have a standard deviation on the order of 300 K, RSM provides analytic fits to the data having 95% confidence interval half width uncertainties in the fit as low as +/-30 K. Methods of optimizing future CARS experiments are explored. The second application of RSM is to quantify the shape of a 5-meter diameter, ultra-light, inflatable space antenna at NASA Langley Research Center.

Danehy, P. M.↗

Response Surface Methods For Spatially-Resolved Optical Measurement Techniques

Response surface methods (or methodology), RSM, have been applied to improve data quality for two vastly different spatially-resolved optical measurement techniques. In the first application, modern design of experiments (MDOE) methods, including RSM, are employed to map the temperature field in a direct-connect supersonic combustion test facility at NASA Langley Research Center. The laser-based measurement technique known as coherent anti-Stokes Raman spectroscopy (CARS) is used to measure temperature at various locations in the combustor. RSM is then used to develop temperature maps of the flow. Even though the temperature fluctuations at a single point in the flowfield have a standard deviation on the order of 300 K, RSM provides analytic fits to the data having 95% confidence interval half width uncertainties in the fit as low as +/- 30 K. Methods of optimizing future CARS experiments are explored. The second application of RSM is to quantify the shape of a 5-meter diameter, ultra-lightweight, inflatable space antenna at NASA Langley Research Center. Photogrammetry is used to simultaneously measure the shape of the antenna at approximately 500 discrete spatial locations. RSM allows an analytic model to be developed that describes the shape of the majority of the antenna with an uncertainty of 0.4 mm, with 95% confidence. This model would allow a quantitative comparison between the actual shape of the antenna and the original design shape. Accurately determining this shape also allows confident interpolation between the measured points. Such a model could, for example, be used for ray tracing of radio-frequency waves up to 95 GHz. to predict the performance of the antenna.

Danehy, P. M.↗

Optimization of Well Configuration for a Sedimentary Enhanced Geothermal Reservoir

The extraction of geothermal energy in the form of hot water from sedimentary rock formations could expand the current geothermal energy resources toward new regions. From previous work, we observed that sedimentary geothermal reservoirs with relatively low permeability would require the application of enhancement techniques (e.g., well hydraulic stimulation) to achieve commercial production/injection rates. In this paper we extend our previous work to develop a methodology to determine the optimum well configuration that maximizes the hydraulic performance of the geothermal system. The geothermal systems considered consist of one vertical well doublet system with hydraulic fractures, and three horizontal well configurations with open-hole completion, longitudinal fractures and transverse fractures, respectively. A commercial thermal reservoir simulation is used to evaluate the geothermal reservoir performance using as design parameters the well spacing and the length of the horizontal wells. The results obtained from the numerical simulations are used to build a response surface model based on the multiple linear regression method. The optimum configuration of the sedimentary geothermal systems is obtained from the analysis of the response surface model. The proposed methodology is applied to a case study based on a reservoir model of the Lyons sandstone formation, located in the Wattenberg field, Denver-Julesburg basin, Colorado.

15 GEOTHERMAL ENERGY↗

Metrics for Evaluating the Accuracy of Solar Power Forecasting: Preprint

Forecasting solar energy generation is a challenging task due to the variety of solar power systems and weather regimes encountered. Forecast inaccuracies can result in substantial economic losses and power system reliability issues. This paper presents a suite of generally applicable and value-based metrics for solar forecasting for a comprehensive set of scenarios (i.e., different time horizons, geographic locations, applications, etc.). In addition, a comprehensive framework is developed to analyze the sensitivity of the proposed metrics to three types of solar forecasting improvements using a design of experiments methodology, in conjunction with response surface and sensitivity analysis methods. The results show that the developed metrics can efficiently evaluate the quality of solar forecasts, and assess the economic and reliability impact of improved solar forecasting.

14 SOLAR ENERGY↗

Improvements to a Response Surface Thermal Model for Orion

A study was performed to determine if a Design of Experiments (DOE)/Response Surface Methodology could be applied to on-orbit thermal analysis and produce a set of Response Surface Equations (RSE) that predict Orion vehicle temperatures within 10 F. The study used the Orion Outer Mold Line model. Five separate factors were identified for study: yaw, pitch, roll, beta angle, and the environmental parameters. Twenty-three external Orion components were selected and their minimum and maximum temperatures captured over a period of two orbits. Thus, there are 46 responses. A DOE case matrix of 145 runs was developed. The data from these cases were analyzed to produce a fifth order RSE for each of the temperature responses. For the 145 cases in the DOE matrix, the agreement between the engineering data and the RSE predictions was encouraging with 40 of the 46 RSEs predicting temperatures within the goal band. However, the verification cases showed most responses did not meet the 10 F goal. After reframing the focus of the study to better align the RSE development with the purposes of the model, a set of RSEs for both the minimum and maximum radiator temperatures was produced which predicted the engineering model output within +/-4 F. Therefore, with the correct application of the DOE/RSE methodology, RSEs can be developed that provide analysts a fast and easy way to screen large numbers of environments and assess proposed changes to the RSE factors.

Miller, Stephen W.↗

Probabilistic Thermal Analysis During Mars Reconnaissance Orbiter Aerobraking

A method for performing a probabilistic thermal analysis during aerobraking has been developed. The analysis is performed on the Mars Reconnaissance Orbiter solar array during aerobraking. The methodology makes use of a response surface model derived from a more complex finite element thermal model of the solar array. The response surface is a quadratic equation which calculates the peak temperature for a given orbit drag pass at a specific location on the solar panel. Five different response surface equations are used, one of which predicts the overall maximum solar panel temperature, and the remaining four predict the temperatures of the solar panel thermal sensors. The variables used to define the response surface can be characterized as either environmental, material property, or modeling variables. Response surface variables are statistically varied in a Monte Carlo simulation. The Monte Carlo simulation produces mean temperatures and 3 sigma bounds as well as the probability of exceeding the designated flight allowable temperature for a given orbit. Response surface temperature predictions are compared with the Mars Reconnaissance Orbiter flight temperature data.

Dec, John A.↗

Development of a Response Surface Thermal Model for Orion Mated to the International Space Station

A study was performed to determine if a Design of Experiments (DOE)/Response Surface Methodology could be applied to on-orbit thermal analysis and produce a set of Response Surface Equations (RSE) that accurately predict vehicle temperatures. The study used an integrated thermal model of the International Space Station and the Orion Outer mold line model. Five separate factors were identified for study: yaw, pitch, roll, beta angle, and the environmental parameters. Twenty external Orion temperatures were selected as the responses. A DOE case matrix of 110 runs was developed. The data from these cases were analyzed to produce an RSE for each of the temperature responses. The initial agreement between the engineering data and the RSE predictions was encouraging, although many RSEs had large uncertainties on their predictions. Fourteen verification cases were developed to test the predictive powers of the RSEs. The verification showed mixed results with some RSE predicting temperatures matching the engineering data within the uncertainty bands, while others had very large errors. While this study to not irrefutably prove that the DOE/RSM approach can be applied to on-orbit thermal analysis, it does demonstrate that technique has the potential to predict temperatures. Additional work is needed to better identify the cases needed to produce the RSEs

Miller, Stephen W.↗

A Global Optimization Methodology for Rocket Propulsion Applications

While the response surface method is an effective method in engineering optimization, its accuracy is often affected by the use of limited amount of data points for model construction. In this chapter, the issues related to the accuracy of the RS approximations and possible ways of improving the RS model using appropriate treatments, including the iteratively re-weighted least square (IRLS) technique and the radial-basis neural networks, are investigated. A main interest is to identify ways to offer added capabilities for the RS method to be able to at least selectively improve the accuracy in regions of importance. An example is to target the high efficiency region of a fluid machinery design space so that the predictive power of the RS can be maximized when it matters most. Analytical models based on polynomials, with controlled level of noise, are used to assess the performance of these techniques.

Source record↗

Comparison of Prediction Modeling Methodologies for Aeroacoustic Characterization of Hovering sUAS Rotors

This work compared artificial neural network and multivariate orthogonal function modeling methodologies for the prediction and characterization of isolated hovering sUAS rotor aerodynamics and aeroacoustics. Design of Experiments was used to create input feature spaces over 9 input features: the number of rotor blades, rotor size, rotor speed, the amount of blade twist, blade taper ratio, tip chord length, collective pitch, airfoil camber, and airfoil thickness. CAMRAD~II and AARON were executed at the points defined by the input feature space to predict aerodynamic and aeroacoustic quantities. These predicted aerodynamic and aeroacoustic data were then used to generate artificial neural networks and polynomial response surface models. The two prediction model methodologies were evaluated over test data previously unseen by the models, which showed good prediction capabilities for both model types, with slightly lower prediction error for the artificial neural networks. A characterization study was performed, which showed that input features correspondent to the spanwise sectional blade lift and drag were the most significant factors to the aerodynamic thrust and power, respectively. It was also shown that the aeroacoustic quantities were highly dependent on variations in rotor speed and size, which affect the Doppler factor for tonal noise and the spanwise Reynolds number for broadband noise.

Christopher S Thurman↗

Applications of Response Surface-Based Methods to Noise Analysis in the Conceptual Design of Revolutionary Aircraft

Due to the growing problem of noise in today's air transportation system, there have arisen needs to incorporate noise considerations in the conceptual design of revolutionary aircraft. Through the use of response surfaces, complex noise models may be converted into polynomial equations for rapid and simplified evaluation. This conversion allows many of the commonly used response surface-based trade space exploration methods to be applied to noise analysis. This methodology is demonstrated using a noise model of a notional 300 passenger Blended-Wing-Body (BWB) transport. Response surfaces are created relating source noise levels of the BWB vehicle to its corresponding FAR-36 certification noise levels and the resulting trade space is explored. Methods demonstrated include: single point analysis, parametric study, an optimization technique for inverse analysis, sensitivity studies, and probabilistic analysis. Extended applications of response surface-based methods in noise analysis are also discussed.

Hill, Geoffrey A.↗

Positive tropical marine low-cloud cover feedback inferred from cloud-controlling factors

Differences in simulations of tropical marine low-cloud cover (LCC) feedback are sources of significant spread in temperature responses of climate models to anthropogenic forcing. Here we show that in models the feedback is mainly driven by three large-scale changes—a strengthening tropical inversion, increasing surface latent heat flux, and an increasing vertical moisture gradient. Variations in the LCC response to these changes alone account for most of the spread in model-projected 21st century LCC changes. A methodology is devised to constrain the LCC response observationally using sea surface temperature (SST) as a surrogate for the latent heat flux and moisture gradient. In models where the current climate's LCC sensitivities to inversion strength and SST variations are consistent with observed, LCC decreases systematically, which would increase absorption of solar radiation. These results support a positive LCC feedback. Finally, correcting biases in the sensitivities will be an important step toward more credible simulation of cloud feedbacks.

58 GEOSCIENCES↗

Reliability of Radioisotope Stirling Convertor Linear Alternator

Onboard radioisotope power systems being developed and planned for NASA s deep-space missions would require reliable design lifetimes of up to 14 years. Critical components and materials of Stirling convertors have been undergoing extensive testing and evaluation in support of a reliable performance for the specified life span. Of significant importance to the successful development of the Stirling convertor is the design of a lightweight and highly efficient linear alternator. Alternator performance could vary due to small deviations in the permanent magnet properties, operating temperature, and component geometries. Durability prediction and reliability of the alternator may be affected by these deviations from nominal design conditions. Therefore, it is important to evaluate the effect of these uncertainties in predicting the reliability of the linear alternator performance. This paper presents a study in which a reliability-based methodology is used to assess alternator performance. The response surface characterizing the induced open-circuit voltage performance is constructed using 3-D finite element magnetic analysis. Fast probability integration method is used to determine the probability of the desired performance and its sensitivity to the alternator design parameters.

Shah, Ashwin↗

Common Cause Failure Modeling

Common Cause Failures (CCFs) are a known and documented phenomenon that defeats system redundancy. CCFS are a set of dependent type of failures that can be caused by: system environments; manufacturing; transportation; storage; maintenance; and assembly, as examples. Since there are many factors that contribute to CCFs, the effects can be reduced, but they are difficult to eliminate entirely. Furthermore, failure databases sometimes fail to differentiate between independent and CCF (dependent) failure and data is limited, especially for launch vehicles. The Probabilistic Risk Assessment (PRA) of NASA's Safety and Mission Assurance Directorate at Marshall Space Flight Center (MFSC) is using generic data from the Nuclear Regulatory Commission's database of common cause failures at nuclear power plants to estimate CCF due to the lack of a more appropriate data source. There remains uncertainty in the actual magnitude of the common cause risk estimates for different systems at this stage of the design. Given the limited data about launch vehicle CCF and that launch vehicles are a highly redundant system by design, it is important to make design decisions to account for a range of values for independent and CCFs. When investigating the design of the one-out-of-two component redundant system for launch vehicles, a response surface was constructed to represent the impact of the independent failure rate versus a common cause beta factor effect on a system's failure probability. This presentation will define a CCF and review estimation calculations. It gives a summary of reduction methodologies and a review of examples of historical CCFs. Finally, it presents the response surface and discusses the results of the different CCFs on the reliability of a one-out-of-two system.

Hark, Frank↗

Common Cause Failure Modeling

Common Cause Failures (CCFs) are a known and documented phenomenon that defeats system redundancy. CCFS are a set of dependent type of failures that can be caused by: system environments; manufacturing; transportation; storage; maintenance; and assembly, as examples. Since there are many factors that contribute to CCFs, the effects can be reduced, but they are difficult to eliminate entirely. Furthermore, failure databases sometimes fail to differentiate between independent and CCF (dependent) failure and data is limited, especially for launch vehicles. The Probabilistic Risk Assessment (PRA) of NASA's Safety and Mission Assurance Directorate at Marshal Space Flight Center (MFSC) is using generic data from the Nuclear Regulatory Commission's database of common cause failures at nuclear power plants to estimate CCF due to the lack of a more appropriate data source. There remains uncertainty in the actual magnitude of the common cause risk estimates for different systems at this stage of the design. Given the limited data about launch vehicle CCF and that launch vehicles are a highly redundant system by design, it is important to make design decisions to account for a range of values for independent and CCFs. When investigating the design of the one-out-of-two component redundant system for launch vehicles, a response surface was constructed to represent the impact of the independent failure rate versus a common cause beta factor effect on a system's failure probability. This presentation will define a CCF and review estimation calculations. It gives a summary of reduction methodologies and a review of examples of historical CCFs. Finally, it presents the response surface and discusses the results of the different CCFs on the reliability of a one-out-of-two system.

Hark, Frank↗

Evaluating cloud feedbacks and rapid responses in the ACCESS model

A cloud feedback diagnostic package is implemented in the Australian Community Climate and Earth-System Simulator General Circulation Model, based on the methodology of “cloud radiative kernels.” Using separate increased sea surface temperature and CO 2 experiments, both the “rapid response” cloud contribution to forcing and temperature-mediated cloud feedbacks are analyzed. Under increased temperature and CO 2 changes, temperature-mediated cloud radiative feedback dominates over the rapid response in the final radiative response. Cloud feedback is positive in both long and short wave, with short wave dominating global values. Contributing most to this are low to mid-level clouds, of medium-to-high optical thickness. As a means of illustration of the methodology, a number of key parameters related to clouds, precipitation, and convection that are typically used in “tuning” in the model are modified. These changes result in substantial impacts on the model's current climate, but only modest changes to rapid response and feedbacks occur globally, regionally, and as a function of cloud optical thickness and height. This limited set of experiments shows that cloud adjustments and feedbacks in this model are robust under these changes, lending confidence that both model climate change projections and the conclusions of attribution studies are not overly sensitive to such parameterization tuning. Of course, a considerably larger set of experiments would be needed to demonstrate that feedbacks and rapid response are robust under the wider set of tuning adjustments commonly undertaken.

54 ENVIRONMENTAL SCIENCES↗

Wear mechanisms found in angular contact ball bearings of the SSME's LOX turbopump

Extensive experimental investigations were carried out on used flight bearings of the Phase 2 high-pressure oxygen turbopump (HPOTP) of the Space Shuttle Main Engine (SSME) in order to determine the wear mechanisms, dominant wear modes, and their extent and causes. The report shows methodology, surface analysis techniques used, result, and discussion. The mode largely responsible for heavy bearing wear in LOX was identified as adhesive/shear peeling of the upper layers of bearing balls and rings. The mode relies on the mechanisms of scale formation, breakdown, and removal, all of which are greatly enhanced by the heavy oxidation environment of the HPOTP. Major causes of the high wear in bearings appear to be lubrication and cooling, both inadequate for the imposed conditions of operation. Numerous illustrations and evidence are given.

Chase, T. J.↗

Validation of Vehicle Panel/Equipment Response from Diffuse Acoustic Field Excitation Using Spatially Correlated Transfer Function Approach

An approach for predicting the vibration, strain, and force responses of a flight-like vehicle panel assembly to acoustic pressures is presented. Important validation for the approach is provided by comparison to ground test measurements in a reverberant chamber. The test article and the corresponding analytical model were assembled in several configurations to demonstrate the suitability of the approach for response predictions when the vehicle panel is integrated with equipment. Critical choices in the analysis necessary for convergence of the predicted and measured responses are illustrated through sensitivity studies. The methodology includes representation of spatial correlation of the pressure field over the panel surface. Therefore, it is possible to demonstrate the effects of hydrodynamic coincidence in the response. The sensitivity to pressure patch density clearly illustrates the onset of coincidence effects on the panel response predictions.

Smith, Andrew↗