SEARCH · Search NASA

Results for “Mean objective cost of uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

13 records

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Neural message-passing for objective-based uncertainty quantification and optimal experimental design

Various real-world scientific applications involve the mathematical modeling of complex uncertain systems with numerous unknown parameters. Accurate parameter estimation is often practically infeasible in such systems, as the available training data may be insufficient and the cost of acquiring additional data may be high. In such cases, based on a Bayesian paradigm, we can design robust operators retaining the best overall performance across all possible models and design optimal experiments that can effectively reduce uncertainty to enhance the performance of such operators maximally. While objective-based uncertainty quantification (objective-UQ) based on MOCU (mean objective cost of uncertainty) provides an effective means for quantifying uncertainty in complex systems, the high computational cost of estimating MOCU has been a challenge in applying it to real-world scientific/engineering problems. In this work, we propose a novel scheme to reduce the computational cost for objective-UQ via MOCU based on a data-driven approach. We adopt a neural message-passing model for surrogate modeling, incorporating a novel axiomatic constraint loss that penalizes an increase in the estimated system uncertainty. As an illustrative example, we consider the optimal experimental design (OED) problem for uncertain Kuramoto models, where the goal is to predict the experiments that can most effectively enhance robust synchronization performance through uncertainty reduction. We show that our proposed approach can accelerate MOCU-based OED by four to five orders of magnitude, without any visible performance loss compared to the state-of-the-art. The proposed approach applies to general OED tasks, beyond the Kuramoto model.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Uncertainty quantification (UQ) is a rapidly growing and evolving discipline, especially within the aerospace community. Performing analysis with UQ can provide decision makers with a wealth of information about a candidate design. However, the value of UQ is fully realized when the information gained during UQ analysis is leveraged in a feedback loop of a design optimization process, often referred to as design under uncertainty. Although design under uncertainty can be a powerful risk mitigation technique, there are a number of roadblocks that prevent its implementation. Two primary factors are computational costs and added complexity of the analysis. High fidelity simulations on the order tens of uncertain variables quickly become computationally infeasible. Also, implementing UQ into an existing multidisciplinary design and optimization (MDO) process often requires extensive knowledge of the UQ methods and careful treatment of the problem formulation. The objective of this work is to address these two primary roadblocks and enable practitioners to efficiently perform design under uncertainty with limited knowledge of the UQ discipline. Methods outlined in this paper demonstrate MDO incorporating UQ into the design process, leveraging an analytic derivative tool chain through the entire optimization. The proposed approach leverages machine learning techniques to generate a differentiable confidence interval output from polynomial chaos models. This technique, coupled with the incorporation of analytical derivatives through the Polynomial Chaos Expansion (PCE) process, eliminates the need to estimate derivatives which are usually obtained from finite difference, complex step, or similar methods. Developing a differentiable confidence interval allows mixed uncertainty problems (both epistemic and aleatory) to be modeled. Without such modeling, these problems cannot accurately predict objective functions containing statistical quantities such as mean and variance. The addition of analytic derivatives to a polynomial chaos-based UQ method decreases the computational costs of performing design under uncertainty by orders of magnitude in comparison with methods such as complex step. The method and codes developed are modular in nature and are a drop-in solution for design under uncertainty within existing MDO problems. A low-fidelity analytical multidisciplinary optimization under uncertainty for a wing design in OpenMDAO is detailed in this paper. This demonstration case will include both objective functions and constraints which are influenced by uncertain parameters.

Ben D Phillips↗

NASA NTRSDate not supplied

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Ben Phillips↗

NASA NTRS2016

Technology Overview and Assessment for Small-Scale EDL Systems

Motivated by missions to land large rovers and humans at Mars and other bodies, high-mass EDL technologies are a prevalent trend in the research community. In contrast, EDL systems for low-mass payloads have attracted less attention. Significant potential in science and discovery exists in small-scale EDL systems. Payloads acting secondary to a flagship mission are a currently under-utilzed resource. Before taking advantage of these opportunities, further developed of scaled EDL technologies is required. The key limitations identified in this study are compact decelerators and deformable impact systems. Current technologies may enable rough landing of small payloads, with moderate restrictions in packaging volume. Utilization of passive descent and landing stages will greatly increase the applicability of small systems, allowing for vehicles robust to entry environment uncertainties. These architectures will provide an efficient means of achieving science and support objectives while reducing cost and risk margins of a parent mission.

small spacecraft↗

NASA NTRS1990

Analysis of AVHRR, CZCS and historical in situ data off the Oregon Coast

The original scientific objectives of this grant were to: (1) characterize the seasonal cycles and interannual variability for phytoplankton concentrations and sea surface temperature (SST) in the California Current using satellite data; and (2) to explore the spatial and temporal relationship between these variables and surface wind forcing. An additional methodological objective was to develop statistical methods for forming mean fields, which minimize the effects of random data gaps and errors in the irregularly sampled CZCS (Coastal Zone Color Scanner) and AVHRR (Advanced Very High Resolution Radiometer) satellite data. A final task was to evaluate the level of uncertainty in the wind fields used for the statistical analysis. Funding in the first year included part of the cost of an image processing system to enable this and other projects to process and analyze satellite data. This report consists of summaries of the major projects carried out with all or partial support from this grant. The appendices include a list of papers and professional presentations supported by the grant, as well as reprints of the major papers and reports.

Strub, P. Ted↗

NASA NTRS2012

Optical Sensors for Planetary Radiant Energy (OSPREy): Calibration and Validation of Current and Next-Generation NASA Missions

A principal objective of the Optical Sensors for Planetary Radiance Energy (OSPREy) activity is to establish an above-water radiometer system as a lower-cost alternative to existing in-water systems for the collection of ground-truth observations. The goal is to be able to make high-quality measurements satisfying the accuracy requirements for the vicarious calibration and algorithm validation of next-generation satellites that make ocean color and atmospheric measurements. This means the measurements will have a documented uncertainty satisfying the established performance metrics for producing climate-quality data records. The OSPREy approach is based on enhancing commercial-off-the-shelf fixed-wavelength and hyperspectral sensors to create hybridspectral instruments with an improved accuracy and spectral resolution, as well as a dynamic range permitting sea, Sun, sky, and Moon observations. Greater spectral diversity in the ultraviolet (UV) will be exploited to separate the living and nonliving components of marine ecosystems; UV bands will also be used to flag and improve atmospheric correction algorithms in the presence of absorbing aerosols. The short-wave infrared (SWIR) is expected to improve atmospheric correction, because the ocean is radiometrically blacker at these wavelengths. This report describes the development of the sensors, including unique capabilities like three-axis polarimetry; the documented uncertainty will be presented in a subsequent report.

Hooker, Stanford B.↗

NASA NTRS2004

Performance and Reliability Optimization for Aerospace Systems subject to Uncertainty and Degradation

This report summarizes work performed by the Space Systems Laboratory (SSL) for NASA Langley Research Center in the field of performance optimization for systems subject to uncertainty. The objective of the research is to develop design methods and tools to the aerospace vehicle design process which take into account lifecycle uncertainties. It recognizes that uncertainty between the predictions of integrated models and data collected from the system in its operational environment is unavoidable. Given the presence of uncertainty, the goal of this work is to develop means of identifying critical sources of uncertainty, and to combine these with the analytical tools used with integrated modeling. In this manner, system uncertainty analysis becomes part of the design process, and can motivate redesign. The specific program objectives were: 1. To incorporate uncertainty modeling, propagation and analysis into the integrated (controls, structures, payloads, disturbances, etc.) design process to derive the error bars associated with performance predictions. 2. To apply modern optimization tools to guide in the expenditure of funds in a way that most cost-effectively improves the lifecycle productivity of the system by enhancing the subsystem reliability and redundancy. The results from the second program objective are described. This report describes the work and results for the first objective: uncertainty modeling, propagation, and synthesis with integrated modeling.

Miller, David W.↗

NASA NTRS1999

Improvement of TOPEX/POSEIDON and Jason-1 Geophysical Data Record for Global Change Studies and Coastal Applications

The Earth's modem climate change has been characterized by interlinked changes in temperature, CO2, ice sheets and sea level. Global sea level change is a critical indicator for study of contemporary climate change. Sea level rise appears to have accelerated since the ice sheet retreats have stopped some 5000 years ago and it is estimated that the sea level rise has been approx. 15 cm over the last century. Contemporary radar altimeters represent the only technique capable of monitoring global sea level change with accuracy approaching 1 mm/yr and with a temporal scale of days and a spatial scale of 100 km or longer. This report highlights the major accomplishments of the TOPEX/POSEIDON (T/P) Extended Mission and Jason-1 science investigation. The primary objectives of the investigation include the calibration and improvement of T/P and Jason-1 altimeter data for global sea level change and coastal tide and circulation studies. The scientific objectives of the investigation include: (1) the calibration and improvement of T/P and Jason-1 data as a reference measurement system for the accurate cross-linking with other altimeter systems (Seasat, Geosat, ERS-1, ERS-2, GFO-1, and Envisat), (2) the improved determination and the associated uncertainties of the long-term (15-year) global mean sea level change using multiple altimeters, (3) the characterization of the sea level change by analyses of independent data, including tide gauges, sea surface temperature, and (4) the improvement coastal radar altimetry for studies including coastal ocean tide modeling and coastal circulation. Major accomplishments of the investigation include the development of techniques for low-cost radar altimeter absolute calibration (including the associated GPS-buoy technology), coastal ocean tide modeling, and the linking of multiple altimeter systems and the resulting determination of the 15-year (1985-1999) global mean sea level variations. The current rate of 15-year sea level rise observed by multiple satellite altimetry is +2.3 +/- 1.2 mm/yr, which is in general agreement with the analysis of sparsely distributed tide gauge measurements for the same data span, and represents the first such determination of sea level change in its kind.

Shum, C. K.↗

DOE OSTI2024

Selection of representative general circulation models under climatic uncertainty for Western North America

Abstract Climate change research uses an ensemble of general circulation model runs (GCMs-runs) to predict future climate under uncertainties. To reduce computational costs, this study selects representative GCM-runs (RGCM-runs) for Western North America (WNA) based on their performance in replicating historical climate conditions from 1981 to 2005 and projecting future changes from 1981–2010 to 2071–2100. This evaluation is conducted under two representative concentration pathways (RCPs) scenarios, RCP4.5 and RCP8.5, from the Coupled Model Intercomparison Project 5. By using an envelope-based selection technique and a multi-objective distance-based approach, we identify four RGCM-runs per RCP representing diverse climatic conditions, including wet-warm, wet-cold, dry-warm, and dry-cold. Compared to the full-set, these selected runs show a decreased mean absolute error (MAE) between the reference and RGCM-runs concerning the monthly average mean air temperature (T̄) and precipitation (P̄). For RCP4.5, T̄ MAE is 0.45 (vs. 0.58 in the full-set) and P̄ MAE is 0.31 (vs. 0.42). For RCP8.5, T̄ MAE is 0.51 (vs. 0.75) and P̄ MAE is 0.25 (vs. 0.36). The lower MAE values in the RGCM-run set indicate closer alignment between predicted and reference values, making the RGCM-run suitable for climate impact assessments in the region.

Water Resources↗

NASA NTRS2010

Human Research Program Space Radiation Standing Review Panel (SRP)

The Space Radiation Standing Review Panel (SRP) met at the NASA Johnson Space Center (JSC) on December 9-11, 2009 to discuss the areas of current and future research targeted by the Space Radiation Program Element (SRPE) of the Human Research Program (HRP). Using evidence-based knowledge as a background for identified risks to astronaut health and performance, NASA had identified gaps in knowledge to address those risks. Ongoing and proposed tasks were presented to address the gaps. The charge to the Space Radiation SRP was to review the gaps, evaluate whether the tasks addressed these gaps and to make recommendations to NASA s HRP Science Management Office regarding the SRP's review. The SRP was requested to evaluate the practicality of the proposed efforts in light of the demands placed on the HRP. Several presentations were made to the SRP during the site visit and the SRP spent sufficient time to address the SRP charge. The SRP made a final debriefing to the HRP Program Scientist, Dr. John B. Charles, on December 11, 2009. The SRP noted that current SRPE strategy is properly science-based and views this as the best assurance of the likelihood that answers to the questions posed as gaps in knowledge can be found, that the uncertainty in risk estimates can be reduced, and that a solid, cost-effective approach to risk reduction solutions is being developed. The current approach of the SRPE, based on the use of carefully focused research solicitations, requiring thorough peer-review and approaches demonstrated to be on the path to answering the NASA strategic questions, addressed to a broad extramural community of qualified scientists, optimally positioned to take advantage of serendipitous discoveries and to leverage scientific advances made elsewhere, is sound and appropriate. The SRP viewed with concern statements by HRP implying that the only science legitimately deserving support should be "applied" or, in some instances that the very term "research" might be frowned upon. We understand the desire of management to ensure that research stay focused on mission objectives, but the terms used are code words fraught with different meaning for scientists. Such expressions, taken at face value, convey a profoundly flawed view of science, can easily lead down counterproductive paths, and have the potential to irretrievably corrupt NASA requirements. The SRP understands and endorses the mandate to keep research efforts focused on the mission needs. However, thoughtful application of knowledge gained by understanding the mechanisms and pathways of biological effects cannot be replaced.

Woloschak, Gayle↗

NASA NTRS2011

Fission Power System Technology for NASA Exploration Missions

Under the NASA Exploration Technology Development Program, and in partnership with the Department of Energy (DOE), NASA is conducting a project to mature Fission Power System (FPS) technology. A primary project goal is to develop viable system options to support future NASA mission needs for nuclear power. The main FPS project objectives are as follows: 1) Develop FPS concepts that meet expected NASA mission power requirements at reasonable cost with added benefits over other options. 2) Establish a hardware-based technical foundation for FPS design concepts and reduce overall development risk. 3) Reduce the cost uncertainties for FPS and establish greater credibility for flight system cost estimates. 4) Generate the key products to allow NASA decisionmakers to consider FPS as a preferred option for flight development. In order to achieve these goals, the FPS project has two main thrusts: concept definition and risk reduction. Under concept definition, NASA and DOE are performing trade studies, defining requirements, developing analytical tools, and formulating system concepts. A typical FPS consists of the reactor, shield, power conversion, heat rejection, and power management and distribution (PMAD). Studies are performed to identify the desired design parameters for each subsystem that allow the system to meet the requirements with reasonable cost and development risk. Risk reduction provides the means to evaluate technologies in a laboratory test environment. Non-nuclear hardware prototypes are built and tested to verify performance expectations, gain operating experience, and resolve design uncertainties.

Mason, Lee↗

NASA NTRS2011

NASA System Safety Handbook: System Safety Framework and Concepts for Implementation - Volume 1

System safety assessment is defined in NPR 8715.3C, NASA General Safety Program Requirements as a disciplined, systematic approach to the analysis of risks resulting from hazards that can affect humans, the environment, and mission assets. Achievement of the highest practicable degree of system safety is one of NASA's highest priorities. Traditionally, system safety assessment at NASA and elsewhere has focused on the application of a set of safety analysis tools to identify safety risks and formulate effective controls.1 Familiar tools used for this purpose include various forms of hazard analyses, failure modes and effects analyses, and probabilistic safety assessment (commonly also referred to as probabilistic risk assessment (PRA)). In the past, it has been assumed that to show that a system is safe, it is sufficient to provide assurance that the process for identifying the hazards has been as comprehensive as possible and that each identified hazard has one or more associated controls. The NASA Aerospace Safety Advisory Panel (ASAP) has made several statements in its annual reports supporting a more holistic approach. In 2006, it recommended that "... a comprehensive risk assessment, communication and acceptance process be implemented to ensure that overall launch risk is considered in an integrated and consistent manner." In 2009, it advocated for "... a process for using a risk-informed design approach to produce a design that is optimally and sufficiently safe." As a rationale for the latter advocacy, it stated that "... the ASAP applauds switching to a performance-based approach because it emphasizes early risk identification to guide designs, thus enabling creative design approaches that might be more efficient, safer, or both." For purposes of this preface, it is worth mentioning three areas where the handbook emphasizes a more holistic type of thinking. First, the handbook takes the position that it is important to not just focus on risk on an individual basis but to consider measures of aggregate safety risk and to ensure wherever possible that there be quantitative measures for evaluating how effective the controls are in reducing these aggregate risks. The term aggregate risk, when used in this handbook, refers to the accumulation of risks from individual scenarios that lead to a shortfall in safety performance at a high level: e.g., an excessively high probability of loss of crew, loss of mission, planetary contamination, etc. Without aggregated quantitative measures such as these, it is not reasonable to expect that safety has been optimized with respect to other technical and programmatic objectives. At the same time, it is fully recognized that not all sources of risk are amenable to precise quantitative analysis and that the use of qualitative approaches and bounding estimates may be appropriate for those risk sources. Second, the handbook stresses the necessity of developing confidence that the controls derived for the purpose of achieving system safety not only handle risks that have been identified and properly characterized but also provide a general, more holistic means for protecting against unidentified or uncharacterized risks. For example, while it is not possible to be assured that all credible causes of risk have been identified, there are defenses that can provide protection against broad categories of risks and thereby increase the chances that individual causes are contained. Third, the handbook strives at all times to treat uncertainties as an integral aspect of risk and as a part of making decisions. The term "uncertainty" here does not refer to an actuarial type of data analysis, but rather to a characterization of our state of knowledge regarding results from logical and physical models that approximate reality. Uncertainty analysis finds how the output parameters of the models are related to plausible variations in the input parameters and in the modeling assumptions. The evaluation of unrtainties represents a method of probabilistic thinking wherein the analyst and decision makers recognize possible outcomes other than the outcome perceived to be "most likely." Without this type of analysis, it is not possible to determine the worth of an analysis product as a basis for making decisions related to safety and mission success. In line with these considerations the handbook does not take a hazard-analysis-centric approach to system safety. Hazard analysis remains a useful tool to facilitate brainstorming but does not substitute for a more holistic approach geared to a comprehensive identification and understanding of individual risk issues and their contributions to aggregate safety risks. The handbook strives to emphasize the importance of identifying the most critical scenarios that contribute to the risk of not meeting the agreed-upon safety objectives and requirements using all appropriate tools (including but not limited to hazard analysis). Thereafter, emphasis shifts to identifying the risk drivers that cause these scenarios to be critical and ensuring that there are controls directed toward preventing or mitigating the risk drivers. To address these and other areas, the handbook advocates a proactive, analytic-deliberative, risk-informed approach to system safety, enabling the integration of system safety activities with systems engineering and risk management processes. It emphasizes how one can systematically provide the necessary evidence to substantiate the claim that a system is safe to within an acceptable risk tolerance, and that safety has been achieved in a cost-effective manner. The methodology discussed in this handbook is part of a systems engineering process and is intended to be integral to the system safety practices being conducted by the NASA safety and mission assurance and systems engineering organizations. The handbook posits that to conclude that a system is adequately safe, it is necessary to consider a set of safety claims that derive from the safety objectives of the organization. The safety claims are developed from a hierarchy of safety objectives and are therefore hierarchical themselves. Assurance that all the claims are true within acceptable risk tolerance limits implies that all of the safety objectives have been satisfied, and therefore that the system is safe. The acceptable risk tolerance limits are provided by the authority who must make the decision whether or not to proceed to the next step in the life cycle. These tolerances are therefore referred to as the decision maker's risk tolerances. In general, the safety claims address two fundamental facets of safety: 1) whether required safety thresholds or goals have been achieved, and 2) whether the safety risk is as low as possible within reasonable impacts on cost, schedule, and performance. The latter facet includes consideration of controls that are collective in nature (i.e., apply generically to broad categories of risks) and thereby provide protection against unidentified or uncharacterized risks.

Dezfuli, Homayoon↗

NASA NTRS2002

Observer-Based Magnetic Bearing Controller Developed for Aerospace Flywheels

A prototype of a versatile, observer-based magnetic bearing controller for aerospace flywheels was successfully developed and demonstrated on a magnetic bearing test rig (see the photograph) and an actual flywheel module. The objective of this development included a fast, yet low risk, control development process, and a robust, high-performance controller for a large variety of flywheels. This required a good system model, an efficient development procedure, and a model-based controller that addressed the key problems associated with flywheel and bearing imbalance, sensor error, and vibration. The model used in this control development and tuning procedure included the flexible rotor dynamics and motor-induced vibrations. Such a model was essential for low-risk scheduling of speed-dependent control parameters and for reliable evaluation of novel control strategies. The successfully tested control prototype utilized an extended Kalman filter to estimate the true rotor principal-axis motion from the raw sensor position feedback. For control refinement, the extended Kalman filter also estimated and eliminated the combined effects of mass-imbalance and sensor runouts from the input data. A key advantage of the design based on the extended Kalman filter is its ability to accurately estimate both the rotor's principal-axis position and gyroscopic rates with the least amount of phase lag. This is important for control parameter scheduling to dampen the gyroscopic motions. Because of large uncertainties in the magnetic bearing and imbalance characteristics, this state-estimation scheme alone is insufficient for containing the rotor motion within the desired 1-mil excursion radius. A nonlinear gain adjustment based on an estimation of the principal-axis orbit size was needed to provide a coarse (nonoptimal), but robust, control of the orbit growth. Control current minimization was achieved with a (steepest gradient) search of synchronous errors in the principal-axis position input data. Actual flywheel tests of this observer-based controller (developed entirely in-house) at the NASA Glenn Research Center showed that the model correctly predicted the rotor orbit growth as a function of rotational speed, and it demonstrated the capability of gain adjustments to arrest this growth. Data from these tests on an actual flywheel module spun to 26,000 rpm proved that the controller was able to contain the shaft motion to within much less than 0.5 mils of radial excursion with axis currents less than 300 mA in root-mean-square estimate. The test speed range was limited because of thermal expansion concerns for this particular flywheel unit, not because of any deficiency in the controller. Simulations for this unit indicated that the controller should be robust up to its top operating speed of 60,000 rpm. Aside from these important achievements, and most significantly, it took less than 1 week to adapt this controller from the simple test rig to the actual flywheel and to demonstrate full five-axis levitation and control. This demonstration showed that both the controller and the model-based development and tuning framework are easily adaptable to a wide range of rotors and bearing configurations and, hence, are capable of reducing design risks and costs for many future flywheel technology developments.

Le, Dzu K.↗