Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

X-ray evidence for particulate contamination on the AXAF VETA-1 mirrors

X-ray testing of the AXAF outer mirror pairs, in the VETA-1 configuration, reveals a point spread function (PSF) with unexpectedly large wings at low energies. Although the angular dependence in the wings of the PSF is close to that expected for diffractive scattering from surface roughness, the energy dependence differs substantially. Analyses of the observed X-ray PSF, images near ring focus, and single-quadrant images at conjugate focus suggest that the excess scattering observed at low X-ray energies results from diffractive scattering by relatively small grains (as small as a few tenths micrometer in radius). We develop a simple model for the contribution of scattering by particulates to the PSF. Merging this model with that for scattering by surface roughness, we fit the combined model to the observed energy-dependent PSF, in order to estimate parameters and associated uncertainties characterizing the grain-size distribution and the surface-roughness power spectral density. In particular, we find that the fractional coverage of the mirrors by particulates is approximately 1 x 10 exp -4 (for grain radii between 0.1 and 10 microns), and that the rms surface-roughness is approximately 0.7 nm (for spatial frequencies between 1/mm and 1000/mm).

O'Dell, S. L.↗

Validation and Verification of Operational Land Analysis Activities at the Air Force Weather Agency

The NASA developed Land Information System (LIS) is the Air Force Weather Agency's (AFWA) operational Land Data Assimilation System (LDAS) combining real time precipitation observations and analyses, global forecast model data, vegetation, terrain, and soil parameters with the community Noah land surface model, along with other hydrology module options, to generate profile analyses of global soil moisture, soil temperature, and other important land surface characteristics. (1) A range of satellite data products and surface observations used to generate the land analysis products (2) Global, 1/4 deg spatial resolution (3) Model analysis generated at 3 hours. AFWA recognizes the importance of operational benchmarking and uncertainty characterization for land surface modeling and is developing standard methods, software, and metrics to verify and/or validate LIS output products. To facilitate this and other needs for land analysis activities at AFWA, the Model Evaluation Toolkit (MET) -- a joint product of the National Center for Atmospheric Research Developmental Testbed Center (NCAR DTC), AFWA, and the user community -- and the Land surface Verification Toolkit (LVT), developed at the Goddard Space Flight Center (GSFC), have been adapted to operational benchmarking needs of AFWA's land characterization activities.

Shaw, Michael↗

Analysis of Fine-Mode Aerosol Retrieval Capabilities by Different Passive Remote Sensing Instrument Designs

Remote sensing of aerosol optical properties is difficult, but multi-angle, multi-spectral, polarimetric instruments have the potential to retrieve sufficient information about aerosols that they can be used to improve global climate models. However, the complexity of these instruments means that it is difficult to intuitively understand the relationship between instrument design and retrieval success. We apply a Bayesian statistical technique that relates instrument characteristics to the information contained in an observation. Using realistic simulations of fine size mode dominated spherical aerosols, we investigate three instrument designs. Two of these represent instruments currently in orbit: the Multiangle Imaging SpectroRadiometer (MISR) and the POLarization and Directionality of the Earths Reflectances (POLDER). The third is the Aerosol Polarimetry Sensor (APS), which failed to reach orbit during recent launch, but represents a viable design for future instruments. The results show fundamental differences between the three, and offer suggestions for future instrument design and the optimal retrieval strategy for current instruments. Generally, our results agree with previous validation efforts of POLDER and airborne prototypes of APS, but show that the MISR aerosol optical thickness uncertainty characterization is possibly underestimated.

Knobelspiesse, Kirk↗

A Climate Generator for Agricultural Planning in Southeastern South America

A method is described for the generation of climate scenarios in a form suitable for driving agricultural models. The scenarios are tailored to the region in southeastern South America bounded by 25-40 deg S, 45-65 deg W, denoted here as SESA. SESA has been characterized by increasing summer precipitation, particularly during the late 20th century, which, in the context of favorable market conditions, has enabled increases in agricultural production. Since about year 2000, however, the upward tendency appears to have slowed or possibly stopped, raising questions about future climate inputs to regional agricultural yields. The method is not predictive in the deterministic sense, but rather attempts to characterize uncertainty in near-term future climate, taking into account both forced trends and unforced, natural climate fluctuations. It differs from typical downscaling methods in that GCM information is utilized only at the regional scale, subregional variability being modeled based on the observational record. Output, generated on the monthly time scale, is disaggregated to daily values with a weather generator and used to drive soybean yields in the crop model DSSAT-CSM, for which preliminary results are discussed. The simulations produced permit assessment of the interplay between long-range trends and near-term climate variability in terms of agricultural production.

climate simulation↗

VIIRS-J1 Polarization Narrative

The VIS/NIR bands polarization sensitivity of Joint Polar Satellite Sensor 1 (JPSS1) Visible/Infrared Imaging Radiometer Suite (VIIRS) instrument was measured using a broadband source. While polarization sensitivity for bands M5-M7, I1, and I2 was less than 2.5%, the maximum polarization sensitivity for bands M1, M2, M3, and M4 was measured to be 6.4%, 4.4%, 3.1%, and 4.3%, respectively with a polarization characterization uncertainty of less than 0.3%. A detailed polarization model indicated that the large polarization sensitivity observed in the M1 to M4 bands was mainly due to the large polarization sensitivity introduced at the leading and trailing edges of the newly manufactured VISNIR bandpass focal plane filters installed in front of the VISNIR detectors. This was confirmed by polarization measurements of bands M1 and M4 bands using monochromatic light. Discussed are the activities leading up to and including the instruments two polarization tests, some discussion of the polarization model and the model results, the role of the focal plane filters, the polarization testing of the Aft-Optics-Assembly, the testing of the polarizers at Goddard and NIST and the use of NIST's T-SIRCUS for polarization testing and associated analyses and results.

polarization↗

Determining Cloud Thermodynamic Phase from Micropulse Lidar Network Data

Determining cloud thermodynamic phase is a critical factor in studies of Earth's radiation budget. Here we use observations from the NASA Micro Pulse Lidar Network (MPLNET) and thermodynamic profiles from the Goddard Earth Observing System, version 5 (GEOS-5) to distinguish liquid water, mixed-phase, and ice water clouds. The MPLNET provides sparse global, autonomous, and continuous measurements of clouds and aerosols which have been used in a number of scientific investigations to date. The use of a standardized instrument and a common suite of data processing algorithms with thorough uncertainty characterization allows for straightforward comparisons between sites. Lidars with polarization capabilities have recently been incorporated into the MPLNET project which allows, for the first time, the ability to infer a cloud thermodynamic phase. This presentation will look specifically at the occurrence of ice and mixed phase clouds in the temperature region of -10 C to -40 C for different climatological regions and seasons. We compare MPLNET occurrences of mixed-phase clouds to an historical climatology based on observations from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) spacecraft.

mixing layer height↗

Progress of the NASA ACE Mission Polarimeter Working Group Instrument Inter-Comparison

The NASA Aerosol-Cloud-Ecosystem (ACE) mission is a National Research Council Decadal Survey recommended mission that will contain an imaging polarimeter for remote sensing of aerosols and clouds. A variety of airborne polarimeter prototypes exist, so the ACE Polarimeter Working Group (ACEPWG) was formed to share information between groups and collectively work for improved measurement techniques, uncertainty characterization, and algorithm development. The initial focus has been on observations made during the Polarimeter Definition Experiment (PODEX), conducted in early 2013 in Southern California. Three ACE mission supported polarimeters were deployed on the high altitude ER-2 aircraft as it flew over a variety of targets. Two of those instruments to date have successfully produced Level 1 (geolocated radiance and polarization) data. Initial matched scene inter-comparisons found little radiometric, but significant polarimetric, bias. After improvement to geolocation in one instrument, and calibration in the other, polarimetric comparisons have improved significantly. We will describe these results, remaining unresolved issues, and future plans.

Polarimeter↗

NASA Orbital Debris Engineering Model (ORDEM) 3.1: Model Verification and Validation

The NASA Orbital Debris Engineering Model (ORDEM) 3.1 Model Verification and Validation (V&V) document accompanies the delivery of the latest ORDEM 3.1 model (Vavrin & Manis, 2019) and provides a detailed description of the V&V activities used to verify that the model was built correctly and validate the model against independent, real world sources of data obtained from sampling the orbital debris environment. This ORDEM 3.1 Model V&V document, along with the related ORDEM 3.1 Model Process document – which covers details of the mathematical, statistical, and physical basis of the model – are intended to inform credibility assessments, risk analyses, uncertainty characterizations, and other applications derived from use of the model by the ORDEM 3.1 user community.

Timothy Kennedy↗

Hyperspectral Sounder Products: SiFSAP and ClimFiSP

Infrared hyperspectral sounders have demonstrated to provide very high value information for a range of weather and climate applications. Traditional retrieval algorithms of hyperspectral sounders use the ‘cloud clearing’ methodology in the retrieval process due to the lack of means to account for cloud scattering effect. The corresponding Level-2 data products are therefore limited by two major factors: the degradation of spatial resolution as compared with the native resolution of the instruments and the lack of ‘radiance closure’ that is critically needed for climate trend studies. The single field-of-view (FOV) sounder atmospheric products (SiFSAP) algorithm has been developed to supplement existing operational products. The SiFSAP algorithm uses the principal component based radiative transfer model (PCRTM) that is ultra-fast and has been extensively validated for the cloud scattering simulation capability. The cloud properties are physically retrieved along with profiles of temperature, moisture, and trace gases of interest, surface properties simultaneously by fitting single FOV spectral measurements. Therefore, SiFSAP ensure the radiometric consistency between the retrieved geophysical properties and the top-of-atmosphere (TOA) spectral measurements. This presentation provides a general introduction of SiFSAP and details about the physical retrieval algorithm. Also introduced here is a derivative data product of SiFSAP, the climate fingerprinting Sounder Products (ClimFiSP). ClimFiSP include the space-time averaged properties of key climate variables that are derived from the space-time averaged radiances via the spectral fingerprinting scheme. The spectral fingerprinting method allows a low latency data update on ClimFiSP following any potential calibration update on satellite measurements. ClimFiSP also include the rigorously defined uncertainty characterization for trends or anomalies of climate variables, being critical for the construction of long-term climate data record. Both SiFSAP and ClimFiSP will be available to users through NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC).

Wan Wu↗

Computational Math Problems for a Clean Energy Future

Cutting edge computational mathematics are ubiquitous in renewable energy research. Problems in resilient and reliable electric grid operations, infrastructure planning, wind farm yaw control, and more demand sophisticated and scalable computational tools that enable the transition of renewable energy technologies from proof of concept to deployment into our energy system. The mission of the Computational Science Center at NREL is to lead the lab's efforts to solve energy challenges using high-performance computing (HPC), computational science, applied mathematics, scientific data management, visualization, and informatics. In this poster, we provide a short overview of three areas of computational mathematics research at NREL: wind power scenario generation for stochastic grid operations and infrastructure planning, improved rational function approximations for electromagnetic transients codes, and wind farm yaw control using a combination of the Alternating Direction Method of Multipliers (ADMM) and reinforcement learning (RL). Increasing penetrations of renewable energy into power grids motivate the investigation of new approaches to characterizing uncertainty for five-minute economic dispatch problems. Similarly, as the penetration of distributed energy resources on power grids increases, it becomes important to revisit our methods of modelling transient phenomena, i.e. electromagnetic transients programs. Finally, the combination of ADMM and RL for wind farm yaw control presented here can potentially increase the efficiency of the deployed distributed controllers by orders of magnitude.

ADMM↗

Stakeholder-Engaged Structured Decision Making for the Los Alamos Legacy Cleanup Mission - 20501

The Los Alamos National Laboratory (LANL) environmental legacy cleanup program requires decisions to be made for environmental remediation, decommissioning and disposal or management of radioactive waste. This legacy cleanup program was established to address groundwater contamination, material disposal areas (MDAs) that have been used to dispose of radioactive and other waste material, and 'aggregate areas' that might produce radioactive or other chemical waste as a result of remediation activities. The LANL site is regulated for environmental concerns under the Resource Conservation and Recovery Act (RCRA). However, some parts of LANL, such as material disposal area G (MDA G), have disposed of radioactive waste under DOE Order 435.1, and are subject to other regulations. For example, decommissioning the remote-handled TRU material stored in 33 shafts at MDA G falls under EPA's 40 CFR 191. Collectively, the regulations are all aimed in the same direction of finding the best solution, either through constructs such as 'as low as reasonably achievable' (ALARA), considering balancing factors as opposed to only cost and human health risk, and, under EPA regulations such as RCRA and NEPA, evaluating impact from all chemicals and both human health and ecological endpoints. Despite the basic goals and objectives of the regulations or their guidance, the main challenge is in their implementation. Arguably perhaps, but really in principle, all of these (and similar) regulations are asking for a decision analysis to be performed. Implementation challenges encountered have included lack of understanding of decision analysis in the industry, lack of effective stakeholder engagement in the decision analysis process, and lack of appreciation of the need to separate value judgments from science, the latter leading to developing conservative, or protective, science-based models. Conservative models lead to poor solutions, lack of effective stakeholder engagement leads to long drawn out protracted approaches to finding a solution (which also might never be found with this approach), and lack of understanding of decision analysis and Bayesian statistics causes poor models to be built, which creates unfortunate situations of 'garbage in, garbage out' becoming the basis for decision making. Stakeholder-engaged structured decision making (SDM) is an approach to solving problems that relies on the theory of decision science to involve stakeholders in the decision-making process. This approach incorporates stakeholder values using a scientifically rigorous methodology that separates value judgments from science in a way that helps avoid the pitfalls of biased, protective, or conservative modeling. This approach has its foundation in Keeney's 1992 treatise on value-focused thinking [1]. Keeney advocated a paradigm shift in decision making based on the idea that the standard way of thinking about decisions is backwards. The standard approach of focusing first on identifying alternatives rather than on articulating values results in a reactive approach with the emphasis on mechanics and fixed choices instead of the core values that have meaning to stakeholders. This paradigm shift effectively engages all stakeholders in the decision-making process while using a values focused thinking approach that can lead to the identification of decision opportunities and the creation of better alternatives. The intent is to be proactive and generate solutions that are related directly to values and objectives as identified by stakeholders. There are, perhaps, two overarching reasons why SDM can be used to benefit LANL's environmental legacy cleanup. Some of LANL's remaining waste management and environmental management problems are challenging and complex (for example, the Cr and RDX plumes, and MDAs) and while the traditional approach has, arguably, worked well for relatively simple risk-based problems, it cannot, or should not, be applied to more complex problems if the most effective and efficient solutions are desired. The second reason is cost. This has perhaps become more critical since publication of the Government Accountability Office (GAO) reports that DoE's environmental liability is considered a high-risk concern for the nation [2]. The focus of SDM is on structuring solutions to decision risk problems by first addressing stakeholder and decision maker values and subsequently developing decision objectives and ways to measure those objectives, preference weighting across objectives, identifying decision alternatives that best achieve those values, and characterizing uncertainty in predictions of the measures. Because a complete decision model is created using SDM, it can be evaluated to find the main elements of the model that drive, or predict, the best solution. This approach creates complete decision models that are transparent, traceable, reproducible and technically defensible. The science behind SDM, or decision analysis, is well founded, yet it is not unusual to see ad hoc approaches to decision making implemented under various environmental regulations that are pertinent to the LANL site, including NEPA, RCRA and DOE Order 435.1. Such ad hoc approaches are often not transparent or traceable, and lack reproducibility and technical defensibility. The LANL legacy cleanup program has embarked on using SDM to address the complex problems that remain. Stakeholder meetings have been held, and a prototype version of the stakeholder value system has been developed. Further meetings are expected in the future to address specific project needs. This is a long-term endeavor considering the complex environmental problems faced by DOE EM in Los Alamos (EM-LA), and careful planning, consideration of stakeholder value systems, and engagement with stakeholders throughout the SDM process is expected to lead to a successful endpoint. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Impact of Model and Rainfall Forcing Errors on Characterizing Soil Moisture Uncertainty in Land Surface Modeling

The contribution of rainfall forcing errors relative to model (structural and parameter) uncertainty in the prediction of soil moisture is investigated by integrating the NASA Catchment Land Surface Model (CLSM), forced with hydro-meteorological data, in the Oklahoma region. Rainfall-forcing uncertainty is introduced using a stochastic error model that generates ensemble rainfall fields from satellite rainfall products. The ensemble satellite rain fields are propagated through CLSM to produce soil moisture ensembles. Errors in CLSM are modeled with two different approaches: either by perturbing model parameters (representing model parameter uncertainty) or by adding randomly generated noise (representing model structure and parameter uncertainty) to the model prognostic variables. Our findings highlight that the method currently used in the NASA GEOS-5 Land Data Assimilation System to perturb CLSM variables poorly describes the uncertainty in the predicted soil moisture, even when combined with rainfall model perturbations. On the other hand, by adding model parameter perturbations to rainfall forcing perturbations, a better characterization of uncertainty in soil moisture simulations is observed. Specifically, an analysis of the rank histograms shows that the most consistent ensemble of soil moisture is obtained by combining rainfall and model parameter perturbations. When rainfall forcing and model prognostic perturbations are added, the rank histogram shows a U-shape at the domain average scale, which corresponds to a lack of variability in the forecast ensemble. The more accurate estimation of the soil moisture prediction uncertainty obtained by combining rainfall and parameter perturbations is encouraging for the application of this approach in ensemble data assimilation systems.

Maggioni, V.↗

Characterizing and quantifying uncertainty in projections of climate change impacts on air quality

Climate change can aggravate air pollution, with important public health and environmental consequences. While major sources of uncertainty in climate change projections - greenhouse gas (GHG) emissions scenario, model response, and internal variability - have been investigated extensively, their propagation to estimates of air quality impacts has not been systematically assessed. Here, we compare these uncertainties using a coupled modeling framework that includes a human activity model, an Earth system model of intermediate complexity, and a global atmospheric chemistry model. Uncertainties in projections of U.S. air quality under 21st century climate change are quantified based on a climate-chemistry ensemble that includes multiple initializations, representations of climate sensitivity, and climate policy scenarios, under constant air pollution emissions. We find that climate-related uncertainties are comparable at mid-century, making it difficult to distinguish the impact of variations in GHG emissions on ozone and particulate matter pollution. While GHG emissions scenario eventually becomes the dominant uncertainty based on the scenarios considered, all sources of uncertainty are significant through the end of the century. The results provide insights into intrinsically different uncertainties in projections of air pollution impacts and the potential for large ensembles to better capture them.

54 ENVIRONMENTAL SCIENCES↗

A linear programming approach to characterizing norm bounded uncertainty from experimental data

The linear programming spectral overbounding and factorization (LPSOF) algorithm, an algorithm for finding a minimum phase transfer function of specified order whose magnitude tightly overbounds a specified nonparametric function of frequency, is introduced. This method has direct application to transforming nonparametric uncertainty bounds (available from system identification experiments) into parametric representations required for modern robust control design software (i.e., a minimum-phase transfer function multiplied by a norm-bounded perturbation).

Scheid, R. E.↗

What is the Uncertainty in MODIS Aerosol Optical Depth in the Vicinity of Clouds?

MODIS dark-target (DT) algorithm retrieves aerosol optical depth (AOD) using a Look Up Table (LUT) approach. Global comparison of AOD (Collection 6 ) with ground-based sun photometer gives an Estimated Error (EE) of +/-(0.04 + 10%) over ocean. However, EE does not represent per-retrieval uncertainty. For retrievals that are biased high compared to AERONET, here we aim to closely examine the contribution of biases due to presence of clouds and per-pixel retrieval uncertainty. We have characterized AOD uncertainty at 550 nm, due to standard deviation of reflectance in 10 km retrieval region, uncertainty related to gas (H2O, O3) absorption, surface albedo, and aerosol models. The uncertainty in retrieved AOD seems to lie within the estimated over ocean error envelope of +/-(0.03+10%). Regions between broken clouds tend to have higher uncertainty. Compared to C6 AOD, a retrieval omitting observations in the vicinity of clouds (< or = 1 km) is biased by about +/- 0.05. For homogeneous aerosol distribution, clear sky retrievals show near zero bias. Close look at per-pixel reflectance histograms suggests retrieval possibility using median reflectance values.

Patadia, Falguni↗

The NANOGrav 12.5 yr Data Set: The Frequency Dependence of Pulse Jitter in Precision Millisecond Pulsars

Low-frequency gravitational-wave experiments require the highest timing precision from an array of the moststable millisecond pulsars. Several known sources of noise on short timescales in single radio pulsar observationsare well described by a simple model of three components: template fitting from a finite signal-to-noise ratio, pulsephase/amplitude jitter from single-pulse stochasticity, and scintillation errors from short-timescale interstellarscattering variations. Currently template-fitting errors dominate, but as radio telescopes push toward higher signalto-noise ratios, jitter becomes the next dominant term for most millisecond pulsars. Understanding the statistics ofjitter becomes crucial for properly characterizing arrival time uncertainties. We characterize the radio frequencydependence of jitter using data on 48 pulsars in the North American Nanohertz Observatory for GravitationalWaves timing program. We detect significant jitter in 43 of the pulsars and test several functional forms for itsfrequency dependence; we find significant frequency dependence for 30 pulsars. We find moderate correlations ofrms jitter with pulse width (R = 0.62) and number of profile components (R = 0.40); the single-pulse rms jitter istypically 1% of pulse phase. The average frequency dependence for all pulsars using a power-law model hasindex 0.42. We investigate the jitter variations for the interpulse of PSR B1937+21 and find no significantdeviations from the main pulse rms jitter. We also test the time variation of jitter in two pulsars and find thatsystematics likely bias the results for high-precision pulsars. Pulsar timing array analyses must properly modeljitter as a significant component of the noise within the detector.

Lam, M. T.↗