Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Reducing Earth Topography Resolution for SMAP Mission Ground Tracks Using K-Means Clustering

The K-means clustering algorithm is used to reduce Earth topography resolution for the SMAP mission ground tracks. As SMAP propagates in orbit, knowledge of the radar antenna footprints on Earth is required for the antenna misalignment calibration. Each antenna footprint contains a latitude and longitude location pair on the Earth surface. There are 400 pairs in one data set for the calibration model. It is computationally expensive to calculate corresponding Earth elevation for these data pairs. Thus, the antenna footprint resolution is reduced. Similar topographical data pairs are grouped together with the K-means clustering algorithm. The resolution is reduced to the mean of each topographical cluster called the cluster centroid. The corresponding Earth elevation for each cluster centroid is assigned to the entire group. Results show that 400 data points are reduced to 60 while still maintaining algorithm performance and computational efficiency. In this work, sensitivity analysis is also performed to show a trade-off between algorithm performance versus computational efficiency as the number of cluster centroids and algorithm iterations are increased.

ground tracks↗

TPSAS-NF1676L-19788-DND

The calibration of the historical AVHRR visible channels has always been hindered by the degrading NOAA satellite orbits. The complete AVHRR record spans over three decades making it useful for cloud, aerosol, and land use climate studies. Studies that monitor long-term changes in these properties require climate quality calibration. The AVHRR sensors do not have any onboard visible calibration, unlike the IR channels. Many AVHRR post-launch calibration methods have been published. Some of these are based on the pseudo invariant targets such as desert and polar ice and others employ direct calibration transfer from a well-calibrated sensor such as MODIS. Most historical studies only employed only one method and reconciling calibration differences from multiple studies was difficult. This study employs multiple calibration approaches, which are then merged according to their individual uncertainty. Since the visible spectral response functions are similar across AVHRR sensor and that the morning and afternoon orbits usually degrade in the same manner, an afternoon and morning orbiter during the MODIS era is chosen as the reference AVHRR sensor. The reference AVHRR sensor is inter-calibrated with the Aqua-MODIS Collection 6 standard using simultaneous nadir overpass (SNO) radiance pairs. Three pseudo invariant target approaches are utilized, deserts, polar ice and deep convective clouds. These sites are characterized using reference AVHRR reflectances as a function of solar zenith angle. The multiple calibration approach is then validated with non-reference AVHRR sensor during the MODIS era, using AVHRR and MODIS SNO measurements. For historical AVHRR satellite having consistent calibration across invariant targets then validates the approach. This calibration effort is in sponsored by the NOAA CDR program to provide climate quality visible calibration coefficients to the remote sensing community. Each of the calibration approaches are unique and when utilized in tandem can accurately calibrate the AVHRR record. AVHRR calibration methods cannot rely on repeatable annual orbits for calibration model development. Inconsistent results prompt code and invariant target examinations that cannot be determined using only single method approaches. Results from this study will be presented at the meeting.

David Doelling↗

First Measurements of Ambient PM2.5 in Kinshasa, Democratic Republic of Congo and Brazzaville, Republic of Congo Using Field-calibrated Low-cost Sensors

Estimates of air pollution mortality in sub-Saharan Africa are limited by a lack of surface observations of fine particulate matter (PM2.5). Despite being large metropolises, Kinshasa, Democratic Republic of the Congo (DRC), population 14.3 million, and Brazzaville, Republic of the Congo (ROC), population 2.4 million, have no reference air pollution monitors at the time of writing. Recently, a few reference monitors have been deployed in other parts of sub-Saharan Africa, including Kampala, Uganda. A low-cost PurpleAir PM2.5 monitor was collocated next to the Kampala US Embassy BAM-1020 (Met One Beta Attenuation Monitor) starting in August 2019. Raw PurpleAir data are strongly correlated with the BAM (r(exp 2) = 0.88), but have a mean absolute error of approximately 14 μg/cu.m. Two calibration models, multiple linear regression and a random forest approach, decrease mean absolute error (MAE) from 14.3 μg/cu.m to 3.4 µg/cu.m or less and improve the the r(exp 2) from 0.88 to 0.96. Given )the similarity in climate and emissions in Kampala, we apply the collocated field correction factors to four PurpleAir sensors in Kinshasa, DRC and one in neighboring Brazzaville, ROC deployed beginning April 2018. Annual average PM2.5 for 2019 in Kinshasa is estimated at 43.5 µg/cu.m, more than 4 times higher than WHO Interim Target 1 of 10 µg/cu.m. Surface PM2.5 and aerosol optical depth were each about 40% lower during the 2020 COVID19 lockdown period compared to the same time period in 2019, which cannot be explained by changes in meteorology or wildfire emissions alone. Our results highlight the need for clean air solutions implementation in the Congo.

Celeste McFarlane↗

Space-Borne Cloud-Native Satellite-Derived Bathymetry (SDB) Models Using ICESat-2 And Sentinel-2

Shallow nearshore coastal waters provide a wealth of societal, economic and ecosystem services, yet their topographic structure is poorly mapped due to a reliance upon expensive and time intensive methods. Space‐borne bathymetric mapping has helped address these issues, but has remained largely dependent upon in situ measurements. Here we fuse ICESat‐2 lidar data with Sentinel‐2 optical imagery, within the Google Earth Engine cloud platform, to create openly available spatially continuous high‐resolution bathymetric maps at regional‐to‐national scales in Florida, Crete and Bermuda. ICESat‐2 bathymetric classified photons are used to train three Satellite Derived Bathymetry (SDB) methods, including Lyzenga, Stumpf and Support Vector Regression algorithms. For each study site the Lyzenga algorithm yielded the lowest RMSE (approx. 10‐15%) when compared with validation data. We demonstrate a means of using ICESat‐2 for both model calibration and validation, thus cementing a pathway for fully space‐borne estimates of nearshore bathymetry in shallow, clear water environments.

N. Thomas↗

Delineation of vulnerable areas to water erosion in a mountain region using SDR-InVEST model: A case study of the Ourika watershed, Morocco

The Ourika watershed is characterized by higher than average flood flows, a rugged topography, a sparse vegetation cover and a friable substrate that makes it vulnerable to soil erosion. Soil is an important non-renewable asset capital, providing several ecosystem services that sustain life through physical and biological regulation processes. The loss, or otherwise, redistribution of biota by soil erosion in the Ourika watershed has received little attention and thus constitutes a key knowledge gap that needs to be addressed. This study quantifies the level of erosion and maps its spatial distribution in the watershed using the Sediment Delivery Ratio (SDR) of the Integrated Valuation of Ecosystem Services and Tradeoffs model (InVEST3.6.0). The SDR maps the overland sediment generation and delivery to the stream at the watershed level using rainfall, soil properties, topography, cover management and cropping practices as predefined set of input variables. Recommended internal model calibration was used and results were compared to similar studies carried out in different parts of Morocco for validation. The results reveal that 93% of the watershed is subject to a strong rainfall aggressiveness greater than 50 MJ mm ha–1 h–1 yr1 under an average rainfall intensity of 541 mm/year, rainfall capacity to initiate the detachment and transport of soil particles by runoff, and only 11.5% of the watershed area is protected with vegetative cover. We find that overall, the Ourika watershed is losing its soil to erosion at an alarming average rate of 258.48 ton.ha–1.yr–1, a rate well above the tolerable threshold of 7ton.ha–1.yr–1. The spatial distribution of this loss shows areas that need to be urgently remedied. The primary factors for soil erosion in the Ourika watershed appear to be related to the aggressive nature of local rainfall and the inherent susceptibility of soils, which can be costly to this cash-crop region. Because rainfall intensity, soil properties, and topography are intrinsic characteristics of the watershed, we suggest that seasonally adapted cropping rotations that maintains conservative practices with a high cover management may reduce soil erosion in the Ourika watershed.

Erosion↗

Assuring software cost estimates : is it an oxymoron?

The software industry repeatedly observes cost growth of well over 100% even after decades of cost estimation research and well-known best practices, so “What’s the problem?” In this paper we will provide an overview of the current state of software cost estimation best practice. We then explore whether applying some of the methods used in software assurance might improve the quality of software cost estimates. This paper especially focuses on issues associated with model calibration, estimate review, and the development and documentation of estimates as part of an integrated plan.

Hihn, Jairus↗

The Lunar GNSS Receiver Experiment (LuGRE)

The Lunar GNSS Receiver Experiment (LuGRE) is a joint NASA-Italian Space Agency (ASI) payload on the Firefly Blue Ghost Mission 1 (BGM1) with the goal to demonstrate GNSS-based positioning, navigation, and timing at the Moon. LuGRE was chosen by the NASA Commercial Lunar Payload Services (CLPS) program as one of ten payloads on its “19D” task order for delivery to the lunar surface in 2023. The LuGRE payload consists of a weak-signal GNSS receiver, a high-gain L-band patch antenna, a low-noise amplifier, and an RF filter. The receiver will track GPS L1 C/A and L5, and Galileo E1 and E5a signals and will return pseudorange, carrier phase, and Doppler measurements to the ground. It will also calculate least-squares point solutions and Kalman-filter based navigation solutions onboard. In addition, the receiver features the capability to record raw I/Q baseband samples for downlink and ground processing. LuGRE will build on the legacy of prior missions in the Space Service Volume (SSV) including the initial experiments by AMSAT-OSCAR 40 and others, the GOES-R series of geostationary weather satellites, and the NASA Magnetospheric Multiscale (MMS) mission currently operating on GPS-based navigation at nearly 50% of lunar distance. Further, LuGRE will be one of the very first demonstrations of GNSS signal reception and navigation in the lunar environment and on the lunar surface, paving the way for operational use by future lunar missions such as Orion, Gateway, robotic and human landers, and surface rovers. Ultimately, all LuGRE science data will be released to a public data archive for the benefit of the GNSS and space communities. This paper provides a detailed overview of the LuGRE payload, including its design, concept of operations, and its predicted ability to meet its core science objectives. The baseline science investigations and priorities are outlined. Simulated performance results are shown based on the latest calibrated models including signal strength, signal availability, onboard navigation performance and convergence properties, and ground-based post-processed navigation performance.

LuGRE↗

Global Solar Activity Data Portal for Studying 3D Dynamics and Activity of the Sun

The main problems with understanding and predicting solar activity are tightly linked to limitations in describing the global evolution of the Sun from the deep interior to the corona. Because of the complexity of interactions in a wide range of dynamical, turbulent, and spatial scales and dramatic changes in thermodynamic and magnetic field conditions, only physics-based models can provide essential background to generate reliable solar activity forecasts. However, performing accurate model calibration and estimating uncertainties is often challenging due to the unavailability of a long time series of observations. To mitigate these limitations, we have developed the Global Solar Activity (GSA) Data Portal, which enables convenient access to a variety of modern and historical data. The portal supports a dynamic visualization for 1D time series (such as the sunspot number and solar irradiance) and quick-look visualization for 2D datasets (e.g., synoptic magnetograms, the solar internal rotation, and flows). The GSA portal includes a search engine that enables data retrieval from user-specified data sources and time intervals. In this presentation, we will discuss the current and upcoming capabilities of the data portal and its potential applications for space weather studies.

SMD↗

A study of kinematic models for forward calibration of manipulators

The objective of robot calibration is to identify all parameters in a robot model so that the model represents the true robot. Each model has its own set of parameters. The authors prove that regardless of the kinematic model chosen, there are a maximum number of parameters that must be determined, implying that model accuracy cannot be improved by adding parameters. In addition, the authors demonstrate how to model any manipulator so that a minimum size Jacobian is used, thus reducing the computation required for calibration.

Everett, Louis J.↗

Cutting out the Middleman: Calibrating and Validating a Dynamic Vegetation Model (ED2-PROSPECT5) Using Remotely Sensed Surface Reflectance

Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types. Using a single common set of parameters across all sites, the calibrated model was able to accurately reproduce surface reflectance for sites with highly varied forest composition and structure. However, the calibrated model's predictions of leaf area index (LAI) were less robust, capturing only 46 % of the variability in the observations. Comparing the ED2 radiative transfer model with another two-stream soil–leaf–canopy radiative transfer model commonly used in remote sensing studies (PRO4SAIL) illustrated structural errors in the ED2 representation of direct radiation backscatter that resulted in systematic underestimation of reflectance. In addition, we also highlight that, to directly compare with a two-stream radiative transfer model like EDR, we had to perform an additional processing step to convert the directional reflectance estimates of AVIRIS to hemispherical reflectance (also known as “albedo”). In future work, we recommend that vegetation models add the capability to predict directional reflectance, to allow them to more directly assimilate a wide range of airborne and satellite reflectance products. We ultimately conclude that despite these challenges, using dynamic vegetation models to predict surface reflectance is a promising avenue for model calibration and validation using remote sensing data.

Alexey N Shiklomanov↗

Evaluating Differences Among Crop Models in Simulating Soybean in-Season Growth

Crop models are useful tools for simulating agricultural systems that require continued model development and testing to increase their robustness and improve how they describe our current understanding of processes. Coordinated and “blind” evaluation of multiple models using same protocols and experimental datasets provides unique opportunities to further improve models and enhance their reliability. For soybean [Glycine max (L.) Merr.], there has been limited coordinated multi-model evaluations for the simulation of in-season plant growth dynamics. We evaluated ten dynamic soybean crop models for their simulation of in-season plant growth using data from five experiments conducted in Argentina, Brazil, France, and USA. We evaluated models after a Blind (using only phenology data) and a Full calibration (with in-season and end-of-season variables). Calibration reduced model uncertainty by reducing standard bias for the simulation of in-season variables (biomass, leaf, pod, and stem weights, and leaf area index, LAI). However, we found that most models had difficulty in reproducing leaf growth dynamics, with normalized root mean squared error (nRMSE) of 56% for leaf weight and 43% for LAI (across locations and models after Full calibration). Models with different levels of complexity and experience were capable of simulating final seed yield at maturity with reasonable accuracy (nRMSE of 8–31% after Full calibration). However, the nRMSE for pod weight (of 17–64% after Full calibration) was two-fold larger than that of seed yield. Moreover, the models differed in how they simulated timing from sowing to beginning seed growth (47–93 days) and effective seed filling period (18–54 days), owing to model structural differences in defining the reproductive developmental stages. Overall, we identified the following processes that can benefit from further model improvement: leaf expansion and senescence, reproductive phenology, and partitioning to reproductive growth. Simulation of pod wall tissue and individual seed cohorts is another aspect that many models currently lack. Model improvement can benefit from high-temporal resolution experimental datasets that concurrently account for phenology, plant growth, and partitioning. Further, we recommend collecting reproductive phenology in the field consistent with actual dry matter allocation to organs in the models and collecting multiple observations of seed and pod weight to aid model improvement for simulation of seed growth and yield formation.

Agricultural Model Intercomparison and Improvement↗

Impact of Calibrated Land Surface Model Parameters on the Accuracy and Uncertainty of Land-Atmosphere Coupling in WRF Simulations

Land-atmosphere (L-A) interactions play a critical role in determining the diurnal evolution of both planetary boundary layer (PBL) and land surface temperature and moisture budgets, as well as controlling feedbacks with clouds and precipitation that lead to the persistence of dry and wet regimes. Recent efforts to quantify the strength of L-A coupling in prediction models have produced diagnostics that integrate across both the land and PBL components of the system. In this study, we examine the impact of improved specification of land surface states, anomalies, and fluxes on coupled WRF forecasts during the summers of extreme dry (2006) and wet (2007) land surface conditions in the U.S. Southern Great Plains. The improved land initialization and surface flux parameterizations are obtained through the use of a new optimization and uncertainty estimation module in NASA's Land Information System (LIS-OPT/UE), whereby parameter sets are calibrated in the Noah land surface model and classified according to a land cover and soil type mapping of the observation sites to the full model domain. The impact of calibrated parameters on the a) spinup of the land surface used as initial conditions, and b) heat and moisture states and fluxes of the coupled WRF simulations are then assessed in terms of ambient weather and land-atmosphere coupling along with measures of uncertainty propagation into the forecasts. In addition, the sensitivity of this approach to the period of calibration (dry, wet, average) is investigated. Finally, tradeoffs of computational tractability and scientific validity, and the potential for combining this approach with satellite remote sensing data are also discussed.

Santanello, Joseph A., Jr.↗

Uncertainty Evaluation of Computational Model Used to Support the Integrated Powerhead Demonstration Project

NASA and the U.S. Air Force are working on a joint project to develop a new hydrogen-fueled, full-flow, staged combustion rocket engine. The initial testing and modeling work for the Integrated Powerhead Demonstrator (IPD) project is being performed by NASA Marshall and Stennis Space Centers. A key factor in the testing of this engine is the ability to predict and measure the transient fluid flow during engine start and shutdown phases of operation. A model built by NASA Marshall in the ROCket Engine Transient Simulation (ROCETS) program is used to predict transient engine fluid flows. The model is initially calibrated to data from previous tests on the Stennis E1 test stand. The model is then used to predict the next run. Data from this run can then be used to recalibrate the model providing a tool to guide the test program in incremental steps to reduce the risk to the prototype engine. In this paper, they define this type of model as a calibrated model. This paper proposes a method to estimate the uncertainty of a model calibrated to a set of experimental test data. The method is similar to that used in the calibration of experiment instrumentation. For the IPD example used in this paper, the model uncertainty is determined for both LOX and LH flow rates using previous data. The successful use of this model is then demonstrated to predict another similar test run within the uncertainty bounds. The paper summarizes the uncertainty methodology when a model is continually recalibrated with new test data. The methodology is general and can be applied to other calibrated models.

Steele, W. G.↗

Probabilistic Material Strength Degradation Model for Inconel 718 Components Subjected to High Temperature, Mechanical Fatigue, Creep and Thermal Fatigue Effects

This thesis presents the on-going development of methodology for a probabilistic material strength degradation model. The probabilistic model, in the form of a postulated randomized multifactor equation, provides for quantification of uncertainty in the lifetime material strength of aerospace propulsion system components subjected to a number of diverse random effects. This model is embodied in the computer program entitled PROMISS, which can include up to eighteen different effects. Presently, the model includes four effects that typically reduce lifetime strength: high temperature, mechanical fatigue, creep, and thermal fatigue. Statistical analysis was conducted on experimental Inconel 718 data obtained from the open literature. This analysis provided regression parameters for use as the model's empirical material constants, thus calibrating the model specifically for Inconel 718. Model calibration was carried out for four variables, namely, high temperature, mechanical fatigue, creep, and thermal fatigue. Methodology to estimate standard deviations of these material constants for input into the probabilistic material strength model was developed. Using the current version of PROMISS, entitled PROMISS93, a sensitivity study for the combined effects of mechanical fatigue, creep, and thermal fatigue was performed. Results, in the form of cumulative distribution functions, illustrated the sensitivity of lifetime strength to any current value of an effect. In addition, verification studies comparing a combination of mechanical fatigue and high temperature effects by model to the combination by experiment were conducted. Thus, for Inconel 718, the basic model assumption of independence between effects was evaluated. Results from this limited verification study strongly supported this assumption.

Bast, Callie Corinne Scheidt↗

Probabilistic material strength degradation model for Inconel 718 components subjected to high temperature, high-cycle and low-cycle mechanical fatigue, creep and thermal fatigue effects

This report presents the results of both the fifth and sixth year effort of a research program conducted for NASA-LeRC by The University of Texas at San Antonio (UTSA). The research included on-going development of methodology for a probabilistic material strength degradation model. The probabilistic model, in the form of a postulated randomized multifactor equation, provides for quantification of uncertainty in the lifetime material strength of aerospace propulsion system components subjected to a number of diverse random effects. This model is embodied in the computer program entitled PROMISS, which can include up to eighteen different effects. Presently, the model includes five effects that typically reduce lifetime strength: high temperature, high-cycle mechanical fatigue, low-cycle mechanical fatigue, creep and thermal fatigue. Statistical analysis was conducted on experimental Inconel 718 data obtained from the open literature. This analysis provided regression parameters for use as the model's empirical material constants, thus calibrating the model specifically for Inconel 718. Model calibration was carried out for five variables, namely, high temperature, high-cycle and low-cycle mechanical fatigue, creep and thermal fatigue. Methodology to estimate standard deviations of these material constants for input into the probabilistic material strength model was developed. Using an updated version of PROMISS, entitled PROMISS93, a sensitivity study for the combined effects of high-cycle mechanical fatigue, creep and thermal fatigue was performed. Then using the current version of PROMISS, entitled PROMISS94, a second sensitivity study including the effect of low-cycle mechanical fatigue, as well as, the three previous effects was performed. Results, in the form of cumulative distribution functions, illustrated the sensitivity of lifetime strength to any current value of an effect. In addition, verification studies comparing a combination of high-cycle mechanical fatigue and high temperature effects by model to the combination by experiment were conducted. Thus, for Inconel 718, the basic model assumption of independence between effects was evaluated. Results from this limited verification study strongly supported this assumption.

Bast, Callie C.↗

Evaluation of Regression Models of Balance Calibration Data Using an Empirical Criterion

An empirical criterion for assessing the significance of individual terms of regression models of wind tunnel strain gage balance outputs is evaluated. The criterion is based on the percent contribution of a regression model term. It considers a term to be significant if its percent contribution exceeds the empirical threshold of 0.05%. The criterion has the advantage that it can easily be computed using the regression coefficients of the gage outputs and the load capacities of the balance. First, a definition of the empirical criterion is provided. Then, it is compared with an alternate statistical criterion that is widely used in regression analysis. Finally, calibration data sets from a variety of balances are used to illustrate the connection between the empirical and the statistical criterion. A review of these results indicated that the empirical criterion seems to be suitable for a crude assessment of the significance of a regression model term as the boundary between a significant and an insignificant term cannot be defined very well. Therefore, regression model term reduction should only be performed by using the more universally applicable statistical criterion.

Ulbrich, Norbert↗

Calibration and verification of environmental models

The problems of calibration and verification of mesoscale models used for investigating power plant discharges are considered. The value of remote sensors for data acquisition is discussed as well as an investigation of Biscayne Bay in southern Florida.

Lee, S. S.↗