Search NASA⌕ Search

SEARCH · Search NASA

Results for “data modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Linking big models to big data: efficient ecosystem model calibration through Bayesian model emulation

Data-model integration plays a critical role in assessing and improving our capacity to predict ecosystem dynamics. Similarly, the ability to attach quantitative statements of uncertainty around model forecasts is crucial for model assessment and interpretation and for setting field research priorities. Bayesian methods provide a rigorous data assimilation framework for these applications, especially for problems with multiple data constraints. However, the Markov chain Monte Carlo (MCMC) techniques underlying most Bayesian calibration can be prohibitive for computationally demanding models and large datasets. We employ an alternative method, Bayesian model emulation of sufficient statistics, that can approximate the full joint posterior density, is more amenable to parallelization, and provides an estimate of parameter sensitivity. Analysis involved informative priors constructed from a meta-analysis of the primary literature and specification of both model and data uncertainties, and it introduced novel approaches to autocorrelation corrections on multiple data streams and emulating the sufficient statistics surface. We report the integration of this method within an ecological workflow management software, Predictive Ecosystem Analyzer (PEcAn), and its application and validation with two process-based terrestrial ecosystem models: SIPNET and ED2. In a test against a synthetic dataset, the emulator was able to retrieve the true parameter values. A comparison of the emulator approach to standard brute-force MCMC involving multiple data constraints showed that the emulator method was able to constrain the faster and simpler SIPNET model's parameters with comparable performance to the brute-force approach but reduced computation time by more than 2 orders of magnitude. The emulator was then applied to calibration of the ED2 model, whose complexity precludes standard (brute-force) Bayesian data assimilation techniques. Both models are constrained after assimilation of the observational data with the emulator method, reducing the uncertainty around their predictions. Performance metrics showed increased agreement between model predictions and data. Our study furthers efforts toward reducing model uncertainties, showing that the emulator method makes it possible to efficiently calibrate complex models.

58 GEOSCIENCES↗

Autotune Calibrates Models to Building Use Data

Models of existing buildings are currently unreliable unless calibrated manually by a skilled professional. Autotune, as the name implies, automates this process by calibrating the model of an existing building to measured data, and is now available as open source software. This enables private businesses to incorporate Autotune into their products so that their customers can more effectively estimate cost savings of reduced energy consumption measures in existing buildings.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Spatial-frequency response of the Limb Infrared Monitor of the Stratosphere /LIMS/ radiometer

The Limb Infrared Monitor of the Stratosphere (LIMS), an experiment on the Nimbus-7 satellite, is designed to scan the earth's limb vertically and measure spectral emission profiles of trace atmospheric gases believed to be important in processes controlling the stratospheric ozone distribution. Experiment objectives are reviewed and several analyses and measurements are described which were performed to determine the adequacy of the system for satisfying these objectives. Adequate spatial-frequency response for all the spectral channels is required to provide, through inversion of the measured limb-radiance profiles, important information about the temperature, structure, and composition of the atmosphere. From the LIMS design-model data, the MTF was calculated for the optical system, the detector field mask, the electronics, and the overall system, for each channel. The signal output performance of the instrument was predicted from the system MTF data model input radiance data for each channel. MTF measurements made on the flight sensor confirmed the analytical results. The predictions indicate that the instrument can satisfy the basic measurement objectives of the experiment.

Wilson, R. G.↗

Error enhancement in geomagnetic models derived from scalar data

Models of the main geomagnetic field are generally represented by a scalar potential gamma expanded in a finite number of spherical harmonics. Very accurate observations of F were used, but indications exist that the accuracy of models derived from them is considerably lower. One problem is that F does not always characterize gamma uniquely. It is not clear whether such ambiguity can be encountered in deriving gamma from F in geomagnetic surveys, but there exists a connection, due to the fact that the counterexamples of Backus are related to the dipole field, while the geomagnetic field is dominated by its dipole component. If the models are recovered with a finite error (i.e. they cannot completely fit the data and consequently have a small spurious component), this connection allows the error in certain sequences of harmonic terms in gamma to be enhanced without unduly large effects on the fit of F to the model.

Stern, D. P.↗

Bioenergy crop models: Descriptions, data requirements and future challenges

Field studies that address the production of lignocellulosic biomass as a potential source of renewable energy are making available critical information for the development, validation, and use of bioenergy crop models. A literature survey revealed that 14 models have been developed and validated for herbaceous and woody bioenergy crops, and for Crassulacean acid metabolism (CAM) crops adapted to arid lands. These models simulate field-scale production of biomass for switchgrass (ALMANAC, EPIC, and Agro-BGC), miscanthus (MISCANFOR, MISCANMOD, and WIMOVAC), sugarcane (APSIM, AUSCANE, and CANEGRO), and poplar and willow (SECRETS and 3PG). Two models are adaptations of dynamic global vegetation models and simulate biomass yields of miscanthus and sugarcane as plant function types at regional scales (Agro-IBIS and LPJmL). A model of biomass production in CAM plants has been developed (EPI), but lacks the sophistication of the other models. Except for CAM plants, all the models include representations of leaf area dynamics, radiation interception and utilization, biomass production, and partitioning of biomass to roots and shoots. A few of the models are capable of simulating soil water, nutrient, and carbon cycle processes, making them especially useful for assessing environmental consequences (e.g., erosion and nutrient losses) associated with the field-scale deployment of bioenergy crops. Similar to other process-based models, simulations are challenged by computing and data management issues and an integrated framework for model testing and inter-comparison is needed. Considerable work remains concerning the development of models for unconventional bioenergy crops like CAM plants, generation and distribution of high-quality field data for model development and validation, and development of an integrated framework for efficient execution of large-scale simulations for use in planning regional to global sustainable bioenergy production systems.

Surendran Nair, Sujith↗

Bayesian Monte Carlo Evaluation of Imperfect (n, 233 U) Data and Model

Conventional nuclear data evaluation methods using generalized linear least squares make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate to minimize the cost function (even for nonlinear models); the model (e.g., of neutron cross section) and experimental data (including covariance data) are without defect and prior PDFs of parameters and measured data are known perfectly. Neglect of covariance between model parameters and measured data in conventional evaluations contributes to imperfections. These assumptions are inherent to the generalized linear least squares minimization method commonly used for resolved resonance region neutron cross section evaluations but are often not justified due to the presence of non-normal PDFs, nonlinear models (e.g., R-matrix formalism), and inherent imperfections in data and models (e.g., imperfect covariance data). Here, these assumptions are removed in a mathematical framework of Bayes’ theorem, which is implemented using the Metropolis-Hastings Monte Carlo method. Most importantly, new parameters are introduced to parameterize discrepancies between the theoretical model and measured data to quantify judgement about discrepancies or imperfections in a reproducible manner. An evaluation of 233U in the eV region using the ENDF-B/VIII.0 library and transmission data (Guber et al.) is presented, and posterior parameters are compared to those obtained by conventional evaluation methods. This example illustrates the effects of removing the most harmful assumption: that of model-data perfection.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Data Used in Quantified Reliability Models

Data is the crux to developing quantitative risk and reliability models, without the data there is no quantification. The means to find and identify reliability data or failure numbers to quantify fault tree models during conceptual and design phases is often the quagmire that precludes early decision makers consideration of potential risk drivers that will influence design. The analyst tasked with addressing a system or product reliability depends on the availability of data. But, where is does that data come from and what does it really apply to? Commercial industries, government agencies, and other international sources might have available data similar to what you are looking for. In general, internal and external technical reports and data based on similar and dissimilar equipment is often the first and only place checked. A common philosophy is "I have a number - that is good enough". But, is it? Have you ever considered the difference in reported data from various federal datasets and technical reports when compared to similar sources from national and/or international datasets? Just how well does your data compare? Understanding how the reported data was derived, and interpreting the information and details associated with the data is as important as the data itself.

DeMott, Diana↗

Utilization of Hydrologic Remote Sensing Data in Land Surface Modeling and Data Assimilation: Current Status and Challenges

Recent advances in remote sensing technologies have enabled the monitoring and measurement of the Earth's land surface at an unprecedented scale and frequency. The myriad of these land surface observations must be integrated with the state-of-the-art land surface model forecasts using data assimilation to generate spatially and temporally coherent estimates of environmental conditions. These analyses are of critical importance to real-world applications such as agricultural production, water resources management and flood, drought, weather and climate prediction. This need motivated the development of NASA Land Information System (LIS), which is an expert system encapsulating a suite of modeling, computational and data assimilation tools required to address challenging hydrological problems. LIS integrates the use of several community land surface models, use of ground and satellite based observations, data assimilation and uncertainty estimation techniques and high performance computing and data management tools to enable the assessment and prediction of hydrologic conditions at various spatial and temporal scales of interest. This presentation will focus on describing the results, challenges and lessons learned from the use of remote sensing data for improving land surface modeling, within LIS. More specifically, studies related to the improved estimation of soil moisture, snow and land surface temperature conditions through data assimilation will be discussed. The presentation will also address the characterization of uncertainty in the modeling process through Bayesian remote sensing and computational methods.

Kumar, Sujay V.↗

Photospheric Current Spikes and Their Possible Association with Flares - Results from an HMI Data Driven Model

A data driven, near photospheric magnetohydrodynamic model predicts spikes in the horizontal current density, and associated resistive heating rate per unit volume Q. The spikes appear as increases by orders of magnitude above background values in neutral line regions (NLRs) of active regions (ARs). The largest spikes typically occur a few hours to a few days prior to M or X flares. The spikes correspond to large vertical derivatives of the horizontal magnetic field. The model takes as input the photospheric magnetic field observed by the Helioseismic & Magnetic Imager (HMI) on the Solar Dynamics Observatory (SDO) satellite. This 2.5 D field is used to determine an analytic expression for a 3 D magnetic field, from which the current density, vector potential, and electric field are computed in every AR pixel for 14 ARs. The field is not assumed to be force-free. The spurious 6, 12, and 24 hour Doppler periods due to SDO orbital motion are filtered out of the time series of the HMI magnetic field for each pixel using a band pass filter. The subset of spikes analyzed at the pixel level are found to occur on HMI and granulation scales of 1 arcsec and 12 minutes. Spikes are found in ARs with and without M or X flares, and outside as well as inside NLRs, but the largest spikes are localized in the NLRs of ARs with M or X flares. The energy to drive the heating associated with the largest current spikes comes from bulk flow kinetic energy, not the electromagnetic field, and the current density is highly non-force free. The results suggest that, in combination with the model, HMI is revealing strong, convection driven, non-force free heating events on granulation scales, and that it is plausible these events are correlated with subsequent M or X flares. More and longer time series need to be analyzed to determine if such a correlation exists. Above an AR dependent threshold value of Q, the number of events N(Q) with heating rates greater than or equal to Q obeys a scale invariant power law distribution for each AR given by N(Q) varies Q(sup -s), where 0.40 less than or equal to S less than or equal to 0.53, with a mean and standard deviation across the 14 ARs of 0.47 and 0.045, showing there is little variation of S from one AR to another. These properties of N(Q) are in close agreement with those of the distribution N(E) for the total energy E of solar flares, determined from observations to be N(E) = constant x E(sup -alpha). From observations of nanoflares in the 0.7 to 4 MK range, and from observations of flares in hard X-rays, it is found that 0.51 less than or equal to alpha less than or equal to 0.57, and 0.4 less than or equal to alpha less than or equal to 0.6, respectively (Crosby et al. 1993, Sol. Phys., 143, 275; Aschwanden & Parnell 2002, ApJ, 572, 1048). Observations also show that, as is found here for the exponent S, there is little variation of alpha with AR (Wheatland 2000, ApJ, 532, 1209), indicating N(E) and N(Q) are largely independent of individual properties of ARs such as area, total magnetic flux, and distribution of current density (i.e. non-potentiality). Therefore the power law scaling of the photospheric heating rate Q computed here on granulation scales is essentially identical to that found for coronal observations of flare energies on scales 1-2 orders of magnitude larger. This suggests the physical mechanisms that cause Q and coronal flares are closely related. It seems likely that Q is the signature of a magnetic reconnection process in an energy range and volume orders of magnitude smaller than those of flares. In this context, at least the larger spikes in Q might be signatures of UV photospheric or lower chromospheric bombs in which plasma is heated to temperatures approximately 10(exp -5) K (Peter et al. 2014, Science 346, 1255726; Judge 2015, ApJ, 808, 116). In addition, lattice based avalanche simulations of flare energy release predict 0.4 less than or equal to alpha less than or equal to 0.5, while analytic, fractal-diffusive self-organized criticality models predict 0.4 less than or equal to alpha less than or equal to 0.67, in excellent agreement with observations, and the results presented here (Aschwanden & Parnell 2002, ApJ, 572, 1048; Aschwanden 2012, A&A, 539, A2; Aschwanden 2013, in "Self Organized Criticality Systems"; Aschwanden et al. 2016, SSR, 198, 47).

Goodman, Michael↗

Conductance Effects on Inner Magnetospheric Plasma Morphology: Model Comparisons with IMAGE EUV, MENA, and HENA Data

Modeling results of the inner magnetosphere showing the influence of the ionospheric conductance on the inner magnetospheric electric fields during the April 17, 2002 magnetic storm are presented. Kinetic plasma transport code results are analyzed in combination with observations of the inner magnetospheric plasma populations, in particular those from the IMAGE satellite. Qualitative and quantitative comparisons are made with the observations from EW, MENA, and HENA, covering the entire energy range simulated by the model (0 to 300 keV). The electric field description, and in particular the ionospheric conductance, is the only variable between the simulations. Results from the data-model comparisons are discussed, detailing the strengths and weaknesses of each conductance choice for each energy channel.

Liemohn, M.↗

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗

Requirements and principles for the implementation and construction of large-scale geographic information systems

This paper provides a brief survey of the history, structure and functions of 'traditional' geographic information systems (GIS), and then suggests a set of requirements that large-scale GIS should satisfy, together with a set of principles for their satisfaction. These principles, which include the systematic application of techniques from several subfields of computer science to the design and implementation of GIS and the integration of techniques from computer vision and image processing into standard GIS technology, are discussed in some detail. In particular, the paper provides a detailed discussion of questions relating to appropriate data models, data structures and computational procedures for the efficient storage, retrieval and analysis of spatially-indexed data.

Smith, Terence R.↗

Development of A Composite Drought Indicator for Operational Drought Monitoring in the MENA Region

This paper presents the composite drought indicator (CDI) that Jordanian, Lebanese, Moroccan, and Tunisian government agencies now produce monthly to support operational drought management decision making, and it describes their iterative co-development processes. The CDI is primarily intended to monitor agricultural and ecological drought on a seasonal time scale. It uses remote sensing and modelled data inputs, and it reflects anomalies in precipitation, vegetation, soil moisture, and evapotranspiration. Following quantitative and qualitative validation assessments, engagements with policymakers, and consideration of agencies’ technical and institutional capabilities and constraints, we made changes to CDI input data, modelling procedures, and integration to tailor the system for each national context. We summarize validation results, drought modelling challenges and how we overcame them through CDI improvements, and we describe the monthly CDI production process and outputs. Finally, we synthesize procedural and technical aspects of CDI development and reflect on the constraints we faced as well as trade-offs made to optimize the CDI for operational monitoring to support policy decision-making—including aspects of salience, credibility, and legitimacy—within each national context.

Karim Bergaoui↗

Combining Satellite and in Situ Data with Models to Support Climate Data Records in Ocean Biology

The satellite ocean color data record spans multiple decades and, like most long-term satellite observations of the Earth, comes from many sensors. Unfortunately, global and regional chlorophyll estimates from the overlapping missions show substantial biases, limiting their use in combination to construct consistent data records. SeaWiFS and MODIS-Aqua differed by 13% globally in overlapping time segments, 2003-2007. For perspective, the maximum change in annual means over the entire Sea WiFS mission era was about 3%, and this included an El NinoLa Nina transition. These discrepancies lead to different estimates of trends depending upon whether one uses SeaWiFS alone for the 1998-2007 (no significant change), or whether MODIS is substituted for the 2003-2007 period (18% decline, P less than 0.05). Understanding the effects of climate change on the global oceans is difficult if different satellite data sets cannot be brought into conformity. The differences arise from two causes: 1) different sensors see chlorophyll differently, and 2) different sensors see different chlorophyll. In the first case, differences in sensor band locations, bandwidths, sensitivity, and time of observation lead to different estimates of chlorophyll even from the same location and day. In the second, differences in orbit and sensitivities to aerosols lead to sampling differences. A new approach to ocean color using in situ data from the public archives forces different satellite data to agree to within interannual variability. The global difference between Sea WiFS and MODIS is 0.6% for 2003-2007 using this approach. It also produces a trend using the combination of SeaWiFS and MODIS that agrees with SeaWiFS alone for 1998-2007. This is a major step to reducing errors produced by the first cause, sensor-related discrepancies. For differences that arise from sampling, data assimilation is applied. The underlying geographically complete fields derived from a free-running model is unaffected by solar zenith angle requirements and obscuration from clouds and aerosols. Combined with in situ dataenhanced satellite data, the model is forced into consistency using data assimilation. This approach eliminates sampling discrepancies from satellites. Combining the reduced differences of satellite data sets using in situ data, and the removal of sampling biases using data assimilation, we generate consistent data records of ocean color. These data records can support investigations of long-term effects of climate change on ocean biology over multiple satellites, and can improve the consistency of future satellite data sets.

Gregg, Watson↗

Data-Driven Modeling and Optimization of Building Energy Consumption: a Case Study

Installing sensors and Building Automation Systems (BAS) allows controlling the facility operations while generating data that can be analyzed for model development. This work focuses on data-driven modeling of the building to optimize energy consumption. The City of Orlando aims to reduce its energy consumption so, they provided us access to their BAS for data and studying the operation of its facilities. We selected a mid-size pilot building to conduct data analysis and modeling. We develop an Application Programming Interface (API) to login to the servers and scrape data. The scraped data contains features ranging from environmental conditions to equipment activity. This dataset is a time series so, it's handled in accordance and analyzed to investigate patterns and relations between data points that help choose parameters for predictive models for building and equipment. Finally, the models are optimized to reduce the energy consumption of the facility.

Grover, Divas↗