Search NASA⌕ Search

SEARCH · Search NASA

Results for “data models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Hybrid methods for cybersecurity analysis :

Early 2010 saw a signi cant change in adversarial techniques aimed at network intrusion: a shift from malware delivered via email attachments toward the use of hidden, embedded hyperlinks to initiate sequences of downloads and interactions with web sites and network servers containing malicious software. Enterprise security groups were well poised and experienced in defending the former attacks, but the new types of attacks were larger in number, more challenging to detect, dynamic in nature, and required the development of new technologies and analytic capabilities. The Hybrid LDRD project was aimed at delivering new capabilities in large-scale data modeling and analysis to enterprise security operators and analysts and understanding the challenges of detection and prevention of emerging cybersecurity threats. Leveraging previous LDRD research e orts and capabilities in large-scale relational data analysis, large-scale discrete data analysis and visualization, and streaming data analysis, new modeling and analysis capabilities were quickly brought to bear on the problems in email phishing and spear phishing attacks in the Sandia enterprise security operational groups at the onset of the Hybrid project. As part of this project, a software development and deployment framework was created within the security analyst work ow tool sets to facilitate the delivery and testing of new capabilities as they became available, and machine learning algorithms were developed to address the challenge of dynamic threats. Furthermore, researchers from the Hybrid project were embedded in the security analyst groups for almost a full year, engaged in daily operational activities and routines, creating an atmosphere of trust and collaboration between the researchers and security personnel. The Hybrid project has altered the way that research ideas can be incorporated into the production environments of Sandias enterprise security groups, reducing time to deployment from months and years to hours and days for the application of new modeling and analysis capabilities to emerging threats. The development and deployment framework has been generalized into the Hybrid Framework and incor- porated into several LDRD, WFO, and DOE/CSL projects and proposals. And most importantly, the Hybrid project has provided Sandia security analysts with new, scalable, extensible analytic capabilities that have resulted in alerts not detectable using their previous work ow tool sets.

Dunlavy, Daniel M.↗

Modeling Transient Soil Moisture Limitations on Microbial Carbon Respiration

Soil microorganisms are known to survive periods of aridity and to recover rapidly after wetting events, with the ability to transition between a dormant state in dry conditions and an active state in wet conditions. While this dynamic behavior has been previously incorporated into soil carbon respiration modeling frameworks, a direct comparison between this active-dormant transition mechanism and a more simplified first-order model has yet to be made. Here, we demonstrate the necessary extent of model complexity needed to reproduce transient carbon respiration rates obtained from a set of soil incubation experiments implemented over a range of soil depths and time intervals. Two approaches are tested, one uses simplified first-order kinetics, whereas the other employs a transition between active and dormant biomass. The performance of each model is evaluated using an Akaike Information Criterion (AIC) based on the accuracy with which they reproduce an experimental dataset consisting of two sets of time series soil incubations collected across a range of time and depth resolutions. Based on the AIC evaluation and model-data comparison, we conclude that a dormancy-enabled model featuring two distinct microbial strategists performs best for the majority of the soil profile (above 108 cm) for both high and low depth resolution and sampling frequency, despite the added parameters required. In contrast, the first-order model achieves better AIC scores when simulating our deepest soils (112–165 cm), where moisture fluctuations are expected to be less prevalent. These findings guide how and where we choose to apply more cost intensive models.

58 GEOSCIENCES↗

Canopus: A Paradigm Shift Towards Elastic Extreme-Scale Data Analytics on HPC

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking on the current HPC software ecosystem. To that end, this paper develops Canopus, a progressive JPEGlike data management scheme for storing and analyzing big scientific data. It co-designs the data decimation, compression and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, Canopus provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. We evaluate the impact of Canopus on unstructured triangular meshes, a pervasive data model used by scientific modeling and simulations. In particular, we demonstrate the progressive data exploration of Canopus using the “blob detection” use case on the fusion simulation data.

Lu, Tao↗

Integrated Evaluation of Power Sector Decarbonization

MARKAL-PROMOD Integration presentation for USAEE conference on November 4, 2024. The presentation shows the construction of the MAGIIC translation tool to convert MARKAL capacity expansion to PROMOD model data, and PROMOD unit dispatch results to MARKAL technology availability data to allow a more robust analysis leveraging both modeling tools.

Sharma, Smriti↗

A Parallel Graph Environment for Real-World Data Analytics Workflows

Economic competitiveness and national security depend increasingly on the insightful analysis of large data sets. The diversity of real-world data sources and analytic workflows impose challenging hardware and software requirements for parallel graph platforms. The irregular nature of graph methods is not supported well by the deep memory hierarchies of conventional distributed systems, requiring new processor and runtime system designs to tolerate memory and synchronization latencies. Moreover, the efficiency of relational table operations and matrix computations are not attainable when data is stored in common graph data structures. In this paper, we present HAGGLE, a high-performance, scalable data analytics platform. The platform’s hybrid data model supports a variety of distributed, thread-safe data structures, parallel programming constructs, and persistent and streaming data. An abstract runtime layer enables us to map the stack to conventional, distributed computer systems with accelerators. The runtime uses multithreading, active messages, and data aggregation to hide memory and synchronization latencies on large-scale systems.

Graph Analytics↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

MLP-NN vs Gauss-Newton files

-Input files for randomly selected subset data (30 instances) from primary dipole-dipole forward modeling data.-Inversion results in surfer grid format as well as in .DAT format.-Scatterplots for MLP-NN vs Gauss-Newton present in the excel sheet.

58 GEOSCIENCES↗

The OVIS analysis architecture.

This report summarizes the current statistical analysis capability of OVIS and how it works in conjunction with the OVIS data readers and interpolators. It also documents how to extend these capabilities. OVIS is a tool for parallel statistical analysis of sensor data to improve system reliability. Parallelism is achieved using a distributed data model: many sensors on similar components (metaphorically sheep) insert measurements into a series of databases on computers reserved for analyzing the measurements (metaphorically shepherds). Each shepherd node then processes the sheep data stored locally and the results are aggregated across all shepherds. OVIS uses the Visualization Tool Kit (VTK) statistics algorithm class hierarchy to perform analysis of each process's data but avoids VTK's model aggregation stage which uses the Message Passing Interface (MPI); this is because if a single process in an MPI job fails, the entire job will fail. Instead, OVIS uses asynchronous database replication to aggregate statistical models. OVIS has several additional features beyond those present in VTK that, first, accommodate its particular data format and, second, improve the memory and speed of the statistical analyses. First, because many statistical algorithms are multivariate in nature and sensor data is typically univariate, interpolation of data is required to provide simultaneous observations of metrics. Note that in this report, we will refer to a single value obtained from a sensor as a measurement while a collection of multiple sensor values simultaneously present in the system is an observation. A base class for interpolation is provided that abstracts the operation of converting multiple sensor measurements into simultaneous observations. A concrete implementation is provided that performs piecewise constant temporal interpolation of multiple metrics across a single component. Secondly, because calculations may summarize data too large to fit in memory OVIS analyses batches of observations at a time and aggregates these intermediate intra-process models as it goes before storing the final model for inter-process aggregation via database replication. This reduces the memory footprint of the analysis, interpolation, and the database client and server query processing. This also interleaves processing with the disk I/O required to fetch data from the database - also improving speed. This report documents how OVIS performs analyses and how to create additional analysis components that fetch measurements from the database, perform interpolation, or perform operations on streamed observations (such as model updates or assessments). The rest of this section outlines the OVIS analysis algorithm and is followed by sections specific to each subtask. Note that we are limiting our discussion for now to the creation of a model from a set of measurements, and not including the assessment of observations using a model. The same framework can be used for assessment but that use case is not detailed in this report.

97 MATHEMATICS AND COMPUTING↗

Predictive Models of Li-ion Battery Lifetime (Presentation)

Predictive models of Li-ion battery reliability must consider a multiplicity of electrochemical, thermal and mechanical degradation modes experienced by batteries in application environments. Complicating matters, Li-ion batteries can experience several path dependent degradation trajectories dependent on storage and cycling history of the application environment. Rates of degradation are controlled by factors such as temperature history, electrochemical operating window, and charge/discharge rate. Lacking accurate models and tests, lifetime uncertainty must be absorbed by overdesign and warranty costs. Degradation models are needed that predict lifetime more accurately and with less test data. Models should also provide engineering feedback for next generation battery designs. This presentation reviews both multi-dimensional physical models and simpler, lumped surrogate models of battery electrochemical and mechanical degradation. Models are compared with cell- and pack-level aging data from commercial Li-ion chemistries. The analysis elucidates the relative importance of electrochemical and mechanical stress-induced degradation mechanisms in real-world operating environments. Opportunities for extending the lifetime of commercial battery systems are explored.

25 ENERGY STORAGE↗

Best Practices of Uncertainty Estimation for the National Solar Radiation Database (NSRDB 1998-2015): Preprint

It is essential to apply a traceable and standard approach to determine the uncertainty of solar resource data. Solar resource data are used for all phases of solar energy conversion projects, from the conceptual phase to routine solar power plant operation, and to determine performance guarantees of solar energy conversion systems. These guarantees are based on the available solar resource derived from a measurement station or modeled data set such as the National Solar Radiation Database (NSRDB). Therefore, quantifying the uncertainty of these data sets provides confidence to financiers, developers, and site operators of solar energy conversion systems and ultimately reduces deployment costs. In this study, we implemented the Guide to the Expression of Uncertainty in Measurement (GUM) 1 to quantify the overall uncertainty of the NSRDB data. First, we start with quantifying measurement uncertainty, then we determine each uncertainty statistic of the NSRDB data, and we combine them using the root-sum-of-the-squares method. The statistics were derived by comparing the NSRDB data to the seven measurement stations from the National Oceanic and Atmospheric Administration's Surface Radiation Budget Network, National Renewable Energy Laboratory's Solar Radiation Research Laboratory, and the Atmospheric Radiation Measurement program's Southern Great Plains Central Facility, in Billings, Oklahoma. The evaluation was conducted for hourly values, daily totals, monthly mean daily totals, and annual mean monthly mean daily totals. Varying time averages assist to capture the temporal uncertainty of the specific modeled solar resource data required for each phase of a solar energy project; some phases require higher temporal resolution than others. Overall, by including the uncertainty of measurements of solar radiation made at ground stations, bias, and root mean square error, the NSRDB data demonstrated expanded uncertainty of 17 percent - 29 percent on hourly and an approximate 5 percent - 8 percent annual bases.

14 SOLAR ENERGY↗

Capturing the variable reactivity of goethites in surface complexation modeling by correlating model parameters with specific surface area

The development of predictive tools capable of simulating adsorption behavior on goethite (α-FeOOH) surfaces has evolved over the past several decades. Recent research has focused on capturing the variation of surface reactivity and adsorption behavior for different preparations of synthetic goethites. Here in this research, an approach to estimate modeling parameters based on the specific surface area (SSA) of goethites was established and combined with a Charge Distribution – Multi-site Complexation (CD-MUSIC) surface complexation model. It was assumed that differences in crystal face contributions (CFC), inner-Helmholtz capacitances (C 1 ), and protonation constants of surface oxygens (pK a ’s) among different preparations of goethite contribute to the variation of surface reactivity. Thus, correlations of these modeling parameters with the SSA of a range of goethites were identified by comprehensively combining microscopic, macroscopic, and modeling data reported in literature along with adsorption data collected from macroscopic experiments conducted as part of this study. A CD-MUSIC model shown to be capable of accurately predicting adsorption for several metal ions and oxyanion selenite on a 62.9 m 2 /g SSA goethite served as the basis for the development of the adsorption modeling approach described in this paper. The predictive capability of the newly developed modeling approach was verified by comparing predictions of protons, SeO 3 2- , and Cd 2+ adsorption with experimental data from goethites with SSAs ranging between 21.3 and 105 m 2 /g; in total, 40 adsorption data sets from 13 different goethites were used for model verification. The results from this study indicate that the variation of surface reactivity of goethites can be successfully simulated by changing CFC, C 1 , and pK 2,singly (i.e. second protonation constant of singly-coordinated oxygens on the goethite surface) based on the SSA, which implies that self-consistent adsorption parameters can be applied to predict adsorption behavior over a range of goethite preparations.

58 GEOSCIENCES↗

Aggregate data‐driven dynamic modeling of active distribution networks with DERs for voltage stability studies

Abstract Electric distribution networks increasingly host distributed energy resources based on power electronic converter (PEC) toward active distribution networks (ADN). Despite advances in computational capabilities, electromagnetic transient models are limited in scalability because of their reliance on exact data about the distribution system and each of its components. Similarly, the use of the DER_A model, which is intended to examine the combined dynamic behavior of many DERs, is limited by the difficulty in parameterization. There is a need for improved dynamic models of DERs for use in large power system simulations for stability analysis. This paper proposes an aggregate model‐free, data‐driven approach for deriving a dynamic partitioned model (DPM) of ADNs. Detailed residential distribution feeders were first developed, including PEC‐based DERs and composite load models (CMLDs), from which the aggregated DPM was derived. The performance was evaluated through various case studies and validated against the detailed ADN model and state‐of‐the‐art DER_A model with CMLD. The data‐driven DPM achieved a of over 90%, accurately representing the aggregated dynamic behavior of ADNs. Furthermore, the DPM significantly accelerated the simulation process with a computational speedup of 68 times compared to the detailed ADN and a 3.5 times speedup compared to the DER_A CMLD model.

42 ENGINEERING↗

Discovering the Whole by the Coarse: A topological paradigm for data analysis

The increasing interest in big data applications is ushering in a large effort in seeking new, efficient, and adapted data models to reduce complexity, while preserving maximal intrinsic information. Graph-based models have recently been getting a lot of attention on account of their intuitive and direct connection to the data. The cost of these models, however, is to some extent giving up geometric insight as well as algebraic flexibility. Topology, as an intermediate analysis medium, focuses on coarse structures of an object/signal in general. It affords a formalism of transitioning from a local to a global description of an object, while providing significant information, which respects the local structure of measurements. It may also support a global visualization (e.g., data variation trends) and enhances the understanding of the underlying phenomenon. Throughout this article, measurements may be considered proximal in various ways, depending on the specific application, and the selected proximity metrics are subsequently used in the construction of a graph structure, thus highlighting various groups of neighboring data. As described later, these groups, often based on proximity criteria, are represented by n-simplices, where n + 1 corresponds to the number of points in an associated group. Collectively, they form what is (and will be throughout) referred to as a simplicial complex, a special representation of a topological space. We find the key advantage of computational topology is its inherently algebraic structure on the basic elements of the resulting graph-like structure.

97 MATHEMATICS AND COMPUTING↗

Locating Seismic Events with Local-Distance Data

As the seismic monitoring community advances toward detecting, identifying, and locating ever-smaller natural and anthropogenic events, the need is constantly increasing for higher resolution, higher fidelity data, models, and methods for accurately characterizing events. Local-distance seismic data provide robust constraints on event locations, but also introduce complexity due to the significant geologic heterogeneity of the Earth’s crust and upper mantle, and the relative sparsity of data that often occurs with small events recorded on regional seismic networks. Identifying the critical characteristics for improving local-scale event locations and the factors that impact location accuracy and reliability is an ongoing challenge for the seismic community. Using Utah as a test case, we examine three data sets of varying duration, finesse, and magnitude to investigate the effects of local earth structure and modeling parameters on local-distance event location precision and accuracy. We observe that the most critical elements controlling relocation precision are azimuthal coverage and local-scale velocity structure, with tradeoffs based on event depth, type, location, and range.

42 ENGINEERING↗