Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Map reduce using coordination namespace hardware acceleration

A system and method for supporting data MapReduce operations in a tuple space/coordinated namespace (CNS) extended memory storage architecture. The system-wide CNS provides an efficient means for storing and communicating data generated by local processes running at the nodes, and coordinated to provide MapReduce operations in a multi-nodal system. A hardware accelerated mechanism supports map reduce sorting/shuffle operations and reduce operations according to an aggregate function. Local processes running at a node generate a tuple corresponding to data generated by a process, each tuple having a tuple name and tuple data value corresponding to the generated data. Each tuple is processed and stored at the node or another node, dependent upon its tuple name. Tuple records associated with a tuple name are accumulated at one or more nodes according to a linked list structure at each that is accessible via a hash table index pointer at the node.

Jacob, Philip↗

Transportation Electrification Load Development For a Renewable Future Analysis

Electrification of the transportation sector offers the opportunity to significantly reduce petroleum consumption. The transportation sector accounts for 70% of US petroleum consumption. The transition to electricity as a transportation fuel will create a new load for electricity generation. In support of a recent US Department of Energy funded activity that analyzed a future generation scenario with high renewable energy technology contributions, a set of regional hourly load profiles for electrified vehicles were developed for the 2010 to 2050 timeframe. These load profiles with their underlying assumptions will be presented in this paper. The transportation electrical energy was determined using regional population forecast data, historical vehicle per capita data, and market penetration growth functions to determine the number of plug-in electric vehicles (PEVs) in each analysis region. Two market saturation scenarios of 30% of sales and 50% of sales of PEVs consuming on average {approx}6 kWh per day were considered. Results were generated for 3109 counties and were consolidated to 134 Power Control Areas (PCA) for the use NREL's's regional generation planning analysis tool ReEDS. PEV aggregate load profiles from previous work were combined with vehicle population data to generate hourly loads on a regional basis. A transition from consumer-controlled charging toward utility-controlled charging was assumed such that by 2050 approximately 45% of the transportation energy demands could be delivered across 4 daily time slices under optimal control from the utility perspective. No other literature has addressed the potential flexibility in energy delivery to electric vehicles in connection with a regional power generation study. This electrified transportation analysis resulted in an estimate for both the flexible load and fixed load shapes on a regional basis that may evolve under two PEV market penetration scenarios. EVS25 Copyright.

02 PETROLEUM↗

Trade Study: Storing NASA HDF5/netCDF-4 Data in the Amazon Cloud and Retrieving Data Via Hyrax Server Data Server

This study explored three candidate architectures with different types of objects and access paths for serving NASA Earth Science HDF5 data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the study were: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and netCDF4 data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3). Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.We will describe the three architectures and the use cases along with performance results and recommendations for further work.

AWS cost↗

Validation of sea ice models using an uncertainty-based distance metric for multiple model variables: NEW METRIC FOR SEA ICE MODEL VALIDATION

Here, we implement a variance-based distance metric (D n ) to objectively assess skill of sea ice models when multiple output variables or uncertainties in both model predictions and observations need to be considered. The metric compares observations and model data pairs on common spatial and temporal grids improving upon highly aggregated metrics (e.g., total sea ice extent or volume) by capturing the spatial character of model skill. The D n metric is a gamma-distributed statistic that is more general than the χ 2 statistic commonly used to assess model fit, which requires the assumption that the model is unbiased and can only incorporate observational error in the analysis. The D n statistic does not assume that the model is unbiased, and allows the incorporation of multiple observational data sets for the same variable and simultaneously for different variables, along with different types of variances that can characterize uncertainties in both observations and the model. This approach represents a step to establish a systematic framework for probabilistic validation of sea ice models. The methodology is also useful for model tuning by using the D n metric as a cost function and incorporating model parametric uncertainty as part of a scheme to optimize model functionality. We apply this approach to evaluate different configurations of the standalone Los Alamos sea ice model (CICE) encompassing the parametric uncertainty in the model, and to find new sets of model configurations that produce better agreement than previous configurations between model and observational estimates of sea ice concentration and thickness.

58 GEOSCIENCES↗

Hexagonal Lattices of HIV Capsid Proteins Explored by Simulations Based on a Thermodynamically Consistent Model

HIV capsid proteins (CAs) may self-assemble into a variety of shapes under in vivo and in vitro conditions. Here, we employed simulations based on a residue-level coarse-grained (CG) model with full conformational flexibility to investigate hexagonal lattices, which are the underlying structural pattern for CA aggregations. Facilitated by enhanced sampling simulations to rigorously calculate CA dimerization and polymerization affinities, we calibrated our model to reproduce the experimentally measured affinities. Here using the calibrated model, we performed unbiased simulations on several large systems consisting of 1512 CA subunits, allowing reversible binding and unbinding of the CAs in a thermodynamically consistent manner. In one simulation, a preassembled hexagonal CA sheet developed spontaneous curvatures reminiscent of those observed in experiments, and the edges of the sheet exhibited local curvatures larger than those of the interior. In other simulations starting with randomly distributed CAs at different concentrations, existing CA assemblies grew by binding free capsomeres to the edges and by merging with other assemblies. At high CA concentrations, rapid establishment of predominant aggregates was followed by much slower adjustments toward more regular hexagonal lattices, with increasing numbers of intact CA hexamers and pentamers being formed. Our approach of adapting a general CG model to specific systems by using experimental binding data represents a practical and effective strategy for simulating and elucidating intricate protein aggregations.

59 BASIC BIOLOGICAL SCIENCES↗

Observed effects of soil organic matter content on the microwave intensity of soils

In order to determine the significance of organic matter content on the microwave emissivity of soils when estimating soil moisture, field experiments were conducted in which 1.4 GHz microwave emissivity data were collected over test plots of sandy loam soil with different organic matter levels (1.8, 4.0, and 6.1 percent) for a range of soil moisture values. Analyses of the observed data show only minor variation in microwave emissivity due to a change in organic matter content at a given moisture level for soils with similar texture and structure. Predictions of microwave emissivity made using a dielectric model for aggregated soils exhibit the same trends and type of response as the measured data when appropriate values for the input parameters were utilized.

Jackson, T. J.↗

Observed effects of soil organic matter content on the microwave emissivity of soils

In order to determine the significance of organic matter content on the microwave emissivity of soils when estimating soil moisture, field experiments were conducted in which 1.4 GHz microwave emissivity data were collected over test plots of sandy loam soil with different organic matter levels (1.8, 4.0, and 6.1 percent) for a range of soil moisture values. Analyses of the observed data show only minor variation in microwave emissivity due to a change in organic matter content at a given moisture level for soils with similar texture and structure. Predictions of microwave emissivity made using a dielectric model for aggregated soils exhibit the same trends and type of response as the measured data when appropriate values for the input parameters were utilized.

O'Neill, P. E.↗

The 2010 Desert Rats Science Operations Test: Outcomes and Lessons Learned

The Desert RATS 2010 Team tested a variety of science operations management techniques, applying experience gained during the manned Apollo missions and the robotic Mars missions. This test assessed integrated science operations management of human planetary exploration using real-time, tactical science operations to oversee daily crew science activities, and a night shift strategic science operations team to conduct strategic level assessment of science data and daily traverse results. In addition, an attempt was made to collect numerical metric data on the outcome of the science operations to assist test evaluation. The two most important outcomes were 1) the production of significant (almost overwhelming) volume of data produced during daily traverse operations with two rovers, advanced imaging systems and well trained, scientifically proficient crew-members, and 2) the degree to which the tactical team s interaction with the surface crew enhanced science return. This interaction depended on continuous real-time voice and data communications, and the quality of science return from any human planetary exploration mission will be based strongly on the aggregate interaction between a well trained surface crew and a dedicated science operations support team using voice and imaging data from a planet s surface. In addition, the scientific insight developed by both the science operations team and the crews could not be measurable by simple numerical quantities, and its value will be missed by a purely metric-based evaluation of test outcome. In particular, failure to recognize the critical importance of this qualitative type interaction may result in mission architecture choices that will reduce science return.

Eppler, D. B.↗

Automated Generation of Graph-based Cyber Threat Intel

With the advancement of AI technology and tools, specifically in the cybersecurity domain, both cyber defenders and threat actors are continuously adapting the use of these capabilities to expedite their operations. With this phenomenon, threat intelligence that is up to date, refreshable, and has relevant context to a specific threat becomes more and more important as it enables cybersecurity professionals to gain insight into relevant data and relationships to guide their operations. This project enables users to frequently aggregate threat intelligence from various sources, such as vendor vulnerability advisories affecting critical infrastructure, malware reports, and adversary writeups into a centralized, standardized database. The project utilizes the Structured Threat Intelligence eXpression (STIX) for a standardized, shareable threat intelligence data format and Neo4j as a graph database solution to store STIX nodes and relationships. Initial results of the project include datasets of over 8,000 nodes and 20,000 relationships extracted from over 500 data sources that have been released within the past month.

Threat Intelligence↗

Cationic Phospholipids Forming Cubic Phases: Lipoplex Structure and Transfection Efficiency

The transfection activity and the phase behavior of two novel cationic O-alkyl-phosphatidylcholines, 1,2-dioleoyl-sn-glycero-3-hexylphosphocholine (C6-DOPC) and 1,2-dierucoyl-sn-glycero-3-ethylphosphocholine (di22:1-EPC), have been examined with the aim of more completely understanding the mechanism of lipid-mediated DNA delivery. Both lipids form cubic phases: C6-DOPC in the entire temperature range from -10 to 90 C, while di22:1-EPC exhibits an irreversible lamellar-cubic transition between 50 and 70 C on heating. The lipoplexes formed by C6-DOPC arrange into hexagonal phase, while the lipoplexes of di22:1-EPC are lamellar. Both lipids exhibit lower transfection activity than the lamellar-forming 1,2-dioleoyl-sn-glycero-3-ethylphosphocholine (EDOPC). Thus, for the studied cationic phospholipid-DNA systems, the lipoplex phase state is a factor that does not seem to correlate with transfection activity. The parameter that exhibits better correlation with the transfection activity within the present data set is the phase state of the lipid dispersion prior to the addition of DNA. Thus, the lamellar lipid dispersion (EDOPC) produces more efficient lipoplexes than the dispersion with coexisting lamellar and cubic aggregates (diC22:1-EPC), which is even more efficient than the purely cubic dispersions (C6-DOPC; diC22:1-EPC after heating). It could be inferred from these data and from previous research that cubic phase lipid aggregates are unlikely to be beneficial to transfection. The lack of correlation between the phase state of lipoplexes and their transfection activity observed within the present data set does not mean that lipid phase state is generally unimportant for lipofection: a viewpoint now emerging from our previous studies is that the critical factor in lipid-mediated transfection is the structural evolution of lipoplexes within the cell, upon interacting and mixing with cellular lipids.

59 BASIC BIOLOGICAL SCIENCES↗

Reasoning Service Exemplars for NASA’s Data and Reasoning Fabric

Future operations for Urban and Advanced Air Mobility are enabled by a distributed network of reliable and secured data and reasoning services referred to here as a fabric. In the aggregate, such a system must be all encompassing and mission agnostic, but specific use-cases are still needed to improve understanding and drive design paradigms. For this purpose, three reasoning service exemplars for Target Selection and Routing, Trajectory Generation, and Battery Health Management were developed and integrated into a specific NASA proposed data and reasoning fabric. These services were then used to build a mission reasoning application for lightning strike reconnaissance developed in collaboration with the Civil Air Patrol. Autonomous mission execution was then demonstrated using a multivehicle simulation platform with a full envelope 6 Degree-of-Freedom dynamics model for a concept electric Vertical Takeoff and Landing aircraft.

Autonomy↗

The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?

The PALS Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predictions from different land surface models, at a broad range of flux tower sites using common evaluation metrics, was on average worse than relatively simple empirical models. For sensible heat fluxes, all land surface models were outperformed by a linear regression against downward shortwave radiation. For latent heat flux, all land surface models were outperformed by a regression against downward shortwave, surface air temperature and relative humidity. These results are explored here in greater detail and possible causes are investigated. We examine whether particular metrics or sites unduly influence the collated results, whether results change according to time-scale aggregation and whether a lack of energy conservation in flux tower data gives the empirical models an unfair advantage in the intercomparison. We demonstrate that energy conservation in the observational data is not responsible for these results. We also show that the partitioning between sensible and latent heat fluxes in LSMs, rather than the calculation of available energy, is the cause of the original findings. In conclusion, we present evidence suggesting that the nature of this partitioning problem is likely shared among all contributing LSMs. While we do not find a single candidate explanation for why land surface models perform poorly relative to empirical benchmarks in PLUMBER, we do exclude multiple possible explanations and provide guidance on where future research should focus.

54 ENVIRONMENTAL SCIENCES↗

Sensitivity of geographic information system outputs to errors in remotely sensed data

The sensitivity of the outputs of a geographic information system (GIS) to errors in inputs derived from remotely sensed data (RSD) is investigated using a suitability model with per-cell decisions and a gridded geographic data base whose cells are larger than the RSD pixels. The process of preparing RSD as input to a GIS is analyzed, and the errors associated with classification and registration are examined. In the case of the model considered, it is found that the errors caused during classification and registration are partially compensated by the aggregation of pixels. The compensation is quantified by means of an analytical model, a Monte Carlo simulation, and experiments with Landsat data. The results show that error reductions of the order of 50% occur because of aggregation when 25 pixels of RSD are used per cell in the geographic data base.

Ramapriyan, H. K.↗

Multi-decade high-resolution regional hindcasts for wave energy resource characterization in U.S. coastal waters

Long-term, high-resolution, regional wave hindcast datasets were generated using unstructured-grid Simulating WAves Nearshore (SWAN) models for the U.S. coastal waters to support nearshore wave energy development in the U.S. including those bordering U.S. territorial islands. The model domains resolved the entire U.S. exclusive economic zones, with a spatial resolution of approximately 200 m nearshore. The regional SWAN models were driven by the global WAVEWATCH III® model outputs and run for a 42-year period from 1979 to 2020. Extensive model validations were performed using buoy observations and altimeter data. Regional resource characterization was performed based on hindcast data points at 2 km from shore and along the 100 m isobath. Aggregations of wave resource parameters were produced, and spatial and seasonal variations were analyzed for all the regions. Wave resource metrics recommended by international standards, including a 3-hour time series of six resource parameters, hourly frequency- and directionally resolved wave spectra at selected “virtual buoy” locations, and average-annual values of omni-directional wave power, significant wave height, and energy period are publicly disseminated through an Amazon Web Service and a Marine Energy Atlas web application tool to facilitate wave energy research and a wide range of coastal ocean applications.

16 TIDAL AND WAVE POWER↗

The Role of the NASA Global Hawk Link Module as an Information Nexus For Atmospheric Mapping Missions

The Link Module described in this paper was developed for the NASA Uninhabited Aerial System (UAS) Global Hawk Pacific Mission (GloPAC) Airborne Science Campaign; four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). It was used again during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link Module negotiated all communication over the high bandwidth Ku satellite link, archived all the science data from onboard experiments in a spatially enabled database, routed command and control of the instruments from the Global Hawk Operations Center, and re-transmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. The Link Module NG now being flown in support of the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (A TTREX) mission, has advanced data fusion technologies that are further advancing the Scientific productivity, flexibility and robustness of these systems. On-the-fly traffic shaping has been developed to allow the high definition video, used for critical flight control segments, to dynamically allocate variable bandwidth on demand. Historically, the Link Module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990' s. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the answer to the challenges imposed by extremely long duration UASs, with on-board multi-instrument (>= 12) Sensor Webs.

Hurricanes↗

Proceedings of Technical Sessions, Volumes 1 and 2: the LACIE Symposium

The technical design of the Large Area Crop Inventory Experiment is examined and data acquired over 3 global crop years is analyzed with respect to (1) sampling and aggregation; (2) growth size estimation; (3) classification and mensuration; (4) yield estimation; and (5) accuracy assessment. Seventy-nine papers delivered at conference sessions cover system implementation and operation; data processing systems; experiment results and accuracy; supporting research and technology; and the USDA application test system.

Source record↗

Constructing an AIRS Climatology for Data Visualization and Analysis to Serve the Climate Science and Application Communities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for NASA sounders: the present Aqua AIRS mission and the succeeding SNPP CrIS mission. The AIRS mission is entering its 15th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. The GES DISC, in collaboration with the AIRS Project, released product from the version 6 algorithm in early 2013. Giovanni, a Web-based application developed by the GES DISC, provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download the data. Most important variables from version 6 AIRS product are available in Giovanni. We are developing a climatology product using 14-year AIRS retrievals. The study can be a good start for the long term climatology from NASA sounders: the AIRS and the succeeding CrIS. This presentation will show the impacts to the climatology product from different aggregation methods. The climatology can serve climate science and application communities in data visualization and analysis, which will be demonstrated using a variety of functions in version 4 Giovanni. The highlights of these functions include user-defined monthly and seasonal climatology, inter annual seasonal time series, anomaly analysis.

AIRS↗

An Information NEXUS: The NASA Global Hawk Link Module

The Link Module described in this paper was first developed for the NASA Global Hawk Pacific Mission (GloPAC), four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). Its second use was during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link module negotiated all communication over the high bandwidth Ku satellite link, archived al the science data from onboard experiments in a spatially enable database, routed command and control of the instruments from the Global Hawk Operations Center, and retransmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. Also described is the next generation Link Module now being designed and tested to support the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (ATTREX) mission. Advanced data fusion technologies being developed will further advance the Scientific productivity, flexibility and robustness of these systems. Historically, the Link module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990's. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the next step in the evolution, a multi board system packaged in a Curtiss Wright MIL-spec, flight qualified enclosure.

Remote Sensing↗