Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Challenge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Methods for Specifying Scientific Data Standards and Modeling Relationships with Applications to Neuroscience [Plus Supplementary Data]

Neuroscience continues to experience a tremendous growth in data; in terms of the volume and variety of data, the velocity at which data is acquired, and in turn the veracity of data. These challenges are a serious impediment to sharing of data, analyses, and tools within and across labs. Here, we introduce BRAINformat, a novel data standardization framework for the design and management of scientific data formats. The BRAINformat library defines application-independent design concepts and modules that together create a general framework for standardization of scientific data. We describe the formal specification of scientific data standards, which facilitates sharing and verification of data and formats. We introduce the concept of Managed Objects, enabling semantic components of data formats to be specified as self-contained units, supporting modular and reusable design of data format components and file storage. We also introduce the novel concept of Relationship Attributes for modeling and use of semantic relationships between data objects. Based on these concepts we demonstrate the application of our framework to design and implement a standard format for electrophysiology data and show how data standardization and relationship-modeling facilitate data analysis and sharing. The format uses HDF5, enabling portable, scalable, and self-describing data storage and integration with modern high-performance computing for data-driven discovery. The BRAINformat library is open source, easy-to-use, and provides detailed user and developer documentation and is freely available at: https://bitbucket.org/oruebel/brainformat.

60 APPLIED LIFE SCIENCES↗

Data from: Nitrogen fertilization challenges the climate benefit of cellulosic biofuels

Cellulosic biofuels are intended to improve future energy and climate security. Nitrogen (N) fertilizer is commonly recommended to stimulate yields but can increase losses of the greenhouse gas nitrous oxide (N2O) and other forms of reactive N, including nitrate. We measured soil N2O emissions and nitrate leaching along a switchgrass (Panicum virgatum) high resolution N-fertilizer gradient for three years post-establishment. Results revealed an exponential increase in annual N2O emissions that each year became stronger (R 2 > 0.9, P < 0.001) and deviated further from the fixed percentage assumed for IPCC Tier 1 emission factors. Concomitantly, switchgrass yields became less responsive each year to N fertilizer. Nitrate leaching (and calculated indirect N2O emissions) also increased exponentially in response to N inputs, but neither methane (CH4) uptake nor soil organic carbon changed detectably. Overall, N fertilizer inputs at rates greater than crop need curtailed the climate benefit of ethanol production almost two-fold, from a maximum mitigation capacity of −5.71 ± 0.22 Mg CO2e ha−1 yr−1 in switchgrass fertilized at 56 kg N ha−1 to only −2.97 ± 0.18 Mg CO2e ha−1 yr−1 in switchgrass fertilized at 196 kg N ha−1. Minimizing N fertilizer use will be an important strategy for fully realizing the climate benefits of cellulosic biofuel production.

09 BIOMASS FUELS↗

Comments on the challenge of using mesoscale data in mesoscale numerical models

The dangers of addressing the initialization issues for limited-area mesoscale models by extending the lessons learned during the development of global analysis and prediction systems are discussed. Lack of impact with data inserts at one time suggests that the lateral boundary conditions imposed on the limited-area models might force the model simulation toward a preferred solution, work against the new data being inserted into the model and, therefore, limit the potential impact that this data can have on the model system. The second potential pitfall involves the imposition of balance constraints on the data that are being inserted into the model to compute winds from temperature data and/or temperature from wind data.

Uccellini, Louis W.↗

Challenges of AVHRR Vegetation Data for Real Time Applications

Remote sensing data has long been used to monitor global ecosystems for floods and droughts and AVHRR data, as one of the first product, has many users interested in receiving the data within hours of acquisition. With the introduction of a new series of sensors in 2000 (the AVHRR/3 series), the quality of the NDVI datasets available for real time environmental monitoring has declined. This paper provides evidence of problems of cloud contamination, calibration and noise in the real time data which are not present in the historical AVHRR NDVIg dataset. These differences introduce significant uncertainty in the use of the real time data, degrading their utility for detecting climate variations in near real time.

Brown, Molly↗

The Human Dimension of Closing the Training Gap for Fifth-Generation Fighters

Based on a review of the recent technical literature there is little question that a serious training gap exists for fifth-generation fighters, primarily arising from the need to provide their own red-air. There are several methods for reducing this gap, including injecting virtual and constructive threats into the live cockpit. This live-virtual-constructive (LVC) training approach provides a cost effective means for addressing training needs but faces several challenges. Technical challenges include data links and information assurance. A more serious challenge may be the human factors dimension of representing virtual and constructive entities in the cockpit while ensuring safety-of-flight. This also needs to happen without increasing pilot workload. This paper discusses the methods Rockwell Collins and the University of Iowa's Operator Performance Lab use to assess pilot workload and training fidelity measures in an LVC training environment and the research we are conducting in safety-of-flight requirements of integrated LVC symbology.

Hoke, Jaclyn↗

Accelerating Space Life Sciences: Successes and Challenges of Biospecimen and Data Sharing

NASA's current human space flight research is directed towards enabling human space exploration beyond Low Earth Orbit (LEO). To that end, NASA Space Flight Payload Projects; Rodent Research, Cell Science, and Microbial Labs, flown on the International Space Station (ISS), benefit the global life sciences and commercial space communities. Verified data sets, science results, peer-reviewed publications, and returned biospecimens, collected and analyzed for flight and ground investigations, are all part of the knowledge base collected by NASA's Human Exploration and Operations Mission Directorate's Space Life and Physical Sciences Research and Applications (SLPSRA) Division, specifically the Human Research and Space Biology Programs. These data and biospecimens are made available through the public Life Sciences Data Archive (LSDA) website to promote basic discovery, pre-clinical and clinical science.The NASA Institutional Scientific Collection (ISC), stores flight and ground biospecimens from Space Shuttle and ISS programs. These specimens are curated and managed by the Ames Life Sciences Data Archive (ALSDA), an internal node of NASA's LSDA. The ISC stores over 30,000 specimens from experiments dating from 1984 to present. Currently available specimens include tissues from the circulatory, digestive, endocrine, excretory, integumentary, muscular, neurosensory, reproductive, respiratory and skeletal systems.NASA's biospecimen collection represents a unique and limited resource of unique spaceflight payload and ground control research subjects. These specimens are harvested according to well established SOPs that maintain their quality and integrity. Once the primary scientific objectives have been met, the remaining specimens are made available to provide secondary opportunities for complementary studies or new investigations to broaden research without large expenditures of time or resources. Website: https://lsda.jsc.nasa.gov/

Scott, Ryan T.↗

Comparative Analysis of Empirical and Machine Learning Models for Chla Extraction Using Sentinel-2 and Landsat OLI Data: Opportunities, Limitations, and Challenges

Remote retrieval of near-surface chlorophyll-a (Chla) concentration in small inland waters is challenging due to substantial optical interferences of various water constituents and uncertainties in the atmospheric correction (AC) process. Although various algorithms have been developed to estimate Chla from moderate-resolution terrestrial missions (∼10–60 m), the production of both accurate distribution maps and time series of Chla has proven challenging, limiting the use of remote analyses for lake monitoring. Here, we develop a support vector regression (SVR) model, which uses satellite-derived remote-sensing reflectance spectra () from Sentinel-2 and Landsat-8 images as input for Chla retrieval in a representative eutrophic prairie lake, Buffalo Pound Lake (BPL), Saskatchewan, Canada. Validated against in situ Chla from seven ice-free seasons (N ∼ 200; 2014–2020), the SVR model outperformed both locally tuned, -fed empirical models (Normalized Difference Chlorophyll Index, 2- and 3-band, and OC3) and Mixture Density Networks (MDNs) by 15–65%, while exhibiting comparable performance to a locally trained MDN, with an error of ∼35%. Comparison of Chla retrieval models, AC processors (iCOR, ACOLITE), and radiometric products (Rayleigh-corrected, surface, and top-of-atmosphere reflectance) showed that the best Chla maps and optimal time series (up to 100 mg m−3) were produced using a coupled SVR-iCOR system.

algal blooms↗

Building Simulation Modelers are we big-data ready?

Recent advances in computing and sensor technologies have pushed the amount of data we collect or generate to limits previously unheard of. Sub-minute resolution data from dozens of channels is becoming increasingly common and is expected to increase with the prevalence of non-intrusive load monitoring. Experts are running larger building simulation experiments and are faced with an increasingly complex data set to analyze and derive meaningful insight. This paper focuses on the data management challenges that building modeling experts may face in data collected from a large array of sensors, or generated from running a large number of building energy/performance simulations. The paper highlights the technical difficulties that were encountered and overcome in order to run 3.5 million EnergyPlus simulations on supercomputers and generating over 200 TBs of simulation output. This extreme case involved development of technologies and insights that will be beneficial to modelers in the immediate future. The paper discusses different database technologies (including relational databases, columnar storage, and schema-less Hadoop) in order to contrast the advantages and disadvantages of employing each for storage of EnergyPlus output. Scalability, analysis requirements, and the adaptability of these database technologies are discussed. Additionally, unique attributes of EnergyPlus output are highlighted which make data-entry non-trivial for multiple simulations. Practical experience regarding cost-effective strategies for big-data storage is provided. The paper also discusses network performance issues when transferring large amounts of data across a network to different computing devices. Practical issues involving lag, bandwidth, and methods for synchronizing or transferring logical portions of the data are presented. A cornerstone of big-data is its use for analytics; data is useless unless information can be meaningfully derived from it. In addition to technical aspects of managing big data, the paper details design of experiments in anticipation of large volumes of data. The cost of re-reading output into an analysis program is elaborated and analysis techniques that perform analysis in-situ with the simulations as they are run are discussed. The paper concludes with an example and elaboration of the tipping point where it becomes more expensive to store the output than re-running a set of simulations.

Sanyal, Jibonananda↗