Search NASA⌕ Search

SEARCH · Search NASA

Results for “science data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Blanco DECam Bulge Survey (BDBS) II: project performance, data analysis, and early science results

ABSTRACT The Blanco DECam Bulge Survey (BDBS) imaged more than 200 sq deg of the Southern Galactic bulge using the ugrizY filters of the Dark Energy Camera, and produced point spread function photometry of approximately 250 million unique sources. In this paper, we present details regarding the construction and collation of survey catalogues, and also discuss the adopted calibration and dereddening procedures. Early science results are presented with a particular emphasis on the bulge metallicity distribution function and globular clusters. A key result is the strong correlation (σ ∼ 0.2 dex) between (u − i)o and [Fe/H] for bulge red clump giants. We utilized this relation to find that interior bulge fields may be well described by simple closed box enrichment models, but fields exterior to b ∼ −6° seem to require a secondary metal-poor component. Applying scaled versions of the closed box model to the outer bulge fields is shown to significantly reduce the strengths of any additional metal-poor components when compared to Gaussian mixture models. Additional results include: a confirmation that the u band splits the subgiant branch in M22 as a function of metallicity, the detection of possible extratidal stars along the orbits of M 22 and FSR 1758, and additional evidence that NGC 6569 may have a small but discrete He spread, as evidenced by red clump luminosity variations in the reddest bands. We do not confirm previous claims that FSR 1758 is part of a larger extended structure.

Johnson, Christian I.↗
DOE OSTI2021

OpenOA: An Open-Source Codebase For Operational Analysis of Wind Farms

OpenOA is an open source framework for operational data analysis of wind energy plants, implemented in the Python programming language. OpenOA provides a common data model, high level analysis workflows, and low-level convenience functions that engineers, analysts, and researchers in the wind energy industry can use to facilitate analytics workflows on operational data sets. OpenOA contains documentation, worked out examples in Jupyter notebooks, and a corresponding example dataset from the Engie Renewable’s La Haute Borne Dataset.

17 WIND ENERGY↗
DOE OSTI2020

2020 Multiscale Microbial Dynamics Modeling Course

The 2020 Multiscale Microbial Dynamics course is adapted from the virtual 2020 Mutliscale Microbial Dynamics Summer School that was hosted by Environmental Molecular Sciences Laboratory (EMSL), a U.S. Department of Energy (DOE) science user facility located on the Pacific Northwest National Laboratory (PNNL) campus, in collaboration with the Joint Genome Institute (JGI) and the DOE Systems Biology Knowledgebase (KBase). The course course covers how to incorporate microbial metagenomic and environmental metabolite data from watershed ecosystems into metabolic and community modeling using computational frameworks, such as KBase and PFLOTRAN. The curriculum includes lectures and software and data analysis tutorials. All materials are freely accessible to the community as part of the 2020 Microbial Dynamics Summer School Organization in KBase.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The Astronomy Commons Platform: A Deployable Cloud-based Analysis Platform for Astronomy

Abstract We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular data sets. The presented platform is built on Amazon Web Services (over Kubernetes and S3 abstraction layers), utilizes Apache Spark and the Astronomy eXtensions for Spark for parallel data analysis and manipulation, and provides the familiar JupyterHub web-accessible front end for user access. We outline the architecture of the analysis platform, provide implementation details and rationale for (and against) technology choices, verify scalability through strong and weak scaling tests, and demonstrate usability through an example science analysis of data from the Zwicky Transient Facility’s 1Bn+ light-curve catalog. Furthermore, we show how this system enables an end user to iteratively build analyses (in Python) that transparently scale processing with no need for end-user interaction. The system is designed to be deployable by astronomers with moderate cloud engineering knowledge, or (ideally) IT groups. Over the past 3 yr, it has been utilized to build science platforms for the DiRAC Institute, the ZTF partnership, the LSST Solar System Science Collaboration, and the LSST Interdisciplinary Network for Collaboration and Computing, as well as for numerous short-term events (with over 100 simultaneous users). In a live demo instance, the deployment scripts, source code, and cost calculators are accessible. 4 4 http://hub.astronomycommons.org/

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

COMBIgor: Data-Analysis Package for Combinatorial Materials Science

Combinatorial experiments involve synthesis of sample libraries with lateral composition gradients requiring spatially-resolved characterization of structure and properties. Here, due to maturation of combinatorial methods and their successful application in many fields, the modern combinatorial laboratory produces diverse and complex data sets requiring advanced analysis and visualization techniques. In order to utilize these large data sets to uncover new knowledge, the combinatorial scientist must engage in data science. For data science tasks, most laboratories adopt common-purpose data management and visualization software. However, processing and cross-correlating data from various measurement tools is no small task for such generic programs. Here we describe COMBIgor, a purpose-built open-source software package written in the commercial Igor Pro environment, designed to offer a systematic approach to loading, storing, processing, and visualizing combinatorial data sets. It includes (1) methods for loading and storing data sets from combinatorial libraries, (2) routines for streamlined data processing, and (3) data analysis and visualization features to construct figures. Most importantly, COMBIgor is designed to be easily customized by a laboratory, group, or individual in order to integrate additional instruments and data-processing algorithms. Utilizing the capabilities of COMBIgor can significantly reduce the burden of data management on the combinatorial scientist.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

NGEE Arctic Rainfall Simulator Validation Data from Los Alamos National Laboratory, New Mexico, Summer 2022

Experiments evaluating the uniformity and intensity of rainfall produced by the NGEE Arctic Rainfall Simulator (NARS) were conducted at Los Alamos National Laboratory, New Mexico, over summer 2022. Petri dishes were placed in a grid within the NARS plot. Simulated rainfall was collected in each petri dish and the intensity and uniformity of the simulator was subsequently calculated. This data package contains two .csv files, one that summarizes the rainfall intensity and uniformity for each experiment, the other that contains individual petri dish water volume and intensity for each plot location and experiment. The Python scripts to control NARS are also included. The NGEE Arctic Rainfall Simulator (NARS) is a variable intensity rainfall simulator (RFS) with a frame design based on the Humphry et al. (2002) RFS and a water delivery system based on the Walnut Gulch (Paige et al., 2004) RFS. The NARS uses an aluminum frame that is fully deconstructable for transportation to field locations and a water system that enables variable rain intensity. Rain intensity control and data collection are automated using a Raspberry Pi microcomputer. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Nevada National Security Site Site-Directed Research and Development Report (FY 2018 Annual Report)

This report compiles multiple articles describing activities developed and performed under the Site-Directed Research and Development Program for the benefit the Nation during Fiscal Year 2018. Sustained investment and ongoing core innovation are the keys to successful research and development programs. These elements drive the Site-Directed Research and Development (SDRD) Program and provide solutions to some of the most challenging problems our nation and our allies face. Our Nevada enterprise, consisting of both our management and operating entity and our NNSA field office, is aggressively investing in SDRD and injecting innovation through strategic partnerships. Our partnerships with universities, industry, and our sister institutions within the National Nuclear Security Administration (NNSA) build upon our core capabilities and allow us to create innovative solutions to support our mission requirements. In 2018, we raised the investment level of SDRD for only the second time in the history of the program. Nearly at our congressionally authorized limit, SDRD has substantial resources to successfully address numerous issues. Investment is only one part of the equation; innovation is generated through collaborations that bring discovery and provide the “technical differentiation” and the return on investment we seek. This report demonstrates an enduring theme of how partnerships help us drive the best outcomes and provide the maximum impact possible, while using our resources efficiently.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A Co-design Framework for Online Data Analysis and Reduction

Science applications preparing for the exascale era are increasingly exploring in situ computations comprising of simulation-analysis-reduction pipelines coupled in-memory. Efficient composition and execution of such complex pipelines for a target platform is a codesign process that evaluates the impact and tradeoffs of various application- and system-specific parameters. In this article, we describe a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for composing parametric studies on coupled applications, and Savanna, a runtime engine for orchestrating and executing campaigns of codesign experiments. Furthermore, this toolset facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage versus compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design of Cheetah and Savanna, and present application examples that use this framework to conduct codesign studies on small clusters as well as leadership class supercomputers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

DES science portal: Creating science-ready catalogs

We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Green space definition affects associations of green space with overweight and physical activity

Highlights: • Associations of different green space definitions differ considerably. • Distance to park was not associated with being overweight. • Surrounding greenness was non-linearly associated with being overweight. • Associations were generally non-significant for the more urban population. In epidemiological studies, exposure to green space is inconsistently associated with being overweight and physical activity, possibly because studies differ widely in their definition of green space exposure, inclusion of important confounders, study population and data analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Wide-field lensing mass maps from Dark Energy Survey science verification data: Methodology and detailed analysis

Weak gravitational lensing allows one to reconstruct the spatial distribution of the projected mass density across the sky. These “mass maps” provide a powerful tool for studying cosmology as they probe both luminous and dark matter. In this paper, we present a weak lensing mass map reconstructed from shear measurements in a 139 deg 2 area from the Dark Energy Survey (DES) science verification data. We compare the distribution of mass with that of the foreground distribution of galaxies and clusters. The overdensities in the reconstructed map correlate well with the distribution of optically detected clusters. We demonstrate that candidate superclusters and voids along the line of sight can be identified, exploiting the tight scatter of the cluster photometric redshifts. We cross-correlate the mass map with a foreground magnitude-limited galaxy sample from the same data. Our measurement gives results consistent with mock catalogs from N-body simulations that include the primary sources of statistical uncertainties in the galaxy, lensing, and photo-z catalogs. The statistical significance of the cross-correlation is at the 6.8σ level with 20 arcminute smoothing. We find that the contribution of systematics to the lensing mass maps is generally within measurement uncertainties. In this study, we analyze less than 3% of the final area that will be mapped by the DES; the tools and analysis techniques developed in this paper can be applied to forthcoming larger data sets from the survey.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Note: Optimization of the numerical data analysis for conductivity percolation studies of drying moist porous systems

A simplified data analysis protocol, for dielectric spectroscopy use to study conductivity percolation in dehydrating granular media is discussed. To enhance visibility of the protonic conductivity contribution to the dielectric loss spectrum, detrimental effects of either low-frequency dielectric relaxation or electrode polarization are removed. Use of the directly measurable monofrequency dielectric loss factor rather than estimated DC conductivity to parameterize the percolation transition substantially reduces the analysis work and time.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Integrating HPC, AI, and Workflows for Scientific Data Analysis: Report from Dagstuhl Seminar 23352

The Dagstuhl Seminar 23352, titled “Integrating HPC, AI, and Workflows for Scientific Data Analysis,” held from August 27 to September 1, 2023, was a significant event focusing on the synergy between High-Performance Computing (HPC), Artificial Intelligence (AI), and scientific workflow technologies. The seminar recognized that modern Big Data analysis in science rests on three pillars: workflow technologies for reproducibility and steering, AI and Machine Learning (ML) for versatile analysis, and HPC for handling large data sets. These elements, while crucial, have traditionally been researched separately, leading to gaps in their integration. The seminar aimed to bridge these gaps, acknowledging the challenges and opportunities at the intersection of these technologies. The event highlighted the complex interplay between HPC, workflows, and ML, noting how ML has increasingly been integrated into scientific workflows, thereby enhancing resource demands and bringing new requirements to HPC architectures, like support for GPUs and iterative computations. The seminar also addressed the challenges in adapting HPC for large-scale ML tasks, including in areas like deep learning, and the need for workflow systems to evolve to leverage ML in data analysis fully. Moreover, the seminar explored how ML could optimize scientific workflow systems and HPC operations, such as through improved scheduling and fault tolerance. A key focus was on identifying prestigious use cases of ML in HPC and understanding their unique, unmet requirements. The stochastic nature of ML and its impact on the reproducibility of data analysis on HPC systems was also a topic of discussion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Retrospective on decadal progress of the NOAA/NPS ocean noise reference station network

The National Oceanic and Atmospheric Administration (NOAA), in partnership with the U.S. National Park Service (NPS), established the Ocean Noise Reference Station Network (NRS) in 2014 as a foundational component of NOAA’s Ocean Noise Strategy. This long-term effort aims to characterize baseline ocean ambient sound conditions across diverse marine environments and to inform management of noise impacts on protected species and habitats within U.S. waters. The NRS is now composed of 13 autonomous passive acoustic monitoring stations strategically positioned across the U.S. Exclusive Economic Zone (EEZ), extending from Arctic regions to tropical waters in depths ranging from 33 to 4,790 m. These locations include several National Marine Sanctuaries and National Parks, such as the recently designated Chumash Heritage National Marine Sanctuary off the coast of California. Each station is equipped to continuously sample low-frequency underwater sound at five kHz, enabling the detection of anthropogenic, geophysical, and biological acoustic signals. To date the network has sampled over 72 years of calibrated acoustic data. The spatial breadth and consistent methodology of the NRS allow for comparative acoustic assessments across diverse marine ecosystems. In addition to applied research functions, the NRS has served as a platform for education and training, offering opportunities for students to develop skills for marine science and data analysis. Looking forward, the NRS project team is focused on network expansion, improved data delivery, and broader integration with collaborative scientific initiatives. NRS recordings are being archived in partnership with NOAA’s National Centers for Environmental Information to enhance accessibility and long-term utility. Efforts are underway to develop standardized metadata and summary products to accompany raw audio files, making the data more usable for a wide range of stakeholders in the ocean science community. The NRS is evolving into a fully integrated national framework for ocean sound monitoring that supports scientific inquiry, management decision-making, national security interests, and public engagement with ocean acoustic environments.

Long-term monitoring↗
DOE OSTI2016

Analysis of soil eDNA functional genes: potential to increase profitability and sustainability of pastoral agriculture

Management of soil biological resources to optimise plant production, efficiency of nutrient inputs, and system sustainability is an emerging opportunity for pastoral agriculture. To attain these goals, suitable tools that can assess the functional state of the soil ecosystem must be developed and standardised approaches to their application adopted. Towards this end, we have undertaken comprehensive, high-density functional-gene microarray analysis (GeoChip5) of environmental DNA (eDNA) extracted from 50 pastoral soils. When combined with soil, environmental and management metadata, the information can be used to provide insights into soil biological processes spanning greenhouse gas emissions, through to natural suppression of plant root diseases. To give an example of a structured workflow of analysis in a pastoral system context, we analysed the GeoChip data using a combination of approaches spanning routine univariate methods through to more complex multivariate and network-based analysis. Analyses were restricted to comparing effects of land-use (dairy or ‘other’ farming systems), and exploring relationships of the GeoChip data with the soil properties from each sample. These exemplar analyses introduce a pathway for the application of eDNA approaches (GeoChip or others) to deliver outcomes for pastoral agricultural in New Zealand.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Statistics on magnetic properties of Co compounds: A database-driven method for discovering Co-based ferromagnets

The search for new ferromagnetic compounds is often targeted at known structure families, particularly those containing iron, cobalt, and manganese. Here, we propose a method to expand this search to lesser-known structure types, using a database of experimental Curie and Néel temperatures. This study, in particular, illustrates the case of compounds containing the element cobalt, and we demonstrate how the use of such a database can lead to the discovery of ferromagnetic materials that had previously been overlooked. We report statistics from a literature survey of the magnetic properties of Co-based compounds with more than 33 at. % Co. We classify more than 13 000 compounds by structure type, cobalt content, and magnetic ground state. From these data, compounds TaCo 2 Ga, La 6 Co 13 Bi, and Nd 2 Co 3 were identified as potential ferromagnets, and we confirm their ferromagnetic ordering theoretically via first-principles calculations and experimentally via synthesis and characterization measurements. In addition, the analysis is focused on the collection of data trends and discovery of ferromagnetic materials with easy-axis magnetic anisotropy. Both known ferromagnetic materials with unknown magnetic anisotropy, and unstudied compounds were considered. From the subset of known ferromagnets with unknown anisotropy, the compound Co 2 Mg was synthesized, characterized, and determined to have easy-axis magnetic anisotropy at room temperature.

36 MATERIALS SCIENCE↗
DOE OSTI2017

PRRT2 inhibits the proliferation of glioma cells by modulating unfolded protein response pathway

Accumulating studies reported mutations in the gene encoding the proline-rich transmembrane protein 2 (PRRT2) to be causative for several paroxysmal neurological disorders, including paroxysmal kinesigenic dyskinesia (PKD), PKD combined with infantile seizures (ICCA), and benign familial infantile seizures (BFIS). However, the impact of PRRT2 in tumorigenesis is not known. Based on a large-scale data analysis, we found that PRRT2 was down-regulated in glioma tumor tissues compared with normal brain tissue. Dysregulation of PRRT2 was not induced by mutation, copy number variation and epigenetic modification, but modulated by microRNA-30a-5p. Overexpression of PRRT2 strongly impaired the cell viability and promoted cell apoptosis and these anti-tumor effects could be largely reversed by microRNA-30a-5p. Mechanistically, PRRT2 expression was closely correlated genes involved in unfolded protein response (UPR) pathway and introduction of PRRT2 inhibited gene expression in the three branches of UPR, including PERK axis, IRE1 axis and ATF6 axis. Taken together, our findings identify PRRT2 as a tumor suppressor in glioma and provide a promising target for potential therapeutic intervention. - Highlights: • PRRT2 is decreased in glioma and is targeted by miR-30a-5p. • PRRT2 exhibits tumor-suppressive effects on glioma cells. • PRRT2 correlates genes involved in unfolded protein response. • Over-expressed PRRT2 induces unfolded protein response in glioma in vitro.

60 APPLIED LIFE SCIENCES↗