MPDV Analysis: Inside the Black Box
Presentation describes the complexity of MPDV analysis and available tools and approaches to improve the process, to include combinations of text data, visualizations, and spreadsheets.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Presentation describes the complexity of MPDV analysis and available tools and approaches to improve the process, to include combinations of text data, visualizations, and spreadsheets.
The Basic Energy Sciences (BES) X-ray and neutron user facilities attract more than 12,000 researchers each year to perform cutting-edge science at these state-of-the-art sources. While impressive breakthroughs in X-ray and neutron sources give us the powerful illumination needed to peer into the nano- to mesoscale world, a stumbling block continues to be the distinct lag in detector development, which is slowing progress toward data collection and analysis. Urgently needed detector improvements would reveal chemical composition and bonding in 3-D and in real time, allow researchers to watch “movies” of essential life processes as they happen, and make much more efficient use of every X-ray and neutron produced by the source The immense scientific potential that will come from better detectors has triggered worldwide activity in this area. Europe in particular has made impressive strides, outpacing the United States on several fronts. Maintaining a vital U.S. leadership in this key research endeavor will require targeted investments in detector R&D and infrastructure. To clarify the gap between detector development and source advances, and to identify opportunities to maximize the scientific impact of BES user facilities, a workshop on Neutron and X-ray Detectors was held August 1-3, 2012, in Gaithersburg, Maryland. Participants from universities, national laboratories, and commercial organizations from the United States and around the globe participated in plenary sessions, breakout groups, and joint open-discussion summary sessions. Sources have become immensely more powerful and are now brighter (more particles focused onto the sample per second) and more precise (higher spatial, spectral, and temporal resolution). To fully utilize these source advances, detectors must become faster, more efficient, and more discriminating. In supporting the mission of today’s cutting-edge neutron and X-ray sources, the workshop identified six detector research challenges (and two computing hurdles that result from the corresponding increase in data volume) for the detector community to overcome in order to realize the full potential of BES neutron and X-ray facilities. Resolving these detector impediments will improve scientific productivity both by enabling new types of experiments, which will expand the scientific breadth at the X-ray and neutron facilities, and by potentially reducing the beam time required for a given experiment. These research priorities are summarized in the table below. Note that multiple, simultaneous detector improvements are often required to take full advantage of brighter sources. High-efficiency hard X-ray sensors: The fraction of incident particles that are actually detected defines detector efficiency. Silicon, the most common direct-detection X-ray sensor material, is (for typical sensor thicknesses) 100% efficient at 8 keV, 25%efficient at 20 keV, and only 3% efficient at 50 keV. Other materials are needed for hard X-rays. Replacement for 3He for neutron detectors: 3He has long been the neutron detection medium of choice because of its high cross section over a wide neutron energy range for the reaction 3He + n —> 3H + 1H + 0.764 MeV. 3He stockpiles are rapidly dwindling, and what is available can be had only at prohibitively high prices. Doped scintillators hold promise as ways to capture neutrons and convert them into light, although work is needed on brighter, more efficient scintillator solutions. Neutron detectors also require advances in speed and resolution. Fast-framing X-ray detectors: Today’s brighter X-ray sources make time-resolved studies possible. For example, hybrid X-ray pixel detectors, initially developed for particle physics, are becoming fairly mature X-ray detectors, with considerable development in Europe. To truly enable time-resolved studies, higher frame rates and dynamic range are required, and smaller pixel sizes are desirable. High-speed spectroscopic X-ray detectors: Improvements in the readout speed and energy resolution of X-ray detectors are essential to enable chemically sensitive microscopies. Advances would make it possible to take images with simultaneous spatial and chemical information. Very high-energy-resolution X-ray detectors: The energy resolution of semiconductor detectors, while suitable for a wide range of applications, is far less than what can be achieved with X-ray optics. A direct detector that could rival the energy resolution of optics could dramatically improve the efficiency of a multitude of experiments, as experiments are often repeated at a number of different energies. Very high-energy-resolution detectors could make these experiments parallel, rather than serial. Low-background, high-spatial-resolution neutron detectors: Low-background detectors would significantly improve experiments that probe excitations (phonons, spin excitations, rotation, and diffusion in polymers and molecular substances, etc.) in condensed matter. Improved spatial resolution would greatly benefit radiography, tomography, phase-contrast imaging, and holography. Improved acquisition and visualization tools: In the past, with the limited variety of slow detectors, it was straightforward to visualize data as it was being acquired (and adjust experimental conditions accordingly) to create a compact data set that the user could easily transport. As detector complexity and data rates explode, this becomes much more challenging. Three goals were identified as important for coping with the growing data volume from high-speed detectors: Facilitate better algorithm development. In particular, algorithms that can minimize the quantity of data stored. Improve community-driven mechanisms to reduce data protocols and enhance quantitative, interactive visualization tools. Develop and distribute community-developed, detector-specific simulation tools. Aim for parallelization to take advantage of high-performance analysis platforms. Improved analysis work flows: Standardize the format of metadata that accompanies detector data and describes the experimental setup and conditions. Develop a standardized user interface and software framework for analysis and data management. The diversity of detector improvements required is necessarily as broad as the range of scientific experimentation at BES facilities. This workshop identified a variety of avenues by which detector R&D can enable enhanced science at BES facilities. The Research Directions listed above will be addressed by focused R&D and detector engineering, both of which require specialized infrastructure and skills. While U.S. leadership in neutron and X-ray detectors lags behind other countries in several areas, significant talent exists across the complex. A forum of technical experts, facilities management, and BES could be a venue to provide further definition.
Advancements in the capabilities of JavaScript frameworks and web browsing technology have made online visualization of large geospatial datasets such as those coming from precipitation satellites viable. These data benefit from being visualized on and above a three-dimensional surface. The open-source JavaScript framework CesiumJS (http://cesiumjs.org), developed by Analytical Graphics, Inc., leverages the WebGL protocol to do just that. This presentation will describe how CesiumJS has been used in three-dimensional visualization products developed as part of the NASA Precipitation Processing System (PPS) STORM data-order website. Existing methods of interacting with Global Precipitation Measurement (GPM) Mission data primarily focus on two-dimensional static images, whether displaying vertical slices or horizontal surface/height-level maps. These methods limit interactivity with the robust three-dimensional data coming from the GPM core satellite. Integrating the data with CesiumJS in a web-based user interface has allowed us to create the following products. We have linked with the data-order interface an on-the-fly visualization tool for any GPM/partner satellite orbit. A version of this tool also focuses on high-impact weather events. It enables viewing of combined radar and microwave-derived precipitation data on mobile devices and in a way that can be embedded into other websites. We also have used CesiumJS to visualize a method of integrating gridded precipitation data with modeled wind speeds that animates over time. Emphasis in the presentation will be placed on how a variety of technical methods were used to create these tools, and how the flexibility of the CesiumJS framework facilitates creative approaches to interact with the data.
Shewanella oneidensis MR-1 is a motile, facultative γ-Proteobacterium with remarkable respiratory versatility; it can utilize a range of organic and inorganic compounds as terminal electronacceptors for anaerobic metabolism. The ability to effectively reduce nitrate, S0, polyvalent metals andradionuclides has established MR-1 as an important model dissimilatory metal-reducing microorganism for genome-based investigations of biogeochemical transformation of metals and radionuclides that are of concern to the U.S. Department of Energy (DOE) sites nationwide. Metal-reducing bacteria such as Shewanella also have a highly developed capacity for extracellular transfer of respiratory electrons to solid phase Fe and Mn oxides as well as directly to anode surfaces in microbial fuel cells. More broadly, Shewanellae are recognized free-living microorganisms and members of microbial communities involved in the decomposition of organic matter and the cycling of elements in aquatic and sedimentary systems. To function and compete in environments that are subject to spatial and temporal environmental change, Shewanella must be able to sense and respond to such changes and therefore require relatively robust sensing and regulation systems. The overall goal of this project is to apply the tools of genomics, leveraging the availability of genome sequence for 18 additional strains of Shewanella , to better understand the ecophysiology and speciation of respiratory-versatile members of this important genus. To understand these systems we propose to use genome-based approaches to investigate Shewanella as a system of integrated networks; first describing key cellular subsystems - those involved in signal transduction, regulation, and metabolism - then building towards understanding the function of whole cells and, eventually, cells within populations. As a general approach, this project will employ complimentary "top-down" - bioinformatics-based genome functional predictions, high-throughput expression analyses, and functional genomics approaches to uncover key genes as well as metabolic and regulatory networks. The "bottom-up" component employs more traditional approaches including genetics, physiology and biochemistry to test or verify predictions. This information will ultimately be linked to analyses of signal transduction and transcriptional regulatory systems and used to develop a linked model that will contribute to understanding the ecophysiology of Shewanella in redox stratified environments. A central component of this effort is the development of a data and knowledge integration environment that will allow investigators to query across the individual research domains, link to analysis applications, visualize data in a cell systems context, and produce new knowledge, while minimizing the effort, time and complexity to participating institutions.
This final report summarizes activities and results at the University of North Carolina as part of the the SciDAC-2 Project The Secret Life of Quarks: National Computational Infrastructure for Lattice Quantum Chromodynamics. The overall objective of the project is to construct the software needed to study quantum chromo- dynamics (QCD), the theory of the strong interactions of subatomic physics, and similar strongly coupled gauge theories anticipated to be of importance in the LHC era. It built upon the successful efforts of the SciDAC-1 project National Computational Infrastructure for Lattice Gauge Theory, in which a QCD Applications Programming Interface (QCD API) was developed that enables lat- tice gauge theorists to make effective use of a wide variety of massively parallel computers. In the SciDAC-2 project, optimized versions of the QCD API were being created for the IBM Blue- Gene/L (BG/L) and BlueGene/P (BG/P), the Cray XT3/XT4 and its successors, and clusters based on multi-core processors and Infiniband communications networks. The QCD API is being used to enhance the performance of the major QCD community codes and to create new applications. Software libraries of physics tools have been expanded to contain sharable building blocks for inclusion in application codes, performance analysis and visualization tools, and software for au- tomation of physics work flow. New software tools were designed for managing the large data sets generated in lattice QCD simulations, and for sharing them through the International Lattice Data Grid consortium. As part of the overall project, researchers at UNC were funded through ASCR to work in three general areas. The main thrust has been performance instrumentation and analysis in support of the SciDAC QCD code base as it evolved and as it moved to new computation platforms. In support of the performance activities, performance data was to be collected in a database for the purpose of broader analysis. Third, the UNC work was done at RENCI (Renaissance Computing Institute), which has extensive expertise and facilities for scientific data visualization, so we acted in an ongoing consulting and support role in that area.
Working across U.S. federal agencies, international agencies, and multiple worldwide data centers, and spanning seven international network organizations, the Earth System Grid Federation (ESGF) allows users to access, analyze, and visualize data using a globally federated collection of networks, computers, and software. Its architecture employs a system of geographically distributed peer nodes that are independently administered yet united by common federation protocols and application programming interfaces (APIs). The full ESGF infrastructure has now been adopted by multiple Earth science projects and allows access to petabytes of geophysical data, including the Coupled Model Intercomparison Project (CMIP) output used by the Intergovernmental Panel on Climate Change assessment reports. Data served by ESGF not only include model output (i.e., CMIP simulation runs) but also include observational data from satellites and instruments, reanalyses, and generated images. Metadata summarize basic information about the data for fast and easy data discovery.
Scientific discovery is progressing towards autonomous science with the combination of scientific instruments, high-performance computing, and artificial intelligence in complex workflows. This evolution introduces new requirements for managing scientific workflows, including feedback loops, near real-time constraints, and the ability to dynamically control workflow execution. In situ workflows that analyze and visualize data as it is generated are well-suited to satisfy stringent time constraints and their iterative nature offers greater opportunities for command-and-control. However, only a few of the many workflow management systems available have been specifically designed to manage in situ workflows and often lack support for automated feedback loops that allow analysis and visualization components to interact with the main scientific data producer. To address this need, we present in this paper how to add command-and-control capabilities to a workflow management system. We identify the functional design requirements of such a command-and-control system, detail its architecture, interface, and core mechanisms, and illustrate how advanced in situ workflows can leverage command-and-control in three use cases: graceful termination with checkpoint, dynamic and adaptive data reduction, and event-triggered analysis.
Faraday is a high-temperature electrolysis data visualization tool, which reveals the performance of various button cells under test conditions. These tests and the resulting analytics on their data constitute a state of the industry as the US Department of Energy pushes for the production of hydrogen. Faraday leverages the Idaho National Laboratory's DeepLynx data warehouse to standardize and query button cell data. Faraday programmatically accesses this data in DeepLynx by traversing the schema, represented by a custom ontology. The user interface queries DeepLynx for timeseries data associated with specific button cells in the warehouse, and renders them using JavaScript charts. Additional charting and data analysis techniques are made possible by an auxiliary Python server.
The U.S. Department of Energy (DOE) Geothermal Technologies Office (GTO), in partnership with the Frontier Observatory for Research in Geothermal Energy (FORGE) and the Idaho National Laboratory (INL), invited high school and university (undergraduate and graduate) teams to explore the future of geothermal energy and visualize the world of geothermal energy by participating in the 2019 Geothermal Design Challenge™. Teams of 2 or 3 members researched data, interpreted information and created a data visualization portfolio that told a compelling story about geothermal energy by answering the challenge question, “Where do you target your next production well to maximize geothermal reservoir performance?” The purpose of this document is to provide an overview of how the 2019 Geothermal Design Challenge™ was organized and conducted.
The U.S. Department of Energy (DOE) Geothermal Technologies Office (GTO), in partnership with the Frontier Observatory for Research in Geothermal Energy (FORGE) and the Idaho National Laboratory (INL), invited high school and university (undergraduate and graduate) teams to explore the future of geothermal energy and visualize the world of geothermal energy by participating in the 2019 Geothermal Design Challenge™. Teams of 2 or 3 members researched data, interpreted information and created a data visualization portfolio that told a compelling story about geothermal energy by answering the challenge question, “Where do you target your next production well to maximize geothermal reservoir performance?” The purpose of this document is to provide an overview of how the 2019 Geothermal Design Challenge™ was organized and conducted.
Data ordering in large fast Fourier transforms (FFT's) is both conceptually and implementationally difficult. Discribed here is a method of visualizing data orderings as vectors of address bits, which enables the engineer to use more efficient data orderings and reduce double-buffer memory designs. Also detailed are the difficulties and algorithmic solutions involved in FFT lengths up to 4 megasamples (Msamples) and sample rates up to 80 MHz.
Timely, frequent, and complete cropland soil moisture information acquired throughout the growing season is critical for agricultural policy, production, food security, and food prices. The NASA Soil Moisture Active and Passive (SMAP) mission provides a reliable data source for cropland soil moisture assessment. This paper presents Crop-CASMA- a web GIS application tool for cropland soil moisture monitoring and assessment based on SMAP data. This interactive Web service-based GIS application tool enables CONUS SMAP derived soil moisture data visualization, dissemination, and analytics. In this paper, we describe the Crop-CASMA application system architecture, the application implementation, and the data it serves. In addition, we also present a few snapshots of the Crop-CASMA data for cropland soil moisture monitoring. The release of Crop-CASMA greatly enhances the user experience and facilitates using soil moisture data products for crop condition monitoring and decision support.
Timely, frequent, and complete cropland soil moisture information acquired throughout the growing season is critical for agricultural policy, production, food security, and food prices. The NASA Soil Moisture Active and Passive (SMAP) mission provides a reliable data source for cropland soil moisture assessment. This paper presents Crop-CASMA - a web GIS application tool for cropland soil moisture monitoring and assessment based on SMAP data. This interactive Web service-based GIS application tool enables CONUS SMAP derived soil moisture data visualization, dissemination, and analytics. In this paper, we describe the Crop-CASMA application system architecture, the application implementation, and the data it serves. In addition, we also present a few snapshots of the Crop-CASMA data for cropland soil moisture monitoring. The release of Crop-CASMA greatly enhances the user experience and facilitates using soil moisture data products for crop condition monitoring and decision support.
A water-tunnel study on a 1/48-scale model of the X-29A aircraft was performed at the NASA Dryden Flow Visualization Facility. The water-tunnel test enhanced the results of the X-29A flight tests by providing flow-visualization data for comparison and insights into the aerodynamic characteristics of the aircraft. The model was placed in the water tunnel at angles of attack of 20 to 55 deg. and with angles of sideslip from 0 to 5 deg. In general, flow-visualization techniques provided useful information on vortex formation, separation, and breakdown and their role in yaw asymmetries and tail buffeting. Asymmetric forebody vortices were observed at angles of attack greater than 30 deg. with 0 deg. sideslip and greater than 20 deg. with 5 deg. sideslip. While the asymmetric flows observed in the water tunnel did not agree fully with the flight data, they did show some of the same trends. In addition, the flow visualization indicated that the interaction of forebody vortices and the wing wake at angles of attack between 20 and 35 deg. may cause vertical-tail buffeting observed in flight.
The FaceBase Consortium, funded by the National Institute of Dental and Craniofacial Research, National Institutes of Health, is designed to accelerate understanding of craniofacial developmental biology by generating comprehensive data resources to empower the research community, exploring high-throughput technology, fostering new scientific collaborations among researchers and human/computer interactions, facilitating hypothesis-driven research, and translating science into improved health care to benefit patients. The resources generated by the FaceBase projects include a number of dynamic imaging modalities, genome-wide association studies, software tools for analyzing human facial abnormalities, detailed phenotyping, anatomical and molecular atlases, global and specific gene expression patterns, and transcriptional profiling over the course of embryonic and postnatal development in animal models and humans. The integrated data visualization tools, faceted search infrastructure, and curation provided by the FaceBase Hub offer flexible and intuitive ways to interact with these multidisciplinary data. In parallel, the datasets also offer unique opportunities for new collaborations and training for researchers coming into the field of craniofacial studies. Here we highlight the focus of each spoke project and the integration of datasets contributed by the spokes to facilitate craniofacial research.
An experimental investigation was conducted to measure the flow velocity in the boundary layer of an Eppler 387 airfoil. In particular, the laminar separation bubble that this airfoil exhibits at low Reynolds numbers was the focus. Single component laser Doppler velocimetry data were obtained at a Reynolds number of 100,000 at an angle of attack of 2.0 degree. Static Pressure and flow visualization data for the Eppler 387 airfoil were also obtained. The difficulty in obtaining accurate experimental measurements at low Reynolds numbers is addressed. Laser Doppler velocimetry boundary layer data for the NACA 663-018 airfoil at a Reynolds number of 160,000 and angle of attack of 12 degree is also presented.
The deployment and integration of high-sensitivity infrared cameras in a transonic wind tunnel testenvironment has resulted in a unique capability to image aerodynamic phenomena in real-time. Multi-camera infrared flow visualization data systems are now routinely utilized at the NASA Ames Unitary Plan Wind Tunnel. The small flow-induced temperature gradients on the surface of the wind tunnel test article coupled with the high bit-depth of the infrared camera sensor makes the processing of the image data critically important. An image processing routine must enhance features of interest with minimal artifacts. Additionally, the production wind tunnel test environment demands that these processed images are made available in a real-time, automatic fashion. Therefore, any image processing routine must be computationally economical and enhance the image data with minimal input from a human operator. The following seeks to qualitatively explore selected image processing techniques by assessing their effectiveness to resolve flow features on a wind tunnel test article. A multi-scale contrast enhancement technique is discussed as well as a new implementation of a multi-scale, non-interpolated adaptive histogram equalization. Finally, a novel method is introduced that demonstrates the ability to resolve flow features imaged on bare-steel test articles possessing low emissivity.This method makes use of dynamic mode decomposition and discrete-time filtering to separate the background reflections that dominate low emissivity surfaces from the aerodynamic driven surface temperature gradients.This process will be shown to resolve the onset of boundary layer transition on a bare metal wing as well as identify and resolve hidden features in the image data. While the implementation of this technique is very preliminary it demonstrates the potential to extend the application of infrared flow-visualization within the wind tunnel test environment.
During the time from December 1991 through March 1992, there were four operational DMSP satellites in polar orbit. All four satellites carried the Special Sensor-Ions, Electrons, Scintillation (SSIES) plasma package which included an ion drift meter. Data from the drift meter, combined with the magnetic field data, allowed the calculation of the electrostatic potential in the ionosphere along the satellite's path. Simultaneous polar coverage by four satellites was unprecedented, providing researchers with almost continuous monitoring of the potential distribution in both hemispheres for the four month period. Combining the magnitude and location of the potential data from each of the four satellites in order to examine the varying potential distribution pattern in both hemispheres presented a major challenge in data visualization. The problem was solved by developing a three-dimensional presentation of the data where the potentials are color coded and represented by the vertical dimension. This paper presents examples from a computer animation of several days of data demonstrating evolution of the size and shape of the potential distribution, along with how these changes correspond to variations in other geophysical parameters, such as the IMF orientation and the K(sub p) index.