Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Management and Analysis System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Constructing a Testing Application for GWMS

Many of Fermilab’s High Energy Physics experiments require High Throughput Computing to carry out simulations, data reconstruction, and data analysis. Glidein Workflow Management System (GWMS) is a tool that distributes High Throughput Computing. The purpose of GWMS is to provide convenient access to Grid resources and sites. GWMS is coupled to HTCondor. HTCondor is the workload management system that is used for scheduling and job control. Users submit jobs to a local HTCondor queue and GWMS will make sure the job will run on one of the many remote resources.

Neely-Brown, LeRayah↗

Automation for deep space vehicle monitoring

Information on automation for deep space vehicle monitoring is given in viewgraph form. Information is given on automation goals and strategy; the Monitor Analyzer of Real-time Voyager Engineering Link (MARVEL); intelligent input data management; decision theory for making tradeoffs; dynamic tradeoff evaluation; evaluation of anomaly detection results; evaluation of data management methods; system level analysis with cooperating expert systems; the distributed architecture of multiple expert systems; and event driven response.

Schwuttke, Ursula M.↗

The MCDB System for Management and Analysis of Petabyte-Scale Uncertain Data

Analysts working with very large data sets often use statistical models to “guess” at unknown, inaccurate, or missing information associated with the data. For example, a distant object viewed through an optical lens will have its position slightly shifted by imperfections in the lens. Thus, rather than considering the object’s observed position to be absolutely correct, it makes sense to take into account the lens’s imperfections to obtain a probabilistic guess as to the object’s true position. For another example, it might be important to associate some sort of error distribution with each of the individual sensors in an array of magnetometers. This error distribution may be complex and include spatially-driven covariances, because errors in nearby sensors are likely to be correlated (caused, for example, by the presence of some nearby, fixed metal object). This project is concerned with the design and implementation of a prototype data management system called the Monte Carlo Database System, or MCDB for short. MCDB allows an expert-level analyst or statistician to attach arbitrary stochastic models to very large data sets in order to “guess” the values for unknown or inaccurate data, such as the actual position of the observed object in the lens example above. When the resulting data set is analyzed, the underlying stochastic models are used to generate hundreds or thousands of possible data set instances, and each of those possible instances is analyzed separately by MCDB. Thus, MCDB does not just give a single answer to the analysis, but it actually gives an empirical distribution of query results that embody the underlying uncertainty, and can in turn be analyzed using standard statistical techniques. The stochastic models in MCDB are implemented as user-defined, external C++ libraries called Variable Generation functions (VG functions for short). Because the VG function interface is exceedingly general, it allows MCDB to be used in a very wide variety of application domains, in conjunction with virtually any stochastic model. Ultimately, we ended up calling the system that we developed over the course of the project SimSQL, to denote the fact that it allowed for stochastic simulation of data. The software developed during the lifetime of the project is available for download from the SimSQL project website: http://cmj4.web.rice.edu/SimSQL/SimSQL.html.

42 ENGINEERING↗

SNF Data Visualization on the Centralized Used Fuel Resource for Information Exchange (CURIE) Website

To better inform stakeholders regarding the nature of spent nuclear fuel (SNF) at utility sites, an online data visualization system has been created for the U.S. Department of Energy's Office of Nuclear Energy (DOENE). The data visualization system is part of the Centralized Used Fuel Resource for Information Exchange (CURIE) website, hosted by the Oak Ridge National Laboratory (ORNL) for DOE-NE. The visualization employs a database that is part of an analysis tool known as the Used Nuclear Fuel Storage, Transportation and Disposal Analysis Resource and Data System (UNF-ST[and]DARDS). Because many of the previous document management and sharing tools related to SNF have been terminated (or are inaccessible), a new tool, the CURIE, was developed for DOE-NE and launched on March 1, 2013 at http://curie.ornl.gov. In addition to supporting DOE SNF programs, CURIE is a national resource that is accessible to industry, vendor, federal, and laboratory partners, as well as other stakeholders. CURIE's architecture was initially based on previous work that supported DOE's Bioenergy Technologies Office on the Bioenergy Knowledge Discovery Framework (KDF). The site uses an open-source search engine, Apache Solr, which provides intuitive search results based on a faceted search method similar to that used by Amazon.com{sup R}. This algorithm helps to ensure that finding documents and data is straightforward. SNF data visualization capability was added to the CURIE website which provides a capability to post and access documents and data related to the management of SNF. CURIE currently maintains over 4,100 documents and the Siting Experience Database (SED), which was developed in response to a near-term recommendation by the Blue Ribbon Commission on America's Nuclear Future (BRC). The SED is a database of the experience that has been gained and relevant documentation that has been produced in efforts to site nuclear waste facilities, both in the US and abroad. Most of these documents are publicly accessible. In addition, CURIE maintains a current calendar of related events, an SNF image gallery, featured documents, and external links to related databases and websites. CURIE also maintains private groups (or communities) to facilitate collaborative development through sharing and editing documents that are not publicly available. There are more than 250 registered users in 23 different communities within CURIE.ORNL has also been developing UNF-ST[and]DARDS to provide a controlled source of technical data for various waste management system analysis/evaluation tools, access to key technical data, and analysis capabilities for characterizing the SNF inventory. UNF-ST[and]DARDS also provides enhanced capabilities to assess safety, risk, and uncertainty throughout the integrated waste management system. This paper describes the UNF-ST[and]DARDS data available for visualization and the associated visualization techniques used by CURIE to display this data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of a naming convention and data ma nagement system

This contract covered work in data management, acquisition, and analysis for the Earth Science and Applications Division (ESAD) of the Space Science Laboratory of MSFC. Under this contract, a naming convention and data management system were developed for ESAD data sets, data visualization, and standard data format issues were investigated, and specific data analysis and management needs were addressed for several ESAD projects and data sets. In the following sections, details of the research performed over the duration of this contract are summarized.

Mcnider, Richard T.↗

Design sensitivity analysis using EAL. Part 2: Shape design parameters

A numerical implementation of shape design sensitivity analysis of built-up structures is presented, using the versatility and convenience of an existing finite element structural analysis code and its data base management system. This report is a continuation of a previous report on conventional design parameters. The finite element code used in the implementation presented is the Engineering Analysis Language (EAL), which is based on a hybrid analysis method. It has been shown that shape design sensitivity computations can be carried out using the database management system of EAL, without writing a separate program and a separate data base. The material derivative concept of continuum mechanics and an adjoint variable method of design sensitivity analysis are used to derive shape design sensitivity information of structural performances. A domain method of shape design sensitivity analysis and a design component method are used. Displacement and stress functionals are considered as performance criteria.

Dopker, B.↗

Py MILab: Capturing, Analyzing and Storing Test Data

Integrated Computational Materials Engineering (ICME) has recently received widespread attention due to its promises in reducing dependence on physical testing for engineering design by relying on simulation, reducing both time and cost to market for various applications. ICME however requires validated multiscale material models, which is heavily dependent on available test data with full material and test pedigree, including material processing, test and measurement equipment, raw data collection, and analysis methodology and results. Populating searchable information management systems with such rich data sets is often burdensome for data producers, resulting in a lack of findable data for modelers to validate and verify their models. To overcome these cultural barriers to ICME, NASA has developed of various database-integration toolsets that perform both data management activities within the organization’s best practices with additional functionality that relieves the effort of the data producer and promotes adoption of information management system. One such tool currently under development is Py MILab, an automatic framework for automatic capturing, analysis, maintenance, and storage of material test data. Py MILab uses a modular approach for capturing raw data, analyzing the data, and storing the data in a database, interfaced by neutral file structures, to promote plug-and-play capabilities for various analysis types. TMAnalysis is a Python-based tool that performs automatic data reduction and analysis of uniaxial thermomechanical test data. The TMAnalysis toolset can be implemented within the Analysis module of Py MILab, and thus requires a populated neutral file form the Raw Data Module of Py MILab and outputs a Analysis neutral file compatible with the Database Module of Py MILab. TMAnalysis is able to perform automatic segmentation of multistage tests and perform data analysis and reduction, including determination of point-wise properties in tension, compression, and shear, analysis of stress relaxation tests, creep analysis and zone identification, and combination of these stage types for tests with complex loading histories. The TMAnalysis code is accompanied with a graphical user interface (GUI) that allows users to easily analyze test data in bulk, verify the automatic, consistent analysis performed by the backend code, and edit stage segmentation if necessary before producing the output neutral files, ensuring data is properly analyzed and maintained with full traceability.

Data management↗

Residual acceleration data on IML-1: Development of a data reduction and dissemination plan

The main thrust of our work in the third year of contract NAG8-759 was the development and analysis of various data processing techniques that may be applicable to residual acceleration data. Our goal is the development of a data processing guide that low gravity principal investigators can use to assess their need for accelerometer data and then formulate an acceleration data analysis strategy. The work focused on the flight of the first International Microgravity Laboratory (IML-1) mission. We are also developing a data base management system to handle large quantities of residual acceleration data. This type of system should be an integral tool in the detailed analysis of accelerometer data. The system will manage a large graphics data base in the support of supervised and unsupervised pattern recognition. The goal of the pattern recognition phase is to identify specific classes of accelerations so that these classes can be easily recognized in any data base. The data base management system is being tested on the Spacelab 3 (SL3) residual acceleration data.

Rogers, Melissa J. B.↗

An image based information system - Architecture for correlating satellite and topological data bases

The paper describes the development of an image based information system and its use to process a Landsat thematic map showing land use or land cover in conjunction with a census tract polygon file to produce a tabulation of land use acreages per census tract. The system permits the efficient cross-tabulation of two or more geo-coded data sets, thereby setting the stage for the practical implementation of models of diffusion processes or cellular transformation. Characteristics of geographic information systems are considered, and functional requirements, such as data management, geocoding, image data management, and data analysis are discussed. The system is described, and the potentialities of its use are examined.

Bryant, N. A.↗

Application of data management to thermal/structural analysis of space trusses

A relational data base management system has been used for managing engineering data in a prototype computerized thermal/structural integrated design system. The resulting system has been applied to the analysis of a tetrahedral space truss to demonstrate and evaluate the ability to store, retrieve, query, modify, and manipulate data. Key software used includes relational data management software, several applications programs, and selected integrated software developed during the study. Results discussed include system development, system use and performance, and advantages of an integrated data management system.

Rogers, V. A.↗

National Space Science Data Center and World Data Center A for Rockets and Satellites - Ionospheric data holdings and services

The activities and services of the National Space Science data Center (NSSDC) and the World Data Center A for Rockets and Satellites (WDC-A-R and S) are described with special emphasis on ionospheric physics. The present catalog/archive system is explained and future developments are indicated. In addition to the basic data acquisition, archiving, and dissemination functions, ongoing activities include the Central Online Data Directory (CODD), the Coordinated Data Analysis Workshopps (CDAW), the Space Physics Analysis Network (SPAN), advanced data management systems (CD/DIS, NCDS, PLDS), and publication of the NSSDC News, the SPACEWARN Bulletin, and several NSSD reports.

Bilitza, D.↗

Improvements to information management systems simulator

The performance of personnel in the augmentation and improvement of the interactive IMSIM information management simulation model is summarized. With this augmented model, NASA now has even greater capabilities for the simulation of computer system configurations, data processing loads imposed on these configurations, and executive software to control system operations. Through these simulations, NASA has an extremely cost effective capability for the design and analysis of computer-based data management systems.

Bilek, R. W.↗

Programs for transferring data between a relational data base and a finite element structural analysis program

An interface system for passing data between a relational information management (RIM) data base complex and engineering analysis language (EAL), a finite element structural analysis program is documented. The interface system, implemented on a CDC Cyber computer, is composed of two FORTRAN programs called RIM2EAL and EAL2RIM. The RIM2EAL reads model definition data from RIM and creates a file of EAL commands to define the model. The EAL2RIM reads model definition and EAL generated analysis data from EAL's data library and stores these data dirctly in a RIM data base. These two interface programs and the format for the RIM data complex are described.

Johnson, S. C.↗

Evolution of the ATLAS PanDA Production and Distributed Analysis System

Evolution of the ATLAS PanDA Production and Distributed Analysis System T Maeno1,5, K De2, T Wenaus1, P Nilsson2, R Walker3, A Stradling2, V Fine1, M Potekhin1, S Panitkin1 and G Compostella4 Published under licence by IOP Publishing Ltd Journal of Physics: Conference Series, Volume 396, Part 3 Article PDF References Citations Metrics 101 Total downloads Cited by 8 articles Turn on MathJax Share this article Article information Abstract The PanDA (Production and Distributed Analysis) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at LHC data processing scale. PanDA has performed well with high reliability and robustness during the two years of LHC data-taking, while being actively evolved to meet the rapidly changing requirements for analysis use cases. We will present an overview of system evolution including automatic rebrokerage and reattempt for analysis jobs, adaptation for the CernVM File System, support for the multi-cloud model through which Tier-2 sites act as members of multiple clouds, pledged resource management and preferential brokerage, and monitoring improvements. We will also describe results from the analysis of two years of PanDA usage statistics, current issues, and plans for the future.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Study of systems and techniques for data base management

Data management areas were studied to identify pertinent problems and issues that will affect future NASA data users in terms of performance and cost. Specific topics discussed include the identifications of potential NASA data users other than those normally discussed, consideration affecting the clustering of minicomputers, low cost computer system for information retrieval and analysis, the testing of minicomputer based data base management systems, ongoing work related to the use of dedicated systems for data base management, and the problems of data interchange among a community of NASA data users.

Source record↗

A Review of Edge Computing Technology and Its Applications in Power Systems

Recent advancements in network-connected devices have led to a rapid increase in the deployment of smart devices and enhanced grid connectivity, resulting in a surge in data generation and expanded deployment to the edge of systems. Classic cloud computing infrastructures are increasingly challenged by the demands for large bandwidth, low latency, fast response speed, and strong security. Therefore, edge computing has emerged as a critical technology to address these challenges, gaining widespread adoption across various sectors. This paper introduces the advent and capabilities of edge computing, reviews its state-of-the-art architectural advancements, and explores its communication techniques. A comprehensive analysis of edge computing technologies is also presented. Furthermore, this paper highlights the transformative role of edge computing in various areas, particularly emphasizing its role in power systems. It summarizes edge computing applications in power systems that are oriented from the architectures, such as power system monitoring, smart meter management, data collection and analysis, resource management, etc. Additionally, the paper discusses the future opportunities of edge computing in enhancing power system applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗