Search NASA⌕ Search

SEARCH · Search NASA

Results for “data logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Toward resilient high performance applications through real time reliability metric generaion and autonomous failure correction

One predominant barrier encountered in furthering research and development efforts aimed at facilitating resilient HPC applications is a substantial lack of existing reliability and performance data originating from extreme-scale computing distributions. In order to develop an understanding of how and why highly scaled HPC applications are encountering increasingly frequent performance interruptions, one must conduct extensive trending and analysis on contemporary machines and their associated programs. However, existing HPC application log files are labyrinthine documents that, even with the assistance of intelligent data mining algorithms, translate poorly to human discern. In addition, conventional log filtering, processes are limited to execution within a post-mortem, reactive time period, as the enormous size of these documents prevents efficient real time interaction. Thus, there exists a strong need within the HPC field for the provision of accurate-yet-concise real time application information. Moreover, the means of reporting this data must be sufficiently lightweight and non-intrusive, as to successfully-yet-discretely attach itself to the multiple processes running on multiple cores within tens (or in some cases, hundreds) of thousands of compute nodes. Furthermore, this information should in turn be used to facilitate the autonomous correction of application-threatening faults, suspensions, and interruptions. This paper describes a dynamic application instrumentation module (utilizing a combination of Open/SpeedShop software and custom scripting) aimed at successfully achieving these goals.

97 MATHEMATICS AND COMPUTING↗

Structural and Stratigraphic Controls on Methane Hydrate occurrence and distribution: Gulf of Mexico, Walker Ridge 313 and Green Canyon 955: Final Report

The goal of this project was to determine structural and stratigraphic controls on hydrate occurrence and distribution in Green Canyon (GC) 955 and Walker Ridge (WR) 313 blocks using seismic and well data. Gas hydrate was discovered in these blocks in coarse- and fine-grained sediments during the 2009 Joint Industrial project (JIP) Leg 11 drilling expedition. Although the immediate interest of the exploration community is exclusively hydrate which is present in coarse–grained sediments, factors that control hydrate and free gas distribution in the two blocks and whether coarse and fine-grained hydrate-bearing units are related in any manner, formed the core of this research. The project spanned from 10/01/2012 to 07/31/2016. In the project, in both the leased blocks, the interval spanning the gas hydrate stability zone (GHSZ) was characterized using a joint analysis of sparse Ocean Bottom Seismic (OBS) and dense, surface–towed multichannel seismic (MCS) data. The project team had the luxury of calibrating their results with two well logs. Advance processing methods such as depth migration and full-waveform inversion (FWI) were used for seismic data analysis. Hydrate quantification was achieved through interpretation of the FWI velocity field using appropriate rock physics models at both blocks. The seismic modeling/inversion methodology (common to both GC955 and WR313 blocks) was as follows. First, the MCS data were depth migrated using a P-wave velocity (VP) model constructed using inversion of reflection arrival times of a few (four in both cases) key horizons carefully picked in the OBS data to farthest possible offsets. Then, the resolution of the traveltime VP model was improved to wavelength scale by inverting OBS gathers up to the highest frequency possible (21.75 Hz for GC955 and 17.5 for WR313) using FWI. Finally, the hydrate saturation (or the volume fraction) was estimated at the well location assuming one of the other hydrate morphology (filling the primary or the secondary porosity) was extrapolated out from the wells using the FWI VP as a guide. General outcomes were as follows. First and foremost, an imaging methodology using sparse seismic data, which is easily replicable at other sites with similar datasets, has been demonstrated. The end product of this methodology at both the leased blocks is quantitative estimates of hydrate distribution. Second, at both locations there is strong evidence that the base of the GHSZ, which does not appear as a clear Bottom Simulating Reflection (BSR), manifests in the VP perturbations created by FWI, suggesting that FWI is sensitive to subtle compositional changes in shallow sediments and establishes it as a valuable tool for investigations of hydrate-bearing basins. Third, through joint interpretation of the depth migrated image and the FWI VP model, how structure and stratigraphy jointly determine hydrate and free gas distribution in both blocks could be clearly visualized. The joint interpretation also suggests that the coarse and fine grained hydrate-bearing sediments at both leased are connected. Site specific results, in addition to general results, are as follows. At GC955 the overlying fine-grained hydrate-bearing unit could have been sourced from the underlying hydrate coarse-grained channel-levee complex through a chimney feature. The channel-levee system at GC955 is compartmentalized by faults, of which only a few may be impermeable. Although compartmentalized, the channel-levee system in the GC955 as a whole might be in communication except selected zones. At WR313 the overlying fine-grained fracture-filled hydrate unit appears to be sourced from below the GHSZ. The reason that only a particular fine-grained unit has hydrate, despite having lower porosity that the bounding units, could be the presence of secondary porosity (such as those formed from clay dewatering under compaction). In conclusion, the project was a pioneering effort in in joint analysis of OBS and MCS datasets for advancing the knowledge about a hydrate and free–gas system dynamics using advanced processing methods such as FWI and depth migration. Results obtained in this project can greatly advance the tools and techniques used for delineating specific hydrate prospects. Results obtained in this project can also be seamlessly incorporated into other DOE funded project on modeling the potential productivity and commercial viability of hydrate from sand-dominated reservoirs. The OBS and MCS data in this project were acquired in 2012 (after the JIP II drilling) by the USGS and therefore the results are a posteriori. Nonetheless, the seismic inversion workflow established through this project can be used to generate various what-if quantification scenarios even in absence of logs and serve as a valuable tool for guiding drilling operations. Results from this project can augment other DOE sponsored projects on determining the commercial viability of methane production from the Gulf of Mexico.

03 NATURAL GAS↗

From the inner to outer Milky Way: a photometric sample of 2.6 million red clump stars

ABSTRACT Large pristine samples of red clump stars are highly sought after given that they are standard candles and give precise distances even at large distances. However, it is difficult to cleanly select red clumps stars because they can have the same Teff and log g as red giant branch stars. Recently, it was shown that the asteroseismic parameters, $\rm {\Delta }$P and $\rm {\Delta \nu }$, which are used to accurately select red clump stars, can be derived from spectra using the change in the surface carbon to nitrogen ratio ([C/N]) caused by mixing during the red giant branch. This change in [C/N] can also impact the spectral energy distribution. In this study, we predict the $\rm {\Delta }$P, $\rm {\Delta \nu }$, Teff, and log g using 2MASS, AllWISE, Gaia, and Pan-STARRS data in order to select a clean sample of red clump stars. We achieve a contamination rate of ∼20 per cent, equivalent to what is achieved when selecting from Teff and log g derived from low-resolution spectra. Finally, we present two red clump samples. One sample has a contamination rate of ∼20 per cent and ∼405 000 red clump stars. The other has a contamination of ∼33 per cent and ∼2.6 million red clump stars that includes ∼75 000 stars at distances >10 kpc. For |b| > 30 deg, we find ∼15 000 stars with contamination rate of ∼9 per cent. The scientific potential of this catalogue for studying the structure and formation history of the Galaxy is vast, given that it includes millions of precise distances to stars in the inner bulge and distant halo where astrometric distances are imprecise.

Lucey, Madeline↗

CVEVOLVE

CVEvolve is an agentic AI system for autonomous algorithm discovery for scientific data processing. It creates workflows where large language model agents freely set up and configure development environments and evaluation harnesses, develop and improve data processing algorithms with designed exploration-exploitation balancing mechanisms, log history and findings in a structured database, and run holdout testing to ensure algorithm generalizability. CVEvolve offers a zero-code interface and does not require users to provide structured data and evaluation scripts.

Cherukara, MatthewJoseph [Argonne National Laborat↗

Automated Test Systems for Toxic Vapor Detectors

The NASA Toxic Vapor Detection Laboratory (TVDL) at the Kennedy Space Center (KSC), Florida, has been using Personal Computer based Data Acquisition and Control Systems (PCDAS) for about nine years. These systems control the generation of toxic vapors of known concentrations under controlled conditions of temperature and humidity. The PCDAS also logs the test conditions and the test article responses in data files for analysis by standard spreadsheets or custom programs. The PCDAS was originally developed to perform standardized qualification and acceptance tests in a search for a commercial off-the-shelf (COTS) toxic vapor detector to replace the hydrazine detectors for the Space Shuttle launch pad. It has since become standard test equipment for the TVDL and is indispensable in producing calibration standards for the new hydrazine monitors at the 10 part per billion (ppb) level. The standard TVDL PCDAS can control two toxic vapor generators (TVG's) with three channels each and two flow/temperature/humidity (FIFH) controllers and it can record data from up to six toxic vapor detectors (TVD's) under test and can deliver flows from 5 to 50 liters per minute (L/m) at temperatures from near zero to 50 degrees Celsius (C) using an environmental chamber to maintain the sample temperature. The concentration range for toxic vapors depends on the permeation source installed in the TVG. The PCDAS can provide closed loop control of temperature and humidity to two sample vessels, typically one for zero gas and one for the standard gas. This is required at very low toxic vapor concentrations to minimize the time required to passivate the sample delivery system. Recently, there have been several requests for information about the PCDAS by other laboratories with similar needs, both on and off KSC. The purpose of this paper is to inform the toxic vapor detection community of the current status and planned upgrades to the automated testing of toxic vapor detectors at the Kennedy Space Center.

Mattson, C. B.↗

Automated Test Systems for Toxic Vapor Detectors

The NASA Toxic Vapor Detection Laboratory (TVDL) at the Kennedy Space Center (KSC), Florida, has been using Personal Computer based Data Acquisition and Control Systems (PCDAS) for about nine years. These systems control the generation of toxic vapors of known concentrations under controlled conditions of temperature and humidity. The PCDAS also logs the test conditions and the test article responses in data files for analysis by standard spreadsheets or custom programs. The PCDAS was originally developed to perform standardized qualification and acceptance tests in a search for a commercial off-the-shelf (COTS) toxic vapor detector to replace the hydrazine detectors for the Space Shuttle launch pad. It has since become standard test equipment for the TVDL and is indispensable in producing calibration standards for the new hydrazine monitors at the 10 part per billion (ppb) level. The standard TVDL PCDAS can control two toxic vapor generators (TVG's) with three channels each and two flow/ temperature / humidity (FTH) controllers and it can record data from up to six toxic vapor detectors (TVD's) under test and can deliver flows from 5 to 50 liters per minute (L/m) at temperatures from near zero to 50 degrees Celsius (C) using an environmental chamber to maintain the sample temperature. The concentration range for toxic vapors depends on the permeation source installed in the TVG. The PCDAS can provide closed loop control of temperature and humidity to two sample vessels, typically one for zero gas and one for the standard gas. This is required at very low toxic vapor concentrations to minimize the time required to passivate the sample delivery system. Recently, there have been several requests for information about the PCDAS by other laboratories with similar needs, both on and off KSC. The purpose of this paper is to inform the toxic vapor detection community of the current status and planned upgrades to the automated testing of toxic vapor detectors at the Kennedy Space Center.

Mattson, C. B.↗

Use of the ERD for administrative monitoring of Theta

Monitoring the state of an HPC cluster in a timely and accurate fashion is critical to most system administration functions. For many Cray users, the first step in monitoring is ingestion of log files. Unfortunately, log parsing is an inherently inefficient process, requiring multiple software components to read and write from files on disk. Cray's own utilities use a message bus, the Event Router Daemon (ERD), for a wide variety of purposes. At the Argonne Leadership Computing Facility (ALCF), we have begun to use this message bus for monitoring via a client library written in Go, allowing us to read in structured data directly from Cray's services and, in many instances, bypass log files entirely. In this paper, we will examine the implementation and utilization of this approach on our 4392 node XC40, Theta, as well as the overall benefits and drawbacks to using the ERD for real-time monitoring.

Cray↗

SEDS1 mission software verification using a signal simulator

The first flight of the Small Expendable Deployer System (SEDS1) is schedule to fly as the secondary payload of a Delta 2 in March, 1993. The objective of the SEDS1 mission is to collect data to validate the concept of tethered satellite systems and to verify computer simulations used to predict their behavior. SEDS1 will deploy a 50 lb. instrumented satellite as an end mass using a 20 km tether. Langley Research Center is providing the end mass instrumentation, while the Marshall Space Flight Center is designing and building the deployer. The objective of the experiment is to test the SEDS design concept by demonstrating that the system will satisfactorily deploy the full 20 km tether without stopping prematurely, come to a smooth stop on the application of a brake, and cut the tether at the proper time after it swings to the local vertical. Also, SEDS1 will collect data which will be used to test the accuracy of tether dynamics models used to stimulate this type of deployment. The experiment will last about 1.5 hours and complete approximately 1.5 orbits. Radar tracking of the Delta II and end mass is planned. In addition, the SEDS1 on-board computer will continuously record, store, and transmit mission data over the Delta II S-band telemetry system. The Data System will count tether windings as the tether unwinds, log the times of each turn and other mission events, monitor tether tension, and record the temperature of system components. A summary of the measurements taken during the SEDS1 are shown. The Data System will also control the tether brake and cutter mechanisms. Preliminary versions of two major sections of the flight software, the data telemetry modules and the data collection modules, were developed and tested under the 1990 NASA/ASEE Summer Faculty Fellowship Program. To facilitate the debugging of these software modules, a prototype SEDS Data System was programmed to simulate turn count signals. During the 1991 summer program, the concept of simulating signals produced by the SEDS electronics systems and circuits was expanded and more precisely defined. During the 1992 summer program, the SEDS signal simulator was programmed to test the requirements of the SEDS Mission software, and this simulator will be used in the formal verification of the SEDS Mission Software. The formal test procedures specification was written which incorporates the use of the signal simulator to test the SEDS Mission Software and which incorporates procedures for testing the other major component of the SEDS software, the Monitor Software.

Pierson, William E.↗

TraceContract

TraceContract is an API (Application Programming Interface) for trace analysis. A trace is a sequence of events, and can, for example, be generated by a running program, instrumented appropriately to generate events. An event can be any data object. An example of a trace is a log file containing events that a programmer has found important to record during a program execution. Trace - Contract takes as input such a trace together with a specification formulated using the API and reports on any violations of the specification, potentially calling code (reactions) to be executed when violations are detected. The software is developed as an internal DSL (Domain Specific Language) in the Scala programming language. Scala is a relatively new programming language that is specifically convenient for defining such internal DSLs due to a number of language characteristics. This includes Scala s elegant combination of object-oriented and functional programming, a succinct notation, and an advanced type system. The DSL offers a combination of data-parameterized state machines and temporal logic, which is novel. As an extension of Scala, it is a very expressive and convenient log file analysis framework.

Kavelund, Klaus↗

SU-C-BRD-03: Analysis of Accelerator Generated Text Logs for Preemptive Maintenance

Purpose: To develop a model to analyze medical accelerator generated parameter and performance data that will provide an early warning of performance degradation and impending component failure. Methods: A robust 6 MV VMAT quality assurance treatment delivery was used to test the constancy of accelerator performance. The generated text log files were decoded and analyzed using statistical process control (SPC) methodology. The text file data is a single snapshot of energy specific and overall systems parameters. A total of 36 system parameters were monitored which include RF generation, electron gun control, energy control, beam uniformity control, DC voltage generation, and cooling systems. The parameters were analyzed using Individual and Moving Range (I/MR) charts. The chart limits were calculated using a hybrid technique that included the use of the standard 3σ limits and the parameter/system specification. Synthetic errors/changes were introduced to determine the initial effectiveness of I/MR charts in detecting relevant changes in operating parameters. The magnitude of the synthetic errors/changes was based on: the value of 1 standard deviation from the mean operating parameter of 483 TB systems, a small fraction (≤ 5%) of the operating range, or a fraction of the minor fault deviation. Results: There were 34 parameters in which synthetic errors were introduced. There were 2 parameters (radial position steering coil, and positive 24V DC) in which the errors did not exceed the limit of the I/MR chart. The I chart limit was exceeded for all of the remaining parameters (94.2%). The MR chart limit was exceeded in 29 of the 32 parameters (85.3%) in which the I chart limit was exceeded. Conclusion: Statistical process control I/MR evaluation of text log file parameters may be effective in providing an early warning of performance degradation or component failure for digital medical accelerator systems. Research is Supported by Varian Medical Systems, Inc.

07 ISOTOPE AND RADIATION SOURCES↗

Mariner 9 data storage subsystem flight performance summary

The performance is summarized of the Mariner 9 Data Storage Subsystem (DSS) throughout the primary and extended missions. Information presented is limited to reporting of anomalies which occurred during the playback sequences. Tables and figures describe the anomalies (dropouts, missing and added bits, in the imaging data) as a function of time (accumulated tape passes). The data results indicate that the performance of the DSS was satisfactory and within specification throughout the mission. The data presented is taken from the Spacecraft Team Incident/Surprise Anomaly Log recorded during the mission. Pertinent statistics concerning the tape transport performance are given. Also presented is a brief description of DSS operation, particularly that related to the recorded anomalies. This covers the video data encoding and how it is interpreted/decoded by ground data processing and the functional operation of the DSS in abnormal conditions such as loss of lock to the playback signal.

Thomas, N. E.↗

A Comprehensive System of Energy Intensity Indicators for the U.S.: Methods, Data and Key Trends

This report describes a comprehensive system of energy intensity indicators for the United States that has been developed for the Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE) over the past decade. This system of indicators is hierarchical in nature, beginning with detailed indexes of energy intensity for various sectors of the economy, which are ultimately aggregated to an overall energy intensity index for the economy as a whole. The aggregation of energy intensity indexes to higher levels in the hierarchy is performed with a version of the Log Mean Divisia index (LMDI) method. Based upon the data and methods in the system of indicators, the economy-wide energy intensity index shows a decline of about 16% in 2014 relative to a 1985 base year. Discussion of energy intensity indicators for each of the broad end-use sectors of the economy—residential, commercial, industrial, and transportation—is presented in the report. An analysis of recent changes in the efficiency of electricity generation in the U.S. is also included. A detailed appendix describes the data sources and methodology behind the energy intensity indicators for each sector.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Comprehensive System of Energy Intensity Indicators for the U.S.: Methods, Data and Key Trends

This report describes a comprehensive system of energy intensity indicators for the United States that has been developed for the Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE) over the past decade. This system of indicators is hierarchical in nature, beginning with detailed indexes of energy intensity for various sectors of the economy, which are ultimately aggregated to an overall energy intensity index for the economy as a whole. The aggregation of energy intensity indexes to higher levels in the hierarchy is performed with a version of the Log Mean Divisia index (LMDI) method. Based upon the data and methods in the system of indicators, the economy-wide energy intensity index shows a decline of about 16% in 2014 relative to a 1985 base year. Discussion of energy intensity indicators for each of the broad end-use sectors of the economy—residential, commercial, industrial, and transportation—is presented in the report. An analysis of recent changes in the efficiency of electricity generation in the U.S. is also included. A detailed appendix describes the data sources and methodology behind the energy intensity indicators for each sector.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Propagation of electromagnetic waves in a turbulent medium

Theoretical modeling of the wealth of experimental data on propagation of electromagnetic radiation through turbulent media has centered on the use of the Heisenberg-Kolmogorov (HK) model, which is, however, valid only for medium to small sized eddies. Ad hoc modifications of the HK model to encompass the large-scale region of the eddy spectrum have been widely used, but a sound physical basis has been lacking. A model for large-scale turbulence that was recently proposed is applied to the above problem. The spectral density of the temperature field is derived and used to calculate the structure function of the index of refraction N. The result is compared with available data, yielding a reasonably good fit. The variance of N is also in accord with the data. The model is also applied to propagation effects. The phase structure function, covariance of the log amplitude, and variance of the log intensity are calculated. The calculated phase structure function is in excellent agreement with available data.

Canuto, V. M.↗

Evaluation of Delamination Onset and Growth Characterization Methods under Mode I Fatigue Loading

Double-cantilevered beam specimens of IM7/8552 graphite/epoxy from two different manufacturers were tested in static and fatigue to compare the material characterization data and to evaluate a proposed ASTM standard for generating Paris Law equations for delamination growth. Static results were used to generate compliance calibration constants for reducing the fatigue data, and a delamination resistance curve, GIR, for each material. Specimens were tested in fatigue at different initial cyclic GImax levels to determine a delamination onset curve and the delamination growth rate. The delamination onset curve equations were similar for the two sources. Delamination growth rate was calculated by plotting da/dN versus GImax on a log-log scale and fitting a Paris Law. Two different data reduction methods were used to calculate da/dN. To determine the effects of fiber-bridging, growth results were normalized by the delamination resistance curves. Paris Law exponents decreased by 31% to 37% after normalizing the data. Visual data records from the fatigue tests were used to calculate individual compliance constants from the fatigue data. The resulting da/dN versus GImax plots showed improved repeatability for each source, compared to using averaged static data. The Paris Law expressions for the two sources showed the closest agreement using the individually fit compliance data.

Murri, Gretchen B.↗

Fault Tolerance and Scaling in e-Science Cloud Applications: Observations from the Continuing Development of MODISAzure

It can be natural to believe that many of the traditional issues of scale have been eliminated or at least greatly reduced via cloud computing. That is, if one can create a seemingly wellfunctioning cloud application that operates correctly on small or moderate-sized problems, then the very nature of cloud programming abstractions means that the same application will run as well on potentially significantly larger problems. In this paper, we present our experiences taking MODISAzure, our satellite data processing system built on the Windows Azure cloud computing platform, from the proof-of-concept stage to a point of being able to run on significantly larger problem sizes (e.g., from national-scale data sizes to global-scale data sizes). To our knowledge, this is the longest-running eScience application on the nascent Windows Azure platform. We found that while many infrastructure-level issues were thankfully masked from us by the cloud infrastructure, it was valuable to design additional redundancy and fault-tolerance capabilities such as transparent idempotent task retry and logging to support debugging of user code encountering unanticipated data issues. Further, we found that using a commercial cloud means anticipating inconsistent performance and black-box behavior of virtualized compute instances, as well as leveraging changing platform capabilities over time. We believe that the experiences presented in this paper can help future eScience cloud application developers on Windows Azure and other commercial cloud providers.

97 MATHEMATICS AND COMPUTING↗

THE 60 MONTH ALL-SKY BURST ALERT TELESCOPE SURVEY OF ACTIVE GALACTIC NUCLEUS AND THE ANISOTROPY OF NEARBY AGNs

Surveys above 10 keV represent one of the best resources to provide an unbiased census of the population of active galactic nuclei (AGNs). We present the results of 60 months of observation of the hard X-ray sky with Swift/Burst Alert Telescope (BAT). In this time frame, BAT-detected (in the 15-55 keV band) 720 sources in an all-sky survey of which 428 are associated with AGNs, most of which are nearby. Our sample has negligible incompleteness and statistics a factor of {approx}2 larger over similarly complete sets of AGNs. Our sample contains (at least) 15 bona fide Compton-thick AGNs and 3 likely candidates. Compton-thick AGNs represent {approx}5% of AGN samples detected above 15 keV. We use the BAT data set to refine the determination of the log N-log S of AGNs which is extremely important, now that NuSTAR prepares for launch, toward assessing the AGN contribution to the cosmic X-ray background. We show that the log N-log S of AGNs selected above 10 keV is now established to {approx}10% precision. We derive the luminosity function of Compton-thick AGNs and measure a space density of 7.9{sup +4.1}{sub -2.9} Multiplication-Sign 10{sup -5} Mpc{sup -3} for objects with a de-absorbed luminosity larger than 2 Multiplication-Sign 10{sup 42} erg s{sup -1}. As the BAT AGNs are all mostly local, they allow us to investigate the spatial distribution of AGNs in the nearby universe regardless of absorption. We find concentrations of AGNs that coincide spatially with the largest congregations of matter in the local ({<=}85 Mpc) universe. There is some evidence that the fraction of Seyfert 2 objects is larger than average in the direction of these dense regions.

79 ASTRONOMY AND ASTROPHYSICS↗