Search NASA⌕ Search

SEARCH · Search NASA

Results for “read performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

ARCHIE: Data Analysis Acceleration with Array Caching in Hierarchical Storage

© 2018 IEEE. Scientific data analysis typically involves reading massive amounts of data that was generated by simulations, experiments, and observations. Performance of reading such large volumes of data from disk-based file systems is often poor because of the slow and mechanical components in the disks. Recent supercomputing systems are adding non-volatile storage layers in a hierarchy to handle the performance gap between fast main memory and slow disk-based storage. Software libraries for managing this hierarchy not only need efficient reading of data but also reduce user-involvement for cross-layer data movement. Furthermore, these libraries need to support array data access patterns into hierarchical storage management as scientific data is often organized in array-based data structures. Existing software typically manage individual storage layers requiring significant manual process in moving data among them. In this paper, we introduce a new array caching in hierarchical storage (ARCHIE) to accelerate array data analysis in a seamless fashion. ARCHIE evaluates array access patterns and prefetches data with array semantics between storage layers. Our evaluation shows that ARCHIE outperforms state-of-the-art file systems, i.e., Lustre and DataWarp, on a production supercomputing system by up to 5.8× in accessing data by scientific analysis applications.

Dong, Bin↗
NASA NTRS1986

A statistical trend analysis of ozonesonde data

A detailed statistical analysis of monthly averages of ozonesond readings is performed to assess trends in ozone in the troposphere and the lower to midstratosphere. Regression time series models, which include seasonal and trend factors, are estimated for 13 stations located mainly in the midlatitudes of the Northern Hemisphere. At each station, trend estimates are calculated for 14 'fractional' Umkehr layers covering the altitude range from 0 to 33 km. For the 1970-1982 period, the main findings indicate an overall negative trend in ozonesonde data in the lower stratosphere (15-21 km) of about -0.5 percent per year, and some evidence of a positive trend in the troposphere (0-5 km) of about 0.8 percent per year. An in-depth sensitivity study of the trend estimates is performed with respect to various correction procedures used to normalize ozonesonde readings to Dobson total ozone measurements. The main results indicate that the negative trend findings in the 15- to 21-km altitude region are robust to the normalization procedures considered.

Tiao, G. C.↗
DOE OSTI2019

Evaluation of new approaches to the access of official monitoring results for live bivalves molluscs

Abstract Background Live bivalve molluscs, echinoderms, tunicates and marine gastropod are referred in EU food laws, and require member states to implement official controls in classified production areas, with the monitoring and classification of those areas. If, due to contaminant tests results, a production area is closed, any product from there is prohibited to be commercialized. Mobile applications optical character recognition (OCR) functionalities could ease the access to contaminant levels and production area classifications. This study verifies what information is available in live bivalves’ labels, describes an OCR algorithm for those labels and evaluates it. Methods 86 labels were selected from four sale points in Lisbon, and photographed using smartphones. Each label was evaluated by a human to determine what data was available (either required or not). An OCR algorithm was developed and applied on the collected labels and validated against the data extracted by the human analysis. Results The analysis shows that all the labels included the required information, and 63% of the labels included the identifier for the production zone. The label-reading algorithm performs with an accuracy of 79.85% for the individual values. Conclusion High accuracy of the developed label-reading algorithm shows potential for providing instant automatic access to the date and production area, but is affected by the variability on the label structure. Although not required by food laws, the majority of the sampled labels included complementary information (classified production area) that will allow access to more precise information about the existing biotoxin tests and analysis results.

da Costa, Manuel Beja↗
DOE OSTI2022

Organizing Large Data Sets for Efficient Analyses on HPC Systems

Upcoming exascale applications could introduce significant data management challenges due to their large sizes, dynamic work distribution, and involvement of accelerators such as graphical processing units, GPUs. In this work, we explore the performance of reading and writing operations involving one such scientific application on two different supercomputers. Our tests showed that the Adaptable Input and Output System, ADIOS, was able to achieve speeds over 1TB/s, a significant fraction of the peak I/O performance on Summit. We also demonstrated the querying functionality in ADIOS could effectively support common selective data analysis operations, such as conditional histograms. In tests, this query mechanism was able to reduce the execution time by a factor of five. More importantly, ADIOS data management framework allows us to achieve these performance improvements with only a minimal amount of coding effort.

Gu, Junmin↗
NASA NTRS2010

Orbital Debris Detection and Tracking Strategies for the NASA/AFRL Meter Class Autonomous Telescope (MCAT)

MCAT (Meter-Class Autonomous Telescope) is a 1.3m f/4 Ritchey-Chr tien on a double horseshoe equatorial mount that will be deployed in early 2011 to the western pacific island of Legan in the Kwajalein Atoll to perform orbital debris observations. MCAT will be capable of tracking earth orbital objects at all inclinations and at altitudes from 200 km to geosynchronous. MCAT s primary objective is the detection of new orbital debris in both low-inclination low-earth orbits (LEO) and at geosynchronous earth orbit (GEO). MCAT was thus designed with a fast focal ratio and a large unvignetted image circle able to accommodate a detector sized to yield a large field of view. The selected primary detector is a close-cycle cooled 4Kx4K 15um pixel CCD camera that yields a 0.9 degree diagonal field. For orbital debris detection in widely spaced angular rate regimes, the camera must offer low read-noise performance over a wide range of framing rates. MCAT s 4-port camera operates from 100 kHz to 1.5 MHz per port at 2 e- and 10 e- read noise respectively. This enables low-noise multi-second exposures for GEO observations as well as rapid (several frames per second) exposures for LEO. GEO observations will be performed using a counter-sidereal time delay integration (TDI) technique which NASA has used successfully in the past. For MCAT the GEO survey, detection, and follow-up prediction algorithms will be automated. These algorithms will be detailed herein. For LEO observations two methods will be employed. The first, Orbit Survey Mode (OSM), will scan specific orbital inclination and altitude regimes, detect new orbital debris objects against trailed background stars, and adjust the telescope track to follow the detected object. The second, Stare and Chase Mode (SCM), will perform a stare, then detect and track objects that enter the field of view which satisfy specific rate and brightness criteria. As with GEO, the LEO operational modes will be fully automated and will be described herein. The automation of photometric and astrometric processing (thus streamlining data collection for environmental modeling) will also be discussed.

Mulrooney, M.↗
NASA NTRS1988

Fano-noise-limited CCDs

Recent developments of scientific CCDs have produced sensors that achieve ultra low read noise performance (less than 2 electrons rms) and near perfect charge transfer efficiency (0.9999996) without the addition of a fat-zero. This progress has now made it possible to achieve Fano-noise-limited performance in the soft X-ray where the detector's energy resolution is primarily limited by the statistical variation in the charge generated by the interacting X-ray photon. In this paper, Fano-noise-limited test data is presented for two different CCD types and a CCD derived estimate of the Fano factor is determined. By evaluating ultra low-modulation images (less than 1 electron peak-to-peak) it is shown that the CCD's global CTE is now superior to its read noise floor. To capitalize on this capability CCD manufacturers are now focusing their attention on reducing the noise floor below the 1 electron level thereby matching the sensor's CTE performance. This improvement, if accomplished, will push Fano-noise-limited performance for the CCD into the extreme ultra-violet.

Janesick, James↗
DOE OSTI2015

Digital signal processing for the ATLAS/LUCID detector

Both the detector and the associated read-out electronics have been improved in order to cope with the LHC luminosity increase foreseen for RUN 2 and RUN 3. The new operating conditions require a careful tuning of the read-out electronics in order to optimize the signal-to-noise ratio. The new read-out electronics will allow the use of digital filtering of the photo multiplier tube signals. In this talk, we will present the first results that we obtained in the optimization of the signal-to-noise ratio. In addition, we will introduce the next steps to adapt this system to high performance read-out chains for low energy gamma rays. Such systems are based, for instance, on Silicon Drift Detector devices and can be used in applications at Free-Electron-Laser facilities such as the XFEL under construction at DESY. (authors)

43 PARTICLE ACCELERATORS↗
DOE OSTI2015

Performance analysis of data intensive cloud systems based on data management and replication: a survey

As we delve deeper into the ‘Digital Age’, we witness an explosive growth in the volume, velocity, and variety of the data available on the Internet. For example, in 2012 about 2.5 quintillion bytes of data was created on a daily basis that originated from myriad of sources and applications including mobiledevices, sensors, individual archives, social networks, Internet of Things, enterprises, cameras, software logs, etc. Such ‘Data Explosions’ has led to one of the most challenging research issues of the current Information and Communication Technology era: how to optimally manage (e.g., store, replicated, filter, and the like) such large amount of data and identify new ways to analyze large amounts of data for unlocking information. It is clear that such large data streams cannot be managed by setting up on-premises enterprise database systems as it leads to a large up-front cost in buying and administering the hardware and software systems. Therefore, next generation data management systems must be deployed on cloud. The cloud computing paradigm provides scalable and elastic resources, such as data and services accessible over the Internet Every Cloud Service Provider must assure that data is efficiently processed and distributed in a way that does not compromise end-users’ Quality of Service (QoS) in terms of data availability, data search delay, data analysis delay, and the like. In the aforementioned perspective, data replication is used in the cloud for improving the performance (e.g., read and write delay) of applications that access data. Through replication a data intensive application or system can achieve high availability, better fault tolerance, and data recovery. In this paper, we survey data management and replication approaches (from 2007 to 2011) that are developed by both industrial and research communities. The focus of the survey is to discuss and characterize the existing approaches of data replication and management that tackle the resource usage and QoS provisioning with different levels of efficiencies. Moreover, the breakdown of both influential expressions (data replication and management) to provide different QoS attributes is deliberated. Furthermore, the performance advantages and disadvantages of data replication and management approaches in the cloud computing environments are analyzed. Open issues and future challenges related to data consistency, scalability, load balancing, processing and placement are also reported.

Malik, Saif Ur Rehman↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Nuclear Data: What, Why How, Who? [Slides]

Nuclear data is data that describes physics in forms and formats that computer code can read to perform simulations of nuclear processes. The data is put into ”evaluations” following the combination of experiment and theory. Various physics are applied to these evaluations by the NJOY nuclear data processing code to produce application files, which simulation codes (e.g., MCNP, Partisn, etc.) can use to model various scenarios. The Nuclear Data Team at Los Alamos National Laboratory—in partnership with a variety of national and international organizations—provides nuclear data for use at LANL and throughout the world. This data is verified and validated to ensure that it performs as expected and accurately represents Mother Nature.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1992

LDEF: Dosimetric measurement results (AO 138-7 experiment)

One of the objectives of the AO 138-7 experiment on board the LDEF was a total dose measurement with Thermo Luminescent Detectors (TLD 100). Two identical cases, both including 5 TLDs inside various aluminum shields, are exposed to the space environment in order to obtain the absorbed dose profile induced. Radiation fluence received during the total mission length was computed, taking into account the trapped particles (solar maximum and solar minimum periods) and the cosmic rays; due to the magnetospheric shielding, the solar proton fluences are negligible on the LDEF orbit. The total dose induced by these radiations inside a semi-infinite plane shield of Al are computed with radiation transport codes. TLD reading are performed after flight; due to the mission duration increase, a post-flight calibration was necessary in order to cover the range of the flight induced dose. The results obtained, similar (+ or - 30 pct.) in both cases, are compared with the dose profile computation. In practice, these LDEF results, with less than a factor 1.4 between measurements and forecasts, reinforce the validity of the computation methods and models used for the long term evaluation of space radiation intensity on low inclination Earth orbits.

Bourrieau, J.↗
NASA NTRS1993

LDEF: Dosimetric measurement results (AO 138-7 experiment)

One of the objectives of the AO 138-7 experiment on board the Long Duration Exposure Facility (LDEF) was a total dose measurement with Thermo Luminescent Detectors (TLD 100). Two identical packages, both of them including five TLD's inside various aluminum shields, are exposed to the space environment in order to obtain the absorbed dose profile. Radiation fluence received during the total mission length was computed, taking into account the trapped particles (AE8 and AP8 models during solar maximum and minimum periods) and the cosmic rays; due to the magnetospheric shielding the solar proton fluences are negligible on the LDEF orbit. The total dose induced by these radiations inside a semi infinite plane shield of aluminum are computed with the radiation transport codes available at DERTS. The dose profile obtained is in good agreement with the evaluation by E.V. Benton. TLD readings are performed after flight; due to the mission duration increase a post flight calibration was necessary in order to cover the range of the in flight induced dose. The results obtained, similar (plus or minus 30 percent) for both packages, are compared with the dose profile computation. For thick shields it seems that the measurements exceed the forecast (about 40 percent). That can be due to a cosmic ray and trapped proton contributions coming from the backside (assumed as perfectly shielded by the LDEF structure in the computation), or to an underestimate of the proton or cosmic ray fluences. A fine structural shielding analysis should be necessary in order to determine the origin of this slight discrepancy between forecast and in flight measurements. For the less shielded dosimeters, mainly exposed to the trapped electron flux, a slight overestimation of the dose (less than 40 percent) appears. Due to the dispersion of the TLD's response, this cannot be confirmed. In practice these results obtained on board LDEF, with less than a factor 1.4 between measurements and forecast, reinforce the validity of the computation methods and models used for the long term evaluation of the radiation levels (flux and dose) encountered in space on low inclination and altitude Earth orbits.

Bourrieau, J.↗
NASA NTRS1995

Next generation fire suppressants

Spectrex, Inc., located in Cedar Grove, NJ is a manufacturer of fire detection and suppression equipment. Spectrex is one of the original pioneers in high speed fire detection and suppression systems for combat vehicles. Spectrex has installed fire suppressions systems in thousands of combat vehicles and ships throughout the world. Additionally, they manufacture flame explosion detectors, ship damage control systems, and optical gas and vapor detectors. The culmination of several years of research and development has recently produced an innovative electro-optical continuous monitoring systems called SharpEye 20/20I IR(sup 3) and SAFEYE that provide fast and reliable gas, vapor, aerosol, flame, and explosion detection. SharpEye 20/20I IR(sup 3) is a self-contained triple spectrum flame detector which scans for oscillating IR radiation (1 to 10 Hz) in the spectral bands ranging from 4.0 to 5.0 microns and uses programmed algorithms to check the ratio and correlation of data received by the three sensors to make the system highly immune to false alarms. It is extremely sensitive as it can detect a 1 x 1 square foot gasoline pan fire at 200 feet in less than 3 seconds. The sensitivity is user programmable, offering 4 ranges of detection. SAFEYE is comprised of a selected number of multispectral ban microprocessors controlled detectors which are in communication with one or more radiation sources that is projected along a 600 feet optical path. The signals from the selected narrow bands are processed and analyzed by highly sophisticated algorithms. It is ideal for high risk, remote, large areas such as petroleum and chemical manufacturing sites, waste dumps, aircraft cargo bays, and ship compartments. The SAFEYE will perform direct readings of the presence or rate of rise of concentrations of gases, vapors, or aerosols at the range of parts per million and provide alarms at various set points at different levels of concentrations.

Brown, Jerry A.↗
NASA NTRS1996

Evaluation of transit-time and electromagnetic flow measurement in a chronically instrumented nonhuman primate model

The Physiology Research Branch at Brooks AFB conducts both human and nonhuman primate experiments to determine the effects of microgravity and hypergravity on the cardiovascular system and to identify the particular mechanisms that invoke these responses. Primary investigative efforts in our nonhuman primate model require the determination of total peripheral resistance, systemic arterial compliance, and pressure-volume loop characteristics. These calculations require beat-to-beat measurement of aortic flow. This study evaluated accuracy, linearity, biocompatability, and anatomical features of commercially available electromagnetic (EMF) and transit-time flow measurement techniques. Five rhesus monkeys were instrumented with either EMF (3 subjects) or transit-time (2 subjects) flow sensors encircling the proximal ascending aorta. Cardiac outputs computed from these transducers taken over ranges of 0.5 to 2.0 L/min were compared to values obtained using thermodilution. In vivo experiments demonstrated that the EMF probe produced an average error of 15% (r = .896) and 8.6% average linearity per reading, and the transit-time flow probe produced an average error of 6% (r = .955) and 5.3% average linearity per reading. Postoperative performance and biocompatability of the probes were maintained throughout the study. The transit-time sensors provided the advantages of greater accuracy, smaller size, and lighter weight than the EMF probes. In conclusion, the characteristic features and performance of the transit-time sensors were superior to those of the EMF sensors in this study.

Non-NASA Center↗
NASA NTRS2018

A Monolithic 2k x 2k LWIR HgCdTe Detector Array for Passively Cooled Space Missions

A 2K x 2K 10 µm cutoff HgCdTe array for background-limited space astronomy has been developed by Teledyne Imaging Sensors to specifications set by JPL, and demonstrated by University of Rochester at a focal plane temperature of 40K for the proposed JPL Near-Earth Object Camera (NEOCam) survey mission under the NASA Planetary Defense Coordination Office. We describe the detector performance for the first large format monolithic HgCdTe detector array tested, including the dark current, well depth, dark current vs. temperature, quantum efficiency, latent image performance, and read noise.

Pan, Jianmei↗
NASA NTRS2018

A Monolithic 2k x 2k LWIR HgCdTe Detector Array for Passively Cooled Space Missions

A 2K x 2K 10 µm cutoff HgCdTe array for background-limited space astronomy has been developed by Teledyne Imaging Sensors to specifications set by JPL, and demonstrated by University of Rochester at a focal plane temperature of 40K for the proposed JPL Near-Earth Object Camera (NEOCam) survey mission under the NASA Planetary Defense Coordination Office. We describe the detector performance for the first large format monolithic HgCdTe detector array tested, including the dark current, well depth, dark current vs. temperature, quantum efficiency, latent image performance, and read noise.

Pan, Jianmei↗