Search NASA⌕ Search

SEARCH · Search NASA

Results for “condor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Reliable and Efficient Distributed Checkpointing System for Grid Environments

In Fine-Grained Cycle Sharing (FGCS) systems, machine owners voluntarily share their unused CPU cycles with guest jobs, as long as their performance degradation is tolerable. However, unpredictable evictions of guest jobs lead to fluctuating completion times. Checkpoint-recovery is an attractive mechanism for recovering from such “failures”. Today’s FGCS systems often use expensive, high-performance dedicated checkpoint servers. However, in geographically distributed clusters, this may incur high checkpoint transfer latencies. Here we present a distributed checkpointing system called FALCON that uses available disk resources of the FGCS machines as shared checkpoint repositories. However, an unavailable storage host may lead to loss of checkpoint data. Therefore, we model the failures of a storage host and develop a prediction algorithm for choosing reliable checkpoint repositories. We experiment with FALCON in the university-wide Condor testbed at Purdue and show improved and consistent performance for guest jobs in the presence of irregular resource availability.

checkpoint↗
DOE OSTI2019

Producing Madgraph5_aMC@NLO gridpacks and using TensorFlow GPU resources in the CMS HTCondor Global Pool

The CMS experiment has an HTCondor Global Pool, composed of more than 200K CPU cores available for Monte Carlo production and the analysis of da.The submission of user jobs to this pool is handled by either CRAB, the standard workflow management tool used by CMS users to submit analysis jobs requiring event processing of large amounts of data, or by CMS Connect, a service focused on final stage condor-like analysis jobs and applications that already have a workflow job manager in place. The latest scenario canbring cases in which workflows need further adjustments in order to efficiently work in a globally distributed pool of resources. For instance, the generation of matrix elements for high energy physics processes via Madgraph5_aMC@NLO and the usage of tools not (yet) fully supported by the CMS software, such as Ten-sorFlow with GPUsupport, are tasks with particular requirements. A special adaption, either at the pool factory level (advertising GPU resources) or at the execute level (e.g: to handle special parameters that describe certain needs for the remote execute nodes during submission) is needed in order to adequately work in the CMS global pool. This contribution describes the challenges and efforts performed towards adaptingsuch workflows so they can properly profit from the Global Pool via CMS Connect.

Bockelman, Brian Paul↗
DOE OSTI2025

The ePIC Simulation Campaign Workflow on the Open Science Grid

The ePIC collaboration is realizing the first experiment of the future Electron-Ion Collider (EIC) at the Brookhaven National Laboratory that will allow for a precision study of the nucleons and the nucleus at the scale of sea quarks and gluons through the study of electron-proton/ion collisions. This paper will discuss the current workflow for running centralized simulation campaigns for ePIC on the Open Science Grid (OSG) infrastructure. This involves monthly releases of ePIC software and container deployments to CVMFS, generation of input datasets in HepMC format according to collaboration-defined policy, using Snakemake in CI/CD for validation and benchmarking, and submitting jobs to the OSG condor scheduler for opportunistic running on available resources. File transfers utilize XrootD, and Rucio is used for data management. The workflow is continuously refined to improve daily throughput (currently 50-100k core hours per day) and minimize job failures. Since May 2023, monthly simulation campaigns employing the workflow have cumulatively used over 20 million core hours on the OSG and produced over 350 TB of simulation data. The campaigns incorporate simulations for the broad science program of the EIC and are actively used for the detector and physics studies in preparation of the Technical Design Report (TDR).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

2022 Swainson Hawk Summary Report

This summary report, prepared by Condor Country Consulting Inc. (CCCI), covers all construction monitoring of the Swainson’s hawk (Buteo swainsoni, SWHA) nest that occurred from April 2022 to July 2022 at the Sandia National Laboratories, California (SNL/CA). SNL/CA personnel first observed the SWHA pair near the pine tree along East Avenue that contained last year’s nest on April 19th, 2022. SWHA are a threatened species in the state of California and require a quarter-mile non-disturbance buffer. SNL/CA received approval from the California Department of Fish and Wildlife (CDFW) to continue work within the buffer area with a biological monitor on site to observe the SWHA for construction related disturbances. Monitoring began on April 20th, 2022 and concluded on July 1st, 2022.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

A Managed Tokens Service for Securely Keeping and Distributing Grid Tokens

Fermilab is transitioning authentication and authorization for grid operations to using bearer tokens based on the WLCG Common JWT (JSON Web Token) Profile. One of the functionalities that Fermilab experimenters rely on is the ability to automate batch job submission, which in turn depends on the ability to securely refresh and distribute the necessary credentials to experiment job submit points. Thus, with the transition to using tokens for grid operations, we needed to create a service that would obtain, refresh, and distribute tokens for experimenters’ use. This service would avoid the need for experimenters to be experts in obtaining their own tokens and would better protect the most sensitive long-lived credentials. Further, the service needed to be widely scalable, as we are currently keeping credentials active for approximately 15 experiments, each with 1-3 different credentials, and distributing those credentials to 2-20 submit points per experiment, with those numbers steadily increasing. To address these issues, we created and deployed a Managed Tokens service. The service is written in Go, taking advantage of that language’s native concurrency primitives to easily be able to scale operations as we onboard experiments. The service uses as its first credentials a set of kerberos keytabs, stored on the same secure machine that the Managed Tokens service runs on. These kerberos credentials allow the service to use htgettoken via condor_vault_storer to store vault tokens in the HTCondor credential managers (credds) that run on the batch system scheduler machines (HTCondor schedds); as well as downloading a local, shorter-lived copy of the vault token. The kerberos credentials are then also used to distribute copies of the locally-stored vault tokens to experiment submit points. When experimenters schedule jobs to be submitted, these distributed vault tokens are used to access a Hashicorp Vault instance (run separately from the Managed Tokens service), and previously-stored refresh tokens there are used to obtain the bearer token that is submitted with the job. We will discuss here the design of the Managed Tokens service, including elaborating on certain choices we made with regards to concurrent operations, configuration, monitoring, and deployment.

Bhat, Shreyas↗
NASA NTRS1982

Stability and control of the Gossamer human powered aircraft by analysis and flight test

The slow flight speed, very light wing loading, and neutral stability of the Gossamer Condor and the Gossamer Albatross emphasized apparent-mass aerodynamic effects and unusual modes of motion response. These are analyzed, approximated, and discussed, and the resulting transfer functions and dynamic properties are summarized and compared. To verify these analytical models, flight tests were conducted with and electrically powered Gossamer Albatross II. Sensors were installed and their outputs were telemetered to records on the ground. Frequency sweeps of the various controls were made and the data were reduced to frequency domain measures. Results are given for the response of: pitch rate, airspeed and normal acceleration from canard-elevator deflection; roll rate and yaw rate from canard-rudder tilt; and roll rate and yaw rate from wing warp. The reliable data are compared with the analytical predictions.

Jex, H. R.↗
NASA NTRS1983

An experimental investigation of the low Reynolds number performance of the Lissaman 7769 airfoil

A Lissaman 7769 airfoil, used on the Gossamer Condor and Gossamer Albatross human-powered aircraft, was tested in a low turbulence subsonic wind tunnel. Lift and drag data were collected at chord Reynolds numbers of 100,000, 150,000, 200,000, 250,000, and 300,000; at angles of attack from -10 to +20 deg by using an external strain gage force balance. Lift curves, drag curves, and drag polars were generated from both uncorrected data and data corrected for wind tunnel blockage effects. A flow visualization study was performed to correlate with the force data. The results of the investigation have shown that the airfoil exhibits a significant degradation in performance for chord Reynolds numbers below 150,000.

Conigliaro, P. E.↗
NASA NTRS1985

Absolute electron density measurements in the equatorial ionosphere

Accurate measurement of the electron density profile and its variations is crucial to further progress in understanding the physics of the disturbed equatorial ionosphere. To accomplish this, a plasma frequency probe was included in the payload complement of two rockets flown during the Condor rocket campaign conducted from Peru in March 1983. This paper presents density profiles of the disturbed equatorial ionosphere from a night-time flight in which spread-F conditions were present and from a day-time flight during strong electrojet conditions. Results from both flights are in excellent agreement with simultaneous radar data in that the regions of highly disturbed plasma coincide with the radar signatures. The spread-F rocket penetrated a topside depletion during both the upleg and downleg. The electrojet measurements showed a profile peaking at 1.3 x 10 to the 5th per cu cm at 106 km, with large scale fluctuations having amplitudes of roughly 10 percent seen only in the upward gradient in electron density. This is in agreement with plasma instability theory. It is further shown that simultaneous measurements by fixed-bias Langmuir probes, when normalized at a single point to the altitude profile of electron density, are inadequate to correctly parameterize the observed enhancements and depletions.

Baker, K. D.↗
NASA NTRS1985

Electron-density irregularities in the day-time equatorial ionosphere

Electron-density irregularities have been observed in the day-time equatorial ionosphere using probe experiments carried out in the payloads of two rockets launched near Lima, Peru during Project Condor, 1983. Simultaneous observations of the mesosphere and upper E-region were obtained using the radar at Jicamarca. A layer of mesospheric irregularities is identified as originating in neutral atmosphere turbulence. In the electrojet the rocket data show the regions of type 2 irregularities (between 90 and 105 km) and type 1 irregularities (between 103 and 108 km), differentiated by the slopes of their respective spectra. The irregularities of the upper E-region seen in the rocket data are reconciled with the radar data by postulating a strong aspect sensitivity.

Smith, L. G.↗
NASA NTRS1985

Rocket observations of energetic particles at the geomagnetic equator

Energetic particle detectors were included in the payloads of two rockets launched in Peru during the Condor campaign of 1983. These night-time flights reached altitudes of 587 and 535 km, respectively. The pitch-angle distribution is anisotropic with the maximum at 90 deg. Each payload included two solid-state detectors differing in the thickness of the aluminum coating. Comparison of the fluxes measured by the two detectors leads to the conclusion that, on both occasions, the energetic particles are predominantly helium ions. The flux is small below 200 km, increases linearly to 350 km, and then more slowly to apogee. The east-west asymmetry of flux, noted at 200 km in a previous equatorial launch, is not seen at greater altitudes, consistent with the flux profile and the large gyroradius of the ions.

Smith, L. G.↗
NASA NTRS1985

A diurnal study of the electrical structure of the equatorial middle atmosphere

Electrical parameters measured from 115 km down to below 20 km during the Project Condor campaign at the Punta Lobos Rocket Range near Lima, Peru, are presented. Ten rocket-launched payloads measured electrical conductivity. A strong diurnal influence due to solar ultraviolet radiation is shown. Nine of the payloads also measured electric fields. No large mesospheric vertical electric fields are found in the data. A calculation of the dc global conduction current density at 18 km is smaller than previously measured at low latitudes and does not show the conventional diurnal variation.

Croskey, C. L.↗
NASA NTRS1987

Electric field and plasma density measurements in the strongly driven daytime equatorial electrojet. I - The unstable layer and gradient drift waves. II - Two-stream waves

The results of electric field and plasma density measurements in the strongly driven daytime equatorial electrojet over Peru, made during the March 1983 Condor electrojet experiment from Punta Lobos, Peru, are discussed together with the rocket instrumentation used for the measurements and the pertinent payload dynamics. The overall characteristics of the irregularity layer observed in situ in the electrojet are described. Special consideration is given to the waves generated by the gradient drift instability (observed between 90 and 106.5 km) and to primary and secondary two-stream waves detected by the two probes on the topside between 103 and 111 km, where the electron current was considered to be strongest.

Pfaff, R. F.↗
NASA NTRS1989

Origins of etioporphyrins in sediments - Evidence from stable carbon isotopes

In samples of the Julia Creek and Condor oil shales (Australia, Albian, and early Tertiary, respectively) etioporphyrin III is significantly depleted in C-13 (4 per mil) relative to porphyrins derived from chlorophylls. This isotopic difference suggests a large contribution from some independent source. The haem group found in cytochromes derived from microbial sources is the most likely candidate.

Boreham, Christopher J.↗
NASA NTRS1993

A comparison of queueing, cluster and distributed computing systems

Using workstation clusters for distributed computing has become popular with the proliferation of inexpensive, powerful workstations. Workstation clusters offer both a cost effective alternative to batch processing and an easy entry into parallel computing. However, a number of workstations on a network does not constitute a cluster. Cluster management software is necessary to harness the collective computing power. A variety of cluster management and queuing systems are compared: Distributed Queueing Systems (DQS), Condor, Load Leveler, Load Balancer, Load Sharing Facility (LSF - formerly Utopia), Distributed Job Manager (DJM), Computing in Distributed Networked Environments (CODINE), and NQS/Exec. The systems differ in their design philosophy and implementation. Based on published reports on the different systems and conversations with the system's developers and vendors, a comparison of the systems are made on the integral issues of clustered computing.

Kaplan, Joseph A.↗
NASA NTRS2000

JavaGenes: Evolving Graphs with Crossover

Genetic algorithms usually use string or tree representations. We have developed a novel crossover operator for a directed and undirected graph representation, and used this operator to evolve molecules and circuits. Unlike strings or trees, a single point in the representation cannot divide every possible graph into two parts, because graphs may contain cycles. Thus, the crossover operator is non-trivial. A steady-state, tournament selection genetic algorithm code (JavaGenes) was written to implement and test the graph crossover operator. All runs were executed by cycle-scavagging on networked workstations using the Condor batch processing system. The JavaGenes code has evolved pharmaceutical drug molecules and simple digital circuits. Results to date suggest that JavaGenes can evolve moderate sized drug molecules and very small circuits in reasonable time. The algorithm has greater difficulty with somewhat larger circuits, suggesting that directed graphs (circuits) are more difficult to evolve than undirected graphs (molecules), although necessary differences in the crossover operator may also explain the results. In principle, JavaGenes should be able to evolve other graph-representable systems, such as transportation networks, metabolic pathways, and computer networks. However, large graphs evolve significantly slower than smaller graphs, presumably because the space-of-all-graphs explodes combinatorially with graph size. Since the representation strongly affects genetic algorithm performance, adding graphs to the evolutionary programmer's bag-of-tricks should be beneficial. Also, since graph evolution operates directly on the phenotype, the genotype-phenotype translation step, common in genetic algorithm work, is eliminated.

Globus, Al↗
NASA NTRS2001

Generic Divide and Conquer Internet-Based Computing

The rapid growth of internet-based applications and the proliferation of networking technologies have been transforming traditional commercial application areas as well as computer and computational sciences and engineering. This growth stimulates the exploration of new, internet-oriented software technologies that can open new research and application opportunities not only for the commercial world, but also for the scientific and high -performance computing applications community. The general goal of this research project is to contribute to better understanding of the transition to internet-based high -performance computing and to develop solutions for some of the difficulties of this transition. More specifically, our goal is to design an architecture for generic divide and conquer internet-based computing, to develop a portable implementation of this architecture, to create an example library of high-performance divide-and-conquer computing agents that run on top of this architecture, and to evaluate the performance of these agents. We have been designing an architecture that incorporates a master task-pool server and utilizes satellite computational servers that operate on the Internet in a dynamically changing large configuration of lower-end nodes provided by volunteer contributors. Our designed architecture is intended to be complementary to and accessible from computational grids such as Globus, Legion, and Condor. Grids provide remote access to existing high-end computing resources; in contrast, our goal is to utilize idle processor time of lower-end internet nodes. Our project is focused on a generic divide-and-conquer paradigm and its applications that operate on a loose and ever changing pool of lower-end internet nodes.

Radenski, Atanas↗
NASA NTRS2001

A Simple XML Producer-Consumer Protocol

There are many different projects from government, academia, and industry that provide services for delivering events in distributed environments. The problem with these event services is that they are not general enough to support all uses and they speak different protocols so that they cannot interoperate. We require such interoperability when we, for example, wish to analyze the performance of an application in a distributed environment. Such an analysis might require performance information from the application, computer systems, networks, and scientific instruments. In this work we propose and evaluate a standard XML-based protocol for the transmission of events in distributed systems. One recent trend in government and academic research is the development and deployment of computational grids. Computational grids are large-scale distributed systems that typically consist of high-performance compute, storage, and networking resources. Examples of such computational grids are the DOE Science Grid, the NASA Information Power Grid (IPG), and the NSF Partnerships for Advanced Computing Infrastructure (PACIs). The major effort to deploy these grids is in the area of developing the software services to allow users to execute applications on these large and diverse sets of resources. These services include security, execution of remote applications, managing remote data, access to information about resources and services, and so on. There are several toolkits for providing these services such as Globus, Legion, and Condor. As part of these efforts to develop computational grids, the Global Grid Forum is working to standardize the protocols and APIs used by various grid services. This standardization will allow interoperability between the client and server software of the toolkits that are providing the grid services. The goal of the Performance Working Group of the Grid Forum is to standardize protocols and representations related to the storage and distribution of performance data. These standard protocols and representations must support tasks such as profiling parallel applications, monitoring the status of computers and networks, and monitoring the performance of services provided by a computational grid. This paper describes a proposed protocol and data representation for the exchange of events in a distributed system. The protocol exchanges messages formatted in XML and it can be layered atop any low-level communication protocol such as TCP or UDP Further, we describe Java and C++ implementations of this protocol and discuss their performance. The next section will provide some further background information. Section 3 describes the main communication patterns of our protocol. Section 4 describes how we represent events and related information using XML. Section 5 describes our protocol and Section 6 discusses the performance of two implementations of the protocol. Finally, an appendix provides the XML Schema definition of our protocol and event information.

Smith, Warren↗
NASA NTRS2001

Towards 100,000 CPU Cycle-Scavenging by Genetic Algorithms

We examine a web-centric design using standard tools such as web servers, web browsers, PHP, and mySQL. We also consider the applicability of Information Power Grid tools such as the Globus (no relation to the author) Toolkit. We intend to implement this architecture with JavaGenes running on at least two cycle-scavengers: Condor and United Devices. JavaGenes, a genetic algorithm code written in Java, will be used to evolve multi-species reactive molecular force field parameters.

Globus, Al↗