Search NASA⌕ Search

SEARCH · Search NASA

Results for “light at night”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Indices of extremes: geographic patterns of change in extremes and associated vegetation impacts under climate intervention

Extreme weather events have been demonstrated to be increasing in frequency and intensity across the globe and are anticipated to increase further with projected changes in climate. Solar climate intervention strategies, specifically stratospheric aerosol injection (SAI), have the potential to minimize some of the impacts of a changing climate while more robust reductions in greenhouse gas emissions take effect. However, to date little attention has been paid to the possible responses of extreme weather and climate events under climate intervention scenarios. We present an analysis of 16 extreme surface temperature and precipitation indices, as well as associated vegetation responses, applied to the Geoengineering Large Ensemble (GLENS). GLENS is an ensemble of simulations performed with the Community Earth System Model (CESM1) wherein SAI is simulated to offset the warming produced by a high-emission scenario throughout the 21st century, maintaining surface temperatures at 2020 levels. GLENS is generally successful at maintaining global mean temperature near 2020 levels; however, it does not completely offset some of the projected warming in northern latitudes. Some regions are also projected to cool substantially in comparison to the present day, with the greatest decreases in daytime temperatures. The differential warming–cooling also translates to fewer very hot days but more very hot nights during the summer and fewer very cold days or nights compared to the current day. Extreme precipitation patterns, for the most part, are projected to reduce in intensity in areas that are wet in the current climate and increase in intensity in dry areas. We also find that the distribution of daily precipitation becomes more consistent with more days with light rain and fewer very intense events than currently occur. In many regions there is a reduction in the persistence of long dry and wet spells compared to present day. However, asymmetry in the night and day temperatures, together with changes in cloud cover and vegetative responses, could exacerbate drying in regions that are already sensitive to drought. Overall, our results suggest that while SAI may ameliorate some of the extreme weather hazards produced by global warming, it would also present some significant differences in the distribution of climate extremes compared to the present day.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

helioLuna: Prospect for cislunar spacecraft and near-earth asteroid detection using heliostat fields at night

We experimentally and computationally investigate a proposed frequency-domain method for detecting and tracking cislunar spacecraft and near-earth asteroids using heliostat fields at night. Unlike imaging, which detects spacecraft and asteroids by their streak in sidereally-fixed long-exposure photographs, our proposed detection method oscillates the orientation of heliostats concentrating light from the stellar field and measures the light’s photocurrent power spectrum at sub-milliHertz resolution. If heliostat oscillation traces out an ellipse fixed in the galactic coordinate system, spacecraft or asteroids produce a peak in photocurrent power spectrum at a frequency slightly shifted from the starlight peak. The frequency shift is on the scale of milliHertz and proportional to apparent angular rate relative to sidereal. Relative phase corresponds to relative angular position, enabling tracking. A potential advantage of this frequency-domain method over imaging is that detectivity improves with apparent angular rate and number of heliostats. Since heliostats are inexpensive compared to an astronomical observatory and otherwise unused at night, the proposed method may cost-effectively augment observatory systems such as NASA’s Asteroid Terrestrial-impact Last Alert System (ATLAS).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Lighting System Control Data to Improve Design and Operation: Tunable Lighting System Data from NICU Patient Rooms

The advancement of LED and controls technology, computing capacity, and software provides new opportunities for researchers and designers to work together to further optimize spaces for occupant benefit. Here, lighting system control data from five neonatal intensive care unit patient rooms was collected over a 25-week monitoring period and analyzed to better understand occupant response to a tunable lighting system with automatic transitions throughout the day. Lighting systems are very rarely refined after installation based on actual use. Objective data detailing how the lighting system is used by the actual occupants highlights the opportunities for optimization after installation and provides insight for improving the next design. As use of the data becomes more commonplace, it can be leveraged for design recommendations. The collection of the data required no additional cost beyond the time for examining the data. The analysis revealed several clear opportunities for improvement, including adjustments to the default control setting at night, re-labeling of the control stations, and adjustments to the nighttime fade rate. The patient room occupants were active users of the different zones, dimming options, and manual overrides made available by the lighting system.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Constraints on the Physical Properties of GW190814 through Simulations Based on DECam Follow-up Observations by the Dark Energy Survey

On 2019 August 14, the LIGO and Virgo Collaborations detected gravitational waves from a black hole and a 2.6 solar mass compact object, possibly the first neutron star–black hole merger. In search of an optical counterpart, the Dark Energy Survey (DES) obtained deep imaging of the entire 90% confidence level localization area with Blanco/DECam 0, 1, 2, 3, 6, and 16 nights after the merger. Objects with varying brightness were detected by the DES Pipeline, and we systematically reduced the candidate counterparts through catalog matching, light-curve properties, host-galaxy photometric redshifts, Southern Astrophysical Research spectroscopic follow-up observations, and machine-learning-based photometric classification. All candidates were rejected as counterparts to the merger. To quantify the sensitivity of our search, we applied our selection criteria to full light-curve simulations of supernovae and kilonovae as they would appear in the DECam observations. Because the source class of the merger was uncertain, we utilized an agnostic, three-component kilonova model based on tidally disrupted neutron star (NS) ejecta properties to quantify our detection efficiency of a counterpart if the merger included an NS. We find that, if a kilonova occurred during this merger, configurations where the ejected matter is greater than 0.07 solar masses, has lanthanide abundance less than 10 -8.56 , and has a velocity between 0.18c and 0.21c are disfavored at the 2σ level. Furthermore, we estimate that our background reduction methods are capable of associating gravitational wave signals with a detected electromagnetic counterpart at the 4σ level in 95% of future follow-up observations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Highly efficient photoelectric effect in halide perovskites for regenerative electron sources

Electron sources are a critical component in a wide range of applications such as electron-beam accelerator facilities, photomultipliers, and image intensifiers for night vision. We report efficient, regenerative and low-cost electron sources based on solution-processed halide perovskites thin films when they are excited with light with energy equal to or above their bandgap. We measure a quantum efficiency up to 2.2% and a lifetime of more than 25 h. Importantly, even after degradation, the electron emission can be completely regenerated to its maximum efficiency by deposition of a monolayer of Cs. The electron emission from halide perovskites can be tuned over the visible and ultraviolet spectrum, and operates at vacuum levels with pressures at least two-orders higher than in state-of-the-art semiconductor electron sources.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Inefficacy of mallard flight responses to approaching vehicles

Vehicle collisions with birds are financially costly and dangerous to humans and animals. To reduce collisions, it is necessary to understand how birds respond to approaching vehicles. We used simulated (i.e., animals exposed to video playback) and real vehicle approaches with mallards (Anas platyrynchos) to quantify flight behavior and probability of collision under different vehicle speeds and times of day (day vs. night). Birds exposed to simulated nighttime approaches exhibited reduced probability of attempting escape, but when escape was attempted, fled with more time before collision compared to birds exposed to simulated daytime approaches. The lower probability of flight may indicate that the visual stimulus of vehicle approaches at night (i.e., looming headlights) is perceived as less threatening than when the full vehicle is more visible during the day; alternatively, the mallard visual system might be incompatible with vehicle lighting in dark settings. Mallards approached by a real vehicle exhibited a delayed margin of safety (both flight initiation distance and time before collision decreased with speed); they are the first bird species found to exhibit this response to vehicle approach. Our findings suggest mallards are poorly equipped to adequately respond to fast-moving vehicles and demonstrate the need for continued research into methods promoting effective avian avoidance behaviors.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Daylength variation affects growth, photosynthesis, leaf metabolism, partitioning, and metabolic fluxes

Abstract Daylength, a seasonal and latitudinal variable, exerts a substantial impact on plant growth. However, the relationship between daylength and growth is nonproportional, suggesting the existence of adaptive mechanisms. Thus, our study aimed to comprehensively investigate the adaptive strategies employed by plants in response to daylength variation. We grew false flax (Camelina sativa) plants, a model oilseed crop, under long-day (LD) and short-day (SD) conditions and used growth measurements, gas exchange measurements, and isotopic labeling techniques, including 13C, 14C, and 2H2O, to determine responses to different daylengths. Our findings revealed that daylength influences various growth parameters, photosynthetic physiology, carbon partitioning, metabolic fluxes, and metabolite levels. SD plants employed diverse mechanisms to compensate for reduced CO2 fixation in the shorter photoperiod. These mechanisms included enhanced photosynthetic rates and reduced respiration in the light (RL), leading to increased shoot investment. Additionally, SD plants exhibited reduced rates of the glucose 6-phosphate (G6P) shunt and greater partitioning of sugars into starch, thereby sustaining carbon availability during the longer night. Isotopic labeling results further demonstrated substantial alterations in the partitioning of amino acids and TCA cycle intermediates between rapidly and slowly turning over pools. Overall, the results point to multiple developmental, physiological, and metabolic ways in which plants adapt to different daylengths to maintain growth.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Degradation and Self-Healing in Perovskite Solar Cells

Organic–inorganic halide perovskites are well-known for their unique self-healing ability. In the presence of strong external stimuli, such as light, temperature, and moisture, high-energy defects are created which can be healed by removing the perovskite from the degradation source. Furthermore, this self-healing ability has been showcased in devices with recoverable performance and day-and-night cycling operation to dramatically extend the device lifetime and even mechanical durability. However, to date, the mechanistic details and theory around this captivating trait are sparse and convoluted by the complex nature of perovskites. With a clear understanding of the intrinsic self-healing property, perovskite solar cells with extended lifetimes and durability can be designed to realize the large-scale commercialization of perovskite solar cells. Here, we spotlight the relevant degradation and self-healing literature and then propose design strategies to help conceptualize future research.

14 SOLAR ENERGY↗
DOE OSTI2020

BVR{sub C}I{sub C} Observations and Analysis of the UV LEO-type Binary, the Pre-WUMa, V1023 Persei

V1023 Per is a polar spotted, but well-detached dwarf binary, very likely a Pre-WUMa eclipsing binary. It was observed on 11 nights in 2015 October, November, and December at Dark Sky Observatory in North Carolina with the 0.81 m reflector of Appalachian State University. The period behavior is complex and may be increasing with a cubic or quadratic ephemeris. Its odd light curves are of high amplitude but have no totality and reach maximum light just before and following the secondary eclipse, indicating that it has polar spots similar to UV Leo. The 28 yr orbital period study calls the attention of observers to further monitor this binary to understand the complex nature of the period evolution. Its presently fixed polar spot does indicate that it must have a strong magnetic field and that it is synchronously rotating. The BVR{sub c}I{sub c} simultaneous 2016 Wilson–Devinney program (W-D) solution gives fillouts of 68% and 75% for the primary and secondary components, respectively. The polar position of the spot, its radius (24°), and T-fact (0.75) indicate that a strong magnetic field is present. The small ΔT in the components (∼289 K) show that the stars are similar in spectral type despite them being well detached. The inclination is high, ∼85.°19 ± 0.°04, but there is not a total eclipse due to the high mass ratio (∼0.739 ± 0.001). Due to the low galactic position (longitude = 150.°390, latitude = −1.°023), its reddening is addressed. The primary components temperature is estimated to be 5250 ± 250 K.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Visible-light Phase Curves from the Second Year of the TESS Primary Mission

We carried out a systematic study of full-orbit phase curves for known transiting systems in the northern ecliptic sky that were observed during Year 2 of the TESS primary mission. We applied the same methodology for target selection, data processing, and light-curve fitting as we did in our Year 1 study. Out of the 15 transiting systems selected for analysis, seven—HAT-P-7, KELT-1, KELT-9, KELT-16, KELT-20, Kepler-13A, and WASP-12—show statistically significant secondary eclipses and day–night atmospheric brightness modulations. Small eastward dayside hot-spot offsets were measured for KELT-9b and WASP-12b. KELT-1, Kepler-13A, and WASP-12 show additional phase-curve variability attributed to the tidal distortion of the host star; the amplitudes of these signals are consistent with theoretical predictions. We combined occultation measurements from TESS and Spitzer to compute dayside brightness temperatures, TESS-band geometric albedos, Bond albedos, and phase integrals for several systems. The new albedo values solidify the previously reported trend between dayside temperature and geometric albedo for planets with 1500 K < T {sub day} < 3000 K. For Kepler-13Ab, we carried out an atmospheric retrieval of the full secondary eclipse spectrum, which revealed a noninverted temperature–pressure profile, significant H{sub 2}O and K absorption in the near-infrared, evidence for strong optical atmospheric opacity due to sodium, and a confirmation of the high geometric albedo inferred from our simpler analysis. We explore the implications of the phase integrals (ratios of Bond to geometric albedos) for understanding exoplanet clouds. We also report updated transit ephemerides for all of the systems studied in this work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

A Techno-Economic Analysis of a 50MWth Light-Trapping Cavity-Planar Solar Receiver Tower Capital Expenditures and its Cost Mitigation Strategies

To maximize thermal efficiency, the National Renewable Energy Laboratory (NREL) has proposed a light-trapping cavity-planar receiver design intended to capture energy from reradiating surfaces. This system implements a macroscale light trapping mechanism induced by panels with triangular channels, this mechanism allows for elevated temperatures on the receiver panels and in turn the temperature of the HTF; using this design coupled with the implementation of a fluidized particle flow as the HTF, it can be expected for some components to reach a peak working temperature of nearly 1000 degrees C cyclically throughout each day-night cycle. While these temperatures correlate to higher efficiency of the CSP tower they also demand intense thermomechanical properties from the materials used to make the receiver panels. In this analysis, we will list our assumptions to provide clarity on the significance of our calculation. This cost analysis will be conducted using a combination of both case study data and surveying industry to determine costs that are relevant to the current market trends. This analysis represents an early attempt to establish the Capital Expenditures required for a CSP tower of such design to determine the feasibility of implementing such a system in the industry.

concentrated solar power (CSP)↗
DOE OSTI2020

Feasibility of Operating a Heavy-Duty Battery Electric Truck Fleet for Drayage Applications

Vehicle fleet electrification is regarded as one major pathway toward achieving energy independence and reducing air pollution and greenhouse gas emissions. Compared to light-duty and medium-duty vehicles, electrification of heavy-duty vehicles, especially Class 8 trucks, is more challenging owing to the battery size required to attain the driving range necessary for their operating goals. As drayage trucks generally have a limited daily mileage, return to a home base every night, and spend a large amount of time creeping and idling, drayage operation has been the first targeted application for Class 8 electric trucks. The feasibility of operating battery electric drayage trucks at the individual vehicle level has recently been demonstrated. However, questions remain as to whether these trucks are capable of meeting the needs of typical drayage operation at the fleet level. Here we present a feasibility analysis of operating an electric truck fleet based on real-world operation data of a diesel drayage operator in Southern California. Second-by-second activity data collected from 20 trucks in the fleet were used to estimate the corresponding electric energy consumption and the state of charge of the battery using a microscopic electric energy consumption model. An algorithm for generating tours of drayage activity from the collected data was developed and implemented. Multiple scenarios with different battery charging and truck scheduling assumptions were analyzed. The results show that 85% of the tours could be served by electric trucks if there is opportunity for charging at the home base during the time gap between consecutive tours.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

The Spectroscopic Data Processing Pipeline for the Dark Energy Spectroscopic Instrument

Abstract We describe the spectroscopic data processing pipeline of the Dark Energy Spectroscopic Instrument (DESI), which is conducting a redshift survey of about 40 million galaxies and quasars using a purpose-built instrument on the 4 m Mayall Telescope at Kitt Peak National Observatory. The main goal of DESI is to measure with unprecedented precision the expansion history of the universe with the baryon acoustic oscillation technique and the growth rate of structure with redshift space distortions. Ten spectrographs with three cameras each disperse the light from 5000 fibers onto 30 CCDs, covering the near-UV to near-infrared (3600–9800 Å) with a spectral resolution ranging from 2000 to 5000. The DESI data pipeline generates wavelength- and flux-calibrated spectra of all the targets, along with spectroscopic classifications and redshift measurements. Fully processed data from each night are typically available to the DESI collaboration the following morning. We give details about the pipeline’s algorithms, and provide performance results on the stability of the optics, the quality of the sky background subtraction, and the precision and accuracy of the instrumental calibration. This pipeline has been used to process the DESI Survey Validation data set, and has exceeded the project’s requirements for redshift performance, with high efficiency and a purity greater than 99% for all target classes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

A New Method for Aerosol Measurement Using Wide-field Photometry

We present a new method to measure the vertical aerosol optical depth (VAOD) during clear nights using a wide-field imager—a CCD camera with a photographic lens on an equatorial mount. A series of 30 s exposures taken at different altitudes above the horizon can be used to measure the VAOD with a precision better than 0.008 optical depths within a few minutes. Such a measurement does not produce any light and is thus suitable for use at sites where other astronomical instruments are located. The precision of the VAOD measurement depends on the laboratory calibration of spectral properties of the system and of the response of the camera electronics to varying illumination levels, as well as careful considerations of the details of stellar photometry and modeling of the dependence of the measured stellar flux, the star color, and the position within the field of view. The results obtained with robotic setups at the future sites of the Cerenkov Telescope Array show good internal consistency and agreement with simultaneous measurements from a Sun/Moon photometer located at the same sites.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Making Northway, Alaska Resilient and Sustainable Through Energy Efficiency and Solar Power

This project implemented energy efficiency measures and installed 6 kW solar arrays on three community buildings in Northway, Alaska, in a collaboration between the Department of Energy - Office of Indian Energy Policy and Programs, the Northway Village Council (NVC), the Tanana Chiefs Conference (TCC), and the Alaska Native Tribal Health Consortium (ANTHC). Northway is a small community in interior Alaska, close to the Canadian border, with high fuel and energy costs: $3.00 per gallon of diesel and $0.56 per kWh, respectively, in 2016, when the project began. The energy efficiency and solar power installation plans aligned with Northway’s long-term energy goals of increasing renewable energy and decreasing reliance on fossil fuels, per the Northway Community Energy Action Plan, the Alaska Interior Regional Energy Plan, and TCC Comprehensive Economic Development Strategy. The project focused on three buildings: (1) the community hall (and later office) building, (2) the washeteria building, and (3) the water/sewer garage. It included multiple directions for energy efficiency measures, such as installing LED lighting upgrades, programmable thermostats, vending machine energy misers, efficient pumps, and adding glycol loops at the water/sewer plant. Since the village has a high potential for solar energy, in order to increase resilience and decrease costs, solar systems were installed on three community buildings. Later, a battery was installed in the community hall to capture solar power produced but not used during the day, and allow the flexibility to use that power during evening and night, further decreasing the reliance on grid power for that building. Electricity savings realized by the village between 2011-2012 and 2018-2019 by improving energy efficiencies in the buildings and adding solar was 23%. This is despite the community hall doubling in size during the same time period. If that is taken into consideration (by adding community hall usage into the 2011-2012 usage one additional time), the energy savings from 2011-2012 to 2018-2019 was 37%.

14 SOLAR ENERGY↗
DOE OSTI2026

Use and Siting of Electric Vehicle Charging Stations in Juneau, Alaska

This report details a study of electric vehicle (EV) Level 2 charging stations in Juneau, Alaska. Utilization analyses of six public over five years and 250 residential chargers over two years are included, and a composite score is introduced to identify optimal locations for future charging stations that target residents of manufactured and multifamily housing (MMFH) in Juneau. We find that public charging station usage is very location-dependent, with three chargers in use more than 60% of days during the peak hour of the day (which ranges from 10 a.m. to 7 p.m.), including a charger near residential housing, illuminating potential needs for additional public chargers in those areas. Residential charging utilization typically occurs overnight - opposite to most public charging stations analyzed - and spikes after 10 p.m. This suggests that Alaska Electric Light & Power Company's time-of-use charging program, which lowers electricity rates at 10 p.m. to incentivize overnight charging, is very effective. Residential charging data also show that households tend to charge 15 hours per week, or 9% of the time, meaning that multiple households could likely share one charger if one were provided near MMFH locations. This is supported by residential charging session analysis, which shows that the median household has around two night charging sessions per week. The EV siting analysis identifies areas of high housing density, low access to public chargers, and unconstrained feeders. A cluster of MMFH parcels in Douglas demonstrated the highest composite scores considering all factors, being the only area to have a perfect score of 2.25.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Chemical Imaging of Atmospheric Biomass Burning Particles from North American Wildfires

The effects of biomass burning aerosols (BBA) on radiative forcing and cloud formation depend on chemical composition and the internal structures of individual particles within smoke plumes. To improve our understanding of the chemical and physical properties of BBA emitted at different times of the day and their evolution during atmospheric aging, we conducted a study as a part of the Fire Influence on Regional to Global Environments and Air Quality field campaign. Particle samples were collected onboard a research aircraft from smoke plumes from a wildfire in eastern Oregon during late afternoon and nighttime flights on August 28, 2019. A time-resolved aerosol collector was used to collect samples on substrates for offline spectromicroscopic imaging to investigate the single-particle characteristics of BBA particles. Approximately 20,400 individual particles from 10 selected samples were analyzed using computer-controlled scanning electron microscopy coupled with energy-dispersive X-ray microanalysis, revealing their elemental composition, morphology, and viscosity. Elemental microanalysis indicated that aged potassium is likely found in the form of K 2 SO 4 , KNO 3 , and possible K-organic salts. Further chemical speciation and carbon bonding mapping within individual particles were conducted using synchrotron-based scanning transmission X-ray microscopy (STXM) coupled with near edge X-ray absorption fine structure (NEXAFS) spectroscopy. Real-time, water-soluble light absorption measurements were acquired using a particle-into-liquid sampler instrument coupled to a liquid waveguide capillary cell and total organic analyzer. In the late afternoon samples, 65% of the total particle number population consisted entirely of organic components, compared to 46% in the nighttime particles. These differences were attributed to discrepancies in composition at the time of emission and to the daytime condensation and accumulation of photochemically formed secondary organic material on existing BBA particles, a process that halts at night. Microscopy images indicated that particle viscosity was lower in the nighttime particles (<10 1 Pa·s), likely due to increased relative humidity and a higher contribution from hygroscopic inorganic components. The chemical heterogeneity of individual particles was quantified using STXM-derived mixing state parameters. The nature of carbon bonding within individual particles was inferred from the extent of carbon sp 2 hybridization derived from NEXAFS spectra. Average percentages of sp 2 hybridization range between 40% and 60%, with no noticeable differences between late afternoon and nighttime flights. These findings were compared with the online optical properties of both late afternoon and nighttime smoke plumes, providing valuable insights into the complex relationship between chemical composition and optical properties of BBA particles at different times of the day.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

NLR HPC Eagle Jobs Data and Additional Energy Metrics

Overview: Anonymized job-level records from the Eagle high-performance computing (HPC) system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, resource utilization, CPU/GPU energy consumption, and efficiency metrics. Sensitive fields (user, account, job name) are replaced with cryptographic hashes. System & Timeframe: Eagle was a 2,000-node, 8-petaflop system operated at NLR from 2019–2024. Data covers the full operational lifetime of the system. Slurm data was processed nightly; timestamps are in Mountain Time. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.eagle.job-anon.zip — Core anonymized job records (Hive-partitioned Parquet) esif.hpc.eagle.job-anon-energy-metrics.zip — Same records with additional iLO and Ganglia energy metrics datacard.md — Full dataset documentation ~13.8 million rows, 62 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct through a pipeline: Eagle Jobs API → Redpanda → StreamSets → HPCMON API → PostgreSQL. Node-level power from iLO (HP Integrated Lights-Out); GPU power from Ganglia monitoring, joined to jobs via node lists and time ranges. Preprocessing: Anonymization of name, user, and account fields via cryptographic hashing Derived columns: queue_wait, cpu_eff, max_mem_eff Simplified job state mapping (e.g., "CANCELLED BY 12345" → "CANCELLED") QoS accounting rules (buy-in, standby, or Slurm QoS value) CPU energy estimated from TDP (200W, Intel Xeon Gold 6154, 18 cores) Timezone-aware columns (_tz) sourced from LEX accounting database to correctly handle DST transitions Key Variables: Scheduling: job_id, partition, state_simple, submit_time_tz, start_time_tz, end_time_tz, queue_waitResources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, node_energy_total_watt_hours (iLO), gpu0/1_energy_total_watt_hours (Ganglia) Partitions: bigmem, bigmem-8600, bigscratch, csc, dav, ddn, debug, gpu, haswell, long, mono, short, standard Job States: CANCELLED, COMPLETED, FAILED, NODE_FAIL, OUT_OF_MEMORY, PENDING, RUNNING, TIMEOUT QoS Levels: Unknown, normal, buy-in, debug, penalty, high, standby Important Notes: Non-_tz timestamp columns may be off by one hour across DST boundaries; use _tz columns for time difference calculations Energy fields are null for jobs without monitoring coverage Job step records and raw Slurm JSONB fields are excluded from this extract Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗