Labeled Time Series Data Shifts
Labeled time series data set containing labeled data shifts/capacity changes for each time series.
14 SOLAR ENERGY↗
SEARCH · Search NASA
Results for “data shifts”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Methods for evaluation and treatment of data shift
This is a code repository for a set of tools for detecting and mitigating data shifts in machine learning. The goal of the tools is to provide capabilities for determining when new data sets differ from training data sets and for adapting existing models to new data or correcting data shifts (via domain adaptation). The components will be written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.
Parikh, Nidhi↗
Modeling of Hidden Structures Using Sparse Chemical Shift Data from NMR Relaxation Dispersion
NMR relaxation dispersion measurements report on conformational changes occurring on the μs-ms timescale. Chemical shift information derived from relaxation dispersion can be used to generate structural models of weakly populated alternative conformational states. Current methods to obtain such models rely on determining the signs of chemical shift changes between the conformational states, which are difficult to obtain in many situations. Here, we use a “sample and select” method to generate relevant structural models of alternative conformations of the C-terminal-associated region of Escherichia coli dihydrofolate reductase (DHFR), using only unsigned chemical shift changes for backbone amides and carbonyls ( 1 H, 15 N, and 13 C'). We find that CS-Rosetta sampling with unsigned chemical shift changes generates a diversity of structures that are sufficient to characterize a minor conformational state of the C-terminal region of DHFR. The excited state differs from the ground state by a change in secondary structure, consistent with previous predictions from chemical shift hypersurfaces and validated by the x-ray structure of a partially humanized mutant of E. coli DHFR (N23PP/G51PEKN). The results demonstrate that the combination of fragment modeling with sparse chemical shift data can determine the structure of an alternative conformation of DHFR sampled on the μs-ms timescale. Such methods will be useful for characterizing alternative states, which can potentially be used for in silico drug screening, as well as contributing to understanding the role of minor states in biology and molecular evolution.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series
PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.
changepoint detection↗
Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series: Preprint
PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.
changepoint detection↗
Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series
PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as time series data shifts. In this research, a changepoint detection (CPD) algorithm that automatically detects data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window across the labeled data sets. Pending approval, we plan to release the labeled data sets for this research on NREL's DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package. By supplying the training sets and algorithm, we hope to encourage further development in this research space.
data shift↗
Decoding the shift-invariant data: applications for band-excitation scanning probe microscopy *
A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other latent variables. Using synthetic data sets, we show that the shift-VAE latent variables closely match the ground truth parameters. The shift VAE is extended towards the analysis of band-excitation piezoresponse force microscopy data, disentangling the resonance frequency shifts from the peak shape parameters in a model-free unsupervised manner. The extensions of this approach towards denoising of data and model-free dimensionality reduction in imaging and spectroscopic data are further demonstrated. This approach is universal and can also be extended to analysis of x-ray diffraction, photoluminescence, Raman spectra, and other data sets.
36 MATERIALS SCIENCE↗
Evaluating the Utility of Permethylated Polysaccharide Solution NMR Data for Characterization of Insoluble Plant Cell Wall Polysaccharides
Plant cell wall polysaccharide analysis encompasses the utilization of a variety of analytical tools, including gas and liquid chromatography, mass spectrometry (MS), and nuclear magnetic resonance (NMR) spectroscopy. These methods provide complementary data, which enable confident structural proposals of the many complex polysaccharide structures that exist in the complex matrices of plant cell walls. However, cell walls contain fractions of varying solubilities, and a few techniques are available that can analyze all fractions simultaneously. We have discovered that permethylation affords the complete dissolution of both soluble and insoluble polysaccharide fractions of plant cell walls in organic solvents such as chloroform or acetonitrile, which can then be analyzed by a number of analytical techniques including MS and NMR. In this work, NMR structure analysis of 10 permethylated polysaccharide standards was undertaken to generate chemical shift data providing insights into spectral changes that result from permethylation of polysaccharide residues. This information is of especial relevance to the structure analysis of insoluble polysaccharide materials that otherwise are not easily investigated by solution-state NMR methodologies. The preassigned NMR chemical shift data is shown to be vital for NMR structure analysis of minor polysaccharide components of plant cell walls that are particularly difficult to assign by NMR correlation data alone. With the assigned chemical shift data, we analyzed the permethylated samples of destarched, alcohol-insoluble residues of switchgrass and poplar by two-dimensional NMR spectral profiling. Thus, we identified, in addition to the major polysaccharide components, two minor polysaccharides, namely, <5% 3-linked arabinoxylan (switchgrass) and <2% glucomannan (poplar). In particular, the position of the arabinose residue in the arabinoxylan of the switchgrass sample was confidently assigned based on chemical shift values, which are highly sensitive to local chemical environments. Furthermore, the high resolution afforded by the 1H NMR spectra of the permethylated switchgrass and poplar samples allowed facile relative quantitative analysis of their polysaccharide composition, utilizing only a few milligrams of the cell wall material. As a result, the concepts herein developed will thus facilitate NMR structure analysis of insoluble plant cell wall polysaccharides, more so of minor cell wall components that are especially challenging to analyze with current methods.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
National-Tribal Critical Infrastructure Protection: Collaboration for Extraordinary National Security Benefit
This paper examines national and tribal collaborative opportunities to get ahead of the critical infrastructure insecurity problem. Recommendations are viewed through the lens of the Sandia Labs Tribal Cyber-Energy initiative and national security projects. Recommendations include 1) Collaboratively address national priority and shared challenges to gain faster and better solutions to national priority problems on a smaller yet comprehensive American Indian and Alaskan Native sovereign single-point of authority scale 2) Utilize newer standards-based technologies to provide scalable, capable, and manageable solutions for greatly expanded and connected national critical infrastructures 3) Employ Cyber-Physical-Resilient design preliminary analysis to define concept- to-disposition design requirements for preemptive critical infrastructure risk mitigation and baked-in security; 4) Develop data-centric protection to provide increased information asset protection as data shifts from data-owner operated on-premises infrastructure to virtual service provider data-steward owned and operated off-premises infrastructure; and 5) Balance shared solutions with the National Institute of Science and Technology (NIST) Cybersecurity and Risk Management frameworks, and the System Security Engineering Guidelines. As yet unallocated federal funding would support research, development, the timely application of National-Tribal critical infrastructure protection, and critical infrastructure Cyber disruption response and recovery with extraordinary mutual benefits for the foreseeable future. The Critical Infrastructure Insecurity Problem: Rapid modernization and expansive connectivity are due to advances in Information and Communications Technologies that have sweeping cyber impact across all critical infrastructure sectors. Supervisory Control and Data Acquisition and Industrial Control Systems are particularly impacted as systems long separated from the Internet are now being connected and computerized. Virtualization and mobility create a Data Everywhere-User Anywhere paradigm that has evaporated the enterprise network perimeter. There are multi-front technological challenges at play, where long depended on technologies simply don't scale to current needs resulting in a digital dichotomy of competing old and new standards. New standards-based technologies scale but are not as well-known or as widely deployed, which leaves decision makers, stakeholders, and the workforce in a quandary, caught mid-stream between the technological past and the virtual future. Rapid and expansive cyber threat accompanies disruptive change in connectivity and computational dependencies. A lack of action will exacerbate the problem if new technologies roll out without baked-in security design. The Risk: If National-Tribal CIP collaboration to design in security is not done, then an ongoing state of insufficient bolt-on security and elevated threat exposure will remain for years to come.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Interpreting test temperature and loading rate effects on the fracture toughness of polymer-metal interfaces via time–temperature superposition
Here, in this letter, we present interfacial fracture toughness data for a polymer-metal interface where tests were conducted at various test temperatures T and loading rates $\dot{δ}$. An adhesively bonded asymmetric double cantilever beam (ADCB) specimen was utilized to measure toughness. ADCB specimens were created by bonding a thinner, upper adherend to a thicker, lower adherend (both 6061 T6 aluminum) using a thin layer of epoxy adhesive, such that the crack propagated along the interface between the thinner adherend and the epoxy layer. The specimens were tested at T from 25 to 65 °C and $\dot{δ}$ from 0.002 to 0.2 mm/s. The measured interfacial toughness Γ increased as both T and $\dot{δ}$ increased. For an ADCB specimen loaded at a constant $\dot{δ}$, the energy release rate G increases as the crack length a increases. For this reason, we defined rate effects in terms of the rate of change in the energy release rate $\dot{G}$. Although not rigorously correct, a formal application of time–temperature superposition (TTS) analysis to the Γ data provided useful insights on the observed dependencies. In the TTS-shifted data, Γ decreased and then increased for monotonically increasing $\dot{G}$. Thus, the TTS analysis suggests that there is a minimum value of Γ. This minimum value could be used to define a lower bound in Γ when designing critical engineering applications that are subjected to T and $\dot{δ}$ excursions.
36 MATERIALS SCIENCE↗
Calibration of Distributed Temperature Sensors Using Commercially Available SMF-28 Optical Fiber From 22 °C to 1000 °C
Optical frequency domain reflectometry (OFDR) is a family of optical techniques which can be used to produce distributed temperature measurements from the spectral shift of an interference pattern based on the Rayleigh backscatter signature of an optical fiber. Adaptive signal processing techniques have recently been used with OFDR to record meaningful spectral shift data from commercially available SMF-28 optical fibers heated beyond 950 °C. Furthermore, a correlation between the measured spectral shift and temperature has not yet been developed at these high temperatures. To extend the measurable temperature range of OFDR in SMF-28, this work describes the development of such a correlation from room temperature (22 °C) to 1000 °C. The relationship between spectral shift and temperature change over this range was found to be best characterized by the fourth-order polynomial ΔT=(-4.241 * 10 -11 )S 4 + (-2.017 * 10 -7 )S 3 + (-3.677 * 10 -4 )S 2 + (-0.8057)S, where ΔT represents the temperature difference compared to the reference temperature, and S represents the spectral shift measured by the fibers. The calibration developed in this work assumes that the fiber has been fully annealed by heating the fiber to 1000 °C for a few hours. This paper is the first to demonstrate the calibration and use of SMF-28 distributed optical fiber sensors up to 1000 °C, enabled using adaptive OFDR-based signal processing.
47 OTHER INSTRUMENTATION↗
Antarctic evidence for an abrupt northward shift of the Southern Hemisphere westerlies at 32 ka BP
High-resolution ice core records from coastal Antarctica are particularly useful to inform our understanding of environmental changes and their drivers. Here, we present a decadally resolved record of sea-salt sodium (a proxy for open-ocean area) and non-sea salt calcium (a proxy for continental dust) from the well-dated Roosevelt Island Climate Evolution (RICE) core, focusing on the time period between 40–26 ka BP. The RICE dust record exhibits an abrupt shift towards a higher mean dust concentration at 32 ka BP. Investigating existing ice-core records, we find this shift is a prominent feature across Antarctica. We propose that this shift is linked to an equatorward displacement of Southern Hemisphere westerly winds. Subsequent to the wind shift, data suggest a weakening of Southern Ocean upwelling and a decline of atmospheric CO 2 to lower glacial values, hence making this shift an important glacial climate event with potentially important insights for future projections.
54 ENVIRONMENTAL SCIENCES↗
Correlated Anion Disorder in Heteroanionic Cubic TiOF 2
Resolving anion configurations in heteroanionic materials is crucial for understanding and controlling their properties. For anion-disordered oxyfluorides, conventional Bragg diffraction cannot fully resolve the anionic structure, necessitating alternative structure determination methods. We have investigated the anionic structure of anion-disordered cubic (ReO 3 -type) TiOF 2 using X-ray pair distribution function (PDF), 19 F MAS NMR analysis, density functional theory (DFT), cluster expansion modeling, and genetic-algorithm structure prediction. Our computational data predict short-range anion ordering in TiOF 2 , characterized by predominant cis-[O 2 F 4 ] titanium coordination, resulting in correlated anion disorder at longer ranges. To validate our predictions, we generated partially disordered supercells using genetic-algorithm structure prediction and computed simulated X-ray PDF data and 19 F MAS NMR spectra, which we compared directly to experimental data. To construct our simulated 19 F NMR spectra, we derived new transformation functions for mapping calculated magnetic shieldings to predicted magnetic chemical shifts in titanium (oxy)fluorides, obtained by fitting DFT-calculated magnetic shieldings to previously published experimental chemical shift data for TiF 4 . We find good agreement between our simulated and experimental data, which supports our computationally predicted structural model and demonstrates the effectiveness of complementary experimental and computational techniques in resolving anionic structure in anion-disordered oxyfluorides. From additional DFT calculations, we predict that increasing anion disorder makes lithium intercalation more favorable by, on average, up to 2 eV, highlighting the significant effect of variations in short-range order on the intercalation properties of anion-disordered materials.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Data Centers and Digital Assurance Workshop 3 – Mitigations for Digital Assurance Risks
The third session of the TADA (Technical Assistance for Digital Assurance) Data Centers Cohort, held on November 18, 2025, focused on developing mitigation strategies for digital assurance risks identified in previous workshops. Hosted by Idaho National Laboratory (INL) and ScottMadden, the session emphasized the application of Cyber-Informed Engineering (CIE) to data center infrastructure, particularly at the utility–data center interface. Participants revisited and ranked key digital assurance risks, including architecture and interface weaknesses, governance gaps, and AI-enabled threats. The workshop introduced the 12 principles of CIE, advocating for consequence-focused design, engineered controls, and secure information architecture to proactively reduce cyber-physical vulnerabilities. These principles were applied to critical data center systems such as power distribution, UPS, cooling, SCADA/BMS, and grid-forming batteries. The session also addressed governance challenges at the interconnection boundary, highlighting the need for clear roles in telemetry sharing, firmware management, and trip settings. Special attention was given to emerging risks from behind-the-meter (BTM) generation, including reverse-power flow and the integration of small modular reactors (SMRs), which shift data centers from large loads to complex generation nodes. Participants explored how interconnection agreements can serve as enforceable instruments for digital assurance, and reviewed gaps in current standards such as NERC CIP, IEC 62443, and IEEE 1547. The workshop concluded with pathways to standardization, including model agreement language, state-level programs, and expanded NERC guidance. INL also presented tools and frameworks for secure procurement and supplier risk management, reinforcing the need for integrated engineering and policy solutions to secure the evolving data center–grid ecosystem. Session 3 of 3.
24 - POWER TRANSMISSION AND DISTRIBUTION↗
PVAnalytics: A Python Package for Automated Processing of Solar Time Series Data
Multiple publicly available software packages exist that analyze solar time series data, including RdTools and Solar Data Tools, among others. Several of these packages contain their own unique quality assurance (QA) and feature recognition algorithms. The python PVAnalytics package was developed to offer an internally consistent source for these analysis tools, making it easier for the end user to deploy these routines on his or her solar data. The PVAnalytics package currently contains routines for outlier detection, inverter clipping detection, irradiance and temperature checks, orientation checks, and data shift detection, among other functions. These functions have been aggregated from various sources including Solar Forecast Arbiter, RdTools, and the QA process developed by NREL's PV Fleets Initiative. We are continuously adding new functionality to the package, including documentation, examples and algorithms. By bundling QA functionality into a single software package, we hope to make PVAnalytics a comprehensive software library to support analysis of solar metadata and time series data.
data cleaning↗
SMART conductor on round core (CORC ® ) wire via integrated optical fibers
Superconducting cables based on high temperature superconductors (HTS) are necessary for applications requiring large currents and low inductance, such as compact fusion reactors. In this paper, we report the proof-of-concept of a SMART Conductor on Round Core (CORC ® ) wire realized via integration of optical fibers into the copper core. A SMART CORC ® wire with integrated optical fibers was manufactured and its capabilities have been experimentally demonstrated. Results show that by interrogating the optical fibers via Rayleigh backscattering, a Spectral Shift signal as a function of time and position along the cable can be used to detect and locate hot-spots that are developed within the wire or its terminations. It has been found that highly localized current injection into the terminations could initiate hot-spots within the cable at locations where current redistribution between tapes occur. This effect is virtually eliminated when adequate current connections are used that inject current evenly along the cable terminations. Normal zone propagation velocities have been calculated as a function of time using Spectral Shift data for a heater-induced quench as well as a quench induced by overcurrent. In both cases the normal zone propagation velocity was about 6 cm s -1 , but in the heater-induced experiment it was preceded by 500 ms of slower propagation at 2.5 cm s -1 .
Physics↗
Frustration-driven magnetic correlations in the spin-$\frac{5}{2}$ triangular lattice antiferromagnet RbFe(HPO 3 ) 2
Here, a detailed study of the structural and magnetic properties of a spin-5/2 triangular lattice antiferromagnet RbFe(HPO 3 ) 2 is presented using x-ray diffraction, magnetization, heat capacity, and 31 P nuclear magnetic resonance (NMR) experiments on a polycrystalline sample. The crystal structure features an equilateral triangular lattice of Fe 3+ ions. The thermodynamic measurements reveal the onset of a magnetic long-range order at 𝑇 N1 ≃7.8K in zero field, followed by another low-temperature field-induced ordering at 𝑇 N2 in higher fields. The transition at 𝑇 N1 is further confirmed from the NMR spin lattice relaxation measurements. The value of the frustration ratio (𝑓≃7) implies moderate spin frustration in the compound. The 31 P NMR spectra exhibit two distinct spectral lines corresponding to two inequivalent phosphorus sites (P1 and P2), consistent with the crystal structure. The P1 site is strongly coupled with an isotropic hyperfine coupling of 𝐴$^{iso}_{hf}$ = 0.55(2) T/𝜇 B while the P2 site is weakly coupled with 𝐴$^{iso}_{hf}$ = 0.25(3) T/𝜇 B with the Fe 3+ ions. The magnetic susceptibility and NMR shift data are described well assuming a spin-5/2 isotropic triangular lattice antiferromagnetic model with an average exchange coupling of 𝐽/𝑘 B = 2.8(2)K. Below 𝑇 N1 , the spectra evolve into a nearly rectangular powder pattern, indicating a commensurate antiferromagnetic type order. The 31 P spin-lattice relaxation rate well below 𝑇N1 follows a 𝑇 3 temperature dependence, implying a two-magnon Raman scattering mechanism in the ordered state. Three well-defined phase regimes are clearly ascertained in the 𝐻−𝑇 phase diagram, reflecting a weak magnetic anisotropy in the compound.
Nagpal, V. [Indian Institute of Science Education ↗
Application of Eh-pH Diagrams on Acid Leaching Systems for the Recovery of REEs from Bastnaesite, Monazite and Xenotime
Bastnaesite, monazite and xenotime are rare earth minerals (REMs) that are typical sources for rare earth elements (REEs). To advance the understanding of their leaching and precipitation behavior in different hydrometallurgical processes, Eh-pH diagrams were constructed and modified using the HSC 9.9 software. The aqueous stability of rare earth elements in H 2 O and acid leaching systems, i.e., the REE-Ligands-H 2 O systems, were depicted and studied based on the Eh-pH diagrams. This study considers the most relevant lixiviants, their resulting equilibrium states and the importance in the hydrometallurgical recovery of rare earth elements (REMs). A literature review was performed summarizing relevant Eh-pH diagrams and associated thermodynamic data. Shifting stability regions for REEs were discovered with additions of acid ligands and a narrow stability region for soluble REE-(SO 4 /Cl/NO 3 ) complexes under highly acidic conditions. As such, the recovery of REEs can be enhanced by adjusting pH and Eh values. In addition, the Eh-pH diagrams of the major contaminants (i.e., Fe, Ca and Al) in leaching systems were studied. The resulting Eh-pH diagrams provide possible insights into potential passivation on the particle surfaces due to the formation of an insoluble product layer.
36 MATERIALS SCIENCE↗