Oracle-RLAIF: Improving Multi-modal Video Model Training with Reinforcement Learning from AI Feedback with Ranked Preferences
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
A method includes determining a feature importance ranking for each pair of clusters of a plurality of clusters to generate a first plurality of feature importance rankings. The method further includes determining a feature importance ranking between a particular data element and each cluster to generate a second plurality of feature importance rankings. A distance value associated with each pair of clusters of the plurality of clusters is determined to generate a plurality of distance values, and a probability value associated with each data element is determined to generate a plurality of probability values. The method further includes weighting the first plurality of feature importance rankings based on the plurality of distance values to determine a first plurality of weighted feature importance rankings and weighting the second plurality of feature importance rankings based on the plurality of probability values to determine a second plurality of weighted feature importance rankings.
We present a reduced-scaling auxiliary-field quantum Monte Carlo (AFQMC) framework designed for large molecular systems and ensembles, with or without coupling to optical cavities. Our approach leverages the natural block sparsity of the Cholesky decomposition (CD) of electron repulsion integrals in molecular ensembles and employs tensor hypercontraction (THC) to efficiently compress low-rank Cholesky blocks. By representing the Cholesky vectors in a mixed format, keeping high-rank blocks in block-sparse form and compressing low-rank blocks with THC, we reduce the scaling of exchange-energy evaluation from quartic to robust cubic in the number of molecular orbitals N, while lowering memory from cubic toward quadratic. Benchmark analyses on one-, two-, and three-dimensional molecular ensembles (up to ∼1,200 orbitals) show that (a) the number of nonzeros in Cholesky tensors grows linearly with system size across dimensions; (b) the average numerical rank increases sublinearly and does not saturate at these sizes; and (c) rank heterogeneity─some blocks nearly full rank and many low rank, naturally motivates the proposed mixed block sparsity and THC scheme for efficient calculation of exchange energy. In conclusion, we demonstrate that the mixed scheme yields cubic wall-time scaling with favorable prefactors and preserves AFQMC accuracy.
The Energy & Environmental Research Center (EERC) conducted a laboratory-scale coal-derived graphene (CDG) project focused on developing a technological process for making graphene from four U.S. domestic coal or coal wastes, including lignite from North Dakota, subbituminous coal from Wyoming, bituminous coal from Utah, and anthracite from Pennsylvania. The project was divided into two performance or budget periods (BPs), with BP1 comprising the up-front laboratory experiments to make graphene materials from coal beginning on May 1, 2020, to April 30, 2022. BP2 was conducted from May 1, 2022, to April 30, 2023, and was focused on analyzing the CDG process economic feasibility and the technical gaps for technological scale-up and commercialization. During this project, a few different coal-derived high-value products have been demonstrated, including graphite, graphene oxide (GO), reduced graphene oxide (rGO), and graphene quantum dots (GQDs). A new graphite microstructure was discovered and named “croissant graphite” because of the exterior morphological and textural resemblance to croissant food items sold in commercial groceries stores. The new graphite structure and the associated preparation from coal or coal waste feedstocks has been the subject of a U.S. patent application. The systematic experimental processes involving coal cleaning, upgrading, and conversion to high-value carbon products culminated into a developed upgraded coal-to-products (UCP) technology that is being pursued for potential fast-track commercialization, if funding is available. It is envisioned that commercialization of the UCP technology would increase consumption of U.S. domestic coals or coal wastes to make environmentally sustainable high-value products for the electronics industry, high-energy-storage applications, and clean energy technologies such as electric vehicle (EV) lithium-ion batteries (LIBs), for which graphite has become a critical mineral commodity. Croissant graphite microstructures, when observed by field emission scanning electron microscopy (FESEM), display wavy surface morphology and often grow from a base that is made of graphitized particles with honeycomb-like layers, which are believed to be graphene layers. While more studies are needed to fully ascertain the mechanisms of the croissant graphite microstructure formation, it is postulated that their growth may begin from curling of the graphene sheets into ribbon-like structures, and continuous growth and densification of the ribbon-like structures forms croissant microstructures. Additional studies are ongoing to evaluate the electrochemical performance of croissant graphite for LIB applications and to determine the experimental conditions necessary to tune on/off croissant formation so that it can be either optimized or suppressed depending on performance evaluation results. In addition to the discovery of croissant graphite, the graphitization process from the four coal ranks in general was successful. X-ray diffraction (XRD) analysis showed that the degree of graphitization (DoG) ranged from 12% to 80% in an early sample set, and further optimization on lignite coal produces a DoG of about 92%, which was spectacular to see as lignite is the lowest-rank coal. Thus, it is expected that the graphitization performance for higher-rank coals will be similar or better when optimized as well. The coal-derived graphite was used to make GO and rGO. Analytical characterization, e.g., by methods such as Raman spectroscopy, XRD, Fourier transform infrared (FTIR) spectroscopy and FESEM, showed that the sequence of converting the coal to graphite, exfoliating it to GO, and then chemically reducing the GO to rGO was successful. Although coal naturally contains aromatic compounds and some relatively small-sized condensed aromatic units, it does not contain graphene sheets. In the UCP process, the aromatic domains in the coals, particularly low-rank coals, are concentrated and condensed further into graphene sheets, which are ordered into a 3D stack during graphitization. The synthesized graphite is then unpacked by methods such as exfoliation to various graphene products. GQDs were synthesized from all four coal types, and their optical properties were demonstrated to be tunable by the coal precursor preprocessing treatments. In all four coal types, enhanced optical properties were observed for the produced GDQs with incremental improvements made to the coal precursors. GQDs produced from raw coal samples displayed lower ultraviolet–visible (UV–Vis) spectroscopy absorbance intensity compared to those obtained from cleaned and upgraded coal residues. The photoluminescence (PL) intensities also varied with pretreatment conditions and with the concentration of GQDs in aqueous solutions. GQDs obtained from anthracite show longer emission wavelengths and can be excited by visible light as opposed to GQDs derived from the other coal ranks. UV fluorescence 3D maps and spectra revealed that the emission wavelength at which the GQDs solutions display the highest intensity was slightly redshifted based on the coal precursor pretreatments. In low-rank coal (lignite and subbituminous) samples, two clusters were observed in the maps for GQDs, which may suggest that there are potentially two types of fluorophores in solution or two main size populations. The ability to tune the properties of GQDs based on processing methods can be exploited to make GQDs for various optical display or optoelectronics applications. The results also highlight the importance of removing coal-borne impurities to improve the quality of the coal precursor for preparation of graphene products. Coal and/or coal wastes preprocessing methods were developed and applied to clean and upgrade the coal precursors prior to graphitization and subsequent conversion to graphene products. The preprocessing methods involve high specific-gravity separations, mineral acid cleaning (no hydrofluoric acid), and subsequent upgrading by reducing the coal-borne heteroatom (nitrogen, sulfur, and oxygen) content using proprietary chemical agents. Analytical characterization revealed that the preprocessing steps were successful, with ash reductions that range from 38% to 80% and residual ash content that was below the 5 wt% initial target. Based on proximate and ultimate analysis, the heteroatom reduction reactions produced upgraded coal residues with the oxygen content reduced by 8% to 24%, with additional reductions in the nitrogen and sulfur contents. An initial assessment of the waste streams from the UCP process shows very small to negligible environmental impact due to CO 2 , NO x , and SO x because most process steps are performed under inert atmosphere with argon. Consequently, reactive oxygen environments that tend to create these species are avoided. The inorganic and potentially hazardous species are released into aqueous waste streams that are easy to handle for proper disposal. The liquid waste streams were found to contain low-level concentrations of rare-earth elements (REEs), which could be concentrated and recovered as value-added by-products. Additionally, the volatile and gaseous fractions from carbonization and heat treatment contain useful organic compounds that can also be recovered as potential valuable by-products. Thus, the UCP technology is considered an environmentally sustainable and promising emerging technology for making high-value products from coal and coal wastes, with potential additional value-added by-products. Analysis of potential markets for the coal-derived carbon products shows a strong demand in both niche market sectors and across a wide variety of other industrial sectors. Graphite is currently considered a critical mineral commodity that has a large and growing demand in the LIB industry for EV applications. Based on data from Fortune Business Insights (2022) and Marketwatch (2023) reports, the average global graphite market is projected to reach about 33 billion by 2028, growing at a compound annual growth rate (CAGR) of about 7%, with much of this growth expected to be in the LIB industry. GO and rGO have strong market potentials in various application areas, such as coatings for anticorrosion, anti-icing, and antimicrobial protection, thermal barriers, wear resistance, sensors, additive manufacturing such as 3D inks, and others. GQDs are the emerging key player in the bioimaging, photovoltaics, and light-emitting diodes (LEDs) applications, with the potential to replace traditional semiconductor quantum dots (SQDs), which are based on metallic systems that are more toxic and more expensive. Biomedical applications of GQDs are becoming more attractive because of low to no toxicity and extremely low cost compared to SQDs. The major challenges for scale-up and commercialization of coal-derived carbon products such as graphene vary from the inherent attributes of graphene itself to reluctance to accept graphene in new manufacturing processes because of the uncertainty of the unknown. The 2D nature of graphene materials with a thickness of one atom presents significant challenges to proper handling/processing, and process scale-up becomes difficult because it requires high-end, expensive equipment, even for routine handling and analysis for quality assurance and control. Pristine graphene can also be extremely difficult to work into other matrices, thus hindering downstream processibility, especially at large scale. Currently, the cost of graphene and graphene products is still high and presents an economic risk that tends to slow down investment in scaling up emerging technologies. The lack of a standard for graphene materials for quality assurance and quality control poses a great challenge not only for the markets but also for commercialization efforts. A first-look economic feasibility analysis of the UCP technology provided valuable information that suggests the UCP process would be feasible, especially when it is scaled to a pilot scale and could be more competitive at the full scale. Graphitization was found to be the most energy-consuming and most capital-intensive step in the overall process. In small laboratory- and bench-scale experiments, labor is a significant contributor to the total process costs. Although these energy, capital, and labor constraints contribute to a higher selling price for the product, a preliminary economic model suggests that the process would be feasible at large scale when the process is fully integrated, optimized, and automated.
We establish non-asymptotic efficiency guarantees for tensor decomposition–based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference , the estimation of the full distributional parameter tensor, and (ii) multiway analysis , the recovery of its canonical polyadic (CP) decomposition factors. Our main result shows that in the rank-one setting, a rank-constrained maximum-likelihood estimator achieves multiway analysis with variance matching the Cramér–Rao Lower Bound (CRLB) up to absolute constants and logarithmic factors. This provides a general framework for studying “near-efficient” multiway estimators in finite-sample settings. For higher ranks, we illustrate that our multiway estimator may not attain the CRLB; nevertheless, CP-based parametric inference remains nearly minimax optimal, with error bounds that improve on prior work by offering more favorable dependence on the CP rank. Numerical experiments corroborate near-efficiency in the rank-one case and highlight the efficiency gap in higher-rank scenarios.
Combining the strengths of MPIProf and IOT, an efficient and systematic method is devised for I/O characterization at the per-job, per-rank, per-file and per-call levels of HPC programs running on the NASA Advanced Supercomputing Center. This method is applied to answer four I/O questions in this paper. A total of 13 MPI programs and 15 cases, ranging from 24 to 5968 ranks, are analyzed to establish the I/O landscape from answers to the four questions. Four of the 13 programs use MPI I/O and the behavior of their collective writes depends on the specific implementation of the MPI library used. The SGI MPT library, the prevailing MPI library for our systems, was found to gather small writes from a large number of ranks to perform larger writes by a small subset of collective buffering ranks. The number of collective buffering ranks invoked by MPT depends on the Lustre stripe count and the number of nodes used for the run. A demonstration of varying the stripe count to achieve double-digit speedup of one program's I/O was presented. Another program, which concurrently opens private files by all ranks and could potentially create a heavy load on the Lustre servers, was identified. The ability to systematically characterize I/O for a large number of programs running on a supercomputer, seek I/O optimization opportunity and identify programs that could cause a high load and instability on the filesystems is important for pursuing exascale in a real production environment.
Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face several challenges, including the need for rank adaptivity, robustness, and computational efficiency during the fine-tuning process. We introduce GeoLoRA, a novel approach that addresses these limitations by leveraging dynamical low-rank approximation theory. GeoLoRA requires only a single backpropagation pass over the small-rank adapters, significantly reducing computational cost as compared to similar dynamical low-rank training methods and making it faster than popular baselines such as AdaLoRA. This allows GeoLoRA to efficiently adapt the allocated parameter budget across the model, achieving smaller low-rank adapters compared to heuristic methods like AdaLoRA and LoRA, while maintaining critical convergence, descent, and error-bound theoretical guarantees. The resulting method is not only more efficient but also more robust to varying hyperparameter settings. We demonstrate the effectiveness of GeoLoRA on several state-of-the-art benchmarks, showing that it outperforms existing methods in both accuracy and computational efficiency.
Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.
The Allegheny Plateau in western Pennsylvania, western Maryland, and northern West Virginia has relatively flat-lying strata with southwest-northeast-trending anticlines cored by splay faults originating from the thrust faults and southeast-northwest-trending lineaments. The lineaments define both the structural relief of the anticlines and the coal rank. Coal rank in the Pennsylvanian Allegheny Group coals is medium volatile bituminous in the region of less-prominent structural relief and low volatile bituminous in the region with more pronounced anticlines. Zinc and Cl exhibit high values in coals in the vicinity of the lineaments. Although coal rank was not a parameter in the Principal components analysis, the highest rank coals clustered together in a quadrant defined, in part, by the Zn concentration. Zinc was selected as a parameter due to its possible link with hydrothermal mineralization and Zr and TiO 2 /Al 2 O 3 were selected based on their presumed association with detrital mineral influences. The highest rare earths + Y values in benches of the Lower Kittanning coal were found at sites close to the lineaments. Negative or negligible Ce anomalies (δCe) and strongly positive Gd anomalies (δGd) suggest marine or hydrothermal influences and negative Eu anomalies (δEu) along with high TiO 2 /Al 2 O 3 values suggest a terrestrial input. In conclusion, the plots of δCe vs. δGd and δCe vs. δEu show that the low volatile bituminous coals are segregated from the other coals, suggesting that the factors that influenced coal rank also influenced the distribution of the rare earth elements.
This work aims to advance computational methods for projection-based reduced-order models (ROMs) of linear time-invariant (LTI) dynamical systems. For such systems, current practice relies on ROM formulations expressing the state as a rank-1 tensor (i.e., a vector), leading to computational kernels that are memory bandwidth bound and, therefore, ill-suited for scalable performance on modern architectures. This weakness can be particularly limiting when tackling many-query studies, where one needs to run a large number of simulations. This work introduces a reformulation, called rank-2 Galerkin, of the Galerkin ROM for LTI dynamical systems which converts the nature of the ROM problem from memory bandwidth to compute bound. We present the details of the formulation and its implementation, and demonstrate its utility through numerical experiments using, as a test case, the simulation of elastic seismic shear waves in an axisymmetric domain. We quantify and analyze performance and scaling results for varying numbers of threads and problem sizes. In conclusion, we present an end-to-end demonstration of using the rank-2 Galerkin ROM for a Monte Carlo sampling study. We show that the rank-2 Galerkin ROM is one order of magnitude more efficient than the rank-1 Galerkin ROM (the current practice) and about 970 times more efficient than the full-order model, while maintaining accuracy in both the mean and statistics of the field.
Background Large language models (LLMs) are increasingly used medicine for diverse applications including differential diagnostic support. The training data used to create LLMs such as the Generative Pretrained Transformer (GPT) predominantly consist of English-language texts, but LLMs could be used across the globe to support diagnostics if language barriers could be overcome. Initial pilot studies on the utility of LLMs for differential diagnosis in languages other than English have shown promise, but a large-scale assessment on the relative performance of these models in a variety of European and non-European languages on a comprehensive corpus of challenging rare-disease cases is lacking. Methods We created 4917 clinical vignettes using structured data captured with Human Phenotype Ontology (HPO) terms with the Global Alliance for Genomics and Health (GA4GH) Phenopacket Schema. These clinical vignettes span a total of 360 distinct genetic diseases with 2525 associated phenotypic features. We used translations of the Human Phenotype Ontology together with language-specific templates to generate prompts in English, Chinese, Czech, Dutch, French, German, Italian, Japanese, Spanish, and Turkish. We applied GPT-4o, version gpt-4o-2024-08-06, and the medically fine-tuned Meditron3-70B to the task of delivering a ranked differential diagnosis using a zero-shot prompt. An ontology-based approach with the Mondo disease ontology was used to map synonyms and to map disease subtypes to clinical diagnoses in order to automate evaluation of LLM responses. Findings For English, GPT-4o placed the correct diagnosis at the first rank 19.9% and within the top-3 ranks 27.0% of the time. In comparison, for the nine non-English languages tested here the correct diagnosis was placed at rank 1 between 16.9% and 20.6%, within top-3 between 25.4% and 28.6% of cases. The Meditron3 model placed the correct diagnosis within the first 3 ranks for 20.9% of cases in English and between 19.9% and 24.0% for the other nine languages. Interpretation The differential diagnostic performance of LLMs across a comprehensive corpus of rare-disease cases was largely consistent across the ten languages tested. This suggests that the utility of LLMs in clinical settings may extend to non-English clinical settings.
Online deep learning (ODL) has become an important methodology for modeling time-based performance of computer systems. An open problem is the intelligent selection of features from raw workload traces of computer systems. The best methods are overly sensitive to noisy data, causing frequent feature changes and re-training. Using all available features inflates training time and introduces model artifacts if some features should have been dropped. We present WinnowML, a method for automatically determining the most relevant feature subset for a predictive time-series model. WinnowML combines existing feature ranking algorithms and a history of each feature's ranking to iteratively rank a feature set to lower prediction error and maximize long term relevance. From this ranked feature set, the most relevant and stable subset is selected to train a model. Experimentally, we show how WinnowML can lower a model's mean absolute relative error up to 42% on average compared to the closest performing approach. Additionally, we lower the fluctuation in feature ranking and selection up to 65%. We also demonstrate how to combine WinnowML and a model search tool to provide improvements in performance of up to 14.5% when compared to using all the feature available.
The software provides a measure selection technique indicating cost effective retrofit activities that can be applied to a home using a standard Savings to Investment Ratio (SIR). Users must provide an input file describing the characteristics of the home to be evaluated. The software takes the input data provided and calculates energy savings and cost savings predicted for a standard set of measures given the input parameters. The Weatherization Assistant computes estimates of pre-retrofit whole building space heating and cooling energy consumptions based on the house description data supplied by the user. The consumptions are computed using a monthly heating and cooling variable base degree-day method by algorithms similar to those developed for the CIRA program [LBL, 1982]. The building consumptions are needed in computing the energy savings from measures affecting the efficiencies of the heating and cooling equipment. Weatherization Assistant then computes the energy savings and costs for each individual measure applicable to the building described as if it were the only measure installed in the house. From these energy savings, a discounted dollar savings over the life of each measure is computed. The ratio of this dollar savings to the cost of installing the measure, the "savings-to-investment ratio" (SIR), is used in an initial ranking of the measures' effectiveness. The "interacted" savings and SIR of measures are then determined assuming the measures are added to the house collectively, in order of their ranking, e.g., the second ranked measure is installed in the house initially described by the user after having been modified by the first ranked measure. If this second-ranked measure's updated SIR is greater than a user-defined limit, the measure is left implemented, else it is removed so that the next measure's effectiveness is not dependent on it. The choice between two mutually exclusive measures (such as different levels of insulation) is made on the basis of their "net present value" (NPV), the difference of life-time savings and installation cost, rather than their SIR. This has been shown to be the more correct criterion on which to base the selection between two measures, both of which cannot be installed. The audit computes and reports to the user the energy savings, discounted dollar savings, installation cost, and SIR for each measure considered cost-effective. For those with SIR greater than the user-designated cutoff, a materials list gives the material name, type, and quantity required for installation of the measure. Weatherization Assistant permits entry of pre-retrofit billing data for gas or electrically heated homes or homes with electric air-conditioning. The user may then make the decision to have the savings of the measures adjusted to reflect the difference in billed consumption and that predicted by the program.
Recommendations are made to enhance user confidence in property values included in the Molten Salt Thermal Database-Thermochemical Properties (MSTDB-TC). Specifically, it is recommended that all available measured values be included with a transparent assessment of each to arrive at a preferred value for each salt composition in the database. The use of a quality assessment and ranking system is recommended for data and property values compiled in the MSTDB-TC that is analogous to the approach developed for data and property values included in the MSTDB-Thermophysical Properties (TP) database. The approach includes assessments of five features of data collection: the method used to measure the property value, calibration of devices used to make the measurements, the quantified uncertainty of the results, control of the environmental conditions, and determination of the salt composition. The quality of each facet is ranked as High, Moderate, or Incomplete based on objective metrics. The overall quality of the dataset is ranked based on rankings of the five data features and traceability of the reported property value, with rankings of A and B indicating the data and property value are deemed suitable for quantitative use, C indicating the value is computed and not validated and U indicating uncertainties restrict the recommended use to qualitative purposes. Sufficient information should be provided or cited within each data set included in the database to verify the reported property value. The recommended approach is suitable for assessing data already in the MSTDB-TC and screening new entries.
The variational quantum eigensolver is one of the most promising algorithms for near-term quantum computers. It has the potential to solve quantum chemistry problems involving strongly correlated electrons with relatively low-depth circuits, which are otherwise difficult to solve on classical computers. The variational eigenstate is constructed from a number of factorized unitary coupled-cluster terms applied onto an initial (single-reference) state. Current algorithms for applying one of these operators to a quantum state require a number of operations that scale exponentially with the rank of the operator. We exploit a hidden SU(2) symmetry to allow us to employ the linear combination of unitaries approach, Our Prepare subroutine uses n+2 ancilla qubits for a rank-n operator. Our Select (U) scheme uses O(n) Cnot gates. This results in a full algorithm that scales like the cube of the rank of the operator n 3 , a significant reduction in complexity for rank five or higher operators. This approach, when combined with other algorithms for lower-rank operators (when compared to the standard implementation), will make the factorized form of the unitary coupled-cluster approach much more efficient to implement on all types of quantum computers.
Abstract. Surface gravity waves play a critical role in several processes, including mixing, coastal inundation, and surface fluxes. Despite the growing literature on the importance of ocean surface waves, wind–wave processes have traditionally been excluded from Earth system models (ESMs) due to the high computational costs of running spectral wave models. The development of the Next Generation Ocean Model for the DOE’s (Department of Energy) E3SM (Energy Exascale Earth System Model) Project partly focuses on the inclusion of a wave model, WAVEWATCH III (WW3), into E3SM. WW3, which was originally developed for operational wave forecasting, needs to be computationally less expensive before it can be integrated into ESMs. To accomplish this, we take advantage of heterogeneous architectures at DOE leadership computing facilities and the increasing computing power of general-purpose graphics processing units (GPUs). This paper identifies the wave action source terms, W3SRCEMD, as the most computationally intensive module in WW3 and then accelerates them via GPU. Our experiments on two computing platforms, Kodiak (P100 GPU and Intel(R) Xeon(R) central processing unit, CPU, E5-2695 v4) and Summit (V100 GPU and IBM POWER9 CPU) show respective average speedups of 2× and 4× when mapping one Message Passing Interface (MPI) per GPU. An average speedup of 1.4× was achieved using all 42 CPU cores and 6 GPUs on a Summit node (with 7 MPI ranks per GPU). However, the GPU speedup over the 42 CPU cores remains relatively unchanged (∼ 1.3×) even when using 4 MPI ranks per GPU (24 ranks in total) and 3 MPI ranks per GPU (18 ranks in total). This corresponds to a 35 %–40 % decrease in both simulation time and usage of resources. Due to too many local scalars and arrays in the W3SRCEMD subroutine and the huge WW3 memory requirement, GPU performance is currently limited by the data transfer bandwidth between the CPU and the GPU. Ideally, OpenACC routine directives could be used to further improve performance. However, W3SRCEMD would require significant code refactoring to make this possible. We also discuss how the trade-off between the occupancy, register, and latency affects the GPU performance of WW3.
Solar-stimulated chlorophyll fluorescence measured with the Fraunhofer line depth method has correlated well with vegetation stress in previous studies. However, the instruments used in those studies were limited to a single solar absorption line (e.g. 656.3 nm), obviating the red/far-red ratio (R/FR) method. Optics and detector technology have reached the level whereby multiple, very narrow Fraunhofer lines are resolvable. Thirteen such lines span the visible spectrum in the red to far-red region where chlorophyll fluorescence occurs. Fluorescence intensities at the 13 Fraunhofer line wavelengths were used to model emission spectra. The source data were collected for summer and fall bean crops (Phaseolus vulgaris L.) subjected to various levels of nitrogen fertilization. The intensities were adjusted to account for Fraunhofer line depth and atmospheric transmittance. Multiple R/FR fluorescence ratios, calculated from the modeled fluorescence spectra, correlated strongly with leaf chlorophyll concentration and well with applied nitrogen. The ratio yielding the best correlation with chlorophyll utilized red fluorescence at the 694.5 nm Fraunhofer line and farred fluorescence at the 755.6 nm Fraunhofer line. Twenty R/FR ratios, each evaluated for the maximum differential between low and high (optimal) nitrogen treatments, ranked higher in some cases and lower in others, possibly related to the time of year the crops were grown and the stage of growth of the crops. Ratios with 728.9 nm and 738.9 nm in the denominator consistently ranked in the lowest and next lowest quartile, respectively. Ratios of the 656.3 nm Fraunhofer line and the 755.6 nm line consistently ranked highest for the summer crop. Ratios with 755.6 nm in the denominator ranked in the upper quartile for 10 out of 12 measurement dates. Differences in ratio ranking indicate that physiological conditions may be estimated using selected ratios of Fraunhofer lines within the context of R/FR analysis. A passive instrument designed to monitor R/FR chlorophyll fluorescence (i.e. vegetation stress) from orbit could be built today.
We present a machine-learning-based approach to ranking images based on learned priorities. Unlike previous methods for image evaluation, which typically assess the value of each image based on the presence of predetermined specific features, this method involves using two levels of machine-learning classifiers: one level is used to classify each pixel as belonging to one of a group of rather generic classes, and another level is used to rank the images based on these pixel classifications, given some example rankings from a scientist as a guide. Initial results indicate that the technique works well, producing new rankings that match the scientist's rankings significantly better than would be expected by chance. The method is demonstrated for a set of images collected by a Mars field-test rover.