Search NASA⌕ Search

SEARCH · Search NASA

Results for “text analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

229 records · Page 13

Assessing the distinguishable cluster approximation based on the triple bond-breaking in the nitrogen molecule

Obtaining the correct potential energy curves for the dissociation of multiple bonds is a challenging problem for ab initio methods which are affected by the choice of a spin-restricted reference function. Coupled cluster (CC) methods such as CCSD (coupled cluster singles and doubles model) and CCSD(T) (CCSD + perturbative triples) correctly predict the geometry and properties at equilibrium but the process of bond dissociation, particularly when more than one bond is simultaneously broken, is much more complicated. New modifications of CC theory suggest that the deleterious role of the reference function can be diminished, provided a particular subset of terms is retained in the CC equations. The Distinguishable Cluster (DC) approach of Kats and Manby [J. Chem. Phys. 139, 021102 (2013)], seemingly overcomes the deficiencies for some bond-dissociation problems and might be of use in quasi-degenerate situations in general. DC along with other approximate coupled cluster methods such as ACCD (approximate coupled cluster doubles), ACP-D45, ACP-D14, 2CC, and pCCSD(α, β) (all defined in text) falls under a category of methods that are basically obtained by the deletion of some quadratic terms in the double excitation amplitude equation for CCD/CCSD (coupled cluster doubles model/coupled cluster singles and doubles model). Here these approximate methods, particularly those based on the DC approach, are studied in detail for the nitrogen molecule bond-breaking. The N{sub 2} problem is further addressed with conventional single reference methods but based on spatial symmetry-broken restricted Hartree–Fock (HF) solutions to assess the use of these references for correlated calculations in the situation where CC methods using fully symmetry adapted SCF solutions fail. The distinguishable cluster method is generalized: 1) to different orbitals for different spins (unrestricted HF based DCD and DCSD), 2) by adding triples correction perturbatively (DCSD(T)) and iteratively (DCSDT-n), and 3) via an excited state approximation through the equation of motion (EOM) approach (EOM-DCD, EOM-DCSD). The EOM-CC method is used to identify lower-energy CC solutions to overcome singularities in the CC potential energy curves. It is also shown that UHF based CC and DC methods behave very similarly in bond-breaking of N{sub 2}, and that using spatially broken but spin preserving SCF references makes the CCSD solutions better than those for DCSD.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost

Deep learning is revolutionizing many areas of science and technology, especially image, text, and speech recognition. In this paper, we demonstrate how a deep neural network (NN) trained on quantum mechanical (QM) DFT calculations can learn an accurate and transferable potential for organic molecules. We introduce ANAKIN-ME (Accurate NeurAl networK engINe for Molecular Energies) or ANI for short. ANI is a new method designed with the intent of developing transferable neural network potentials that utilize a highly-modified version of the Behler and Parrinello symmetry functions to build single-atom atomic environment vectors (AEV) as a molecular representation. AEVs provide the ability to train neural networks to data that spans both configurational and conformational space, a feat not previously accomplished on this scale. We utilized ANI to build a potential called ANI-1, which was trained on a subset of the GDB databases with up to 8 heavy atoms in order to predict total energies for organic molecules containing four atom types: H, C, N, and O. To obtain an accelerated but physically relevant sampling of molecular potential surfaces, we also proposed a Normal Mode Sampling (NMS) method for generating molecular conformations. Through a series of case studies, we show that ANI-1 is chemically accurate compared to reference DFT calculations on much larger molecular systems (up to 54 atoms) than those included in the training data set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Erratum: “History of atomic layer deposition and its relationship with the American Vacuum Society” [J. Vac. Sci. Technol. A 31, 050818 (2013)]

The authors of this review article published in 20131 would like to correct some text and references relating to the first observations and publications on molecular layering. In Sec. II, “Early Years of Atomic Layer Processes” in the original article,1 the first two sentences of the fourth paragraph should instead say “The ALD principle, where surface reactions follow a binary sequence of self-limiting half-reactions, was reported under the name ‘molecular layering’ in the 1960s by S. I. Kol’tsov from Leningrad Technological Institute.2–6 These experiments were conducted under the scientific supervision of V. B. Aleskovskii. The ‘framework hypothesis,’ an antecedent to molecular layering, was proposed by V. B. Aleskovskii in 1952.6” In addition, again in this same section and paragraph, the last two sentences should instead say “In the 1969 article,3 the authors report that the initial reaction between TiCl4 and Si–OH tends to involve 3 Si–OH, forming one Ti–Cl, whereas after the first water step, the second TiCl4 exposure reacts with 2 Ti–OH, forming Ti–Cl2 groups. In the 1969 paper,3 a planar thin film was not produced or evaluated, although nanolayers were prepared by molecular layering at that time.6” These corrections do not affect other sections or the conclusions drawn in the article.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Correction to “Ruthenium Dye Excitations and Relaxations in Natural Sunlight”

An error in computing the optical rate coefficients for dye RuP was discovered in Table S4 of the Supporting Information Section S8 Model S? for this article, published in J. Phys. Chem. A, 2021, 125, 4365-4372, 10.1021/acs.jpca.1c02386. The optical rate coefficients include absorption, stimulated emission, and ground-state bleach associated with the ground state and the singlet and triplet excited states as well as for the excited-state absorption between the excited states and implicit higher-energy excited states. The optical rate coefficients for continuous solar irradiance were computed using eq 3 of the main text in which the product of the individual signal components and the solar spectrum are integrated and multiplied by the fundamental optical rate coefficient. We determined the incorrect signal components were used for RuP in the published Supporting Information Table S4. The corrected Table S4 column for RuP is presented with the reported values from the original paper in the corrected Supporting Information. New simulations have been performed using the corrected values, and the results were used to update Figures 5 and 6 and also Figure S9 in the corrected Supporting Information. The published conclusions are unchanged. The populations of RuP excited states, Figure 5, are only marginally smaller, which should be expected with minor changes to the optical rate coefficients. There is not a significant change in the results for the number of radiative and nonradiative interactions per dye per second (the optical transitions and nonradiative transitions increased, respectively, by approximately 2% and 10%, Figure 6A). The occurrence of excited-state absorption (ESA) and excited-state emission (ESE) events, Figure 6C, both decreased from the original simulation results by 20% and 33%. The most notable difference is exhibited in Figure 6B; the fraction of population moving from the lowest-energy singlet state (i.e., intersystem crossing or ultrafast nonradiative relaxation) and nonradiative relaxation from the triplet state have decreased from ~0.45 to ~0.4 and increased from ~0.35 to ~0.4, respectively..

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Nonlinear Theory of Atmospheric Blocking: A Potential Vorticity Gradient View

In this paper, an extended nonlinear multiscale interaction model of blocking events in the equivalent barotropic atmosphere is used to investigate the effect of a slowly varying zonal wind in the meridional direction on dipole blocking that is regarded as a nonlinear Rossby wave packet. It is shown that the meridional gradient of potential vorticity [Formula: see text] prior to the blocking onset, which is related to the background zonal wind and its nonuniform meridional shear, can significantly affect the lifetime, intensity, and north–south asymmetry of dipole blocking, while the blocking dipole itself is driven by preexisting incident synoptic-scale eddies. The magnitude of the background PV y determines the energy dispersion and nonlinearity of blocking. It is revealed that a small background PV y is a prerequisite for strong and long-lived eddy-driven blocking that behaves as a persistent meandering westerly jet stream, while the blocking establishment further reduces the PV y within the blocking region, resulting in a positive feedback between blocking and PV y . When the core of the background westerly jet shifts from higher to lower latitudes, the blocking shows a northwest–southeast-oriented dipole with a strong anticyclonic anomaly to the northwest and a weak cyclonic anomaly to the southeast as its northern pole moves westward more rapidly and has weaker energy dispersion and stronger nonlinearity than its southern pole because of the smaller PV y in higher latitudes. The opposite is true when the background jet shifts toward higher latitudes. The asymmetry of dipole blocking vanishes when the background jet shows a symmetric double-peak structure. Thus, a small prior PV y is a favorable precursor for the occurrence of long-lived and large-amplitude blocking.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mechanical properties of metal dihydrides

First-principles calculations are used to characterize the bulk elastic properties of cubic and tetragonal phase metal dihydrides, $\text{M}{{\text{H}}_{2}}$ {$\text{M}$ = Sc, Y, Ti, Zr, Hf, lanthanides} to gain insight into the mechanical properties that govern the aging behavior of rare-earth di-tritides as the constituent 3 H, tritium, decays into 3 He. As tritium decays, helium is inserted in the lattice, the helium migrates and collects into bubbles, that then can ultimately create sufficient internal pressure to rupture the material. The elastic properties of the materials are needed to construct effective mesoscale models of the process of bubble growth and fracture. Dihydrides of the scandium column and most of the rare-earths crystalize into a cubic phase, while dihydrides from the next column, Ti, Zr, and Hf, distort instead into the tetragonal phase, indicating incipient instabilities in the phase and potentially significant changes in elastic properties. We report the computed elastic properties of these dihydrides, and also investigate the off-stoichiometric phases as He or vacancies accumulate. As helium builds up in the cubic phase, the shear moduli greatly soften, converting to the tetragonal phase. Conversely, the tetragonal phases convert very quickly to cubic with the removal of H from the lattice, while the cubic phases show little change with removal of H. Finally, the source and magnitude of the numerical and physical uncertainties in the modeling are analyzed and quantified to establish the level of confidence that can be placed in the computational results, and this quantified confidence is used to justify using the results to augment and even supplant experimental measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spacecraft Modeling, Attitude Determination, and Control: Quaternion-Based Approach

Spacecraft attitude determination and control is an important part of a spacecraft to achieve its designed mission. As of today, many spacecrafts have been successfully launched, and most of them have performed well as they were designed. Many research papers have been published to address the attitude determination and control design problems. Several text books are available for students to learn the technology and for engineers to use as references. The most popular spacecraft models for attitude determination algorithms and control design methods are the Euler angle models and the quaternion models . The Euler angle models have been proved very efficient as the linearized models are controllable, and all standard linear control system design methods are directly applicable. The drawbacks related to the Euler angle methods are (a) the designs based on linearized models may not globally stabilize the original nonlinear spacecraft, i.e., the design may not work when the attitude of the spacecraft is far away from the point where the linearization is performed; (b) the models depend on the rotational sequences, this can be error prone if several teams work on the same project and they use different rotational sequences; (c) for any rotational sequence, there is a singular point where the model is not applicable; and (d) since most attitude determination methods use quaternion to represent the spacecraft attitude, there is a need to transform quaternion into Euler angles. On the other hand, for quaternion models, people have found controllers that can globally stabilize nonlinear spacecraft systems; the models do not depend on rotational sequences and they have no singular point; and the quaternion is provided by attitude determination system and ready to use. The main problem with the quaternion model based control system design is that the linearized quaternion model is not controllable. Therefore, most published design methods heavily rely on Lyapunov functions for the nonlinear spacecraft system. But there is no systematic way to obtain a desired Lyapunov functions. Moreover, the Lyapunov function based designs focus on the closed-loop system stability but pay little attention to the closed-loop system performance. In a series of papers, the author proposed some reduced quaternion models which lead to some controllable linearized spacecraft models. Therefore, all standard linear system theory can be directly applied to analyze and design the spacecraft control systems. We showed that, in some cases, the designed control system is not only optimal for the linearized system, but also globally stabilize the original nonlinear system . Clearly, the reduced quaternion models do not depend on rotational sequences. Due to the special structure of the linearized spacecraft model, some most important design methods, such as LQR design and robust pole assignment design are very simple, enjoy the analytical solutions for some problems, have direct connection to the performance measures, such as settling time, rising time , and percentage of overshoot . All these features are attractive for high quality control system designs. The idea mentioned above is then extended to more spacecraft control problems using specific actuators such as magnetic torque bars and control momentum gyroscopes. These types of actuators may not provide exactly desired torques. Most existing methods use different conversions to get approximate solutions, meaning that these actuators may generate a torque close to but not equal to the desired one. Using the reduced quaternion models that incorporate the actuators into the system model, the control inputs are not torques but the operational parameters. The main benefit of this idea is that the control actions are not approximate but accurate. As all actuators have their operational limit, design with input constraints are also considered in this book by using recently developed interior-point optimization techniques. This book grows up from my research on the spacecraft attitude determination and control design methods in more than a decade which is focused on using reduced quaternion models because of their merits stated above. The book provides all necessary background materials on orbital dynamics, rotations and quaternion, frequently used reference frames, transformations between reference frames, space environment and disturbance torques, ephemeris astronomical vector calculations and measurement instruments, spacecraft control actuators and their models, so that the readers will get a global picture and can apply all these information into the spacecraft system modeling, attitude determination, and spacecraft control system designs, which is the main purpose of this book. This book is different from existing books in that we focus on quaternion based spacecraft control system designs and we consider only attitude control system design related problems, from spacecraft modeling, to attitude determination and estimation, to control system design method selection, to control algorithm development, and to the simulation of the control system designs. Moreover, this book addresses different attitude control tasks in the spacecraft life cycle, including spacecraft maneuver, orbit raising, attitude control, and rendezvous. Finally, this book emphasizes the state space design methods rather than the classical frequency design methods.

Attitude determination and control↗

H2OI95: A Stand-Alone Fortran Code for Evaluating the IAPWS-95 Equation-of-State Model for Water (Rev. 1)

H2OI95 is a stand-alone Fortran code for evaluating the IAPWS-95 equation-of-state model for the thermodynamic properties of water. It also evaluates the corresponding thermochemical properties of water consistent with the CODATA recommendations. The IAPWS-95 model is based on a model equation for the dimensionless Helmholtz energy for which the primary variables are the inverse reduced temperature (τ = T cr /T ) and reduced density (δ = ρ/ρ cr ). Here T is the absolute temperature (K), ρ is density (kg/m³), and the subscript “ cr ” refers to the critical point of water (647.096 K and 22.064 MPa pressure in this model, for which ρ cr is 322 kg/m³). The code solves four basic types of problems, distinguished by the specified inputs: 1. Temperature (K) and density (ρ kg/m³) or reduced density (δ) 2. Temperature (K) and pressure (MPa). 3. Temperature (K) on the saturation (liquid-vapor equilibrium) curve 4. Pressure (MPa) on the saturation curve. Each type of problem is run using a corresponding input (text) file. All but the first type of problem require iteration. For example, to solve for desired temperature and pressure, the reduced density must be adjusted to give the desired pressure. Iteration is accomplished using the Newton-Raphson method, though the secant method is also used in solving the fourth type of problem. For the last three types of problems, H2OI95 has been used to conduct numerical studies of convergence and the problem of multiple numerical solutions, some of which are not physically valid. Obtaining valid results depends mainly on appropriate choice of starting values for the density. The default values used in H2OI95 appear to consistently lead to generally desired results. With modification (not addressed here), H2OI95 can be used to support SUPCRT92 and similar codes that compute chemical thermodynamic properties of species and reactions over a wide range of temperature and pressure (273.16-1273K and 0-1000 MPa). Version 1.1 of this software calculates an extended set of water properties, including some derivable solely from IAPWS-95, such as the isobaric thermal expansivity and the isothermal compressibility, and still other properties based on supplementary models sanctioned by IAPWS, including the dynamic viscosity, thermal conductivity, surface tension, and static dielectric constant, and various other properties (notably Debye-Hückel parameters) derivable from the dielectric constant and its partial derivatives with respect to temperature and pressure. A coding error in Version 1.0 was identified while testing the implementation of the viscosity model. This error is described in Appendix C. It mainly affects calculation of “higher order” properties such as compressibility and heat capacity near the critical point.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

MechBERT: Language Models for Extracting Chemical and Property Relationships about Mechanical Stress and Strain

Language models are transforming materials-aware naturallanguage processing by enabling the extraction of dynamic, context-rich information from unstructured text, thus, moving beyond the limitations of traditional information-extraction methods. Moreover, small language models are on the rise because some of them can perform better than large language models (LLMs) when given domain-specific questionanswer tasks, especially about an application area that relies on a highly specialized vernacular, such as materials science. We therefore present a new class of MechBERT language models for understanding mechanical stress and strain in materials. These employ Bidirectional Encoder Representations for transformer (BERT) architectures. We showcase four MechBERT models, all of which were pretrained on a corpus of documents that are textually rich in chemicals and their stress–strain properties and were fine-tuned on question-answering tasks. We evaluated the level of performance of our models on domain-specific as well as general English-language question-answer tasks and also explored the influence of the size and type of BERT architectures on model performance. We find that our MechBERT models outperform BERT-based models of the same size and maintain relevancy better than much larger BERT-based models when tasked with domain-specific question-answering tasks within the stress–strain engineering sector. These small language models also enable much faster processing and require a much smaller fraction of data to pretrain them, affording them greater operational efficiency and energy sustainability than LLMs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation

Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

IMAGINE BioSecurity: Mesocosm-Based Methods to Evaluate Biocontainment Strategies and Impact of Industrial Microbes Upon Native Ecosystems

Project Goals: The Integrative Modeling and Genome-scale Engineering for Biosystems Security (IMAGINE BioSecurity) SFA project seeks to establish an understanding of the behavior of engineered microbes in controlled versus environmental conditions to predictively devise new strategies for responding to biological escape. To this end, the IMAGINE Team has established a plant-soil mesocosm platform to track and quantify the fate of industrial microbes in environmental systems and assess the efficacy of biocontainment constraints upon genetically engineered microbe escape frequency and the impact of industrial microbes upon native ecological microbiomes. Abstract Text: Genetically modified industrial production microbes and their associated bioproducts have emerged as an integral component of a sustainable bioeconomy. However, the rapid development of these innovative technologies raises biosecurity concerns, namely, the risk of environmental escape. Thus, the realization of a bioeconomy hinges not only on the development and deployment of microbial production hosts, but also on the development of secure biosystems and biocontainment designs. Current laboratory-based biocontainment testing systems do not accurately reflect complexities found in natural environments, necessitating an environmentally relevant analysis pipeline that allows for the detection of rare escapees, the effect of associated bio-products, and the impact on native ecologies. To this end, we have developed an approach that utilizes soil mesocosms and integrated systems analyses to evaluate the efficacy of novel biocontainment strategies and to assess the impact of production systems upon terrestrial microbiome dynamics. We demonstrate the utility of this approach by modeling a contamination with industrial microbial chasses versus their biocontained counterparts. Here we demonstrate the broad utility of this system by highlighting findings from both strains of Saccharomyces cerevisiae that are contained with an inducible toxin anti-toxin system, and stains of Escherichia coli that are contained via genomic recoding. The resultant data demonstrate that this system has broad utility across diverse microbial chassis and biocontainment strategies, enables us to track the fate of our contaminating microbe with high sensitivity in the soil, as well as monitor broader impacts of the perturbation on the underlying soil system. The findings presented here support the use of this mesocosm-based approach to assess the environmental impact of industrial microbes and to validate biocontainment strategies.

BASIC BIOLOGICAL SCIENCES,INORGANIC, ORGANIC, PHYS↗

Synthesis, structure, electronic characterization, and halogenation of gold(III) phlorin complexes

The metalation chemistry of the phlorin, which is a non-aromatic tetrapyrrole macrocycle containing a single sp 3 -hybridized meso-carbon has remained underdeveloped, as compared to that of more traditional tetrapyrroles such as porphyrins, corroles and phthalocyanines. There have been few prior efforts to prepare metallophlorins, and those that have been reported have relied on either reduction or nucleophilic attack of parent metalloporphyrins, rather than direct metalation of freebase phlorin constructs. In this work, an alternate synthetic approach for preparation of gold(III) phlorin complexes that involves the first direct metalation of two different freebase phlorin derivatives (3H(Phl tBu ) and 3H(Phl F )) with AuBr 3 to produce the stable and fully isolable gold(III) phlorin complexes Au(Phl tBu ) and Au(Phl F ) is reported. The first structural characterization of a metallophlorin bearing geminal dimethyl substituents at the sp 3 -hybridized meso-carbon via X-ray crystallography is also reported. In addition to the preparation of Au(Phl tBu ) and Au(Phl F ), the UV-vis absorption and redox properties of these two gold(III) phlorins in comparison to those of their freebase homologues is also detailed. Notably, the metallophlorins are characterized by panchromatic absorbance profiles and intense and broad bands that span the long-visible and into the near-IR regions, as well as two fully reversible oxidation and reduction waves as probed by cyclic voltammetry. Lastly, the chlorination of Au(Phl tBu ) using PhI(Cl 2 ) was probed and it was found that this regioslective reaction generates monochlorinated (Au(Phl tBu Cl)) and dichlorinated (Au(Phl tBu Cl 2 )) products, which were both structurally characterized by X-ray crystallography.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Epi Archive: automated data collection of notifiable disease data

LANL has built a software program that automatically collects global notifiable disease data—particularly data stored in files—and makes it available and shareable within the Biosurveillance Ecosystem(BSVE) as a new data source. This will improve the prediction and early warning of disease events and other applications. Most countries do not report national notifiable disease data in a machine-readable format. Data are often in the form of a file that contains text, tables and graphs summarizing weekly or monthly disease counts. This presents a problem when information is needed for more data intensive approaches to epidemiology, biosurveillance and public health as exemplified by the Biosurveillance Ecosystem(BSVE).While most nations do likely store their data in a machine-readable format, the governments are often hesitant to share data openly for a variety of reasons that include technical, political, economic, and motivational issues. For example, an attempt by LANL to obtain a weekly version of openly available monthly data, reported by the Australian government, resulted in an onerous bureaucratic reply. The obstacles to obtaining data included: paperwork to request data from each of the Australian states and territories, a long delay to obtain data (up to 3 months) and extensive limitations on the data’s use that prohibit collaboration and sharing. This type of experience when attempting to contact public health departments or ministries of health for data is not uncommon. A survey conducted by LANL of notifiable disease data reporting in 52 countries identified only 10 as being machine-readable and 42 being reported in pdf files on a regular basis. Within the 42 nations that report in pdf files, 32 report in a structured, tabular format and10 in a non-structured way. As a result, LANL has developed a tool-Epi Archive (formerly known as EPIC)-to automatically and continuously collect global notifiable disease data and make it readily accessible. We conducted a survey of the national notifiable disease reporting systems notating how the data is reported in two important dimensions: date standards and case definitions. The development of software to regularly ingests notifiable disease data frand makes this data available involved four main steps scraping, extracting, parsing and persisting. For scraping: we would examine website designs and determine reporting mechanisms for each country/website as well as what varies across the reporting mechanisms. We then designed and wrote code to automate the downloading of report pdf files, for each country. We stored report pdfs along with appropriate metadata for extracting and parsing. For extracting: we developed software that can extract notifiable disease data presented in tabular form from a pdf file. We combined the methodology of figure placement detection with the in-house developed table extraction and annotation heuristics. For parsing: we determined what to extract from each pdf dataset from the survey conducted. We then parsed the extracted data into uniform data structures correctly accommodating the dimensions surveyed and the various human languages. This task involved ingesting notifiable disease data in many disparate formats extracted from pdf files and coalescing the data into a standardized format. For persisting: We then store the data in the Epi Archive PostgreSQL database and make it available through the BSVE. The EpiArchive tool currently contains subnational notifiable disease data from 10 nations. When a user accesses the EpiArchive site, they are prompted with four fields: country, region, disease, and date duration. These fields allow the user to specify the location(down to the state level), the disease of interest, and the duration of interest. Upon form submission, a time series is generated from the users’ specifications. The generated time series can then be downloaded into a csv file if a user is interested in performing personal analysis. Additionally, the data from EpiArchive can be reached through an API. LANL as part of a currently funded DTRA effort so that it will automatically and continuously collect global notifiable disease data—particularly data stored in pdf files—and make it available and shareable within the Biosurveillance Ecosystem (BSVE) as a new data source. This will provide data to analytics and users that will improve the prediction and early warning of disease events and other applications.

59 BASIC BIOLOGICAL SCIENCES↗