Search NASA⌕ Search

SEARCH · Search NASA

Results for “Unstructured data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Large-scale deep learning for metastasis detection in pathology reports

Objectives No existing algorithm can reliably identify metastasis from pathology reports across multiple cancer types and the entire US population. In this study, we develop a deep learning model that automatically detects patients with metastatic cancer by using pathology reports from many laboratories and of multiple cancer types. Materials and Methods We use 60 471 unstructured pathology reports from 4 Surveillance, Epidemiology, and End Results (SEER) registries. The reports were coded into 1 of 3 labels: metastasis negative, metastases positive, or metastasis undetermined. We utilize a task-specific deep neural network trained from scratch and compare its performance with a widely used large language model (LLM). Results Our deep learning architecture trained on task-specific data outperforms a general-purpose LLM, with a recall of 0.894 compared to 0.824. We quantified model uncertainty and used it to defer reports for human review. We found that retaining 72.9% of reports increased recall from 0.894 to 0.969. Discussion A smaller deep learning architecture trained on task-specific data outperforms a general LLM. Equally critical to model performance is the incorporation of uncertainty quantification, achieved here through an abstention mechanism. Conclusions This study’s finding demonstrate the feasibility of developing algorithms to automatically identify metastatic cancer cases from unstructured pathology reports.

machine learning↗

Sparsely corrupted stimulated scattering signals recovery by iterative reweighted continuous basis pursuit

In this paper, we consider the problem of extracting the desired signals from noisy measurements. This is a classical problem of signal recovery which is of paramount importance in inertial confinement fusion. To accomplish this task, we develop a tractable algorithm based on continuous basis pursuit and reweighted ℓ{sub 1}-minimization. By modeling the observed signals as superposition of scale time-shifted copies of theoretical waveform, structured noise, and unstructured noise on a finite time interval, a sparse optimization problem is obtained. We propose to solve this problem through an iterative procedure that alternates between convex optimization to estimate the amplitude, and local optimization to estimate the dictionary. The performance of the method was evaluated both numerically and experimentally. Numerically, we recovered theoretical signals embedded in increasing amounts of unstructured noise and compared the results with those obtained through popular denoising methods. We also applied the proposed method to a set of actual experimental data acquired from the Shenguang-II laser whose energy was below the detector noise-equivalent energy. Both simulation and experiments show that the proposed method improves the signal recovery performance and extends the dynamic detection range of detectors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A scalable design of experiments framework for optimal sensor placement

Here, we present a scalable design of an experiments framework for sensor placement in systems described by partial differential equations (PDEs). In particular, we aim to compute optimal sensor locations by minimizing the uncertainty of parameters estimated from Bayesian inverse problems and where the system. The resulting problem is a computationally intractable mixed-integer nonlinear program constrained by PDEs. We approach this problem with two heuristics used in compressed sensing and optimal control literature: a sparsity-inducing approach and a sum-up rounding approach. We also investigate metrics to guide the design of experiments (the total flow variance and the A-optimal design criterion) and analyze the effect of different noise structures (white and colored). Using an application in natural gas pipelines, we conclude that the sum-up rounding approach approach gives the best results and produces shrinking gaps with increasing mesh resolution. We also observe that convergence for the white noise measurement error case is slower than for the colored noise case. For A-optimal design, the solution is close to a uniform distribution of sensors along the pipeline while for the flow variance design the distribution is unstructured.

42 ENGINEERING↗

Tidally averaged circulation in Puget Sound sub-basins: Comparison of historical data, analytical model, and numerical model

Through extensive field data collection and analysis efforts conducted since the 1950s, researchers have established an understanding of the characteristic features of circulation in Puget Sound. The pattern ranges from the classic fjordal behavior in some basins, with shallow brackish outflow and compensating inflow immediately below, to the typical two-layer flow observed in many partially mixed estuaries with saline inflow at depth. An attempt at reproducing this behavior by fitting an analytical formulation to past data is presented, followed by the application of a three-dimensional circulation and transport numerical model. The analytical treatment helped identify key physical processes and parameters, but quickly reconfirmed that response is complex and would require site-specific parameterization to include effects of sills and interconnected basins. The numerical model of Puget Sound, developed using unstructured-grid finite volume method, allowed resolution of the sub-basin geometric features, including presence of major islands, and site-specific strong advective vertical mixing created by bathymetry and multiple sills. The model was calibrated using available recent short-term oceanographic time series data sets from different parts of the Puget Sound basin. The results are compared against (1) recent velocity and salinity data collected in Puget Sound from 2006 and (2) a composite data set from previously analyzed historical records, mostly from the 1970s. The results highlight the ability of the model to reproduce velocity and salinity profile characteristics, their variations among Puget Sound subbasins, and tidally averaged circulation. Sensitivity of residual circulation to variations in freshwater inflow and resulting salinity gradient in fjordal sub-basins of Puget Sound is examined.

58 GEOSCIENCES↗

Response of salt intrusion in a tidal estuary to regional climatic forcing

Abstract Salinity distribution in a large tidal estuary is subject to estuarine adjustment under the influences of multiple physical drivers such as freshwater pulses and sea level rise, and is crucial to upstream water quality, aquaculture, and ecosystem functions of the estuary. To better understand the estuarine salinity response to climate change, the unstructured-grid Finite Volume Community Ocean Model was implemented to simulate the salt intrusion in the Delaware Bay Estuary. The model was first validated by multiple observational data sets and subsequently applied in an idealized setting to examine the response of salt front to freshwater pulses in high flow conditions, followed by a long-term drought condition supported by a multi-decadal streamflow drought analysis in the estuary. The model results showed that after the freshwater pulses the salt front location moved further upstream with sea level rise. Under the simulated long-term drought condition, the adjustment timescale of salt intrusion varies nonlinearly with sea level rise. With a significant increase in sea level rise, the adjustment timescale starts to decrease. This shift suggests a transition into a different regime where the estuary becomes more stratified, as indicated by an increasing bulk Simpson number with rising sea levels.

54 ENVIRONMENTAL SCIENCES↗

Response Of Salt Intrusion In A Tidal Estuary To Regional Climatic Forcing (FVCOM Output for the baseline scenario)

Salinity distribution in a large tidal estuary is subject to estuarine adjustment under the influences of multiple physical drivers such as freshwater pulses and sea level rise, and is crucial to upstream water quality, aquaculture, and ecosystem functions of the estuary. To better understand the estuarine salinity response to climate change, the unstructured-grid Finite Volume Community Ocean Model was implemented to simulate the salt intrusion in the Delaware Bay Estuary. The model was first validated by multiple observational data sets and subsequently applied in an idealized setting to examine the response of salt front to freshwater pulses in high flow conditions, followed by a long-term drought condition supported by a multi-decadal streamflow drought analysis in the estuary. The model results showed that after the freshwater pulses the salt front location moved further upstream with sea level rise. Under the simulated long-term drought condition, the adjustment timescale of salt intrusion varies nonlinearly with sea level rise. With a significant increase in sea level rise, the adjustment timescale starts to decrease. This shift suggests a transition into a different regime where the estuary becomes more stratified, as indicated by an increasing bulk Simpson number with rising sea levels. These findings have been summarized into a journal manuscript. The data included in this information release request are FVCOM model output associated with the numerical simulations described in the journal manuscript.

Liu, Jinliang↗

Parallel Randomized Tucker Decomposition Algorithms

The Tucker tensor decomposition is a natural extension of the singular value decomposition (SVD) to multiway data. Here, we propose to accelerate Tucker tensor decomposition algorithms by using randomization and parallelization. We present two algorithms that scale to large data and many processors, significantly reduce both computation and communication cost compared to previous deterministic and randomized approaches, and obtain nearly the same approximation errors. The key idea in our algorithms is to perform randomized sketches with Kronecker-structured random matrices, which reduces computation compared to unstructured matrices and can be implemented using a fundamental tensor computational kernel. We provide probabilistic error analysis of our algorithms and implement a new parallel algorithm for the structured randomized sketch. Our experimental results demonstrate that our combination of randomization and parallelization achieves accurate Tucker decompositions much faster than alternative approaches. We observe up to a 16X speedup over the fastest deterministic parallel implementation on 3D simulation data.

Tucker decompositions↗

Analysis of PKR Structure by Small-Angle Scattering

Protein kinase R (PKR) is a key component of the interferon antiviral defense pathway. Upon binding double-stranded RNA, PKR undergoes autophosphorylation reactions that activate the kinase. PKR contains an N-terminal double-stranded RNA binding domain, which consists of two tandem double-stranded RNA binding motifs, and a C-terminal kinase domain. We have used small-angle X-ray scattering and small-angle neutron scattering to define the conformation of latent PKR in solution. Guinier analysis indicates a radius of gyration of about 35 {angstrom}. The p(r) distance distribution function exhibits a peak near 30 {angstrom}, with a broad shoulder extending to longer distances. Good fits to the scattering data require models that incorporate multiple compact and extended conformations of the two interdomain linker regions. Thus, PKR belongs to the growing family of proteins that contain intrinsically unstructured regions. We propose that the flexible linkers may allow PKR to productively dimerize upon interaction with RNA activators that have diverse structures.

59 BASIC BIOLOGICAL SCIENCES↗

An evaluation of the ocean and sea ice climate of E3SM using MPAS and interannual CORE-II forcing

The Energy Exascale Earth System Model (E3SM) is a new coupled Earth system model sponsored by the US Department of Energy. Here we present E3SM global simulations using active ocean and sea ice that are driven by the CORE–II inter–annual atmospheric forcing data set. The E3SM ocean and sea–ice components are MPAS–Ocean and MPAS–Seaice, which use the Model for Prediction Across Scales (MPAS) framework and run on unstructured horizontal meshes. For this study, grid cells vary from 30 to 60 km for the low resolution mesh and 6 to 18 km at high resolution. The vertical grid is a structured z–star coordinate and uses 60 and 80 layers for low and high resolution, respectively. The lower resolution simulation was run for five CORE cycles (310 years) with little drift in sea surface temperature or heat content. The meridional heat transport is within observational range, while the meridional overturning circulation at 26.5° N is low compared to observations. The largest temperature biases occur in the Labrador Sea and western boundary currents, and the mixed layer is deeper than observations at northern high latitudes in the winter months. In the Antarctic, maximum mixed layer depths (MLD) compare well with observations, but the spatial MLD pattern is shifted relative to observations. Sea–ice extent, volume and concentration agree well with observations. At high resolution, the sea surface height compares well with satellite observations in mean and variability.

54 ENVIRONMENTAL SCIENCES↗

Hydrodynamic Modeling Analysis of Tidal Wetland Restoration in Snohomish River, Washington

To re-establish the intertidal wetlands with full tidal interaction and improve salmonid rearing habitat in the Lower Snohomish River estuary, a diked wetland along Union Slough of the Snohomish River was restored by breaching the existing dike and constructing bridges across the breaches. However, post-restoration monitoring indicated that the restored project site could not drain as efficiently as desired. To improve the drainage conditions at the restoration site during low tides, a modeling study was conducted to evaluate additional restoration scenarios and to provide recommendations for finish-grade ground elevations to achieve the desired drainage. To accurately simulate the drainage of the project site, an unstructured-grid hydrodynamic model with fine-grid resolution down to a few meters was used in this study. The model was first validated with observed water level data collected in the project site and then applied to assess the feasibility of different proposed restoration scenarios. A spatial varying bottom roughness option in the model is also implemented to better represent the high roughness due to the presence of dense vegetation in the project site. The methodology, error statistics of model validation and uncertainty of the modeling analysis are presented and discussed.

Yang, Zhaoqing↗

NOUS: Construction and Querying of Dynamic Knowledge Graphs

The ability to construct domain specific knowledge graphs (KG) and perform question-answering or hypothesis generation is a trans- formative capability. Despite their value, automated construction of knowledge graphs remains an expensive technical challenge that is beyond the reach for most enterprises and academic institutions. We propose an end-to-end framework for developing custom knowl- edge graph driven analytics for arbitrary application domains. The uniqueness of our system lies A) in its combination of curated KGs along with knowledge extracted from unstructured text, B) support for advanced trending and explanatory questions on a dynamic KG, and C) the ability to answer queries where the answer is embedded across multiple data sources.

Choudhury, Sutanay↗

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

To explore the integrated effects of ocean and ocean surface wave related physical processes on TC simulations, a set of three model simulations is performed. * In experiment 'A', the event is modeled using the Weather Research Forecasting (WRF) model alone with prescribed Sea Surface Temperature (SST) at 6-hour intervals. * In experiment ‘AO,’ WRF is coupled with the Finite Volume Community Ocean Model (FVCOM), enabling variable exchange between atmosphere and ocean, but without considering ocean surface wave-related physical processes. * In experiment ‘AOW’, WRF, FVCOM, and Simulating WAves Nearshore (SWAN) exchange variables with each other every hour through the OASIS3-MCT Coupler to allow direct and indirect atmosphere-ocean-wave interactions. * Observational data are also included in this dataset (Dropsonde, HRD-Radar, NDBC_wave). All simulations are initialized at 18:00 UTC on August 19, 2021, within a domain encompassing the western North Atlantic Ocean. The atmospheric domain features a horizontal resolution of 3 km. The ocean domain, which covers a substantial portion of the WRF ocean domain, employs an unstructured triangular grid with resolutions ranging from 3 km near the coast to 9 km in the open ocean, effectively resolving the complex coastline of the U.S. Northeast Coast. Initial and boundary conditions for the atmosphere model are obtained from the 6-hourly 0.25° NCEP (National Centers for Environmental Prediction) Global Forecast System (GFS; NCEP, 2015) data.

17 WIND ENERGY↗

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

To explore the integrated effects of ocean and ocean surface wave related physical processes on TC simulations, a set of three model simulations is performed. * In experiment 'A', the event is modeled using the Weather Research Forecasting (WRF) model alone with prescribed Sea Surface Temperature (SST) at 6-hour intervals. * In experiment ‘AO,’ WRF is coupled with the Finite Volume Community Ocean Model (FVCOM), enabling variable exchange between atmosphere and ocean, but without considering ocean surface wave-related physical processes. * In experiment ‘AOW’, WRF, FVCOM, and Simulating WAves Nearshore (SWAN) exchange variables with each other every hour through the OASIS3-MCT Coupler to allow direct and indirect atmosphere-ocean-wave interactions. * Observational data are also included in this dataset (Dropsonde, HRD-Radar, NDBC_wave). All simulations are initialized at 18:00 UTC on August 19, 2021, within a domain encompassing the western North Atlantic Ocean. The atmospheric domain features a horizontal resolution of 3 km. The ocean domain, which covers a substantial portion of the WRF ocean domain, employs an unstructured triangular grid with resolutions ranging from 3 km near the coast to 9 km in the open ocean, effectively resolving the complex coastline of the U.S. Northeast Coast. Initial and boundary conditions for the atmosphere model are obtained from the 6-hourly 0.25° NCEP (National Centers for Environmental Prediction) Global Forecast System (GFS; NCEP, 2015) data.

17 WIND ENERGY↗

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

To explore the integrated effects of ocean and ocean surface wave related physical processes on tropical cyclone simulations, a set of three model simulations is performed. * In experiment 'A', the event is modeled using the Weather Research Forecasting (WRF) model alone with prescribed Sea Surface Temperature (SST) at 6-hour intervals. * In experiment ‘AO,’ WRF is coupled with the Finite Volume Community Ocean Model (FVCOM), enabling variable exchange between atmosphere and ocean, but without considering ocean surface wave-related physical processes. * In experiment ‘AOW’, WRF, FVCOM, and Simulating WAves Nearshore (SWAN) exchange variables with each other every hour through the OASIS3-MCT Coupler to allow direct and indirect atmosphere-ocean-wave interactions. * Observational data are also included in this dataset (Dropsonde, HRD-Radar, NDBC_wave). All simulations are initialized at 18:00 UTC on August 19, 2021, within a domain encompassing the western North Atlantic Ocean. The atmospheric domain features a horizontal resolution of 3 km. The ocean domain, which covers a substantial portion of the WRF ocean domain, employs an unstructured triangular grid with resolutions ranging from 3 km near the coast to 9 km in the open ocean, effectively resolving the complex coastline of the U.S. Northeast Coast. Initial and boundary conditions for the atmosphere model are obtained from the 6-hourly 0.25° NCEP (National Centers for Environmental Prediction) Global Forecast System (GFS; NCEP, 2015) data. These CSV files are derived from the NetCDF files in the c0 dataset. Unlike the original format, where geographic coordinates were stored in a separate file, each CSV now embeds the corresponding latitude and longitude values alongside the measured or simulated variables.

17 WIND ENERGY↗

Evaluation of native Earth system model output with ESMValTool v2.6.0

Earth system models (ESMs) are state-of-the-art climate models that allow numerical simulations of the past, present-day, and future climate. To extend our understanding of the Earth system and improve climate change projections, the complexity of ESMs heavily increased over the last decades. As a consequence, the amount and volume of data provided by ESMs has increased considerably. Innovative tools for a comprehensive model evaluation and analysis are required to assess the performance of these increasingly complex ESMs against observations or reanalyses. One of these tools is the Earth System Model Evaluation Tool (ESMValTool), a community diagnostic and performance metrics tool for the evaluation of ESMs. Input data for ESMValTool needs to be formatted according to the CMOR (Climate Model Output Rewriter) standard, a process that is usually referred to as “CMORization”. While this is a quasi-standard for large model intercomparison projects like the Coupled Model Intercomparison Project (CMIP), this complicates the application of ESMValTool to non-CMOR-compliant climate model output. In this paper, we describe an extension of ESMValTool introduced in v2.6.0 that allows seamless reading and processing of “native” climate model output, i.e., operational output produced by running the climate model through the standard workflow of the corresponding modeling institute. This is achieved by an extension of ESMValTool's preprocessing pipeline that performs a CMOR-like reformatting of the native model output during runtime. Thus, the rich collection of diagnostics provided by ESMValTool is now fully available for these models. For models that use unstructured grids, a further preprocessing step required to apply many common diagnostics is regridding to a regular latitude–longitude grid. Extensions to ESMValTool's regridding functions described here allow for more flexible interpolation schemes that can be used on unstructured grids. Currently, ESMValTool supports nearest-neighbor, bilinear, and first-order conservative regridding from unstructured grids to regular grids. Example applications of this new native model support are the evaluation of new model setups against predecessor versions, assessing of the performance of different simulations against observations, CMORization of native model data for contributions to model intercomparison projects, and monitoring of running climate model simulations. For the latter, new general-purpose diagnostics have been added to ESMValTool that are able to plot a wide range of variable types. Currently, five climate models are supported: CESM2 (experimental; at the moment, only surface variables are available), EC-Earth3, EMAC, ICON, and IPSL-CM6. As the framework for the CMOR-like reformatting of native model output described here is implemented in a general way, support for other climate models can be easily added.

58 GEOSCIENCES↗

Unstructured discontinuous Galerkin for seismic inversion.

This abstract explores the potential advantages of discontinuous Galerkin (DG) methods for the time-domain inversion of media parameters within the earth's interior. In particular, DG methods enable local polynomial refinement to better capture localized geological features within an area of interest while also allowing the use of unstructured meshes that can accurately capture discontinuous material interfaces. This abstract describes our initial findings when using DG methods combined with Runge-Kutta time integration and adjoint-based optimization algorithms for full-waveform inversion. Our initial results suggest that DG methods allow great flexibility in matching the media characteristics (faults, ocean bottom and salt structures) while also providing higher fidelity representations in target regions. Time-domain inversion using discontinuous Galerkin on unstructured meshes and with local polynomial refinement is shown to better capture localized geological features and accurately capture discontinuous-material interfaces. These approaches provide the ability to surgically refine representations in order to improve predicted models for specific geological features. Our future work will entail automated extensions to directly incorporate local refinement and adaptive unstructured meshes within the inversion process.

58 GEOSCIENCES↗

CEED-MS8:Initial Integration of CEED Software in ECP Applications

Key components of CEED software development involve fast finite element operator storage and evaluation, architecture optimizations, performant algorithms for all orders, global kernels for finite element operators, efficient use of the memory sub-system, optimal data locality and motion, enhanced scalability and parallelism, and fast tensor contractions. As ultimate goals of the project, CEED is exploring and identifying the best algorithms for the full range of discretizations and applying algorithmic and software development to support ECP applications’ needs. In this milestone we report on the initial integration of CEED software in the selected first-wave ECP/CEED apps and the continued exploration of other ECP applications as second-wave (milestone CEED-MS23) and third-wave (milestone CEED-MS35) ECP/CEED application candidates. An extensive evaluation of various approaches for GPU acceleration of the CEED computational motives is also a major focus of the report, both in the settings of CEED’s Nekbone and Laghos miniapps, as well as versions of CEED’s bake-off problems (introduced in milestone CEED-MS6). The first-wave ECP applications targeted for coupling with CEED software include the ExaSMR and MARBL applications. We also report on near-term collaboration with the seed-funded Urban Systems project, as well as engagements with ACME, ExaAM, GEOS and the Application Assessment and Proxy App projects. The ExaSMR project involves coupled thermal-hydraulics/neutronics, with the latter based on Monte Carlo methods and the former based on high-order discretizations of the Navier-Stokes and energy equations for accurate simulation of turbulent transport. The project requires fast and efficient turbulence simulation capabilities that will scale to exascale platforms. Work within CEED will ensure that all aspects of the Nek5000 workflow scale to the target problem space, which involves > 10 10 degrees of freedom in typical production runs. CEED’s goal is to provide implementations that perform with maximum attainable efficiency and deliver low turn-around times. A deliverable for this milestone is beta-release of the GPU-based variant of Nek5000. MARBL is targeting high-energy-density physics problems, including single fluid multi-material hydrodynamics and radiation/magnetic diffusion simulation, with applications in inertial confined fusion, pulsed power experiments, and equation of state/material strength analysis. The code uses high-order methods based arbitrary Lagrangian-Eulerian, direct Eulerian, and unstructured adaptive mesh refinement. A deliverable for this milestone is collaboration with MARBL for improved performance based on partially-assembled operators. The Urban exascale project is planning to couple real-time data with high performance simulations to study particulate transport in cities. Nek5000 will be used for large eddy and RANS (Reynolds-averaged Navier-Stokes) simulations of turbulent transport in these domains. Areas where the CEED team is aiding the Urban Canyon group include creating high-order meshes for urban geometries and developing boundary conditions appropriate for simulations close to real-life urban conditions. The software artifacts delivered as part of this milestone include GPU-enabled versions of the Nekbone and Laghos miniapps, which are provided through the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q4 of FY17, including: the CEED first annual meeting and participation of CEED researchers in a variety of outreach activities.

97 MATHEMATICS AND COMPUTING↗

Scalable multilevel Monte Carlo methods exploiting parallel redistribution on coarse levels

Here, we study an element agglomeration coarsening strategy that requires data redistribution at coarse levels when the number of coarse elements becomes smaller than the number of MPI processes used on the finest level. The overall procedure generates coarse elements (general unstructured unions of fine grid elements) within the framework of element-based algebraic multigrid methods (or AMGe) studied previously. The AMGe-generated coarse spaces have the ability to exhibit approximation properties of the same order as the fine-level spaces since by construction they contain the piecewise polynomials of the same order as on the fine level. These approximation properties are key for the successful use of AMGe in multilevel solvers for nonlinear partial differential equations as well as for multilevel Monte Carlo (MLMC) simulations. The ability to coarsen without being constrained by the number of MPI processes, as described in the present paper, allows to improve the scalability of these solvers as well as the overall MLMC method. The paper illustrates this latter fact with detailed scalability study of MLMC simulations applied to model Darcy equations with a stochastic log-normal permeability field.

AMGe↗