Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Systems; Social and Information sciences”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1995

SEDAC information gateway plan V(1)

This annual update of the Information Gateway Plan incorporates changes recommended by the Socioeconomic Data and Applications Center (SEDAC) User Working Group (UWG) and reflects comments and suggestions from users, collaborators, and the Contracting Officer Technical Representative (COTR). The Information Gateway Plan is a concise and specific plan that outlines SEDAC activities and services in support of the earth and social sciences and other user communities. The SEDAC Information Gateway effort is a primary means by which the Earth Observing System Data and Information System (EOSDIS) can link meaningfully with a broad range of social science data sources and users in ways that lead to tangible benefits to the American people. The SEDAC Information Gateway provides interdisciplinary access to socioeconomic and physical science data and information resources held by SEDAC and numerous other institutions and networks around the world. The Plan describes the areas of research of earth scientists and socioeconomic scientists where interchange of data and information is most needed. It sets guidelines for the continued development of SEDAC's directory of social science datasets and establishes priorities for efforts to make data held by SEDAC or accessible through SEDAC available to the user community. The Plan also describes the means by which the SEDAC user community can access information products specified by the SEDAC Data and Applications Development Plan (DADP). Among other major activities, SEDAC will continue to enhance and operate a directory capability, interoperable with the Global Change Master Directory, that provides the socioeconomic community with information about earth science products and the earth science research community with information about socioeconomic data. The Information Gateway also serves as a unique and powerful access pathway for a wide range of users and potential users of socioeconomic and earth science data, including especially remote sensing data.

Chen, Robert S.↗
NASA NTRS2018

NASA Earth Science Data Rescue Efforts

Historically, at the end of a NASA mission, earth and space science data were stored at NASA's National Space Science Data Center (NSSDC). The original data archive consisted of both magnetic tapes and film media. As data storage technology improved, data from later missions were stored on disks and platters and higher capacity magnetic media for online accessibility. To conserve physical space at NASA archive sites and to meet disaster recovery guidelines, historical data originally stored on magnetic tapes and film were moved to the Federal Archives and Record Center (FRC) as a temporary holding area until its long-term value was determined by NASA. All records at the FRC are controlled by the NASA Records Retention Schedule (NRRS) which determines the disposal date for each record. On that date, responsible NASA parties are notified that all scheduled records should be reviewed and assessed to determine if they continue to hold significant historical, scientific or administrative value. For Earth Science data records being held at FRC, the Earth Science Data and Information System (ESDIS) Project office is the party responsible for making the value assessment that determines which records warrant preservation and which are ready for proper disposal according to NASA guidelines. Once the data's long-term value is determined, ESDIS takes definitive steps to preserve this data for future discovery and access. Deteriorating media containing historic data of value are recalled from FRC and brought back to ESDIS. Through a tedious, laborious process, digital data are recovered and restored to modern formats with improved metadata and documentation to aid discovery. The restored digital products are then incorporated into our modern online archive, and made immediately accessible to the public. In this paper, we will discuss how we identify data-at-risk, ways to minimize data loss, how we plan for recovery, how we delegate recovery activities to our archive facilities, and how we make recovered data more accessible.

Data Systems; Social and Information sciences↗
NASA NTRS1992

Earth science information: Planning for the integration and use of global change information

Activities and accomplishments of the first six months of the Consortium for International Earth Science Information Network (CIESIN's) 1992 technical program have focused on four main missions: (1) the development and implementation of plans for initiation of the Socioeconomic Data and Applications Center (SEDAC) as part of the EOSDIS Program; (2) the pursuit and development of a broad-based global change information cooperative by providing systems analysis and integration between natural science and social science data bases held by numerous federal agencies and other sources; (3) the fostering of scientific research into the human dimensions of global change and providing integration between natural science and social science data and information; and (4) the serving of CIESIN as a gateway for global change data and information distribution through development of the Global Change Research Information Office and other comprehensive knowledge sharing systems.

Lousma, Jack R.↗
DOE OSTI2021

The FEWSION for Community Resilience (F4R) Process: Building Local Technical and Social Capacity for Critical Supply Chain Resilience

Local business leaders, policy makers, elected officials, city planners, emergency managers, and private citizens are responsible for, and deeply affected by, the performance of critical supply chains and related infrastructures. At the center of critical supply chains is the food-energy-water nexus (FEW); a nexus that is key to a community’s wellbeing, resilience, and sustainability. In the 21st century, managing a local FEW nexus requires accurate data describing the function and structure of a community’s supply chains. However, data is not enough; we need data-informed conversation and technical and social capacity building among local stakeholders to utilize the data effectively. There are some resources available at the mesoscale and for food, energy, or water, but many communities lack the data and tools needed to understand connections and bridge the gaps between these scales and systems. As a result, we currently lack the capacity to manage these systems in small and medium sized communities where the vast majority of people, decisions, and problems reside. This study develops and validates a participatory citizen science process for FEW nexus capacity building and data-driven problem solving in small communities at the grassroots level. The FEWSION for Community Resilience (F4R) process applies a Public Participation in Scientific Research (PPSR) framework to map supply chain data for a community’s FEW nexus, to identify the social network that manages the nexus, and then to generate a data-informed conversation among stakeholders. F4R was piloted and co-developed with participants over a 2-year study, using a design-based research process to make evidence-based adjustments as needed. Results show that the F4R model was successful at improving volunteers’ awareness about nexus and supply chain issues, at creating a network of connections and communication with stakeholders across state, regional, and local organizations, and in facilitating data-informed discussion about improvements to the system. In this paper we describe the design and implementation of F4R and discuss four recommendations for the successful application of the F4R model in other communities: 1) embed opportunities for co-created PPSR, 2) build social capital, 3) integrate active learning strategies with user-friendly digital tools, and 4) adopt existing materials and structure.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Organizational Influences on Interdisciplinary Interactions during Research and Design of Large-Scale Complex Engineered Systems

The design of large-scale complex engineered systems (LaCES) such as an aircraft is inherently interdisciplinary. Multiple engineering disciplines, drawing from a team of hundreds to thousands of engineers and scientists, are woven together throughout the research, development, and systems engineering processes to realize one system. Though research and development (R&D) is typically focused in single disciplines, the interdependencies involved in LaCES require interdisciplinary R&D efforts. This study investigates the interdisciplinary interactions that take place during the R&D and early conceptual design phases in the design of LaCES. Our theoretical framework is informed by both engineering practices and social science research on complex organizations. This paper provides preliminary perspective on some of the organizational influences on interdisciplinary interactions based on organization theory (specifically sensemaking), data from a survey of LaCES experts, and the authors experience in the research and design. The analysis reveals couplings between the engineered system and the organization that creates it. Survey respondents noted the importance of interdisciplinary interactions and their significant benefit to the engineered system, such as innovation and problem mitigation. Substantial obstacles to interdisciplinarity are uncovered beyond engineering that include communication and organizational challenges. Addressing these challenges may ultimately foster greater efficiencies in the design and development of LaCES and improved system performance by assisting with the collective integration of interdependent knowledge bases early in the R&D effort. This research suggests that organizational and human dynamics heavily influence and even constrain the engineering effort for large-scale complex systems.

McGowan, Anna-Maria R.↗
NASA NTRS2012

Exploring Remote Sensing Products Online with Giovanni for Studying Urbanization

Recently, a Large amount of MODIS land products at multi-spatial resolutions have been integrated into the online system, Giovanni, to support studies on land cover and land use changes focused on Northern Eurasia and Monsoon Asia regions. Giovanni (Goddard Interactive Online Visualization ANd aNalysis Infrastructure) is a Web-based application developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES-DISC) providing a simple and intuitive way to visualize, analyze, and access Earth science remotely-sensed and modeled data. The customized Giovanni Web portals (Giovanni-NEESPI and Giovanni-MAIRS) are created to integrate land, atmospheric, cryospheric, and social products, that enable researchers to do quick exploration and basic analyses of land surface changes and their relationships to climate at global and regional scales. This presentation documents MODIS land surface products in Giovanni system. As examples, images and statistical analysis results on land surface and local climate changes associated with urbanization over Yangtze River Delta region, China, using data in Giovanni are shown.

Shen, Suhung↗
DOE OSTI2021

Addressing Parental Vaccine Hesitancy and Other Barriers to Childhood/Adolescent Vaccination Uptake During the Coronavirus (COVID-19) Pandemic

Routine childhood immunizations are proven to be one of the most effective public health interventions at controlling numerous deadly diseases. Therefore, the CDC recommends routine immunizations for children and adolescent populations against vaccine-preventable diseases e.g., tetanus, pertussis, diphtheria, etc. This current review sought to examine barriers to pediatric vaccine uptake behaviors during the COVID-19 pandemic. We also explored the implications for parental vaccine hesitancy/delay during an ongoing health crisis and proposed recommendations for increasing vaccine confidence and compliance. Our review determined that the receipt for vaccinations steadily improved in the last decade for both the United States and Tennessee. However, this incremental progress has been forestalled by the COVID-19 pandemic and other barriers i.e. parental vaccine hesitancy, social determinants of health (SDoH) inequalities, etc. which further exacerbate vaccination disparities. Moreover, non-compliance to routine vaccinations could cause an outbreak of diseases, thereby, worsening the ongoing health crisis and already strained health care system. Healthcare providers are uniquely positioned to offer effective recommendations with presumptive languaging to increase vaccination rates, as well as, address parental vaccine hesitancy. Best practices that incorporate healthcare providers’ quality improvement coaching, vaccination reminder recall systems, adherence to standardized safety protocols (physical distancing, hand hygiene practices, etc.), as well as, offer telehealth and outdoor/drive-through/curbside vaccination services, etc. are warranted. Additionally, a concerted effort should be made to utilize public health surveillance systems to collect, analyze, and interpret data, thereby, ensuring the dissemination of timely, accurate health information for effective health policy decision-making e.g., vaccine distribution, etc.

60 APPLIED LIFE SCIENCES↗
NASA NTRSDate not supplied

OpenNEX: An open collaboration platform for the earth science community

Satellite data from the past several decades provide the most consistent record of land-surface processes that form the basis for scientific assessments of the impacts of climate variations and changes on the environment and human social-economical activities. During this time, scientific research on the characterization and assessment of environmental changes had tended to focus on large-scale land-surface changes with significant social-economic impacts. Increasingly, attention is shifting toward changes that occur more locally and that most directly relate to the everyday life of the majority of the population. In addition, there has been needs to develop management and policy decision support systems that are based on local environmental information. Almost at the same time, the advancement in sensor technology has allowed us to collect an unprecedented volume of environmental data. These data must be curated and analyzed to extract useful information for research and decision support purposes. Established in 2013 and funded by NASA, the Open NASA Earth eXchange (OpenNEX; https://opennex.org/ , Jia et al., 2019 ) project partnered with Amazon Web Services (AWS) to make available a large amount of Earth observing data, modeling results, and analysis tools on the AWS. OpenNEX provides researchers, developers, educators, and ordinary users with easy access to an integrated Earth science computational and data platform, enabling citizen scientists and application developers to realize the full value of NASA data assets and software tools. To encourage the public's engagement in this project, NASA ran virtual workshops and prize competitions. The virtual workshops provided online lectures and tutorials about how prominent scientists used the data in their research and the tutorials gave examples how to use the tools to interrogate the data in the Amazon cloud. Finally, the prize competitions allowed much wider participation in the OpenNEX project and enable testing the non-traditional projects and out-of-box ideas. OpenNEX has continued to evolve and mature. Here, we highlight new features and functionalities available to the community.

Jian Zhang↗
DOE OSTI2023

Deriving spatially explicit direct and indirect interaction networks from animal movement data

Abstract Quantifying spatiotemporally explicit interactions within animal populations facilitates the understanding of social structure and its relationship with ecological processes. Data from animal tracking technologies (Global Positioning Systems [“GPS”]) can circumvent longstanding challenges in the estimation of spatiotemporally explicit interactions, but the discrete nature and coarse temporal resolution of data mean that ephemeral interactions that occur between consecutive GPS locations go undetected. Here, we developed a method to quantify individual and spatial patterns of interaction using continuous‐time movement models (CTMMs) fit to GPS tracking data. We first applied CTMMs to infer the full movement trajectories at an arbitrarily fine temporal scale before estimating interactions, thus allowing inference of interactions occurring between observed GPS locations. Our framework then infers indirect interactions—individuals occurring at the same location, but at different times—while allowing the identification of indirect interactions to vary with ecological context based on CTMM outputs. We assessed the performance of our new method using simulations and illustrated its implementation by deriving disease‐relevant interaction networks for two behaviorally differentiated species, wild pigs ( Sus scrofa ) that can host African Swine Fever and mule deer ( Odocoileus hemionus ) that can host chronic wasting disease. Simulations showed that interactions derived from observed GPS data can be substantially underestimated when temporal resolution of movement data exceeds 30‐min intervals. Empirical application suggested that underestimation occurred in both interaction rates and their spatial distributions. CTMM‐Interaction method, which can introduce uncertainties, recovered majority of true interactions. Our method leverages advances in movement ecology to quantify fine‐scale spatiotemporal interactions between individuals from lower temporal resolution GPS data. It can be leveraged to infer dynamic social networks, transmission potential in disease systems, consumer–resource interactions, information sharing, and beyond. The method also sets the stage for future predictive models linking observed spatiotemporal interaction patterns to environmental drivers.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2015

Ecological Forecasting in the Applied Sciences Program and Input to the Decadal Survey

Ecological forecasting uses knowledge of physics, ecology and physiology to predict how ecosystems will change in the future in response to environmental factors. Further, Ecological Forecasting employs observations and models to predict the effects of environmental change on ecosystems. In doing so, it applies information from the physical, biological, and social sciences and promotes a scientific synthesis across the domains of physics, geology, chemistry, biology, and psychology. The goal is reliable forecasts that allow decision makers access to science-based tools in order to project changes in living systems. The next decadal survey will direct the development Earth Observation sensors and satellites for the next ten years. It is important that these new sensors and satellites address the requirements for ecosystem models, imagery, and other data for resource management. This presentation will give examples of these model inputs and some resources needed for NASA to continue effective Ecological Forecasting.

Ecology↗
DOE OSTI2022

A Framework for Effective Science Communication and Outreach Strategies and Dissemination of Research Findings for Marine Energy Projects

Marine energy is an emerging renewable energy industry with the potential to produce 2300 terawatt-hours per year from resources within the United States. As development and testing of marine energy devices advance, regulatory and permitting decision-makers are concerned about the uncertainty surrounding the potential environmental effects resulting from the introduction of these novel devices in coastal and riverine environments. The Triton Initiative researches and provides recommendations for environmental monitoring technologies and methods to inform industry stakeholders with the data necessary to permit the testing of marine energy systems. Effective dissemination of the research findings is essential for improving the accessibility of data to stakeholders who may use the results to inform policy decisions, yet few frameworks for conducting science communications for marine energy projects exist. In this paper, we present tools, channels, and tactics for developing a science communication framework for marine energy projects, or similar areas of study, using the Triton Initiative’s pilot science communication program as a case study. By leveraging existing bodies of work in disciplines such as communications theory, marketing, public relations, and social science, the presented framework includes audience identification and analysis; channel development, including a website, blog, newsletter, social media, and webinars and presentations; and metrics for determining success. Outcomes from one year of Triton’s case study are presented, including the most effective tactics and lessons learned.

communication framework↗
NASA NTRS2021

New Observing Strategies Testbed (NOS-T)

The New Observing Strategies (NOS) initiative within the NASA Earth Science Technology Office(ESTO)Advanced Information Systems Technology(AIST) program envisions future Earth science missions with distributed sensors(nodes) interconnected by a communications fabric that enables dynamic and intelligent operations [1].Some NOS concepts resemble systems-of-systems or collaborative systems where operational authority is distributed among multiple systems, necessitating new methods for systems engineering and design to cope with more decentralized control over constituent systems[2].The New Observing Strategies Testbed (NOS-T, verbalized as "enoh es tee") is a computational environment to develop, test, mature, and socialize new operating concepts and technology for NOS. NOS-T provides infrastructure to integrate and orchestrate user-contributed applications for system-of-systems test cases with true distributed control over constituent systems. The overall concept, illustrated in Figure 1, interconnects individual user applications and a NOS-T manager application via common information system infrastructure to coordinate the execution of virtual Earth science missions. NOS-T enables principal investigators to conduct test runs in the same environment, systematically changing variables to assess the overall efficacy of the proposed new observing strategies. Recorded data and outcomes provide evidence to advance technology readiness level and improve or innovate upon existing Earth science measurement techniques

Paul Grogan↗
DOE OSTI2021

COVID-19 dynamics across the US: A deep learning study of human mobility and social behavior

This paper presents a deep learning framework for epidemiology system identification from noisy and sparse observations with quantified uncertainty. The proposed approach employs an ensemble of deep neural networks to infer the time-dependent reproduction number of an infectious disease by formulating a tensor-based multi-step loss function that allows us to efficiently calibrate the model on multiple observed trajectories. The method is applied to a mobility and social behavior-based SEIR model of COVID-19 spread. The model is trained on Google and Unacast mobility data spanning a period of 66 days, and is able to yield accurate future forecasts of COVID-19 spread in 203 US counties within a time-window of 15 days. Interestingly, a sensitivity analysis that assesses the importance of different mobility and social behavior parameters reveals that attendance of close places, including workplaces, residential, and retail and recreational locations, has the largest impact on the effective reproduction number. Furthermore, the model enables us to rapidly probe and quantify the effects of government interventions, such as lock-down and re-opening strategies. Taken together, the proposed framework provides a robust workflow for data-driven epidemiology model discovery under uncertainty and produces probabilistic forecasts for the evolution of a pandemic that can judiciously provide information for policy and decision making. All codes and data accompanying this manuscript are available at https://github.com/PredictiveIntelligenceLab/DeepCOVID19.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

2024 IUFRO Tree Biotechnology Conference (Aug 4-8, 2024)

The 2024 IUFRO Tree Biotechnology Conference is the biennial meeting on genomics, molecular biology, and biotechnology of forest trees, associated with the IUFRO Working Party 2.04.06. This year's meeting was held in Annapolis, MD, USA from August 4th to 8th and was hosted by Yiping Qi (University of Maryland), Edward Eisenstein (University of Maryland), Gary Coleman (University of Maryland), and Heather Coleman (Syracuse University). The conference covered seven topics over the course of five days: 1) Biological and ecological insights from OMICS, 2) Advancing technologies for targeted trait manipulation and acceptability to diverse tree species, 3) Genes, development, and physiology, 4) Translating genomics and biotechnology to practice, 5) Trees in a changing world, 6) Genetic and phenotypic diversity for breeding and genomic selection, and 7) Biotechnology for biomaterials and bioeconomy. In addition to the sessions, there were two plenary sessions, provided by John Ralph (University of Wisconsin) and Tanja Pyrhäjärvi (University of Helsinki). The meeting celebrated the second awardees of the newly created IUFRO WG 2.04.06 Award: Excellence in Forest Molecular Biology and Genomics, which was presented to Chung-Jui (C.J.) Tsai (University of Georgia). Greg Goralogia (Oregon State University) was the recipient of the associated Early Career Award. The scientific presentations at the conference highlighted cutting-edge advancements in many facets of forest biotechnology research, including applications of genomic selection in forest genetics and breeding, the use of genetic editing, tree physiology, stress response, molecular breeding, wood development, "omics" technologies, and the social and economic impacts of genetically modified (GM) trees. Scientific take homes from the meeting include the power of NMR to dissect the composition of lignin, the genomic diversity of forest trees that has enormous potential for tree improvement and the integration of systems biology with climate and geographical data. The conference attracted a mix of students (25), postdoctoral fellows (32), and scientists from academia (66) and industry (18). In all, the conference was attended by 141 registered participants, representing 20 countries that participated in 23 invited lectures (including 6 'early-career' keynotes), 27 voluntary talks and 61 poster presentations. Support for the conference was drawn from a wide variety of Academia, Industry, and Government sources, and included financial support from several tree improvement companies. Overall, the conference was a great success, providing an exceptional mix of science and social activities in a relaxed and collegial atmosphere. More information about the meeting can be found at treebiotech.org. The next meeting will be held in Stellenbosch, South Africa, in 2026, hosted jointly by Zander Myburg, Dave Drew (University of Stellenbosch,) and Sanushka Naidoo (University of Pretoria, FABI).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Multi-dimensional resilience: A quantitative exploration of disease outcomes and economic, political, and social resilience to the COVID-19 pandemic in six countries

The COVID-19 pandemic has highlighted a need for better understanding of countries’ vulnerability and resilience to not only pandemics but also disasters, climate change, and other systemic shocks. A comprehensive characterization of vulnerability can inform efforts to improve infrastructure and guide disaster response in the future. In this paper, we propose a data-driven framework for studying countries’ vulnerability and resilience to incident disasters across multiple dimensions of society. To illustrate this methodology, we leverage the rich data landscape surrounding the COVID-19 pandemic to characterize observed resilience for several countries (USA, Brazil, India, Sweden, New Zealand, and Israel) as measured by pandemic impacts across a variety of social, economic, and political domains. We also assess how observed responses and outcomes (i.e., resilience) of the COVID-19 pandemic are associated with pre-pandemic characteristics or vulnerabilities, including (1) prior risk for adverse pandemic outcomes due to population density and age and (2) the systems in place prior to the pandemic that may impact the ability to respond to the crisis, including health infrastructure and economic capacity. Our work demonstrates the importance of viewing vulnerability and resilience in a multi-dimensional way, where a country’s resources and outcomes related to vulnerability and resilience can differ dramatically across economic, political, and social domains. This work also highlights key gaps in our current understanding about vulnerability and resilience and a need for data-driven, context-specific assessments of disaster vulnerability in the future.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Non-Powered Dam Custom Analysis and Taxonomy (NPDamCAT) Framework

Over 85,000 non-powered dams (NPDs) exist in the United States that provide services such as flood control, navigation, and water storage for irrigation/domestic water use (USACE 2019). The existing infrastructure of NPDs poses an opportunity for improving economic and environmental performance and generating electricity, as well as a challenge for maintaining aging structures and remediating fragmented river systems. NPD stakeholders interested in the rehabilitation, retrofit, or removal of NPDs must have the relevant information about the population of dams to support decision-making. Each NPD has unique characteristics describing its design, operation, environmental impacts, social impacts, and economic potential. The large number of dams, the diversity of interests related to dams, the variety of dam characteristics, and the types of data required to describe dams all pose major challenges to an analysis of the entire dam population.

13 HYDRO ENERGY↗
NASA NTRS1998

Technology Assessment of High Capacity Data Storage Systems: Can We Avoid a Data Survivability Crisis?

This technology assessment of long-term high capacity data storage systems identifies an emerging crisis of severe proportions related to preserving important historical data in science, healthcare, manufacturing, finance and other fields. For the last 50 years, the information revolution, which has engulfed all major institutions of modem society, centered itself on data-their collection, storage, retrieval, transmission, analysis and presentation. The transformation of long term historical data records into information concepts, according to Drucker, is the next stage in this revolution towards building the new information based scientific and business foundations. For this to occur, data survivability, reliability and evolvability of long term storage media and systems pose formidable technological challenges. Unlike the Y2K problem, where the clock is ticking and a crisis is set to go off at a specific time, large capacity data storage repositories face a crisis similar to the social security system in that the seriousness of the problem emerges after a decade or two. The essence of the storage crisis is as follows: since it could take a decade to migrate a peta-byte of data to a new media for preservation, and the life expectancy of the storage media itself is only a decade, then it may not be possible to complete the transfer before an irrecoverable data loss occurs. Over the last two decades, a number of anecdotal crises have occurred where vital scientific and business data were lost or would have been lost if not for major expenditures of resources and funds to save this data, much like what is happening today to solve the Y2K problem. A pr-ime example was the joint NASA/NSF/NOAA effort to rescue eight years worth of TOVS/AVHRR data from an obsolete system, which otherwise would have not resulted in the valuable 20-year long satellite record of global warming. Current storage systems solutions to long-term data survivability rest on scalable architectures having parallel paths for data migration.

Halem, M.↗
NASA NTRS2018

Enriching the Twitter Stream Increasing Data Mining Yield and Quality Using Machine Learning

Social media data streams are important sources of real-time and historical global information for science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we are exploring the Twitter data stream for its potential in augmenting the validation program of NASA Earth science missions, specifically the Global Precipitation Measurement (GPM) mission. We have implemented a tweet processing infrastructure that outputs classified precipitation tweets. Inputs are "passive" tweets, along with a smaller number of tweets from "active" participants, i.e., those knowingly contributing to our effort. The "active" tweets, presumably of higher quality, enrich the Twitter stream. "Active" sources include data scraped from other social media (e.g., public Facebook posts) and data from existing crowdsourcing programs (e.g., mPING reports). In addition, there is likely relevant precipitation information in images and documents that are the end points of links often included in tweets. Information derived from these "active" sources could then be tweeted into the Twitter stream, thus enriching its quality. The objective of our current work is to mine these tweet­ linked images and documents, using neural networks, to increase the information content and quality related to precipitation. For images, we classified them as either precipitation-related or not. For training and validation, we used images obtained via the Google custom search API. We created two models: (1) by training a simple Convolutional Neural Network and (2) by using transfer learning principles to adapt a pre-trained object recognition model. For documents, both those linked to tweets and the tweet contents, we trained Hierarchical Attention Networks to determine precipitation occurrence, type, and intensity. For training and validation, we used a keyword-filtered tweet data set labelled with ground truth data from Dark Sky (an API to retrieve weather-related labels) and the National Severe Storms Laboratory's Multi­ Radar/Multi-Sensor (MRMS) system. Our results demonstrated the efficacy of our machine learning approaches for enriching the Twitter stream, to derive information potentially useful for validation of earth science satellite data.

Albayrak, Arif↗