6th Annual Earth System Grid Federation Face-to-Face Conference Report, December 5–9, 2016, Washington, D.C.
Since its inception in the late 1990s, the Earth System Grid Federation (ESGF) has evolved significantly as a system. As technology changed and its user base grew larger and more diverse, ESGF gradually developed into the state-of-the-art federated system it is today. Due to the enormity of its scope and the urgency of community needs, many features had to be tested in the real world during the expansion process. The rollout of Version 2.4 in 2016 culminated a series of releases and user feedback initiatives that began in 2013. During this 3-year period, ESGF hosted user group meetings to better understand how the system was being used; this information was then leveraged to begin Version 3.0 planning and preparations. The user meetings were collectively led and organized by the U.S. Department of Energy (DOE), the Infrastructure for the European Network for Earth System Modelling (IS-ENES), the U.S. National Aeronautics and Space Administration (NASA), the Australian National Computational Infrastructure (NCI), the U.S. National Oceanic and Atmospheric Administration (NOAA), and the U.S. National Science Foundation (NSF). The information emerging from the user group meetings influenced requirements, development, and operations. In 2015, representatives from a significant fraction of projects that use ESGF to disseminate and analyze data attended the Fifth Annual ESGF Face-to-Face (F2F) Conference (DOI: 10.2172/1253685). Attendees provided important feedback regarding current and future community data use cases. Discussions focused on maintaining essential operations while developing new and improved software to handle ever-increasing data variety, complexity, velocity, and volume—a task accomplished by the entire consortium.