Updated exascale system for Earth simulations

A new version of the Energy Exascale Earth System Model (E3SM) is two times faster than the previous version.

The Earth — with its myriad interactions of atmosphere, oceans, land and ice components — presents an extraordinarily complex system for investigation. For researchers, simulating the dynamics of these systems has presented a process that is just as complex. But today, Earth system models capable of weather-scale resolution take advantage of powerful new computers to simulate variations in Earth systems and anticipate decade-scale changes that will critically impact the U.S. energy sector in coming years.  

Scientists at the U.S. Department of Energy’s (DOE) Argonne National Laboratory are part of a team that developed Version 2 of the Energy Exascale Earth System Model (E3SMv2). Released to the scientific community in late September, the model runs more than two times faster than its predecessor (E3SMv1).  

“It’s unusual for a new version of a major climate model to be faster than its predecessor,” said Argonne climate scientist Robert Jacob, who leads the Infrastructure Group within E3SM. ​“Climate model developers usually anticipate computing advances and add features or resolution that make the model wind up with the same speed or slower. This time, advances in the algorithms resulted in a model almost twice as fast for the same simulation quality.” 

“It’s unusual for a new version of a major climate model to be faster than its predecessor. Climate model developers usually anticipate computing advances and add features or resolution that make the model wind up with the same speed or slower. This time, advances in the algorithms resulted in a model almost twice as fast for the same simulation quality.” — Robert Jacob, Argonne climate scientist

The E3SM project reliably simulates aspects of Earth system variability, including regional air/water temperatures, which can strain energy grids; water availability, which affects power plant operations; extreme water-cycle events (e.g., floods and droughts), which impact infrastructure and bioenergy; and sea level rise and coastal flooding, which threaten coastal infrastructure. 

“E3SMv2 allows us to more realistically simulate the present, which gives us more confidence to simulate the future,” said David Bader, a scientist at DOE’s Lawrence Livermore National Laboratory in California and overall lead of the E3SM project. 

Other improvements to E3SMv2 include its more accurate representation of precipitation and clouds, as well as a significantly improved representation of dust aerosols.  

“Dust generation from dry soils is closely linked to drought events and land use and land cover changes,” said Argonne principal atmospheric and climate scientist Yan Feng, who led much of that work. ​“Airborne dust particles play an important role in modulating the Earth’s energy balance, acting as nuclei for cloud formation.” 

In addition, the team added to the model the ability to refine the resolution over particular areas of the globe, resulting in two fully coupled configurations: a 100 kilometer (km) globally uniform resolution atmosphere model and a regionally refined model (RRM) with a resolution of 25 km over North America and 100 km elsewhere. The refined mesh configuration is particularly well suited for DOE applications.  

Obtaining results from the RRM and uniform simulations is also faster. 

“E3SMv2 uses a new input/output (I/O) library, called SCORPIO, that incorporates enhanced data caching and rearranges algorithms, allowing simulations to write data at approximately an order of magnitude faster than E3SM version 1,” said lead SCORPIO developer and Argonne scientist Jayesh Krishna. ​“In E3SMv2, I/O only occupies about 1 to 2 percent of the model execution time for production simulations. The model users can focus on writing out all the simulation data required for scientific analysis without worrying about I/O performance.” 

The team is now conducting a simulation campaign of climate change using E3SMv2. Team members have completed simulations that look several thousands of years into the future, and they are planning to run for several thousand more. 

The E3SM project, supported by DOE’s Office of Science, Biological and Environmental Research Office, includes more than 100 scientists and software engineers at several universities and eight DOE laboratories: Argonne, Brookhaven, Lawrence Livermore, Lawrence Berkeley, Los Alamos, Oak Ridge, Pacific Northwest and Sandia national laboratories. In recognition of unifying the DOE Earth system modeling community to perform high-resolution coupled simulations, the E3SM executive committee was awarded the Secretary of Energy’s Achievement Award in 2015.

In addition, the E3SM project benefits from DOE programmatic collaborations, including the Exascale Computing Project and programs in Scientific Discovery Through Advanced Computing, Climate Model Development and Validation, Atmospheric Radiation Measurement, Program for Climate Model Diagnosis and Intercomparison, International Land Model Benchmarking Project, Community Earth System Model, and Next Generation Ecosystem Experiments for the Arctic and the Tropics.

For more information, please visit E3SM website.

Argonne National Laboratory seeks solutions to pressing national problems in science and technology. The nation’s first national laboratory, Argonne conducts leading-edge basic and applied scientific research in virtually every scientific discipline. Argonne researchers work closely with researchers from hundreds of companies, universities, and federal, state and municipal agencies to help them solve their specific problems, advance America’s scientific leadership and prepare the nation for a better future. With employees from more than 60 nations, Argonne is managed by UChicago Argonne, LLC for the U.S. Department of Energy’s Office of Science.

The U.S. Department of Energy’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit https://​ener​gy​.gov/​s​c​ience.