PWDFT-SW: Extending the Limit of Plane-Wave DFT Calculations to 16K Atoms on the New Sunway Supercomputer

Read original: arXiv:2406.10765 - Published 6/18/2024 by Qingcai Jiang, Zhenwei Cao, Junshi Chen, Xinming Qin, Wei Hu, Hong An, Jinlong Yang
Total Score

0

PWDFT-SW: Extending the Limit of Plane-Wave DFT Calculations to 16K Atoms on the New Sunway Supercomputer

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

• This paper presents PWDFT-SW, a parallel implementation of plane-wave density functional theory (PWDFT) calculations that can handle systems with up to 16,000 atoms on the new Sunway supercomputer.

• The researchers developed a flexible multi-dimensional fast Fourier transform (FFT) library and a Gaussian-based plane-wave neural operator to overcome the computational challenges of PWDFT calculations at this scale.

• The new system enables the study of large-scale quantum mechanical phenomena, including flexible-multi-dimensional-ffts-plane-wave-density, gaussian-plane-wave-neural-operator-electron-density, and breaking-molecular-dynamics-timescale-barrier-using-wafer.

Plain English Explanation

This research paper describes a new computer program called PWDFT-SW that can perform quantum mechanical calculations on extremely large systems, with up to 16,000 atoms. Typically, these types of calculations, known as plane-wave density functional theory (PWDFT), are limited to much smaller systems due to their high computational demands.

To overcome this limitation, the researchers developed two key innovations. First, they created a flexible library for performing the complex mathematical operations, called fast Fourier transforms, that are essential for PWDFT. Second, they developed a new method using a type of artificial intelligence called a neural network to model certain aspects of the quantum mechanical behavior, which helped reduce the overall computational burden.

By implementing these advances on a powerful new supercomputer called Sunway, the researchers were able to push the boundaries of what is possible with PWDFT calculations. This allows scientists to study large-scale quantum mechanical phenomena, such as the behavior of electrons in materials with flexible-multi-dimensional-ffts-plane-wave-density, the use of gaussian-plane-wave-neural-operator-electron-density to model electron density, and even breaking-molecular-dynamics-timescale-barrier-using-wafer for studying the dynamics of large molecular systems.

Technical Explanation

The researchers developed PWDFT-SW, a highly parallel implementation of plane-wave density functional theory (PWDFT) that can handle systems with up to 16,000 atoms. This was achieved through two key innovations:

  1. Flexible Multi-Dimensional FFT Library: The researchers created a flexible library for performing the fast Fourier transforms (FFTs) that are essential for PWDFT calculations. This library can efficiently handle the multi-dimensional FFTs required for large-scale systems, enabling flexible-multi-dimensional-ffts-plane-wave-density.

  2. Gaussian-Based Plane-Wave Neural Operator: To further reduce the computational burden, the researchers developed a novel Gaussian-based plane-wave neural operator that can accurately model the electron density, as described in gaussian-plane-wave-neural-operator-electron-density.

The researchers implemented PWDFT-SW on the new Sunway supercomputer, a powerful system that enabled the calculation of large-scale quantum mechanical phenomena, including breaking-molecular-dynamics-timescale-barrier-using-wafer and universal-machine-learning-kohn-sham-hamiltonian-materials.

Critical Analysis

The researchers have made significant advancements in extending the capabilities of PWDFT calculations to handle much larger systems than previously possible. The use of a flexible multi-dimensional FFT library and a Gaussian-based plane-wave neural operator are innovative approaches that help overcome the computational challenges.

However, the paper does not address the potential limitations of these techniques. For example, the accuracy of the Gaussian-based neural operator compared to more traditional methods, or the scalability of the parallel implementation on even larger systems, are not fully explored.

Additionally, while the researchers demonstrate the ability to study large-scale quantum mechanical phenomena, such as neural-pfaffians-solving-many-many-electron-schrodinger, the practical implications and applications of these capabilities are not discussed in depth.

Further research and testing would be needed to fully understand the strengths, weaknesses, and broader impact of the PWDFT-SW system.

Conclusion

This paper presents a significant advancement in the field of plane-wave density functional theory (PWDFT) by introducing PWDFT-SW, a parallel implementation that can handle systems with up to 16,000 atoms. The researchers developed innovative techniques, including a flexible multi-dimensional FFT library and a Gaussian-based plane-wave neural operator, to overcome the computational challenges of large-scale PWDFT calculations.

The new PWDFT-SW system enables the study of large-scale quantum mechanical phenomena, opening up new avenues for research in areas such as materials science, chemistry, and condensed matter physics. While the paper provides a strong technical foundation, further exploration of the system's limitations and practical applications would be beneficial to fully understand its impact on the field.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

PWDFT-SW: Extending the Limit of Plane-Wave DFT Calculations to 16K Atoms on the New Sunway Supercomputer
Total Score

0

PWDFT-SW: Extending the Limit of Plane-Wave DFT Calculations to 16K Atoms on the New Sunway Supercomputer

Qingcai Jiang, Zhenwei Cao, Junshi Chen, Xinming Qin, Wei Hu, Hong An, Jinlong Yang

First-principles density functional theory (DFT) with plane wave (PW) basis set is the most widely used method in quantum mechanical material simulations due to its advantages in accuracy and universality. However, a perceived drawback of PW-based DFT calculations is their substantial computational cost and memory usage, which currently limits their ability to simulate large-scale complex systems containing thousands of atoms. This situation is exacerbated in the new Sunway supercomputer, where each process is limited to a mere 16 GB of memory. Herein, we present a novel parallel implementation of plane wave density functional theory on the new Sunway supercomputer (PWDFT-SW). PWDFT-SW fully extracts the benefits of Sunway supercomputer by extensively refactoring and calibrating our algorithms to align with the system characteristics of the Sunway system. Through extensive numerical experiments, we demonstrate that our methods can substantially decrease both computational costs and memory usage. Our optimizations translate to a speedup of 64.8x for a physical system containing 4,096 silicon atoms, enabling us to push the limit of PW-based DFT calculations to large-scale systems containing 16,384 carbon atoms.

Read more

6/18/2024

Flexible Multi-Dimensional FFTs for Plane Wave Density Functional Theory Codes
Total Score

0

Flexible Multi-Dimensional FFTs for Plane Wave Density Functional Theory Codes

Doru Thom Popovici, Mauro del Ben, Osni Marques, Andrew Canning

Multi-dimensional Fourier transforms are key mathematical building blocks that appear in a wide range of applications from materials science, physics, chemistry and even machine learning. Over the past years, a multitude of software packages targeting distributed multi-dimensional Fourier transforms have been developed. Most variants attempt to offer efficient implementations for single transforms applied on data mapped onto rectangular grids. However, not all scientific applications conform to this pattern, i.e. plane wave Density Functional Theory codes require multi-dimensional Fourier transforms applied on data represented as batches of spheres. Typically, the implementations for this use case are hand-coded and tailored for the requirements of each application. In this work, we present the Fastest Fourier Transform from Berkeley (FFTB) a distributed framework that offers flexible implementations for both regular/non-regular data grids and batched/non-batched transforms. We provide a flexible implementations with a user-friendly API that captures most of the use cases. Furthermore, we provide implementations for both CPU and GPU platforms, showing that our approach offers improved execution time and scalability on the HP Cray EX supercomputer. In addition, we outline the need for flexible implementations for different use cases of the software package.

Read more

6/11/2024

Gaussian Plane-Wave Neural Operator for Electron Density Estimation
Total Score

0

Gaussian Plane-Wave Neural Operator for Electron Density Estimation

Seongsu Kim, Sungsoo Ahn

This work studies machine learning for electron density prediction, which is fundamental for understanding chemical systems and density functional theory (DFT) simulations. To this end, we introduce the Gaussian plane-wave neural operator (GPWNO), which operates in the infinite-dimensional functional space using the plane-wave and Gaussian-type orbital bases, widely recognized in the context of DFT. In particular, both high- and low-frequency components of the density can be effectively represented due to the complementary nature of the two bases. Extensive experiments on QM9, MD, and material project datasets demonstrate GPWNO's superior performance over ten baselines.

Read more

6/14/2024

🔎

Total Score

0

Breaking the Molecular Dynamics Timescale Barrier Using a Wafer-Scale System

Kylee Santos, Stan Moore, Tomas Oppelstrup, Amirali Sharifian, Ilya Sharapov, Aidan Thompson, Delyan Z Kalchev, Danny Perez, Robert Schreiber, Scott Pakin, Edgar A Leon, James H Laros III, Michael James, Sivasankaran Rajamanickam

Molecular dynamics (MD) simulations have transformed our understanding of the nanoscale, driving breakthroughs in materials science, computational chemistry, and several other fields, including biophysics and drug design. Even on exascale supercomputers, however, runtimes are excessive for systems and timescales of scientific interest. Here, we demonstrate strong scaling of MD simulations on the Cerebras Wafer-Scale Engine. By dedicating a processor core for each simulated atom, we demonstrate a 179-fold improvement in timesteps per second versus the Frontier GPU-based Exascale platform, along with a large improvement in timesteps per unit energy. Reducing every year of runtime to two days unlocks currently inaccessible timescales of slow microstructure transformation processes that are critical for understanding material behavior and function. Our dataflow algorithm runs Embedded Atom Method (EAM) simulations at rates over 270,000 timesteps per second for problems with up to 800k atoms. This demonstrated performance is unprecedented for general-purpose processing cores.

Read more

5/14/2024