Taking GPU Programming Models to Task for Performance Portability

Overview

• This paper provides an evaluation and comparison of the performance portability of different GPU programming models.
• The authors assess how well various programming models can achieve high performance across different GPU hardware.
• The study focuses on stencil computations, a common type of algorithm used in scientific computing applications.

Plain English Explanation

The paper examines different ways of writing code to run on graphics processing units (GPUs), which are specialized hardware that can perform certain types of calculations much faster than regular computer processors. The goal is to understand how well these different "programming models" allow the code to achieve high performance when run on different GPU hardware.

The researchers focused on a common type of computation called a "stencil", which is used in many scientific computing applications like simulations. They wrote the same stencil computation using several different programming models, such as CUDA, OpenCL, and Kokkos. Then they ran this code on different GPU hardware and measured how fast it executed, to see which programming model provided the best "performance portability" - the ability to achieve high performance regardless of the specific GPU being used.

The key finding is that some programming models, like Kokkos, were better able to deliver consistent high performance across a range of GPUs, while others like CUDA were more tuned for a specific GPU architecture. This has important implications for developers who need to write code that will run efficiently on different hardware.

Technical Explanation

The paper evaluates the performance portability of several GPU programming models, including CUDA, OpenCL, Kokkos, and SYCL. The authors implement a common stencil computation kernel using these different programming models and evaluate their performance on a variety of GPU hardware, including NVIDIA Volta, AMD CDNA, and Intel Xe.

The results show that the Kokkos programming model is able to achieve the highest level of performance portability, with consistent high performance across the different GPU architectures tested. In contrast, CUDA exhibits the lowest performance portability, with its performance being heavily dependent on the specific GPU hardware. The authors attribute this to CUDA's deep integration with NVIDIA's GPU architecture, whereas Kokkos uses a more abstracted, hardware-agnostic approach.

The paper also includes a detailed analysis of the factors contributing to the performance differences, such as memory access patterns, kernel launch overhead, and compiler optimizations. The authors provide valuable insights into the tradeoffs and design considerations of these programming models in the context of stencil computations.

Critical Analysis

The paper provides a thorough and well-designed evaluation of performance portability across GPU programming models. The focus on stencil computations, a common and important class of algorithms, makes the findings particularly relevant for scientific computing applications.

One limitation of the study is that it only considers a single type of computation (stencil) and a limited set of GPU architectures. The performance portability of these programming models may differ for other types of algorithms or hardware. Additionally, the paper does not delve into the programming complexity or development productivity aspects of these models, which can also be important factors for developers.

Further research could explore the performance portability of these programming models on a wider range of applications and hardware, as well as investigate the trade-offs between performance, portability, and developer productivity. Comparisons with emerging programming models, such as SYCL and OpenMP 5.0, could also provide additional insights.

Despite these potential areas for further study, the paper makes a valuable contribution by providing a comprehensive and rigorous evaluation of performance portability across several prominent GPU programming models. The findings can help inform the selection of programming models for developers targeting heterogeneous computing systems.

Conclusion

This paper presents an in-depth evaluation of the performance portability of various GPU programming models, including CUDA, OpenCL, Kokkos, and SYCL. The authors focus on stencil computations, a common algorithm used in scientific computing, and assess the ability of these models to achieve consistent high performance across different GPU hardware, such as NVIDIA Volta, AMD CDNA, and Intel Xe.

The key finding is that the Kokkos programming model exhibits the highest level of performance portability, with stable and efficient execution on the tested GPU architectures. In contrast, CUDA, which is tightly coupled with NVIDIA's GPU design, shows the lowest performance portability, with its performance heavily dependent on the specific hardware.

These insights are valuable for developers working on heterogeneous computing systems, as they highlight the trade-offs between programming model abstraction and hardware-specific optimization. The paper provides a comprehensive technical analysis and critical discussion, which can help inform the selection of the most appropriate programming model for a given application and target hardware.