Electronics and Telecommunications Trends (전자통신동향분석)

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

HPC Technology Through SC20

SC20를 통해 본 HPC 기술 동향

  • Published : 2021.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

High-performance computing (HPC) is the underpinning for many of today's most exciting new research areas, to name a few, from big science to new ways of fighting the disease, to artificial intelligence (AI), to big data analytics, to quantum computing. This report captures the summary of a 9-day program of presentations, keynotes, and workshops at the SC20 conference, one of the most prominent events on sharing ideas and results in HPC technology R&D. Because of the exceptional situation caused by COVID-19, the conference was held entirely online from 11/9 to 11/19 2020, and interestingly caught more attention on using HPC to make a breakthrough in the area of vaccine and cure for COVID-19. The program brought together 103 papers from 21 countries, along with 163 presentations in 24 workshop sessions. The event has covered several key areas in HPC technology, including new memory hierarchy and interconnects for different accelerators, evaluation of parallel programming models, as well as simulation and modeling in traditional science applications. Notably, there was increasing interest in AI and Big Data analytics as well. With this summary of the recent HPC trend readers may find useful information to guide the R&D directions for challenging new technologies and applications in the area of HPC.

Keywords

Acknowledgement

이 논문은 대한민국 정부(과학기술정보통신부)의 재원으로 한국연구재단 슈퍼컴퓨터개발선도사업의 지원을 받아 수행된 연구임[과제번호: 2021M3H6A1017683].

References

  1. Johnnes de Fine Licht and Torsten Hoefler, "Productive Parallel Programming for FPGA with High-Level Synthesis," Tutorial, SC20, Nov. 2020.
  2. Tiziano De Matteis et al., "FBLAS: Streaming Linear Algebra on FPGA," SC20, Nov. 2020.
  3. Tan Nguyen et al., "The Performance and Energy Efficiency Potential of FPGAs in Scientific Computing," 11th International Workshop on Performance Modelling, Benchmarking and Simulation of High Performance Computer Systems(PMB), Nov. 2020.
  4. Nick Brown, "Exploring the Acceleration of Nekbone on Reconfigurable Architectures," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  5. Zheming Jin and Hal Finkel, "Performance Evaluation of the Vectorizable Binary Search Algorithms on an FPGA Platform," 10th Workshop on irregular Applications:Architectures and Algorithms(IAAA), Nov. 2020.
  6. Burkhard Ringlein et al., "Programming Reconfigurable Heterogeneous Computing Clusters Using MPI with Transpilation," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  7. Marius Meyer et al., "Evaluating FPGA Accelerator Performance with a Parameterized OpenCL Adaptation of Selected Benchmarks of the HPC Challenge Benchmark Suite," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  8. Ryan L. Blanchard et al., "FPGA Acceleration of Fluid-Flow Kernels," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  9. Dylan Rankin et al., "FPGAs-as-a-Service Toolkit(FaaST)," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  10. Norihisa Fujita et al., "OpenCL-enabled Parallel Raytracing for Astrophysical Application on Multiple FPGAs with Optical Links," 6th International Workshop on Heterogeneous High-Performance Reconfigurable Computing(H2RC), Nov. 2020.
  11. Xiaomeng ZHAI et al., "GPU acceleration of the FINE/FR CFD solver in a heterogeneous environment with OpenACC directives," 7th Workshop on Accelerator Programming Using Directives(WACCPD), Nov. 2020.
  12. Thomas Sterling, "Invited Talk: A Parallel Execution Model for Exascale non von Neumann Memory-Centric Architectures," 5th International Workshop on Extreme Scale Programming Models and Middlewar(ESPM2), Nov. 2020.
  13. Peter Kogge, "Keynote: 3rd Wall and the Need for Innovation in Architectures," Workshop on Memory Centric High-Performance Computing(MCHPC), Nov. 2020.
  14. T.Chad Effler et al., "Performance Potential of Mixed Data Management Modes for Heterogeneous Memory Systems," Workshop on Memory Centric High-Performance Computing(MCHPC), Nov. 2020.
  15. Nuwan Jayasena, "Keynote: Memory Performance Optimization," 10th Workshop on Irregular Applications: Architectures and Algorithms(IAAA), Nov. 2020.
  16. Mohammad Alaul Haque Monil et al., "Understanding the Impact of Memory Access Patterns in Intel Processors," Workshop on Memory Centric High-Performance Computing(MCHPC), Nov. 2020.
  17. Wataru Endo, "MENPS: A Decentralized Distributed Shared Memory Exploiting RDMA," 4th International Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware, Nov. 2020.
  18. Ada Gavrilovska, "Data-Centric Resource Management for Complex Memory Fabrics," 10th International Workshop on Runtime and Operating Systems for Supercomputers, Nov. 2020.
  19. Tiziano De Matteis, "ExaMPI-Keynote: Streaming Messages-A Distributed Memory Programming Model for Reconfigurable Hardware" 1Workshop on Exascale MPI, Nov. 2020.
  20. Dhabaleswar K. Panda, "InfiniBand, High-speed Ethernet, RoCE, Omni-Path, EFA and Slingshot for Beginners," Tutorial, SC20, Nov. 2020.
  21. sc20 top500 topics
  22. Wu Feng et al., "The Green 500: Trends in Energy-Efficient Supercomputing," SC20, Nov. 2020.
  23. Thomas Coughlin et al., "Compute Express Link™(CXL™) and Gen-Z Protocols: Bridging the Resource Gap Between CPU, Memory and Accelerators," Tutorial, SC20, Nov. 2020.
  24. https://www.computeexpresslink.org/about-cxl
  25. Steve Lee, "Keynote: Scientific Machine Learning and Artifical Intelligence, DoE, Office of Science," Workshop on Artificial Intelligence and Machine Learning for Scientific Applications(AI4S), Nov. 2020.
  26. Simon Knowles, "Invited Talk: The Re-invention of Accelerated Computing for AI," SC20, Nov. 2020.
  27. Cliff Young, "Invited Talk: Can We Build a Virtuous Cycle Between Machine Learning and HPC?," SC20, Nov. 2020.
  28. Soumyadip Ghosh and Vijay Gupta, "Event-GraD: EventTriggered Communication in Parallel Stochastic Gradient Descent," Workshop on Machine Learning in High Performance Computing Environments(MLHPC), Nov. 2020.
  29. Matthijs Jansen et al., "DDLBench: Towards a Scalable Benchmarking Infrastructure for Distributed Deep Learning," 5th Deep Learning on Supercomputers Workshop(DLS), Nov. 2020.
  30. Yuxin Yang et al., "How Good is Your Scientific Data Generative Model?," Workshop on Artificial Intelligence and Machine Learning for Scientific Applications(AI4S), Nov. 2020.
  31. Romain Lion and Samuel Thibault, "From Tasks Graphs to Asynchronous Distributed Checkpointing with Local Restart," Workshop on Fault-Tolerance for HPC at Extreme Scale(FTXS), Nov. 2020.
  32. Lorena A. Barba, "Invited Talk: Trustworthy Computational Evidence Through Transparency and Reproducibility," Responsible Application of HPC, SC20, Nov. 2020.
  33. Jonathan Lifflander et al., "Design and Implementation Techniques for an MPI-Oriented AMT Runtime," Workshop on Exascale MPI(ExaMPI), Nov. 2020.
  34. Seyedeh Mahdieh Ghazimirsaeed et al., "Accelerating GPU-based Machine Learning in Python using MPI Library: A Case Study with MVAPICH2-GDR," 6th Workshop on Machine Learning in HPC Environments, Nov. 2020.
  35. https://sourceryinstitute.github.io/PAW/
  36. Noah Evans et al., "Implementing Flexible Threading Support in Open MPI," Workshop on Exascale MPI(ExaMPI), Nov. 2020.
  37. https://sc20.supercomputing.org/session/?sess=sess220
  38. Nathan Hanford et al., "Challenges of GPU-aware Communication in MPI," Workshop on Exascale MPI(ExaMPI), Nov. 2020.
  39. Bharath Ramesh et al., "Scalable MPI Collectives using SHARP: Large Scale Performance Evaluation on the TACC Frontera System," Workshop on Exascale MPI(ExaMPI), Nov. 2020.
  40. Richard Shane Canon et al., "Using Containers to Accelerate HPC," Tutorial, SC20, Nov. 2020.
  41. Jayjeet Chakraborty et al., "Enabling Seamless Execution of Computational and Data Science Workflowa on HPC and Cloud with the Popper Container-Native Automation Engine," 2nd International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC(CANOPIE-HPC), Nov. 2020.
  42. Julian L. Pistorius et al., "Exosphere-Bringing The Cloud Closer," 3rd International Workshop on Interoperability of Supercomputing and Cloud Technologies(SuperCompCloud), Nov. 2020.
  43. Sadaf R. Alam et al., "Archival Data Repository Services to Enable HPC and Cloud Workflows in a Federated Research e-Infrastructure," 3rd International Workshop on Interoperability of Supercomputing and Cloud Technologies(SuperCompCloud), Nov. 2020.
  44. Felipe A. Cruz et al., "FirecREST: a RESTful API to HPC Systems," 3rd International Workshop on Interoperability of Supercomputing and Cloud Technologies(SuperCompCloud), Nov. 2020.
  45. Amit Ruhela et al., "Containerization on Petascale HPC Clusters," SC20, Nov. 2020.
  46. Ruonan Wang et al., "Processing Full-Scale Square Kilometre Array Data on the Summit Supercomputer," SC20, Nov. 2020.
  47. Pierre-Yves Aquiland et al., "Best Practices for HPC in the Cloud: Part 2(Amazon)," Tutorial, SC20, Nov. 2020.
  48. Joshua Hursey, "Design Considerations for Building and Running Containerized MPI Applications," 2nd International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC(CANOPIE-HPC), Nov. 2020.