Foundations of High-Performance Computing

Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming offers a comprehensive reference on high-performance computing (HPC). Laying the groundwork for the companion text, High-Performance Computing: Applications and Frontiers, this book serves as a comprehensive introduction to the fundamental concepts, systems, and introductory programming techniques. It focuses on infrastructure, programming basics, and practical access to HPC systems, covering the evolution of HPC and offering an architectural overview of HPC systems. In addition, it explores resource management and performance metrics in parallel systems, discussing practical access to HPC and considering the concepts behind distributed and shared memory. Other sections focuses on OpenMP for multithreading, MPI programming, GPU computing, OpenACC, and CUDA, and parallel I/O, data management, filesystems, cloud based HPC, and virtualization. The book concludes with a reference and glossary, equipping the reader with a thorough grounding in the basics of HPC and providing a comprehensive, multidisciplinary guide on the principles and concepts that underpin high performance computing. It is designed for graduate students, early-career professionals, and researchers seeking to build a solid foundation in HPC.