Parallel and Distributed Computation: Numerical Methods
by Dimitri P. Bertsekas, John Tsitsiklis
Publisher: Athena Scientific 2003
This highly acclaimed work, first published in 1989, is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the fundamental convergence, rate of convergence, communication, and synchronization issues associated with such algorithms.
Home page url
Download or read it online for free here:
(multiple PDF files)
by Henri Casanova, et al. - CRC Press
This book provides a rigorous yet accessible treatment of parallel algorithms, including theoretical models of parallel computation, parallel algorithm design for homogeneous and heterogeneous platforms, complexity and performance analysis, etc.
by Al Geist, at al. - The MIT Press
Written by the team that developed the software, this tutorial is the definitive resource for scientists, engineers, and other computer users who want to use PVM to increase the flexibility and power of their high-performance computing resources.
by Blaise Barney - Lawrence Livermore National Laboratory
This tutorial covers the very basics of parallel computing, and is intended for someone who is just becoming acquainted with the subject. It begins with a brief overview, including concepts and terminology associated with parallel computing.
by Ian Foster - Addison Wesley
Introduction to parallel programming and a guide for developing programs for parallel and distributed systems. Programs are developed in a methodical fashion and both cost and performance are considered at each stage in a design.