Programming on Parallel Machines
by Norm Matloff
Publisher: University of California, Davis 2012
Number of pages: 410
This is aimed more on the practical end of things, real code is featured throughout. The primary emphasis is on simplicity and clarity of the techniques and languages used. It is assumed that the student is reasonably adept in programming, and has math background through linear algebra.
Download or read it online for free here:
by Dimitri P. Bertsekas, John Tsitsiklis - Athena Scientific
This is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the issues associated with such algorithms.
by Ian Foster - Addison Wesley
Introduction to parallel programming and a guide for developing programs for parallel and distributed systems. Programs are developed in a methodical fashion and both cost and performance are considered at each stage in a design.
by Robert Virding, Claes Wikstrom, Mike Williams - Prentice Hall PTR
A tutorial of Erlang, a concurrent, functional programming language. The emphasis of this book is on learning through example and a number of well known problems in designing and programming concurrent fault-tolerant real-time systems.
by Blaise Barney - Lawrence Livermore National Laboratory
This tutorial covers the very basics of parallel computing, and is intended for someone who is just becoming acquainted with the subject. It begins with a brief overview, including concepts and terminology associated with parallel computing.