Programming on Parallel Machines
by Norm Matloff
Publisher: University of California, Davis 2012
Number of pages: 410
This is aimed more on the practical end of things, real code is featured throughout. The primary emphasis is on simplicity and clarity of the techniques and languages used. It is assumed that the student is reasonably adept in programming, and has math background through linear algebra.
Download or read it online for free here:
by Ian Foster - Addison Wesley
Introduction to parallel programming and a guide for developing programs for parallel and distributed systems. Programs are developed in a methodical fashion and both cost and performance are considered at each stage in a design.
by Mikito Takada - mixu.net
This text provides a more accessible introduction to distributed systems. The book brings together the ideas behind many of the more recent distributed systems - such as Amazon's Dynamo, Google's BigTable and MapReduce, Apache's Hadoop and so on.
by Paul E. McKenney
The purpose of this book is to help you understand how to program shared-memory parallel machines. By describing the algorithms that have worked well in the past, we hope to help you avoid some of the pitfalls that have beset parallel projects.
by Dimitri P. Bertsekas, John Tsitsiklis - Athena Scientific
This is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the issues associated with such algorithms.