Introduction to Parallel Computing
by Blaise Barney
Publisher: Lawrence Livermore National Laboratory 2010
Number of pages: 187
This tutorial covers the very basics of parallel computing, and is intended for someone who is just becoming acquainted with the subject. It begins with a brief overview, including concepts and terminology associated with parallel computing. The topics of parallel memory architectures and programming models are then explored. These topics are followed by a discussion on a number of issues related to designing parallel programs. The tutorial concludes with several examples of how to parallelize simple serial programs.
Home page url
Download or read it online for free here:
by Norm Matloff - University of California, Davis
This book is aimed more on the practical end of things, real code is featured throughout. The emphasis is on clarity of the techniques and languages used. It is assumed that the student is reasonably adept in programming and linear algebra.
by Dimitri P. Bertsekas, John Tsitsiklis - Athena Scientific
This is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the issues associated with such algorithms.
by Colin Campbell, Ralph Johnson, Stephen Toub - Microsoft Press
A book that introduces .NET programmers to patterns for including parallelism in their applications. Examples of these patterns are parallel loops, parallel tasks and data aggregation with map-reduce. Each pattern has its own chapter.
by Earl T. Campbell, Joseph Fitzsimons - arXiv
This review provides a gentle introduction to one-way quantum computing in distributed architectures. One-way quantum computation shows significant promise as a model for distributed systems, particularly probabilistic entangling operations.