Programming Massively Parallel Processors: A Hands-on Approach

Programming Massively Parallel Processors: A Hands-on Approach

(11 customer reviews)

Original price was: $89.99.Current price is: $19.95.

Product details :
    ✔️ (PDF) • Pages : 556

    Programming Massively Parallel Processors: A Hands-on Approach shows both students and professionals alike the basic concepts of parallel programming and GPU architecture. Concise, intuitive, and practical, it is based on years of road-testing in the authors’ own parallel computing courses. Various techniques for constructing and optimizing parallel programs are explored in detail, while case studies demonstrate the development process, which begins with computational thinking and ends with effective and efficient parallel programs. The new edition includes updated coverage of CUDA, including the newer libraries such as CuDNN. New chapters on frequently used parallel patterns have been added, and case studies have been updated to reflect current industry practices.

    • Parallel Patterns Introduces new chapters on frequently used parallel patterns (stencil, reduction, sorting) and major improvements to previous chapters (convolution, histogram, sparse matrices, graph traversal, deep learning)
    • Ampere Includes a new chapter focused on GPU architecture and draws examples from recent architecture generations, including Ampere
    • Systematic Approach Incorporates major improvements to abstract discussions of problem decomposition strategies and performance considerations, with a new optimization checklist

    11 reviews for Programming Massively Parallel Processors: A Hands-on Approach

    1. Steve Cole (verified owner) –

      I liked the reorganizations and updates from the 3rd edition to this one. As an instructor, I also very much appreciated the section in the front material describing the typical usage and course context of the book’s chapters, and dependencies and pathways through the chapters.

    2. Arthur Morgan (verified owner) –

      The cover and some pages in the first chapter are folded. Clearly the previous owner returned it before finishing reading the first chapter for some reason

    3. Arslan (verified owner) –

      Just finished reading the first chapter and I am already impressed.

    4. Mark Saroufim (verified owner) –

      I’ve been using this book to teach my sessions in the cuda mode discord community, it’s been by far the best reference I’ve found on the market to learn CUDA.

      In particular chapters 1-6 will give you the core foundation to be able to start working on your own CUDA kernels and if you supplement those chapters with learning how to integrate your kernels in pytorch using features like load_inline but also the ncu profiler you’ll be well on your way to writing real-world kernels that are performant. There’ a long glossary of confusing concepts like grids, blocks, threads, warps which you won’t remember if you’re browsing the occasional medium blogpost or Wikipedia article, even ChatGPT often makes subtle mistakes. Learning CUDA or at least the basics of it is very much a open the textbook and do the problems sort of exercise.

      Starting chapter 7 the book goes into various case studies of popular algorithms and how to optimize them , the lessons are generically helpful even if you’re not interested in those subproblems but my point is more that the book becomes significantly easier to understand after the initial struggle from chapter 1 through 6. This is also a natural point for you to experiment with your own CUDA kernels in maybe a workload you’re trying to accelerate at work, whenever you get stuck you can browse the book for inspiration on common CUDA patterns that accelerate performance.

      Before this book I’d been stuck in tutorial hell with cuda for many years but this book gave me the right foundation to start using kernels at my day job and it’s been a fantastic level up. Keep in mind that with tools like ChatGPT or code generators like torch.compile you can focus on only learning CUDA as opposed to also having to learn about makefiles and c++

      Granted the main gap the book seems to have is that it doesn’t really cover CUDA C++ so reading codebases like CUTLASS will still be a struggle but more importantly the book doesn’t cover how to program with tensor cores or have a treatment of lower precision dtypes and with modern ML workloads. CUDA streams are also briefly covered but spending a bit more on NCCL would be really nice to see in future editions.

    5. Eduardo Hiroshi Nakamura (verified owner) –

      Excelente

    6. Brandon Awbrey (verified owner) –

      Very clear and thoughtful, covers not only the programming abstractions needed to use CUDA to develop applications, but uses that context to explain the hardware differences and challenges. One of the best programming books I’ve ever read.

    7. Brian L. (verified owner) –

      Covers CUDA programming and then has several chapters discussing massively parallel algorithms.

    8. Al – NW2M (verified owner) –

      A great overview along with deep-dives. College & Masters level content.

    9. Nitin Deshpande (verified owner) –

      A great book for beginners. The fundamentals are explained crisply and clearly. A highly recommended book.

    10. Seripis (verified owner) –

      Very happy with the quality and delivery

    11. Vamshi Balanaga (verified owner) –

      It’s good

    Add a review

    Related products

    YOUR CART
    • No products in the cart.
    Total:
    $0.00
    CHECKOUT
    SWEET! Add more products and get 20% Cart off on your entire order!

    New item(s) have been added to your cart.

    View Cart Checkout
    Quantity: 1
    Total: $19.95
    Mathematics for Machine Learning Original price was: $79.86.Current price is: $19.99.
    Machine Learning: An Applied Mathematics Introduction Original price was: $70.00.Current price is: $17.00.
    Machine Learning with PyTorch and Scikit-Learn: Develop machine learning and deep learning models with Python Original price was: $79.99.Current price is: $19.90.
    Pre-calculus, Calculus, and Beyond Original price was: $50.00.Current price is: $19.99.
    The Self-Taught Programmer: The Definitive Guide to Programming Professionally Original price was: $21.87.Current price is: $5.00.
    What's the Point of Math? (DK What's the Point of?) Original price was: $32.00.Current price is: $8.95.
    Building Thinking Classrooms in Mathematics: A Comprehensive Guide for Grades K-12 (3 book series) Original price was: $149.99.Current price is: $30.00.
    All the Math You Missed: (But Need to Know for Graduate School) Original price was: $51.99.Current price is: $19.95.
    Math and Architectures of Deep Learning Original price was: $69.99.Current price is: $25.00.
    The Art of Electronics: The x Chapters Original price was: $148.00.Current price is: $19.99.
    Introduction to Linear Algebra (Gilbert Strang, 5) 6th Edition Original price was: $87.50.Current price is: $19.95.
    Microsoft Excel 365 Bible 2nd Edition Original price was: $55.00.Current price is: $20.00.
    The Little Book of Mathematical Principles, Theories, & Things (IMM Lifestyle Books) Over 120 Laws, Principles, Equations, Paradoxes, and Theorems Explained Simply; Easy to Understand Math Reference Original price was: $15.60.Current price is: $5.00.
    The Quick Python Book, Fourth Edition Original price was: $89.99.Current price is: $26.99.
    Bernoulli's Fallacy: Statistical Illogic and the Crisis of Modern Science Original price was: $49.99.Current price is: $14.00.
    Linux Basics for Hackers, 2nd Edition: Getting Started with Networking, Scripting, and Security in Kali Original price was: $59.99.Current price is: $19.99.
    Outlier Detection in Python Original price was: $169.99.Current price is: $28.00.
    Complex Analysis and Special Functions: Cauchy Formula, Elliptic Functions and Laplace’s Method (De Gruyter Textbook) Original price was: $104.99.Current price is: $19.99.
    Teaching 6-12 Math Intervention: A Practical Framework To Engage Students Who Struggle Original price was: $136.99.Current price is: $21.95.
    AP Statistics Premium, 2025: Prep Book with 9 Practice Tests + Comprehensive Review + Online Practice (Barron's AP Prep) Original price was: $49.99.Current price is: $17.19.
    Advanced Thinking Skills (4 book series) Original price was: $174.95.Current price is: $39.99.
    Introduction to Fourier Optics Original price was: $166.99.Current price is: $19.95.
    Foundations of Modern Physics Original price was: $47.99.Current price is: $19.95.
    Agentic Design Patterns: A Hands-On Guide to Building Intelligent Systems Original price was: $54.99.Current price is: $21.99.
    Essential Mathematics for Quantum Computing: A beginner's guide to just the math you need without needless complexities Original price was: $23.99.Current price is: $13.99.
    Math-ish: Finding Creativity, Diversity, and Meaning in Mathematics Original price was: $29.99.Current price is: $12.94.
    Linear Optimization and Duality: A Modern Exposition Original price was: $100.00.Current price is: $20.00.
    Productive Math Struggle: A 6-Point Action Plan for Fostering Perseverance (Corwin Mathematics Series) Original price was: $59.95.Current price is: $19.99.
    Oswaal CBSE Question Bank Class 9 Mathematics, Chapterwise and Topicwise Solved Papers For 2025 Exams Original price was: $32.99.Current price is: $3.99.
    HTML & CSS: The Comprehensive Guide to Excelling in HTML5 and CSS3 for Responsive Web Design, Dynamic Content, and Modern Layouts (Rheinwerk Computing) Original price was: $59.99.Current price is: $19.95.
    Linear Algebra: Theory, Intuition, Code Original price was: $35.00.Current price is: $10.00.
    Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking Original price was: $49.99.Current price is: $11.00.
    Math Fact Fluency: 60+ Games and Assessment Tools to Support Learning and Retention Original price was: $35.95.Current price is: $19.95.
    Workman Publishing Company - To Ace Math in One Big Fat Notebook: The Complete Middle School Study Guide (Big Fat Notebooks) Original price was: $20.02.Current price is: $9.19.
    Managing Machine Learning Projects: From design to deployment Original price was: $49.99.Current price is: $23.00.
    Discrete Mathematics and Its Applications Original price was: $875.66.Current price is: $20.00.
    Practical Guide to Applied Conformal Prediction in Python: Learn and apply the best uncertainty frameworks to your industry applications Original price was: $49.99.Current price is: $19.98.
    Everything You Need to Ace Geometry in One Big Fat Notebook (Big Fat Notebooks) Original price was: $29.99.Current price is: $10.49.
    Modeling Life: The Mathematics of Biological Systems Original price was: $80.09.Current price is: $17.99.
    HTML and CSS: Design and Build Websites Original price was: $53.15.Current price is: $17.99.
    The SAGE Handbook of Qualitative Research Original price was: $178.00.Current price is: $19.99.
    Machine Learning Crash Course for Engineers Original price was: $64.99.Current price is: $19.92.
    The Cartoon Guide to Geometry Original price was: $26.00.Current price is: $11.95.
    Making Sense of Math: How to Help Every Student Become a Mathematical Thinker and Problem Solver (ASCD Arias) Original price was: $20.00.Current price is: $6.95.
    Essential Math for AI: Next-Level Mathematics for Efficient and Successful AI Systems Original price was: $79.99.Current price is: $19.99.
    The Princeton Companion to Mathematics Original price was: $105.00.Current price is: $19.99.
    The Math Book: From Pythagoras to the 57th Dimension, 250 Milestones in the History of Mathematics (Union Square & Co. Milestones) Original price was: $45.99.Current price is: $18.02.
    Calculus with Multiple Variables Essential Skills Workbook: Includes Vector Calculus and Full Solutions Original price was: $19.99.Current price is: $4.99.
    Concrete Mathematics: A Foundation for Computer Science (2nd Edition) Original price was: $132.15.Current price is: $20.95.
    Calculus 9th Edition Original price was: $312.95.Current price is: $20.00.
    0