Programming Massively Parallel Processors: A Hands-on Approach

Programming Massively Parallel Processors: A Hands-on Approach

(11 customer reviews)

Original price was: $89.99.Current price is: $19.95.

Product details :
    ✔️ (PDF) • Pages : 556

    Programming Massively Parallel Processors: A Hands-on Approach shows both students and professionals alike the basic concepts of parallel programming and GPU architecture. Concise, intuitive, and practical, it is based on years of road-testing in the authors’ own parallel computing courses. Various techniques for constructing and optimizing parallel programs are explored in detail, while case studies demonstrate the development process, which begins with computational thinking and ends with effective and efficient parallel programs. The new edition includes updated coverage of CUDA, including the newer libraries such as CuDNN. New chapters on frequently used parallel patterns have been added, and case studies have been updated to reflect current industry practices.

    • Parallel Patterns Introduces new chapters on frequently used parallel patterns (stencil, reduction, sorting) and major improvements to previous chapters (convolution, histogram, sparse matrices, graph traversal, deep learning)
    • Ampere Includes a new chapter focused on GPU architecture and draws examples from recent architecture generations, including Ampere
    • Systematic Approach Incorporates major improvements to abstract discussions of problem decomposition strategies and performance considerations, with a new optimization checklist

    11 reviews for Programming Massively Parallel Processors: A Hands-on Approach

    1. Steve Cole (verified owner) –

      I liked the reorganizations and updates from the 3rd edition to this one. As an instructor, I also very much appreciated the section in the front material describing the typical usage and course context of the book’s chapters, and dependencies and pathways through the chapters.

    2. Arthur Morgan (verified owner) –

      The cover and some pages in the first chapter are folded. Clearly the previous owner returned it before finishing reading the first chapter for some reason

    3. Arslan (verified owner) –

      Just finished reading the first chapter and I am already impressed.

    4. Mark Saroufim (verified owner) –

      I’ve been using this book to teach my sessions in the cuda mode discord community, it’s been by far the best reference I’ve found on the market to learn CUDA.

      In particular chapters 1-6 will give you the core foundation to be able to start working on your own CUDA kernels and if you supplement those chapters with learning how to integrate your kernels in pytorch using features like load_inline but also the ncu profiler you’ll be well on your way to writing real-world kernels that are performant. There’ a long glossary of confusing concepts like grids, blocks, threads, warps which you won’t remember if you’re browsing the occasional medium blogpost or Wikipedia article, even ChatGPT often makes subtle mistakes. Learning CUDA or at least the basics of it is very much a open the textbook and do the problems sort of exercise.

      Starting chapter 7 the book goes into various case studies of popular algorithms and how to optimize them , the lessons are generically helpful even if you’re not interested in those subproblems but my point is more that the book becomes significantly easier to understand after the initial struggle from chapter 1 through 6. This is also a natural point for you to experiment with your own CUDA kernels in maybe a workload you’re trying to accelerate at work, whenever you get stuck you can browse the book for inspiration on common CUDA patterns that accelerate performance.

      Before this book I’d been stuck in tutorial hell with cuda for many years but this book gave me the right foundation to start using kernels at my day job and it’s been a fantastic level up. Keep in mind that with tools like ChatGPT or code generators like torch.compile you can focus on only learning CUDA as opposed to also having to learn about makefiles and c++

      Granted the main gap the book seems to have is that it doesn’t really cover CUDA C++ so reading codebases like CUTLASS will still be a struggle but more importantly the book doesn’t cover how to program with tensor cores or have a treatment of lower precision dtypes and with modern ML workloads. CUDA streams are also briefly covered but spending a bit more on NCCL would be really nice to see in future editions.

    5. Eduardo Hiroshi Nakamura (verified owner) –

      Excelente

    6. Brandon Awbrey (verified owner) –

      Very clear and thoughtful, covers not only the programming abstractions needed to use CUDA to develop applications, but uses that context to explain the hardware differences and challenges. One of the best programming books I’ve ever read.

    7. Brian L. (verified owner) –

      Covers CUDA programming and then has several chapters discussing massively parallel algorithms.

    8. Al – NW2M (verified owner) –

      A great overview along with deep-dives. College & Masters level content.

    9. Nitin Deshpande (verified owner) –

      A great book for beginners. The fundamentals are explained crisply and clearly. A highly recommended book.

    10. Seripis (verified owner) –

      Very happy with the quality and delivery

    11. Vamshi Balanaga (verified owner) –

      It’s good

    Add a review

    Related products

    YOUR CART
    • No products in the cart.
    Total:
    $0.00
    CHECKOUT
    SWEET! Add more products and get 20% Cart off on your entire order!

    New item(s) have been added to your cart.

    View Cart Checkout
    Quantity: 1
    Total: $19.95
    Build a Large Language Model (From Scratch) Original price was: $299.99.Current price is: $27.99.
    AI Engineering: Building Applications with Foundation Models Original price was: $79.99.Current price is: $19.99.
    Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG Original price was: $89.99.Current price is: $9.99.
    ChatGPT For Dummies Original price was: $45.00.Current price is: $14.95.
    Why Machines Learn: The Elegant Math Behind Modern AI Original price was: $52.00.Current price is: $16.95.
    Building Agentic AI Systems Original price was: $49.99.Current price is: $19.19.
    Mindset Mathematic (10 books) Original price was: $275.99.Current price is: $49.99.
    Large Language Models: A Deep Dive: Bridging Theory and Practice Original price was: $84.99.Current price is: $15.99.
    Generative AI with LangChain: Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph Original price was: $59.99.Current price is: $19.95.
    Vector: A Surprising Story of Space, Time, and Mathematical Transformation Original price was: $58.00.Current price is: $19.99.
    The Quick Python Book, Fourth Edition Original price was: $89.99.Current price is: $26.99.
    Storytelling with Data: A Data Visualization Guide for Business Professionals Original price was: $41.99.Current price is: $18.99.
    The Art of Computer Programming (6 books) Original price was: $499.99.Current price is: $44.99.
    Statistics for People Who (Think They) Hate Statistics Original price was: $156.00.Current price is: $19.95.
    RAG-Driven Generative AI: Build custom retrieval augmented generation pipelines with LlamaIndex, Deep Lake, and Pinecone Original price was: $45.99.Current price is: $19.95.
    Building Thinking Classrooms in Mathematics: A Comprehensive Guide for Grades K-12 (3 book series) Original price was: $149.99.Current price is: $30.00.
    Practical Generative AI with ChatGPT: Unleash your prompt engineering potential with OpenAI technologies for productivity and creativity Original price was: $44.99.Current price is: $19.00.
    The Self-Taught Programmer: The Definitive Guide to Programming Professionally Original price was: $21.87.Current price is: $5.00.
    Practical Statistics for Data Scientists: 50+ Essential Concepts Using R and Python Original price was: $79.99.Current price is: $17.49.
    Complex Analysis and Special Functions: Cauchy Formula, Elliptic Functions and Laplace’s Method (De Gruyter Textbook) Original price was: $104.99.Current price is: $19.99.
    Introduction to Graph Theory (Dover Books on Mathematics) Original price was: $35.00.Current price is: $8.99.
    Machine Learning: An Applied Mathematics Introduction Original price was: $70.00.Current price is: $17.00.
    Advanced Thinking Skills (4 book series) Original price was: $174.95.Current price is: $39.99.
    Hands-On Large Language Models: Language Understanding and Generation Original price was: $79.99.Current price is: $19.99.
    Computer Programming And Cyber Security for Beginners: This Book Includes: Python Machine Learning, SQL, Linux, Hacking with Kali Linux, Ethical Hacking. Coding and Cybersecurity Fundamentals Original price was: $100.97.Current price is: $18.99.
    Linear Algebra: Theory, Intuition, Code Original price was: $35.00.Current price is: $10.00.
    Numsense! Data Science for the Layman: No Math Added Original price was: $28.99.Current price is: $5.49.
    Making Sense of Math: How to Help Every Student Become a Mathematical Thinker and Problem Solver (ASCD Arias) Original price was: $20.00.Current price is: $6.95.
    Essential Prealgebra Skills Practice Workbook Original price was: $16.99.Current price is: $4.99.
    Learn Physics with Calculus Step-by-Step (3 book series) Original price was: $159.95.Current price is: $29.99.
    Math Illuminated: A Visual Guide to Calculus and Its Applications (4 book series) Original price was: $175.00.Current price is: $40.00.
    Math Fact Fluency: 60+ Games and Assessment Tools to Support Learning and Retention Original price was: $35.95.Current price is: $19.95.
    The Calculus Story: A Mathematical Adventure Original price was: $29.99.Current price is: $7.95.
    Mental Math: Tricks To Become A Human Calculator (For Speed Math, Math Tricks, Vedic Math Enthusiasts, Gmat, Gre, SAT Students & Case Interview Study) Original price was: $19.99.Current price is: $6.00.
    Generative AI in Action Original price was: $59.99.Current price is: $24.00.
    Humble Math - Area, Perimeter, Volume, & Surface Area: Geometry for Beginners - Workbook with Answer Key (KS2 KS3 Maths) Elementary, Middle School, High School Math – Geometry for Kids Original price was: $17.00.Current price is: $4.99.
    Essential Math for AI: Next-Level Mathematics for Efficient and Successful AI Systems Original price was: $79.99.Current price is: $19.99.
    Probabilistic Machine Learning: Advanced Topics (Adaptive Computation and Machine Learning series) Original price was: $150.00.Current price is: $19.99.
    Math-ish: Finding Creativity, Diversity, and Meaning in Mathematics Original price was: $29.99.Current price is: $12.94.
    The Art of Game Design: A Book of Lenses, Third Edition Original price was: $123.96.Current price is: $19.99.
    Math Practice Workbook Grades 6-8: 1000+ Questions You Need to Kill in Middle School by Brain Hunter Prep (Arithmetic, Algebra, Geometry, Measurement, ... more in Kill It Series by Brain Hunter Prep) Original price was: $33.99.Current price is: $11.99.
    Causal Inference in Statistics - A Primer Original price was: $50.95.Current price is: $19.99.
    Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking Original price was: $49.99.Current price is: $11.00.
    Artificial Intelligence: A Systems Approach from Architecture Principles to Deployment (MIT Lincoln Laboratory Series) Original price was: $108.22.Current price is: $19.99.
    What's the Point of Math? (DK What's the Point of?) Original price was: $32.00.Current price is: $8.95.
    Mastering Essential Math Skills: 20 Minutes a Day to Success, Book 2: Middle Grades/High School 2nd Edition Original price was: $31.49.Current price is: $9.97.
    Machine Learning using Python Original price was: $16.99.Current price is: $7.99.
    Essential Math for Data Science: Take Control of Your Data with Fundamental Linear Algebra, Probability, and Statistics Original price was: $65.99.Current price is: $14.49.
    Fractions Essentials Workbook with Answers Original price was: $13.99.Current price is: $4.99.
    0