No Certificate / Course on Audit Track
The Parallel Computing Foundations course introduces learners to the core concepts and principles of parallel computing in modern computer systems. The course explores how the limitations of sequential processing and the rise of multicore architectures have driven the need for parallel computing approaches.
Students will examine key aspects of parallel architecture design, performance evaluation, and benchmarking techniques. The course also covers fundamental programming models, including shared memory and message passing paradigms, along with important concepts such as cache coherence and memory consistency, helping learners understand how efficient parallel systems are designed and evaluated.
This course has been curated by Riphah International University faculty and staff using publicly available third-party content and Open Educational Resources (OER) for self-paced learning. Learners will engage with curated open-access materials to achieve the course learning outcomes. All third-party content is used under open-access or fair-use policies, while any original materials are developed specifically for this learning experience.
Source and Credits:
By the end of this course, you will be able to:
To be successful on this course, you should have a basic knowledge of Computer Organization
This course is designed for:
Introduction to Parallel Computing
Why do we need Parallel Architecture (Video)
Multicore Revolution
Multicore Computers (Video)
Parallel Architecture
What is parallel Architecture (Video)
Performance and Benchmarking
Benchmarking Performance (Video)
Reporting Performance
Reporting Performance (Video)
Laws on Parallel Performance
Performance Laws (Video)
A shift from sequential to Parallel
Shift -Sequential to Parallel (Video)
Programming Models
Parallel Programming Models (Video)
Shared Memory Paradigm
Shared Memory Model (Video)
Message Passing Paradigm
Distributed Memory Model (Video)
Parallel Program Examples
Writing Parallel Programs (Video)
Cache Coherence
Cache Coherence Problems (Video)
Concept of Serialization
Serialization (Video)
Conditions of Coherence
Coherence Related Conditions (Video)
Types of Cache Coherence
Types of Cache Coherence Protocols (1) (Video)
Types of Cache Coherence Protocols (2) (Video)
The Cache Coherence Protocols
VI Cache Coherence Protocols (Video)
MSI Protocol (Video)
MESI Protocol (Video)
Strict Consistency
Sequential Consistency (Video)
Implication of Sequential Consistency (Video)
Relaxed Consistency
Relaxed Consistency Models (1) (Video)
Relaxed Consistency Models (2) (Video)
Approximately 11 Hours
Intermediate
Fully Online (Asynchronous)
Self Paced
English Only