Parallel systems¶

• More than one CPU/core in close communication
• Usually communicate through shared memory

Multi-Core Processor¶

• AMD Ryzen
• AMD EPYC
• Intel Core i7

Many Core Processor¶

• integrated GPU on CPUs
• Nvidia RTX
• Nvidia GTX
• Nvidia A100
• Intel Arc GPU
• AMD Radeon RX GPU

Memeory access Architecture¶

• Uniform Memory Access (UMA)

  • Symmetric multiprocessor (SMP)
  • identical processors
  • Equal access times to memory

• Non-Uniform Memory Access (NUMA)

  • linking two or more SMPs
  • SMP can directly access other SMP's memory