Presentation HSA-4130 by Wen Mei Hwu at the AMD Developer Summit (APU13) November 11-13, 2013.

1. HSA FOR APPLICATION
PROGRAMMING
Wen-mei W. Hwu
CTO, MulticoreWare, Inc.
Professor University of Illinois, Urbana-Champaign

2. CURRENT GPU COMPUTING PAIN
POINTS

Kernel launch overhead

Limited virtual and physical memory space

Extra data movement in I/O and networking

Tedious host code

Multiple source code development

3. KERNEL LAUNCH OVERHEAD

4. DESIRED DATA TRANSFER BEHAVIOR
Main Memory
(DRAM)
Network I/O
CPU
Disk I/O
Device
Memory
DMA
GPU card
(or other Accelerator cards)
SAMOS 2013

5. ACTUAL DATA TRANSFER BEHAVIOR
Main Memory
(DRAM)
Each additional copy
diminishes applicationperceived bandwidth
Network I/O
CPU
Disk I/O
Device
Memory
DMA
GPU card
(or other Accelerator cards)
SAMOS 2013

6. HSA COMMON ADDRESS SPACE

7. STANDARDIZED USER-LEVEL QUEUES

8. LOW OVERHEAD KERNEL LAUNCH

9. DYNAMIC COMPILATION AND BINARY
COMPATIBLITY

10. FAMILIAR COMPUTATION ORGANIZATION

11. EXAMPLE: COMPUTER VISION

16. EXAMPLE EXECUTION TIME

17. TOOLS WORKING GROUP

Tools Group will be looking at foundation for Developer Tools (compilation,
debugging and performance analysis)


Working with the working group to insure the right interface are in place Compilation,
Debugging, and Performance Analysis initially
We act as stewards for


HSA functional simulator with GDB support (AMD/MCW)

HSA performance simulator (AMD)


LLVM backend for generating HSAIL (AMD/MCW)
Loader Library for Simulator - BRIG object loading support ( AMD)
Longer Terms will spawn sub-group that will drive requirement for language
support for HSA

C, C++, C++ AMP

Java (JVM, Dalvik)

Python

JavaScript

DSL…

…
Hwu 2013

18. CURRENT TIME TABLE

Kickoff Conference and Refined Charter –
November 2013

Tools Roadmap – December 2013

Initial Tools – December 2013

Initial Language Tool Chains – January 2013
Please join us and contribute!
Hwu 2013

19. HAS BOOK IN THE MAKING
Heterogeneous System Architecture
For Application Programming

Audience
Performance application developers
 System architects
 Component architects
 Software stack developers

Hwu 2013

20. EDITORIAL BOARD

Gaster, Benedict – Qualcomm

Hegde Manju - AMD

Hwu, Wen-mei - MulticoreWare/UIUC

Jablin, Thomas – MultcoreWare

Lokhmotov, Anton – ARM

Lu, Chien-Ping – MediaTek

Whitecotton, Bob - AMD
Hwu 2013

21. CURRENT TABLE OF CONTENTS

HSA Overview (50 pages)

Chapter 1: What is HSA? (Hwu/Jablin)

Chapter 2: The HSA Architecture (Hwu/Jablin/Others)

Chapter 3: A Programmer's View of HSA (Hwu/Jablin)


Chapter 4: The Tools Framework for HAS,
(Hwu/Jablin/Others)
Chapter 5: Mapping of Classical algorithms onto the
HSA Architecture (Hwu/Jablin)
Hwu 2013

22. CURRENT TABLE OF CONTENTS (CONT.)


Representative Workloads:
Chapter 6: Photography, Minh Do, Professor UIUC, CTO
Personify

Chapter 7: Video-Audio Search, Ren Wu, Baidu

Chapter 8: Augmented Reality Chein-ping Lu, MeidaTek


Chapter 9: Biometrics (Face Detection) Mike Jones, MERL
& Harris Gasparakis, AMD
Chapter 10: Audio-Video processing Bill Herz, Sr. Fellow
AMD
Hwu 2013

23. CURRENT TABLE OF CONTENTS (CONT.)






Chapter 11: Ray-Tracing, TBD
Chapter 12: Natural user Interfaces, Navneett
CEO Flutter
Dallal,
Chapter 13: Physics Processing, Ronald Fedkiw,
Professor Stanford U. and Eftychios Sifakis
Chapter 14: Graphics enhancement, Ignacio Vargas, CTO,
Nextlimit (Interested)
Chapter 15: Communications and networking, Don BanksCisco (Interested)
Chapter 16: Data/Business Analytics , Zubin Dowlaty,
CTO Mu Sigma
Hwu 2013

24. CURRENT TABLE OF CONTENTS (CONT.)





Chapter 17: Hadoop, Memcached and cloud frameworks,
Bharath Mundlapudi, CTO Orzota
Chapter 18: Bioinformatics Wu Feng, VirginiaTech
Chapter 19: Scientific Computations, Byunghyun Jang,
Univ Miss.
Chapter 20: Computer Aided Design and Engineering,
Martin Wong, Professor UIUC
Chapter 21: Oil and Gas, Nacho Navarro, UPC/BSC
(interested)
Hwu 2013

25. CURRENT TABLE OF CONTENTS (CONT.)




Chapter 22: Financial Services & Analysis, Surra
Yanamadala, CA VP
Chapter 23: Computer Vision facial expression,
Elnar Hajiyev, Realeye
Chapter 24: Legacy Code Interoperability, Wenmei and Tom Jablin, MCW
Chapter 25: Java for HSA, Gary Frost, AMD
Hwu 2013

26. MAJOR UPCOMING MILESTONES

Author Algorithm and Code Due – February 2014

Author Chapters Due – April 2014

Review Due Back to Authors – May 2014

Chapters to Elsevier – June 2014

Books available – October 2014
Hwu 2013

27. THANK YOU!
ANY MORE QUESTIONS?
Hwu 2013