InfiniBand is a type of communications link for data flow between processors and I/O devices that offers throughput of up to 2.5 gigabytes per second and support for up to 64,000 addressable devices. Presented by Shekhar Kumar of SOE,CUSAT, 200

1. INFINIBAND Presented By- Shekhar Kumar 074, CS-’B’ Guided By- Latha R. Nair

2. Contents Introduction I/O Architectures- Fabric vs Bus Technical Overview InfiniBand Layers InfiniBand Architecture Advantages & Drawbacks Markets Conclusion References

4. Operates at a base speed of 2.5 Gb/s or 10 Gb/s in each direction (per port)

5. Provides both QoS (Quality of Service) and RAS (Reliability, Availability and Serviceability)

7. I/O Architectures Contd… Shared Bus Architecture CPU System Memory System Controller I/O Controller PCI to PCI Bridge PCI to PCI Bridge I/O Controller I/O Controller I/O Controller I/O Controller

8. I/O Architectures Contd… Switched Fabric Architecture

9. Technical Overview Switch-based point-to-point interconnect architecture Each individual link is based on a four-wire 2.5Gb/s bidirectional connection. Architecture defines a layered hardware protocol (Physical, Link, Network, Transport Layers) as well as a software layer Each link can support multiple transport services for reliability

10. InfiniBand Feature Set Layered Protocol- Physical, Link, Network, Transport, Upper Layers Packet based communication Quality Of Service Three link speeds 1X- 2.5 Gb/s, 4 Wire 4X- 10 Gb/s, 16 Wire 12X- 30 Gb/s, 48 Wire PCB, Copper and Fiber cable interconnect Multicast and Unicast support

11. InfiniBand Layers

12. InfiniBand LayersContd… Physical Layer Defines both electrical and mechanical characteristics for the system Includes cables and receptables for fibre and copper media, backplane connectors Defines three link speeds, 1X,4X,12X Each individual link is a 4-wire differential connection that provides a full duplex connection at 2.5 Gb/s

13. InfiniBand Layers Contd… 2) Link Layer Encompasses packet layout, point-to-point operations, and switching within a local subnet Packets- Two types: Management and Data packets Management Packets- Used for link configuration and maintenance Data Packets- Carry up to 4k bytes of a transaction payload Switching- Devices within a subnet have a 16-bit Local ID assigned by the subnet manager. This LID is used for addressing.

15. 16-bit VCRC includes all fields in the packet and is recalculated at each hop

17. InfiniBand Architecture

18. InfiniBand ArchitectureContd… Defines multiple devices for system communication: channel adapter, switch, router, and a subnet manager At least one channel adapter is required for each end node Subnet Manager sets up and maintains link Channel adapters and switches contains Subnet Management Agent(SMA) for handling communication with the subnet manager

19. Channel Adapters Connects InfiniBand to other devices Two types: Host Channel adapter(HCA) and Target Channel Adapter(TCA) HCA- Provides interface to a host device and supports all software verbs defined by InfiniBand TCA- Provides connection to an I/O device from InfiniBand with a subset of HCA features necessary for specific operations of each device

20. Switches and Routers

22. Can be configured to forward either unicast packets or multicast packets

25. Drawbacks Complex in design Few platforms supports it as yet Bleeding edge, for now, so users will need to perform extensive testing

26. Markets Application Clustering Inter-Processor Communication(IPC) Storage Area Networks

27. CONCLUSION Greater processor performance Supports RAS Works both in-the-box and enables Bandwidth Out of the Box Supports scalability

28. REFERENCES InfiniBandTrade Association www.infinibandta.org InfiniBandNetwork Architecture, MindShare, Inc. By Tom Shanley InfiniBand Architecture, Development and Deployment: A strategic guide to server I/O solutions By William T. Futral Qos in InfiniBandSubnetworks: Alfaro,F.J.; Sanchez, J.L.; Duato, J.; Department de Informatica, Univ. de Castilla-La Mancha, Albacete, Spain

29. THANK YOU

30. Queries ???