An Easy way to build a server cluster without top of rack switches (MEMO) 12-Feb-2015 SAKURA Internet Research Center. Senior Researcher / Naoto MATSUMOTO

1. 12-Feb-2015
SAKURA Internet Research Center.
Senior Researcher / Naoto MATSUMOTO

2. Proof of Concept
Reduce top of rack switches costs
10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server
Top of Rack SW
Aggregation SW
Paper: How to build and manage a large scale switchless server clustering, Naoto MATSUMOTO,IOT28, 2015 /
The Special Interest Group on Internet and Operation Technology (SIG-IOT) / Information Processing Society of Japan.

3. How does it works
Using OSPFv3 Link-state advertisement for server clustering
Quagga or
another routing
daemons

4. How to build it (CentOS7)
# yum install -y quagga iptables-services
# nmcli con mod eth0 connection.autoconnect yes
# nmcli con mod eth1 connection.autoconnect yes
# nmcli con mod eth2 connection.autoconnect yes
# nmcli con mod eth3 connection.autoconnect yes
# echo "net.ipv6.conf.all.forwarding = 1" >> /etc/sysctl.conf
# cp -p /etc/quagga/zebra.conf /etc/quagga/ospf6d.conf
# setsebool -P zebra_write_config 1
# systemctl mask firewalld
# systemctl disable ip6tables
# systemctl enable ospf6d
# systemctl start ospf6d
# vtysh
# configure terminal
# router ospf6
# router-id 10.0.0.16
# redistribute connected
# area 0.0.0.0 range fd50:d026:7eee::/48
# interface eth0 area 0.0.0.0
# interface eth1 area 0.0.0.0
# interface eth2 area 0.0.0.0
# interface eth3 area 0.0.0.0
# interface lo
# ipv6 address fd50:d026:7eee:16::16/64
# end
# write
# quit
# reboot
Routing daemon setup
OSPFv3 configuration

5. Fast OSPFv3 Link Update TIPS
# uname -sr ; cat /etc/redhat-release
Linux 3.10.0-123.13.2.el7.x86_64
CentOS Linux release 7.0.1406 (Core)
# vtysh
# configure terminal
# interface eth0
# ipv6 ospf6 hello-interval 1
# ipv6 ospf6 retransmit-interval 2
# ipv6 ospf6 dead-interval 3
# interface eth1
# ipv6 ospf6 hello-interval 1
# ipv6 ospf6 retransmit-interval 2
# ipv6 ospf6 dead-interval 3
# interface eth2
# ipv6 ospf6 hello-interval 1
# ipv6 ospf6 retransmit-interval 2
# ipv6 ospf6 dead-interval 3
# interface eth3
# ipv6 ospf6 hello-interval 1
# ipv6 ospf6 retransmit-interval 2
# ipv6 ospf6 dead-interval 3
# end
# write
# quit
OSPFv3 update interval adjustment

6. Workload models
10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server
Web Service ...etc Hadoop, Software Defined Storage ...etc

7. Network Durability
Using OSPFv3 Link-state updates for re-route and failover
failover

8. Backward Compatibility
Translation,proxy and tunneling for IPv4 backward compatibility
10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server
IPv4
IPv6
NAT, Proxy, L2TPv3 ..etc

9. 19' Rack Design
Reduce networking cables costs
10/40GSW: 10/40Gigabit Ethernet Switch, SV: Server

10. Conclusion
"An Easy way to build a server cluster
without top of rack Switches" is ...
- Reduce top of rack switches & cables costs.
- Lightweight and simple configuration.
- High network durability.
- Good IPv4/IPv6 backward compatibility.

11. Thanks for your interset.
SAKURA Internet Research Center.