深入淺出 Laravel Octane

1. @LaravelConf Taiwan 2021
Deep Dive into Laravel Octane
Albert Chen

2. About Me
{
"data": {
"human": {
"name": "Albert Chen",
"occupation": "Software Architect",
"website": "https://albert-chen.com",
"interests": [
"traveling",
"programming",
"cooking"
]
},
"tags": [
"Laravel Artisan",
"Swoole Enthusiast",
"Open Source Contributor"
]
}
}

3. Outline
• Lifecycle in PHP and Laravel
• Introduction of Octane
• Reminders in Long-Lived PHP
• Service Container
• Concurrent Tasks
• Other Features in Octane
• Blocking I/O in PHP
• Coroutine
• Benchmark
• Q&A

4. Slido
Join at
slido.com
#257351

5. Slido
Join at
slido.com
#257351

6. Why PHP Performs
Poorly in High Concurrency?

7. Lifecycle in PHP

8. Lifecycle in Laravel
Autoload Load App Bootstrap
Register
Service
Providers
Boot
Service
Providers
Http
Kernel
Middleware
Dispatch
by Router
Routes
Match
Controller
Response
Terminate
Middleware
Request
public/
index.php

9. How many files are required for one
request in Laravel?
426
get_included_files()
In Laravel 8.52

10. Stateless PHP
• How do we serve PHP today?
• PHP-FPM
• mod_php for Apache
• Both patterns are all stateless

11. Stateless PHP
• Pros
• Easy scaling
• Simple, less risk causing memory leaks
• Cons
• States can't be shared between requests
• States must rely on external storages
• Resources can't be reused e
ffi
ciently
• Connection cost is expensive (like database)
• Not good for high performance

12. Laravel Octane

13. Laravel Octane
• Published in April 2021
• Maintained by o
ffi
cial Laravel team
• Supports Swoole and Roadrunner
• Requires Laravel 8 and PHP 8
• Becoming more friendly in long-lived app
• Hot reload support
• Brings additional features

14. What is RoadRunner?
• Built with Golang
• A replacement for web server and PHP-FPM
• Works on both Linux and Windows
• HTTPS and HTTP/2 support (including HTTP/2 Push, H2C)
• No external PHP dependencies

15. What is RoadRunner?
(Process Manager)
Request
HTTP
Handler
Load
Balancer
PSR-7
Consumer
Workers
Pool
RoadRunner

16. What is Swoole?
• A C extension for PHP
• An asynchronous network engine for PHP
• Features:
• Event-driven non-blocking I/O
• HTTP / HTTP2 / Websocket / TCP / UDP
• Coroutine (CSP Model)
• Excellent performance for high concurrency

17. Server Structure in Swoole

18. Lifecycle in Octane
Reset
Prepare
Sandbox
Request
WarmUp
Middleware
Dispatch
by Router
Routes
Match
Controller
Response
Terminate
Middleware
Run only once

19. PHP Lifecycle in Octane
Run only once!

20. Reminders in Long-Lived PHP
• Global States Pollution
• Global states will be shared in
di
ff
erent requests.
• Use global variables carefully
unless you know what you’re
doing in long-lived PHP.
• You need to reset these states in
the beginning of request if you
don’t want to share them.

21. • Potential Memory Leaks
Reminders in Long-Lived PHP

22. • Don’t exit in your PHP code
Reminders in Long-Lived PHP

23. Static variables in Laravel?

24. Laravel’s Service Container
$resolved = [];
$aliases = [];
$bindings = [];
$instances = [];
$serviceProviders = [];
$loadedProviders = [];
Container

25. Laravel’s Service Container
protected static $app;
protected static
$resolvedInstance;
Facades
Service Container
• $app->singleton(‘event’, …)
• $app->singleton(‘db’, …)
• $app->singleton(‘auth’, …)
Service Provider
event db auth

26. Containers in Octane
• Warm Up Initial Container
Container
Auth Cache Con
fi
g Cookie
DB Encrypt Files Hash
Log Router Routes Session
Trans Url View
Default Services
Register

27. Containers in Octane
• Container Dependencies
Http Kernel
App
Router
Container
Routes Collection
Route
Container
Route
Container

28. Containers in Octane
• Setup Sandbox Container
Clone
Initial
Container
Sandbox
Reset States
Replace Container
Register Other Services
Handle Request

29. • Container dependencies in singleton
Reminders in Octane

30. • Container dependencies in singleton
Reminders in Octane

31. • Container dependencies in singleton
Reminders in Octane

32. Concurrent Tasks

33. • PHP’s Blocking I/O Model
Concurrent Tasks
Process Send API A Send API B Query DB A Query DB B
50ms 50ms 20ms 20ms
140ms in total
Request

34. Concurrent Tasks
• PHP’s Blocking I/O Model
Process
50ms
Child
Child
Child
Child
Fork
Return
Send API request A
Query DB A
Query DB B
50ms
Send API request A
20ms
20ms
Request

35. Concurrent Tasks
• Concurrent Tasks in Octane (Swoole Only)
Process
Task Worker
Dispatch Task Worker
Task Worker
Task Worker
Workers Pool
Send API request A
Send API request B
Query DB A
Query DB B
Return
Request

36. Concurrent Tasks
• Concurrent Tasks in Octane (Swoole Only)

37. Other Features in Octane
(Only support Swoole)

38. • Ticker
• You can set a timer to execute periodic tasks
(e.g. Report your server states every 10 seconds)
Other Features in Octane

39. • Cache & Table
• High performance swoole table driver shared by di
ff
erent
workers without external storage
Other Features in Octane

40. • Cache & Table
• High performance swoole table driver shared by di
ff
erent
workers without external storage
Other Features in Octane

41. • What will this counter number be?
Process Communication
1
2
3
1
4
1

42. • Each worker has its own memory space
Process Communication
Worker
Memory
Worker
Memory
Worker
Memory
Worker
Memory

43. • Use Swoole Table for Sharing Data
Process Communication
Worker
Memory
Worker
Memory
Worker
Memory
Worker
Memory
Swoole Table

44. Blocking I/O in PHP
• PHP is originally created as glue layer to call C functions
• The I/O model is blocking by default
• Almost all client-side libraries involving I/O are blocking
• Multiple process for handling blocking I/O
• I/O bound concurrency depends on process number
• Cost for context switch in processes is expensive

45. Blocking I/O in PHP
• Resource can't be reused
• I/O requests are blocking
• 80% time cost on blocking I/O

46. Concurrency Problem
• 100 requests at the same time need 100 processes
• 100 connections will be established as well
• Scale to increase concurrency

47. Coroutine in Swoole

48. Coroutine in Swoole
• Non-Blocking I/Os are scheduled by coroutine automatically.
PHP is the best
Swoole is awesome!
Hello world!

49. Coroutine in Swoole
Hello Swoole
• Non-Blocking I/Os are scheduled by coroutine automatically.
1.2.3.4

50. Coroutine in Swoole
1.2.3.4
1.2.3.4
1.2.3.4
1.2.3.4
…
• Non-Blocking I/Os are scheduled by coroutine automatically.
Hello Swoole!

51. Coroutine in Swoole
Hello Swoole!
• Non-Blocking I/Os are scheduled by coroutine automatically.
1.2.3.4
1.2.3.4
1.2.3.4
1.2.3.4
…

52. Coroutine in Swoole
• CSP Model
1
2
3
4
5

53. Does Octane Support
Coroutine?

54. • Does Octane support coroutine?
Coroutine in Octane
Coroutine A
Coroutine B
Coroutine C
Process
Request
Request
Request
Yield & Resume

55. • Does Octane support coroutine?
Coroutine in Octane
Coroutine A
Coroutine B
Coroutine C
Process
Request
Request
Request
Yield & Resume
ContainerA
ContainerB
ContainerC
Container ???

56. • Does Octane support coroutine?
Coroutine in Octane

57. Laravel’s Container
Is Not Friendly to Coroutine

58. • Swoole’s New Concurrency Mode
Coroutine in Octane

59. • Concurrent Tasks in Coroutine
Coroutine in Octane
Process
Coroutine A
Yield & Resume
Coroutine B
Coroutine C
Coroutine D
Send API request A
Send API request B
Query DB A
Query DB B
Request
max_concurrency=1

60. • Concurrent Tasks in Coroutine
• Connection pool support for database
• No global variable modi
fi
cations in coroutines
• Only one request in one worker at the same time
• Still not e
ff
ective enough unless container supports
coroutine
Coroutine in Octane

61. • Environment
• MacBook Air 2020
• Core i5 1.1GHz (4 Cores)
Benchmark

62. • PHP-FPM + Nginx
Benchmark

63. • Laravel Octane
Benchmark

64. Some Facts about Swoole
• There’s knowledge gap for traditional PHP developers.

65. Q&A