Agile Data (http://git.io/ad) is my new open-source framework that fills the growing gap between ORM and Raw SQL queries. In this presentation I explain why have I started Agile Data project and how can it enable PHP developer to generate more sophisticated queries when they need them.

2. WARNING
This presentation may contain:
‣ Alternattive opinions
‣ Mention of phrase "new framework"
‣ Mention of paid services and/or software
‣ Out-of PHP concepts (Java, Scala, Ruby)

3. Love and Hate
between ORM
and
Query Builders

4. Myself
‣ Love Web Apps
‣ 25 years of coding
‣ Entrepreneur
‣ I buy Software
My PHP Startup
‣ Helps developers
‣ Open-source
‣ PHP in Enterprise
‣ Code Sharing
About Me

5. Query
‣ Control
‣ Advanced Features
‣ Multi-Record
ORM
‣ 10+ tables
‣ SoftDelete, Audit
‣ Domain Model
Database Interaction
Today

6. MapperEntity Query
ORM: How it should
work
Database
Business Logic
ORM

7. MapperEntity SQL Query
The Reality
SQL Database
Business Logic
ORM

8. SQL Query
Why Bother…
SQL Database
Business Logic

9. Love Compatibility

11. Query Builder
‣ Query
‣ Conditions
‣ Statements
‣ Expressions
ORM
‣ Entity
‣ Property
‣ Operations
(C.R.U.D.)
What do we work with?

12. Love Compatibility
Entity Property Operations
Query ❤️
Condition
Statements
Expression
ORM Components
QueryComponents

13. Love Compatibility
Entity Property Operations
Query ❤️ 😔 😔
Condition
Statements
Expression
ORM Components
QueryComponents

14. Love Compatibility
Entity Property Operations
Query ❤️ 😔 😔
Condition 😐 ❤️
Statements
Expression
ORM Components
QueryComponents

15. Love Compatibility
Entity Property Operations
Query ❤️ 😔 😔
Condition 😐 😔 ❤️
Statements
Expression
ORM Components
QueryComponents

16. Love Compatibility
Entity Property Operations
Query ❤️ 😔 😔
Condition 😐 😔 ❤️
Statements 💀 💀 💀
Expression
ORM Components
QueryComponents

17. Love Compatibility
Entity Property Operations
Query ❤️ 😔 😔
Condition 😐 😔 ❤️
Statements 💀 💀 💀
Expression 💀 💀 💀
ORM Components
QueryComponents

18. Reimagine a better data access
framework. With fresh start.
Agile Data

19. Agile Data
Entity Property Operations
Query
Condition
Statements
Expression
ORM Components
QueryComponents

20. Properties
/** @Column(type="datetime", name="posted_at") */
private $postedAt;
protected $casts = [
'is_admin' => 'boolean',
];
public function setFirstNameAttribute($value)
{
$this->attributes['first_name'] = strtolower($value);
}

21. Fields in Agile Data
$book->addField('total_cost', ['type'=>'money']);
Like properties, but smarter.

22. Property
‣ Handy and Native
‣ No type
‣ No logic
‣ No meta-info
Field
‣ Array-access
‣ Type enforcing
‣ Extensible logic
‣ Meta-info
Fields

23. Fields
class Document extends atk4dataModel
{
public $table = 'document';
function init() {
parent::init();
$this->addField('ref_no', ['type'=>'string']);
$this->addField('date', ['type'=>'date']);
$this->addField('type', ['enum'=>['invoice','payment']]);
$this->hasOne('contact_id', new Contact());
$this->addField('is_archived', ['type'=>'boolean']);
}
}

24. Generic UI
$form = new uiForm();
$form->setModel(new smboModel_Job($db));
echo $form->render();
Fastest imaginable way to build
good looking data entry form?

25. Generic UI

26. Expression
$client->addExpression(
'balance',
'coalesce([total_invoice]-[total_paid],0)'
);
Define custom SQL code for your
field.

27. Aggregate Field
$client->hasMany('Order')
->addField('total_orders', [
'field'=>'amount', 'aggregate'=>'sum'
]);
Express related model aggregate
as sub-query.

28. Agile Data
Entity Field Operations
Query ❤️
Condition ❤️
Statements ❤️
Expression ❤️
ORM Components
QueryComponents

29. Entity
Client
name
address_id
Order
title
total_order
Expression
SubQuery
hasMany
hasOne
6 objects

30. Is this slow?
6 objects 5 rows*

31. Object representing collection of
records
Data Sets

32. Record Mapping
‣ Active Record and ORM map individual records
‣ Multiple records require Multiple objects in memory
Model_Client object
user type=client
user type=client
user type=client
user type=client
user type=admin
user type=admin
tableuser
Model_Client object

33. DataSet Mapping
‣ Agile Data works with DataSets
‣ Multiple records require Single objects in memory
Model_Client object
user type=client
user type=client
user type=client
user type=client
user type=admin
user type=admin
tableuser

34. DataSet
Client Admin
User

35. Conditions
class Client extend User {
function init() {
parent::init();
$this->addCondition('type', 'client');
}
}
Narrow the scope of accessible
records

36. Conditions
$client = new Client($db);
$client->load(12);
$client['type'] = 'admin';
$client->save(); // <== Exception
Prevent human error

37. Project
DataSet $m = new Project($db);

38. Project
$m = new Project($db);
$m->addCondition(
'client_id', $c_id
);
client=$c_id

39. Project
$m = new Project($db);
$m->addCondition(
'client_id', $c_id
);
$m->addCondition(
'is_cancelled',
false
);
client=1
client=$c_id
is_cancelled =
"N"

40. Conditions
$client = new Client($db);
$client->load($_GET['user_id']);
$project = $client->ref('Project');
$project->insert($_POST);
Prevent human error

41. Conditions
$profitable_client = new Client($db);
$profitable_client->addCondition($this->expr(
'[income]>[expense]'
));
$data = $profitable_client->export();
Dynamically add expressions for
reports.

42. Deep Traversal
foreach(
$author->withID(20)
->ref('App')
->ref('Review')
->addCondition('rating', 1) as $bad_review
) {
$bad_review->sendApologyEmail();
}
Traverse without querying

43. QRM->Q.B.
‣ Static scope
‣ Limited inheritance
‣ Persistence layer
DataSet Model
‣ Dynamic scope
‣ Fully OOP
‣ References infer
conditions
‣ Domain layer
Model

44. Agile Data
Model (DataSet
)
Field Operations
Query ❤️ ❤️
Condition ❤️ ❤️
Statements ❤️ ❤️
Expression ❤️ ❤️
ORM Components
QueryComponents

45. ORM limit multi-record features
and other database capabilities.
N+1 problem

46. foreach (Client::all() as $client) {
foreach($client->orders() as $order){
$sum += $order->amount;
}
}
N+1 problem
‣ 20 users in database
‣ 20 extra queries to fetch orders

47. foreach (Client::all() as $client) {
foreach($client->orders() as $order){
$sum += $order->amount;
}
}
Memory Problem
‣ 20 users in database
‣ array of 20 objects
‣ other properties are also fetched

48. foreach (Client::all() as $client) {
foreach($client->orders() as $order){
$sum += $order->amount;
}
}
Lazy-loading; ID Stuffing
‣ only load IDs
‣ trigger loading on property access
‣ select from `order` where user in (1,2,3,…)

49. Action
$client = new Client($db);
$sum = $client->ref('Order')
->action('fx', ['sum', 'amount'])
->execute();
Event from Domain Model to your
database

50. Multi-record operations
$author->withID(20)
->ref('App')
->ref('Review')
->addCondition('rating', 1)
->action('delete')
->execute();
Delete all entries in data-set

51. Multi-record operations
$author->withID(20)
->ref('App')
->ref('Review')
->addCondition('rating', '<', 3)
->action('update')
->set('rating=rating+1')
->execute();
or just update rating

52. Aggregation
$q = $client->action('field', ['industry']);
$q->field('count(*)', 'c');
$q->group('industry');
$data = $q->get();
Create any query around Model

53. Union
$q_inv = $client->ref('Invoice')
->action('field',['date','total']);
$q_pay = $client->ref('Payment')
->action('field',['date','paid']);
foreach($db->expr(
'select * from ([] UNION []) u1',
$q_inv, $q_pay
) as $row) {
///
}
Prepare client statement

54. ORM
‣ Emit query-builder
‣ Limited scope
support
‣ SQL only
‣ Fully Persistence
logic
Agile Actions
‣ Emit DSQL
‣ All conditions
applied
‣ Extensible to
NoSQL
‣ Domain model
support
Multi-record operations

55. Agile Data
Model (DataSet
)
Field Operations
Query ❤️ ❤️ ❤️
Condition ❤️ ❤️ ❤️
Statements ❤️ ❤️ ❤️
Expression ❤️ ❤️ ❤️
ORM Components
QueryComponents

56. Summary
‣ ORM and Query Builders has a bumpy relationship
‣ Luckily there are other patterns
‣ Consider query latency
‣ Consider flexibility
‣ Consider abstraction

57. Execute less queries Design a beautiful API
Friendly with UIExtensions
Agile Data

58. Download

59. Result

60. Make UI better

61. git.io/ad
✓ Works in any framework / PHP app
✓ Lightweight and Agile
✓ Integrates with UI frameworks (like
ATK)
✓ Commercial Support
Agile Data is Open-
Source

62. Join my OSS project
‣ Agile Data v1.1.5
git.io/ad
‣ Agile UI (developing)
github.com/atk4/ui
My other topics
‣ Agile Toolkit
Full-stack PHP UI

63. More examples
if there is time

64. Query into Field
$client->addExpression('last_sale',
function($m){
return $m->refLink('Invoice')
->setLimit(1)
->setOrder('date desc')
->action('field',['total']);
}, 'type'=>'money'
);
Convert Entity into Query then use
inside Field / Expression.

65. Join on Expression
$invoice->hasOne('client_id', new Client())
->addField('client_country_id', 'country_id');
$invoice->join('country', 'client_country_id')
->addFields([
'country_short_code'=>'short_code',
'country_is_eu'=>'is_eu',
'country'=>'name'
]);
If you need country data inside
your Invoice report, but country_id
is defined through Client.

66. Aliasing

67. Self-referencing
class Folder extends atk4dataModel
{
public $table = 'folder';
public function init()
{
parent::init();
$this->addField('name');
$this->hasMany('SubFolder', [
new Folder(),
'their_field'=>'parent_id']
)->addField('count', [
'aggregate'=>'count',
'field'=>$this->expr('*')]
);
$this->hasOne('parent_id', new Folder())
->addTitle();
}
}

68. Unique Aliases
select
`id`,`name`,
(select count(*) from `folder` `S` where
`parent_id` = `folder`.`id`) `count`,
`folder`.`parent_id`,
(select `name` from `folder` `p` where
`id` = `folder`.`parent_id`) `parent`
from `folder`

69. ✓ ACL, Audit, Undo, Logging, ..
✓ File Management
✓ Import/Export utility
✓ RestAPI server
Commercial Extensions
git.io/ad