SlideShare ist ein Scribd-Unternehmen logo
1 von 13
1
Evolving the strategies of agents for the ANTS
Game
J. Carpio, P. García-Sánchez, A.M. Mora,
J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta
IWANN 2013, Tenerife, 12-14 July
2
Agenda
●
RTS Games
●
Google AI Challenge
●
ANTS game
●
Bot Behaviour
●
Parameters to optimize
●
Fitness used
●
Experimental Setup
●
Results
●
Conclusions
3
RTS Games
●
Real-Time Strategy Games
●
Several units distributed in a playing arena that
competes for resources
●
Examples: StarCraft, WarCraft, Age of Empires
4
Google AI Challenge
●
Create AIs for RTS games: TRON (2010), Planet
Wars (2011) , and ANTS (2012)
●
Each submission competes with the others in the
Google server
5
ANTS Game
●
Objective: conquer all the anthills of the enemy
●
Surround enemy's ants to kill them
●
Collect food to create more ants
●
Restrictions
–
Algorithms can not use previous fighting information.
–
Only a second per turn to move the ants colony.
6
Maps
7
Bot Behaviour
IF enemy hill in sight
attack the hill
ELSE IF food in sight
pick up the food
ELSE IF enemy ants in sight
attack the ants
ELSE IF non-explored zone in sight
explore the area randomly
8
Parameters to optimize with the GA
●
Food distance
●
Time remaining margin
●
Distances to hill/ant
●
Turns during left mode
9
Fitness used
●
Standard: using only the “score” (number of anthills
conquered)
●
Hierarchical: a tuple with [score, -enemy's score,
number of ants, -number of enemy's ants]
10
Experimental Setup
●
Six different maps have been used
●
Each fitness evaluation is made 10 times
●
64 individuals
●
0,3 crossover rate
●
Pool of 32 best parents
●
After the training we compare versus the winner of
the competition and positions 165 and 993.
11
Results
●
Prior to optimization of the parameters, our bot ended
in position 2076.
●
But after optimization, it wins the bot in position 993
●
Number 1 and 163 were very competitive, but using
the optimized parameters with the hierarchical fitness
increased the number of ants and decreased the
enemy's ant
12
Conclusions
●
A simple agent can be optimized to win better
opponents
●
Hierarchical fitness increases the chances to win
(adding more information)
●
The strategy depends of the enemies
●
Future work: map analysis, online adaptation,
analysis of the enemies...
13
Thanks!

Weitere ähnliche Inhalte

Andere mochten auch

Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesChesapeake Bay Foundation
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsIECP
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίουΥπουργείο Παιδείας
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013cepdegranada
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov schoolPepi Nikova
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησpankatrisiosi
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioVinay Mani
 

Andere mochten auch (13)

41 55
41 5541 55
41 55
 
Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal Communities
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
 
Taller d'aromes
Taller d'aromesTaller d'aromes
Taller d'aromes
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov school
 
Mabel
MabelMabel
Mabel
 
Radhika
RadhikaRadhika
Radhika
 
Periódico
PeriódicoPeriódico
Periódico
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησ
 
Vysoké Mýto
Vysoké MýtoVysoké Mýto
Vysoké Mýto
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development Portfolio
 

Kürzlich hochgeladen

Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 

Kürzlich hochgeladen (20)

Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

Ants iwann jcc

  • 1. 1 Evolving the strategies of agents for the ANTS Game J. Carpio, P. García-Sánchez, A.M. Mora, J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta IWANN 2013, Tenerife, 12-14 July
  • 2. 2 Agenda ● RTS Games ● Google AI Challenge ● ANTS game ● Bot Behaviour ● Parameters to optimize ● Fitness used ● Experimental Setup ● Results ● Conclusions
  • 3. 3 RTS Games ● Real-Time Strategy Games ● Several units distributed in a playing arena that competes for resources ● Examples: StarCraft, WarCraft, Age of Empires
  • 4. 4 Google AI Challenge ● Create AIs for RTS games: TRON (2010), Planet Wars (2011) , and ANTS (2012) ● Each submission competes with the others in the Google server
  • 5. 5 ANTS Game ● Objective: conquer all the anthills of the enemy ● Surround enemy's ants to kill them ● Collect food to create more ants ● Restrictions – Algorithms can not use previous fighting information. – Only a second per turn to move the ants colony.
  • 7. 7 Bot Behaviour IF enemy hill in sight attack the hill ELSE IF food in sight pick up the food ELSE IF enemy ants in sight attack the ants ELSE IF non-explored zone in sight explore the area randomly
  • 8. 8 Parameters to optimize with the GA ● Food distance ● Time remaining margin ● Distances to hill/ant ● Turns during left mode
  • 9. 9 Fitness used ● Standard: using only the “score” (number of anthills conquered) ● Hierarchical: a tuple with [score, -enemy's score, number of ants, -number of enemy's ants]
  • 10. 10 Experimental Setup ● Six different maps have been used ● Each fitness evaluation is made 10 times ● 64 individuals ● 0,3 crossover rate ● Pool of 32 best parents ● After the training we compare versus the winner of the competition and positions 165 and 993.
  • 11. 11 Results ● Prior to optimization of the parameters, our bot ended in position 2076. ● But after optimization, it wins the bot in position 993 ● Number 1 and 163 were very competitive, but using the optimized parameters with the hierarchical fitness increased the number of ants and decreased the enemy's ant
  • 12. 12 Conclusions ● A simple agent can be optimized to win better opponents ● Hierarchical fitness increases the chances to win (adding more information) ● The strategy depends of the enemies ● Future work: map analysis, online adaptation, analysis of the enemies...