SlideShare ist ein Scribd-Unternehmen logo
1 von 13
1
Evolving the strategies of agents for the ANTS
Game
J. Carpio, P. García-Sánchez, A.M. Mora,
J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta
IWANN 2013, Tenerife, 12-14 July
2
Agenda
●
RTS Games
●
Google AI Challenge
●
ANTS game
●
Bot Behaviour
●
Parameters to optimize
●
Fitness used
●
Experimental Setup
●
Results
●
Conclusions
3
RTS Games
●
Real-Time Strategy Games
●
Several units distributed in a playing arena that
competes for resources
●
Examples: StarCraft, WarCraft, Age of Empires
4
Google AI Challenge
●
Create AIs for RTS games: TRON (2010), Planet
Wars (2011) , and ANTS (2012)
●
Each submission competes with the others in the
Google server
5
ANTS Game
●
Objective: conquer all the anthills of the enemy
●
Surround enemy's ants to kill them
●
Collect food to create more ants
●
Restrictions
–
Algorithms can not use previous fighting information.
–
Only a second per turn to move the ants colony.
6
Maps
7
Bot Behaviour
IF enemy hill in sight
attack the hill
ELSE IF food in sight
pick up the food
ELSE IF enemy ants in sight
attack the ants
ELSE IF non-explored zone in sight
explore the area randomly
8
Parameters to optimize with the GA
●
Food distance
●
Time remaining margin
●
Distances to hill/ant
●
Turns during left mode
9
Fitness used
●
Standard: using only the “score” (number of anthills
conquered)
●
Hierarchical: a tuple with [score, -enemy's score,
number of ants, -number of enemy's ants]
10
Experimental Setup
●
Six different maps have been used
●
Each fitness evaluation is made 10 times
●
64 individuals
●
0,3 crossover rate
●
Pool of 32 best parents
●
After the training we compare versus the winner of
the competition and positions 165 and 993.
11
Results
●
Prior to optimization of the parameters, our bot ended
in position 2076.
●
But after optimization, it wins the bot in position 993
●
Number 1 and 163 were very competitive, but using
the optimized parameters with the hierarchical fitness
increased the number of ants and decreased the
enemy's ant
12
Conclusions
●
A simple agent can be optimized to win better
opponents
●
Hierarchical fitness increases the chances to win
(adding more information)
●
The strategy depends of the enemies
●
Future work: map analysis, online adaptation,
analysis of the enemies...
13
Thanks!

Weitere ähnliche Inhalte

Andere mochten auch

Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesChesapeake Bay Foundation
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsIECP
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίουΥπουργείο Παιδείας
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013cepdegranada
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov schoolPepi Nikova
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησpankatrisiosi
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioVinay Mani
 

Andere mochten auch (13)

41 55
41 5541 55
41 55
 
Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal Communities
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
 
Taller d'aromes
Taller d'aromesTaller d'aromes
Taller d'aromes
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov school
 
Mabel
MabelMabel
Mabel
 
Radhika
RadhikaRadhika
Radhika
 
Periódico
PeriódicoPeriódico
Periódico
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησ
 
Vysoké Mýto
Vysoké MýtoVysoké Mýto
Vysoké Mýto
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development Portfolio
 

Kürzlich hochgeladen

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbuapidays
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 

Kürzlich hochgeladen (20)

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

Ants iwann jcc

  • 1. 1 Evolving the strategies of agents for the ANTS Game J. Carpio, P. García-Sánchez, A.M. Mora, J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta IWANN 2013, Tenerife, 12-14 July
  • 2. 2 Agenda ● RTS Games ● Google AI Challenge ● ANTS game ● Bot Behaviour ● Parameters to optimize ● Fitness used ● Experimental Setup ● Results ● Conclusions
  • 3. 3 RTS Games ● Real-Time Strategy Games ● Several units distributed in a playing arena that competes for resources ● Examples: StarCraft, WarCraft, Age of Empires
  • 4. 4 Google AI Challenge ● Create AIs for RTS games: TRON (2010), Planet Wars (2011) , and ANTS (2012) ● Each submission competes with the others in the Google server
  • 5. 5 ANTS Game ● Objective: conquer all the anthills of the enemy ● Surround enemy's ants to kill them ● Collect food to create more ants ● Restrictions – Algorithms can not use previous fighting information. – Only a second per turn to move the ants colony.
  • 7. 7 Bot Behaviour IF enemy hill in sight attack the hill ELSE IF food in sight pick up the food ELSE IF enemy ants in sight attack the ants ELSE IF non-explored zone in sight explore the area randomly
  • 8. 8 Parameters to optimize with the GA ● Food distance ● Time remaining margin ● Distances to hill/ant ● Turns during left mode
  • 9. 9 Fitness used ● Standard: using only the “score” (number of anthills conquered) ● Hierarchical: a tuple with [score, -enemy's score, number of ants, -number of enemy's ants]
  • 10. 10 Experimental Setup ● Six different maps have been used ● Each fitness evaluation is made 10 times ● 64 individuals ● 0,3 crossover rate ● Pool of 32 best parents ● After the training we compare versus the winner of the competition and positions 165 and 993.
  • 11. 11 Results ● Prior to optimization of the parameters, our bot ended in position 2076. ● But after optimization, it wins the bot in position 993 ● Number 1 and 163 were very competitive, but using the optimized parameters with the hierarchical fitness increased the number of ants and decreased the enemy's ant
  • 12. 12 Conclusions ● A simple agent can be optimized to win better opponents ● Hierarchical fitness increases the chances to win (adding more information) ● The strategy depends of the enemies ● Future work: map analysis, online adaptation, analysis of the enemies...