SlideShare ist ein Scribd-Unternehmen logo
1 von 82
Downloaden Sie, um offline zu lesen
The Geometry of Evolutionary Algorithms:
Unification & Theory-Laden Design

Alberto Moraglio
University of Birmingham, UK
a.moraglio@cs.bham.ac.uk

IEEE CONGRESS ON EVOLUTIONARY COMPUTATION
20 June 2013, Cancun, Mexico

1
Instructor Biography
Education:
• PhD in Computer Science from Essex University, UK (2007)
Positions:
• Research Fellow, University of Birmingham, UK
• Research Fellow, University of Kent, UK
• Assistant Professor, University of Coimbra, Portugal
Research Interests:
• Foundational Principles of Evolutionary Computation
• Bridging Theory and Practice in Evolutionary Computation
Main contributions to the field:
• Geometric View of Evolutionary Algorithms

2
Three Questions

1. Are there common principles that explain how all
evolutionary algorithms (EAs) work?
2. Can these principles be formalised in a rigorous theory?
3. Can this theory lead to the systematic design of provably
good EAs for my favourite problem?
Geometric View of Evolutionary Algorithms
(>60 publications)
3
The Geometric Family – Photo Album

4
Contents
1. Geometric Interpretation of Search Operators
2. Unification of Evolutionary Algorithms
3. Principled Design of Crossover Operators
4. Principled Generalization of Search Algorithms
5. Unified Theory of Evolutionary Algorithms

5
PART 1: Geometric Interpretation
of Search Operators

6
Metric Space

d ( x, y ) ≥ 0
d ( x, y ) = 0 ⇔ x = y
d ( x, y ) = d ( y , x )
d ( x, z ) + d ( z , y ) ≥ d ( x, y )

7
Balls & Segments

B ( x; r ) = { y ∈ S | d ( x, y ) ≤ r}
[ x; y ] = {z ∈ S | d ( x, z ) + d ( z, y ) = d ( x, y )}

8
Squared Balls & Chunky Segments
Balls
100

000

101

001

111

110

3

3

010

011

3

3

B((3, 3); 1)
Euclidean space

B(000; 1)
Hamming space

B((3, 3); 1)
Manhattan space

Line segments
100

000

101

001

2
1

110

010

2
1

111

011

[000; 011] = [001; 010]
2 geodesics
Hamming space

1

3

[(1, 1); (3, 2)]
1 geodesic
Euclidean space

1

3

[(1, 1); (3, 2)] = [(1, 2); (3, 1)]
infinitely many geodesics
Manhattan space

9
Geometric Crossover & Mutation
Geometric operators are defined on the structure of the search
space by means of simple geometric shapes, like balls and
segments. These shapes are used to delimit the region of space
that includes all possible offspring with respect to the location of
their parents.
Geometric crossover: a recombination operator is a geometric
crossover under the metric d if all its offspring are in the d-metric
segment between its parents.
Geometric mutation: a mutation operator is a r-geometric
mutation under the metric d if all its offspring are in the d-ball of
radius r centred in the parent.

10
Example of Geometric Mutation
Traditional one-point mutation is 1-geometric under Hamming
distance.
101

100
000
001
110

010

111

011

Neighbourhood structure naturally associated with the shortest path
distance.
11
Example of Geometric Crossover
The traditional crossover is geometric under the Hamming
distance.

1
A

B

X

0 1 1 0 1
2

B

1 1 0 1 1

3
A

X

0 1 0 1 1

H(A,X) + H(X,B) = H(A,B)

12
Uniform Crossover & Uniform Mutation
Uniform geometric crossover:

fUX ( z | x, y ) = Pr{UX = z | P1 = x, P 2 = y} =

δ ( z ∈ [ x, y ])
| [ x, y ] |

Im[UX ( x, y)] = {z ∈ S | fUX ( z | x, y) > 0} = [ x, y]

Uniform geometric ε-mutation:

f UM ε ( z | x ) = Pr{ UM = z | P = x } =

δ ( z ∈ B ( x , ε ))
| B ( x,ε ) |

Im[UMε ( x)] = {z ∈ S | f Mε ( z | x) > 0} = B( x, ε )
Example: Traditional uniform crossover for binary strings is uniform
geometric crossover under Hamming distance.
13
Representation-Search Space Duality
Cartesian duality: via equating points in the plane and their
coordinate, geometric object have algebraic dual.

y = 2x - 3

14
Representation-Search Space Duality
REPRESENTATION

SEARCH SPACE

Vector of Coordinates (x,y)

Point in Cartesian Plane

Syntactic configuration
(e.g., binary string)

Point in search space
(e.g., point in Hamming space)

Search Operator (algebraic):
defined in terms of manipulation
of the representation

Search Operator (geometric):
defined in terms of spatial
relationship

Operational/Concrete

Declarative/Specification

Representation-specific

Representation-independent

Example: traditional uniform crossover can be defined:
(i) geometrically: pick offspring points uniformly at random in the
Hamming segment between parent points
(ii) algebraically: generate a random recombination mask that is
used to position-wise select the bits of the parent binary strings
to form the offspring binary string

15
Fitness landscapes & search operators
What is the fitness landscape seen by a search algorithm?
Fitness landscape =
Solution set + Fitness function + Search space structure
The search space structure is induced by the search operators
MUTATION (traditional view):
• the space structure is a graph
• nodes represent candidate solutions
• weighted edges indicate the probability of producing a certain
offspring given a certain parent

16
Crossover Landscape
What is the structure induced by crossover?
As crossover has two parents, each pair of nodes are linked by
edges to nodes representing possible offspring.
This structure is not a graph, it is an hyper-graph.
Problem with traditional view: the natural spatial interpretation of
graph is lost, these fitness landscapes have difficult interpretation.

17
Geometric Interpretation of Landscape
The structure of the landscape is given by the distance
associated with the geometric operators.
As mutation and crossover operator can be defined using the
same distance they see the same simple fitness landscape,
which is also the landscape seen by the search algorithm.
Mutation and crossover navigate the same search space in
different ways, as mutation produces offspring (i.e., accesses)
a ball around the parent, and crossover accesses the segment
between the parents.
Probabilities of accessing offspring are spatial distributions
(weights on nodes) on balls and segments.
18
PART 2: Geometric Unification
of Evolutionary Algorithms

19
Motivations: Fragmentation
Different flavors of (traditional) Evolutionary Algorithms:
• Very many variations on each flavors
• It is desirable to have a coherent picture (De Jong)
Evolutionary Algorithms are very similar:
• Algorithmically irrelevant differences
(e.g., application domain and phenotype interpretation)
• Algorithmic elements that can be freely exchanged
(e.g., selection scheme)
Real difference:
• Solution representation (e.g., binary strings, real vectors)
• Search operators (i.e., mutation and crossover)
Is there a deeper unity encompassing all Evolutionary
Algorithms beyond the specific representation?
20
Minkowski spaces – real vectors
Balls

2

2

2

2

2

2

B((2, 2); 1)
Euclidean
space

B((2, 2); 1)
Manhattan space

B((2, 2); 1)
Chessboard space

Segments

2

2

2

1

1

1

1

3

[(1, 1); (3, 2)]
1 geodesic
Euclidean space

1

3

1

3

[(1, 1); (3, 2)] = [(1, 2); (3, 1)]
[(1, 1); (3, 2)]
infinitely many geodesics
infinitely many geodesics
Manhattan space
Chessboard space

21
Pre-existing operators – real vectors
Mutations:
• bounded spherical mutation: geometric under Euclidean
distance
• creep mutation: geometric under Chessboard distance
Recombinations:
• blend crossover: geometric under Euclidean distance
• box crossover: geometric under Manhattan distance
• discrete crossover: geometric under Manhattan distance
• extended-line & extended-box crossovers:
non-geometric

22
Hamming spaces – n-ary strings
100

101
00

01

02

10

11

12

20

000

21

22

001

110

111

011

010

B(00;1)
Hamming space H(2,3)

B(000; 1)
Hamming space
H(3,2)
100

101
00

11

12

20

21

22

001
111

11
0

010

02

10

000

01

011

[000; 011] = [001; 010]
2 geodesics
Hamming space
H(3,2)

[00;11]=[01;10]
2 geodesics
Hamming space H(2,3)

23
Pre-existing operators – n-ary strings
Mutations:
• point-mutations for binary and n-ary strings:
1-geometric mutation under Hamming distance
• position-wise mutations:
n-geometric mutation under Hamming distance
(with probability distribution only function of the distance)
Recombinations:
• all mask-based crossovers (including 1-point, 2-point,
uniform) for binary and n-ary strings:
geometric crossover under Hamming distance
• intermediate recombination for integer vectors:
geometric crossover under Manhattan distance on integer
vectors
24
Cayley spaces - permutations
abc

abc
abc

bac

bac
bac

cba

cab

acb

cab

bca

acb

bca

acb

cab

bca
cba

cba

B(abc; 1)
Adjacent swap
space

B(abc; 1)
Swap space

abc

abc
bac

abc
acb
cab

bca

B(abc; 1)
Insertion space

bac

bca

cba

cab

acb
cab
cba

cba
[abc; bca]
1 geodesic
Adjacent swap
space

acb

bca

bac

[abc; bca]
3 geodesics
Swap space

[abc; bca]
1 geodesic
Insertion space

25
Pre-existing operators – permutations
Mutations:
• single edit-move mutations: 1-geometric mutation under
corresponding edit distance
Recombinations:
• PMX: geometric crossover under swap distance
• Cycle crossover: geometric crossover under swap distance &
Hamming distance (restricted to permutations)
• Cut-and-fill crossovers (adaptations of 1-point crossover):
geometric crossovers under swap and adjacent swap distances
• Merge crossover: geometric crossover under insertion
distance
• Davis’s order crossover: non-geometric crossover
26
Syntactic tree spaces –
Homologous Crossover
Parent 1

Parent 2

+

*

sin

*

+

x

x

x

y

*

y

x

y

Alignment
Crossover Point
Swap

y

Offspring 2

Offspring 1

*

+
sin

x

*

+

*

*

x

y

*

y

y

y

x

x

27
Pre-existing operators – syntactic trees
Mutations:
• point and sub-tree mutations: geometric mutation under
structural Hamming distance on trees (mutations towards the
root have larger radius)
Recombinations:
• Koza’s sub-tree swap crossover: non-geometric
• Homologous crossover: geometric under structural
Hamming distance

28
Variable length sequence spaces –
Homologous Recombination
Parent1=AGCACACA
Parent2=ACACACTA

best inexact alignment (with gaps):
AGCA|CAC-A
A-CA|CACTA

Child1=AGCACACTA
Child2=ACACACA

29
Pre-existing operators – sequences:
Biological Recombination
Mutation:
• insertion, deletion or substitution of a single amino acid:
1-geometric mutation under Levenshtein distance
Recombination:
• Homologous recombination for variable length
sequences (1-point, 2-points, n-points, uniform):
geometric crossover under Levenshtein distance
• More realistic models of homologous biological
recombination with respects to gap size and base-pairs
matching preference:
geometric crossovers under weighted and block-based
Levenshtein distance
30
Significance of Unification
Most of the existing crossover operators for major representations
fit the geometric definition
Established existing operators have emerged from experimental
work done by generations of practitioners over decades
Geometric crossover compresses in a simple formula an
empirical phenomenon

31
PART 3: Principled Design of
Crossover Operators

32
Motivations: ad-hoc crossover design
For every new problem and new solution representation search
operators are designed ad-hoc
No systematic way of designing new search operators
• Only informal rule-of-thumbs (heuristic)
• Not applicable to all representations/problems (limited scope)
• Mostly for mutation and less for crossover (simple operators)
• Application of guidelines to specific representation is a black
art (vague)

Can we formally derive good representationspecific crossovers for any target representation?
33
Crossover Principled Design
Domain specific solution representation is effective
Problem: for non-standard representations it is not clear how
crossover should look like
But: given a problem you may know already a good
neighbourhood structure/distance/mutation
Geometric Interpretation of Crossover:
• your representation and space structure
• specific geometric crossover by plugging the space
structure in the definition
• operational definition of crossover manipulating the
underlying representation

34
Crossover Design: Graph Example

+

=?

35
Non-labelled graph neighbourhood
2

3

2

0

1

1

MOVE: Insert/remove an edge
Edit distance: minimum
number of moves to transform
a graph to the other
36
Offspring
+

37
Operational Geometric Crossover
Edit distance has a natural dual interpretation:
• measure of distance in the search space
• measure of similarity on the underlying representation
• this can be used to help identifying an operational definition
of crossover (implementation) which corresponds to its
geometric definition in terms of distance (specification)
For graphs under ins/del edge edit distance the operational
crossover is as follows:
• Pair up the nodes of the parent graphs such that there are
the minimum number of edges mismatches
• Recombine the aligned parent graphs using a recombination
mask on the edges
• This recombination implements the geometric crossover
38
Crossover Design: TSP Example
Edit distance duality for permutations:
• producing offspring in the segment between parents on a
space generated by moves of type x (e.g., swaps)
• producing offspring permutations on minimal sorting
trajectories to sort a parent permutation into the other using
move of type x
Sorting Crossovers:
• Geometric crossover for permutations can be implemented
using traditional sorting algorithms and returning as offspring
a partially sorted permutation
• Adj. Swap -> bubble sort
• Swap -> selection sort,
• Insertion ->insertion sort
39
Crossover Design: TSP example
A known good neighbourhood structure for TSP is 2opt
structure = space of circular permutations endowed with reversal
edit distance
Geometric crossover for TSP =
picking offspring on the minimal sorting trajectories by sorting
one parent circular permutation toward the other parent by
reversals (sorting circular permutations by reversals)

40
41
Operational Geometric Crossover
for TSP
BAD NEWS: sorting circular permutations by reversals is NPHard!
GOOD NEWS: there are approximation algorithms that sort
within a bounded error to optimality
A 2-approximation algorithm sorts by reversals using sorting
trajectories that are at most twice the length of the minimal
sorting trajectories
Approximation algorithms can be used to build approximated
geometric crossovers for TSP
In experiments, this crossover beats Edge Recombination which
is the best for TSP
42
Product Geometric Crossover
It is a simple and general method to build more complex
geometric crossovers from simple geometric crossovers
GX1:AxA A geometric under d1
GX2:BxB B geometric under d2
A product crossover of GX1 and GX2 is an operator defined on
the cartesian product of their domains PGX:(A,B)x(A,B) (A,B)
that applies GX1on the first projection and GX2 on the second
projection. GX1 and GX2 do not need to be independent and
can be based on different representations.
Theorem: PGX is a geometric crossover under the distance d =
d1+d2

43
Crossover Design: Sudoku Example
Fill in the grid so that every row,
every column, and every 3x3 box
contains the digits 1 through 9

4 types of constraints:
1)
Fixed Elements
2)
Rows are permutations
3)
Columns are permutations
4)
Boxes are permutations

44
Crossover Design: Sudoku Example
We start from an initial population of solutions (filled grids)
correct with respect to constraints 1) and 2)
We want a geometric crossover defined on the entire Sudoku
grid that preserves constraints 1) and 2) so that we search a
smaller search space
Constraints 3) and 4) are treated as soft constrains and the
fitness of a solution is the number of unsatisfied constraints (to
minimze)
The Hamming distance between grids gives rise to a smooth
landscape because close grids have similar fitness
45
Crossover Design: Sudoku Example
The cycle crossover on a row preserves constraints 1) and 2)
and it is geometric under Hamming distance
For the product geometric crossover theorem, the row-wise
cycle crossover is geometric under Hamming distance on the
entire grid
The fitness landscape seen by this crossover is “smooth”
This crossover performed very well in experiments compared
with other recombinations

46
PART 4: Principled Generalization of
Search Algorithms

47
Motivations
Problem: ad hoc extensions of continuous search algorithms to
combinatorial spaces. Is there a formal & systematic way of
generalizing search algorithms for specific search spaces
to formal meta-heuristics?
Solution: Principled generalization: formal generalization of
continuous search algorithm via geometric interpretation of
operators
Applied to
• Particle Swarm, Differential Evolution, Nelder&Mead
• Binary strings, Permutations, GP trees

48
Generalization Methodology
1.

Take a continuous optimization algorithm

2.

Rewrite search operators using geometric objects as
functions of only the Euclidean distance

3.

Substitute Euclidean distance with a generic metric
geometric algorithm

4.

Plug a new distance in the formal algorithm
algorithm for a new space

5.

Rewrite the search operators getting rid of the distance and
using the associated representation

formal

instance of the

49
Differential Evolution Example

DM
DX

50
Differential Mutation
Construction of U using vectors

51
Convex Combination & Extension Ray
Convex Combination

Extension Ray

B=?

A
C

C=?
B
A
C=CX(A,B)

B=ER(A,C)

• Extension ray is the inverse operation of convex combination

• They are well-defined in any metric space
52
Differential Mutation
Construction of U using convex combination and extension ray

53
Formal Geometric Differential Evolution

DM
DX

54
Specialization (Hamming space)
The GDE is a formal algorithm that is specialized to the
Hamming space once all its operators (DM and DX) are
specialized to the Hamming space
DM and DX can be rewritten solely in terms of convex
combination and extension ray combination
So, to obtain the specialization of the GDE to the Hamming
space, we only need the specializations of convex combination
and extension ray

55
Convex Combination & Extension Ray
(Hamming space)
Convex combination: it is a form of biased uniform crossover
which prefers bits form one or the other parents according to
their weights
Extension ray recombination: the offspring C of binary
extension ray originating in parent A and passing through parent
B can be obtained by starting from B and with a suitable
probability flipping those bits that, at the same time, increase
the Hamming distance form B and from A
These operators are provably conforming to the geometric
formal definitions of convex combination and extension ray
under Hamming distance
56
Results
When ported from continuous to Hamming space all the
algorithms (DE, PSO, NM) worked very well out-of-the-box.
This shows that continuous algorithm can be ported using this
methodology to discrete spaces.
When specified to permutations and GP trees spaces a number
of surprising behaviours appeared.
As we applied the very same algorithms to different spaces, the
cause of their specific behaviours are specific geometric
properties of the underlying search space they are applied to.
Taxonomy of spaces based on effect on search behaviour.
Relevant properties: symmetry, curvature, deformation.
57
PART 5: Unified Theory
of Evolutionary Algorithms

58
Motivations
Is a general, representation-independent, rigorous theory of
Evolutionary Algorithms possible?
The NFL theorem implies that evolutionary algorithms can
perform better than random search only on a restricted, wellmatched class of problems
What are the “topographic features” of fitness landscapes and
“behavioural features” of all evolutionary algorithms that alone
explain/lead to good performance?

59
Formal Evolutionary Algorithm
Geometric Crossover can be understood as a functional form
taking the distance d as argument.
Functional Interpretation: An evolutionary algorithm with
geometric crossover can be understood as a function of the
metric d (d is a parameter as e.g., the mutation rate).
Axiomatic Interpretation: An evolutionary algorithm with
geometric crossover with any metric is a representationindependent formal specification of a search algorithms whose
properties derive form the metric axioms.
What happens if we “run” a formal evolutionary algorithm?
60
Abstract Convex Evolutionary Search

co ( pop n +1 ) ⊆ co ( pop n ) ⊆ K ⊆ co ( pop1 ) ⊆ co ( pop 0 )
It holds across representations for any EA with crossover &
selection (shown using a generic distance, i.e., metric axioms)

61
Abstract Concave Fitness Landscapes
What topographic feature of the landscape is a good match for
the convex behavioural feature of the search (when maximising)?

Concave landscapes can be defined in a representation-independent
way (i.e., on a generic metric space)

62
Abstract vs. Specific Analysis

Abstract performance: performance as a function of the underlying
metric space and solution representation.
Abstract Convex Search Algorithm
Initialise Population Uniformly at Random
Until Population has converged to the same individual
• Rank individuals on fitness
• Remove all individuals with the worst fitness
(when there are at least two fitness values in the population)
• Apply the Convex Hull Uniform Recombination to the remaining
individuals to create the next population

Return individual in the last population
Abstract Concave Landscape
Concave landscape: all level sets are convex sets
A concave landscape on a combinatorial space
is a “Tower of Hanoi” of convex sets
Polynomial Concave Landscape:
• Not too many levels: the number of possible fitness values
(level sets) is polynomial in the problem size
• Not too sudden shrinking: the rate between areas of
successive level sets is polynomial
Computational Complexity Analysis
The algorithm does not converge to the optimum all the time
With a large enough population the algorithm converges to the
optimum most of the times
The probability of convergence and the convergence time are
expressions that hold for all metric spaces, and are functions of
a single “convexity number” of the specific metric space
When specified to Hamming space, a small population size (i.e.,
log n) suffices to get to the optimum with high probability in
linear number of generation (i.e., n).

66
Work in Progress
Specification of results for other spaces (i.e., continuous,
permutations)
Analysis of standard EAs: How can mutation be naturally
included in this framework?
Analysis of rugged concave landscapes
Analysis of combinatorial problems: big valley hypothesis is an
informal notion of convexity of fitness landscapes that holds for
interesting problems (e.g., TSP)
How far can a theory be pushed forward at this level of
abstraction?
67
Conclusions

68
Summary
Motivations:
• fragmentation, no formal design, no general theory.
Geometric Operators:
• Search operators can be defined formally across
representations using simple geometric shapes.
Unification:
• Many crossover operators across representations are
geometric crossover under some distance.

69
Summary
Crossover Principled Design:
• Plugging in an edit distance associated with a new
representation it is possible to derive operational definition of
the specific geometric crossover.
Principled Generalization of Search Algorithms:
• Generalization by replacing the Euclidean distance in
continuous search algorithm with a generic metric.
Unified Theory of Evolutionary Algorithms:
• All evolutionary algorithms with geometric crossover do a
form of convex search. They work well on concave-like
landscapes.

70
A Dream: Bridging Theory & Practice Gap
PRACTITIONER: “I want to use
EAs to solve my problem”

BLACK ART: Ad-hoc design
based on a random intuition
had before breakfast

THEORETICIAN: “I want to
do rigorous analysis of EAs”

TOY PROBLEMS: Yet
another rigorous analysis of
ONEMAX

IDEAL GEOMETRIC FRAMEWORK: Rigorous theoretical framework
for provably good systematic EAs design for your problem

Automated design & implementation of
provably good custom EA for your problem
71
Take home message
There are fundamental geometric principles behind all
evolutionary algorithms across representations.
The geometric view is a unifying way of thinking about
evolutionary algorithms which is general, rigorous and intuitive at
the same time, with the potential to bridge theory and practice.
I hope from now on you will think geometrically about whatever
aspect of evolution interests you!
Collaborations are welcome!

Thank you!
72
References
A. Moraglio, “Geometric Theory of Representations for
Evolutionary Algorithms”, Springer (forthcoming)
A. Moraglio, D. Sudholt "Runtime Analysis of Convex
Evolutionary Search", Evolutionary Computation Journal, MIT
Press, 2013 (accepted for publication)
A. Moraglio, J. Togelius, S. Silva "Geometric Differential
Evolution for Combinatorial and Programs Spaces", Evolutionary
Computation Journal, 2012
H-Y. Kim, Y. Yoon, A. Moraglio, B-R. Moon “Geometric
Crossover for Real-coded Genetic Algorithms”, Information
Sciences Journal, 2010
Y. Yoon, Y.-H. Kim, A. Moraglio, B.-R. Moon, "Geometric
Interpretation of Genotype-Phenotype Mapping and Induced
Crossovers", Theoretical Computer Science Journal, 2010
A. Moraglio, R. Poli “Topological Crossover for the Permutation
Representation", Italian Journal Intelligenza Artificiale, 2010

73
References
A. Moraglio, C. Di Chio, J. Togelius, R. Poli “Geometric particle
swarm optimisation”, Journal of Artificial Evolution and
Applications, online article ID 143624, 14 pages, Volume 2008,
2008
A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon “Geometric
Crossovers for Multiway Graph Partitioning”, Evolutionary
Computation Journal, volume 15, issue 4, pages 445-474, 2007
Moraglio, A. Mambrini "Runtime Analysis of Mutation-Based
Geometric Semantic Genetic Programming for Basis Functions
Regression", Genetic and Evolutionary Computation
Conference, 2013
A. Moraglio, A. Mambrini, L. Manzoni “Runtime Analysis of
Mutation-Based Geometric Semantic Geometric Programming
on Boolean Functions”, Foundations of Genetic Algorithms,
2013
74
References
A. Moraglio, D. Sudholt "Runtime Analysis of Convex
Evolutionary Search", Genetic and Evolutionary Computation
Conference, pages 649-656, 2012
A. Moraglio, K. Krawiec, C. Johnson “Geometric Semantic
Genetic Programming”, Proceedings of Parallel Problem Solving
from Nature, pages 21-31, 2012
A. Moraglio, D. Sudholt “Runtime Analysis of Convex
Evolutionary Search”, 6th Workshop on Theory of Randomized
Search Heuristics, 2012
A. Moraglio, K. Krawiec, C. Johnson “Geometric Semantic
Genetic Programming”, 5th Workshop on Theory of Randomized
Search Heuristics, 2011
A. Moraglio, S. Silva “Geometric Nelder-Mead Algorithm on the
Space of Genetic Programs”, Genetic and Evolutionary
Computation Conference, pages 1307-1314, 2011
75
References
A. Moraglio, H-Y. Kim, Y. Yoon “Geometric Surrogate-Based
Optimisation for Permutation-Based Problems”, GECCO 2011
A. Moraglio, A. Kattan “Geometric Generalisation of Surrogate
Model Based Optimisation to Combinatorial Spaces”, European
Conference on Combinatorial Optimisation, 2011
A. Moraglio "Abstact Evolutionary Convex Search", Workshop on
the Foundations of Genetic Algorithms, 2011
A. Alentorn, A. Moraglio, C. G. Johnson “Binary Nelder-Mead
Algorithm for Market Neutral Portfolio Optimization”, IEEE UK
Conference on Computational Intelligence, 2010
A. Moraglio "One-Point Geometric Crossover", Proceedings of
Parallel Problem Solving from Nature 2010

76
References
A. Moraglio, J. Togelius "Geometric Nelder-Mead Algorithm for
the Permutation Representation", Proceedings of IEEE World
Conference on Computational Intelligence 2010
A. Moraglio, S. Silva "Geometric Differential Evolution on the
Space of Genetic Programs", Proceedings of European
Conference on Genetic Programming, pages 171-183, 2010
A. Moraglio, C. Johnson "Geometric Generalization of NelderMead Algorithm", Proceedings of European Conference on
Evolutionary Computation in Combinatorial Optimisation, pages
190-201, 2010
A. Moraglio, J. Togelius “Geometric Differential Evolution”,
Genetic and Evolutionary Computation Conference, pages
1705-1712, 2009
A. Moraglio, J. Togelius “Inertial Geometric Particle Swarm
Optimization”, IEEE Congress on Evolutionary Computation,
pages 1973-1980, 2009
77
References
A. Moraglio, Y. Borenstein “A Gaussian Random Field Model of
Smooth Fitness Landscapes”, Workshop on Foundations of
Genetic Algorithms, pages 171-182, 2009
J. Togelius, R. De Nardi, A. Moraglio “Geometric PSO + GP =
Particle Swarm Programming”, IEEE Congress on Evolutionary
Computation, pages 3594-3600, 2008
C. Di Chio, A. Moraglio, R. Poli “Geometric Particle Swarm
Optimization on Binary and Real Spaces: from Theory to
Practice”, Particle Swarms: the Second Decade – Genetic and
Evolutionary Computation Conference workshop, 2007
A. Moraglio, J. Togelius “Geometric PSO for the Sudoku Puzzle”,
Genetic and Evolutionary Computation Conference, pages 118 125, 2007
Y. Yoon, H-Y. Kim, A. Moraglio, B-R. Moon “Geometric
Crossover for Real-Vector Representation”, Genetic and
Evolutionary Computation Conference, page 1539, 2007
78
References
A. Moraglio, C. Di Chio, R. Poli “Geometric particle swarm
optimisation”, European Conference on Genetic Programming,
pages 125-136, 2007
A. Moraglio, R. Poli “Inbreeding Properties of Geometric
Crossover and Non-geometric Recombinations”, Foundations of
Genetic Algorithms, pages 1-14, 2007
A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon, R. Poli “Cycle
Crossover for Permutations with Repetitions: Application to
Graph Partitioning”, Evolutionary Algorithms: Bridging Theory
and Practice - Parallel Problem Solving from Nature workshop,
2006
A. Moraglio, R. Poli “Geometric Crossover for Sets, Multisets and
Partitions”, Parallel Problem Solving from Nature, pages 10381047, 2006
A. Moraglio, R. Poli “Product Geometric Crossover”, Parallel
Problem Solving from Nature, pages 1018-1027, 2006
79
References
A. Moraglio, R. Poli “Inbreeding Properties of Geometric
Crossover and Non-geometric Recombinations”, Evolutionary
Computation Workshop - European Conference on Artificial
Intelligence, 2006
R. Seehuus, A. Moraglio "Geometric Crossover for Protein Motif
Discovery", Workshop on Adaptive Representations - Genetic
and Evolutionary Computation Conference, 2006
A. Moraglio, R. Poli, R. Seehuus “Geometric Crossover for
Biological Sequences", Workshop on Adaptive Representations
- Genetic and Evolutionary Computation Conference, 2006
A. Moraglio, J. Togelius, S. Lucas "Product Geometric
Crossover for the Sudoku Puzzle", IEEE Congress on
Evolutionary Computation, pages 470-476, 2006
A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon, R. Poli "Generalized
Cycle Crossover for Graph Partitioning", Genetic and
Evolutionary Computation Conference, pages 1421-1422, 2006
80
References
H-Y. Kim, Y. Yoon, A. Moraglio, B-R. Moon "Geometric
Crossover for Multiway Graph Partitioning", Genetic and
Evolutionary Computation Conference, pages 1217-1224, 2006
A. Moraglio “Geometric Unification of Evolutionary Algorithms",
European Graduate Student Workshop on Evolutionary
Computation – European Conference on Genetic Programming,
2006
A. Moraglio, R. Poli, R. Seehuus “Geometric Crossover for
Biological Sequences”, European Conference on Genetic
Programming, pages 121-132, 2006
A. Moraglio, R. Poli “Topological Crossover for the Permutation
Representation”, Italian Workshop on Evolutionary Computation Italian Association of Artificial Intelligence Conference, 2005
A. Moraglio, R. Poli “Geometric Landscape of Homologous
Crossover for Syntactic Trees”, IEEE Congress on Evolutionary
Computation, pages 427- 434, 2005
81
References
A. Moraglio, R. Poli “Topological Crossover for the Permutation
Representation", Workshop on Theory of Representations Genetic and Evolutionary Computation Conference, 2005
A. Moraglio “Geometric Unification of Evolutionary Algorithms”,
British Colloquium for Theoretical Computer Science, page 251,
2005
A. Moraglio, R. Poli “Topological Interpretation of Crossover",
Genetic and Evolutionary Computation Conference, pages
1377-1388, 2004
A. Moraglio “Towards a Geometric Unification of Evolutionary
Algorithms”, PhD thesis, University of Essex, 2007

82

Weitere ähnliche Inhalte

Was ist angesagt?

A ciência secreta vol i
A ciência secreta vol iA ciência secreta vol i
A ciência secreta vol i
MongeTeodoro
 

Was ist angesagt? (18)

Marea Evanghelie a Lui Ioan - Vol 2 - Dicteu Divin Prin Jakob Lorber
Marea Evanghelie a Lui Ioan - Vol 2 - Dicteu Divin Prin Jakob LorberMarea Evanghelie a Lui Ioan - Vol 2 - Dicteu Divin Prin Jakob Lorber
Marea Evanghelie a Lui Ioan - Vol 2 - Dicteu Divin Prin Jakob Lorber
 
Roteiro 3 triplice aspecto da doutrina espírita
Roteiro 3   triplice aspecto da doutrina espíritaRoteiro 3   triplice aspecto da doutrina espírita
Roteiro 3 triplice aspecto da doutrina espírita
 
A ciência secreta vol i
A ciência secreta vol iA ciência secreta vol i
A ciência secreta vol i
 
O que é ser família
O que é ser famíliaO que é ser família
O que é ser família
 
Estudo do livro Roteiro liçãoo 37
Estudo do livro Roteiro liçãoo 37Estudo do livro Roteiro liçãoo 37
Estudo do livro Roteiro liçãoo 37
 
O umbral existe?
O umbral existe?O umbral existe?
O umbral existe?
 
Evangelho cap8 item11
Evangelho cap8 item11Evangelho cap8 item11
Evangelho cap8 item11
 
A quaresma e o espiritismo
A quaresma e o espiritismoA quaresma e o espiritismo
A quaresma e o espiritismo
 
Aula intervencao dos espiritos no mundo fisico
Aula   intervencao dos espiritos no mundo fisicoAula   intervencao dos espiritos no mundo fisico
Aula intervencao dos espiritos no mundo fisico
 
A importância da evangelização espírita!
A importância da evangelização espírita!A importância da evangelização espírita!
A importância da evangelização espírita!
 
(Livro Boa nova) Cap.13 pecado e punição
(Livro Boa nova) Cap.13   pecado e punição(Livro Boa nova) Cap.13   pecado e punição
(Livro Boa nova) Cap.13 pecado e punição
 
Nosso Lar - Capitulo36
Nosso Lar - Capitulo36Nosso Lar - Capitulo36
Nosso Lar - Capitulo36
 
38 nosso lar o caso tobias
38 nosso lar  o caso tobias38 nosso lar  o caso tobias
38 nosso lar o caso tobias
 
Estudando com Andre Luiz - Os Mensageiros capitulo 06 Advertencias profundas
Estudando com Andre Luiz - Os Mensageiros  capitulo 06 Advertencias profundasEstudando com Andre Luiz - Os Mensageiros  capitulo 06 Advertencias profundas
Estudando com Andre Luiz - Os Mensageiros capitulo 06 Advertencias profundas
 
Ovelha Perdida
Ovelha PerdidaOvelha Perdida
Ovelha Perdida
 
Epistola lui Pavel către comunitatea din Laodiceea
Epistola lui Pavel către comunitatea din LaodiceeaEpistola lui Pavel către comunitatea din Laodiceea
Epistola lui Pavel către comunitatea din Laodiceea
 
Curso visitação fraterna
Curso visitação fraternaCurso visitação fraterna
Curso visitação fraterna
 
CVPR 2022 Tutorial에 대한 쉽고 상세한 Diffusion Probabilistic Model
CVPR 2022 Tutorial에 대한 쉽고 상세한 Diffusion Probabilistic ModelCVPR 2022 Tutorial에 대한 쉽고 상세한 Diffusion Probabilistic Model
CVPR 2022 Tutorial에 대한 쉽고 상세한 Diffusion Probabilistic Model
 

Ähnlich wie IEEE CEC 2013 Tutorial on Geometry of Evolutionary Algorithms

The Geometric Characteristics of the Linear Features in Close Range Photogram...
The Geometric Characteristics of the Linear Features in Close Range Photogram...The Geometric Characteristics of the Linear Features in Close Range Photogram...
The Geometric Characteristics of the Linear Features in Close Range Photogram...
IJERD Editor
 
Calculus and Numerical Method =_=
Calculus and Numerical Method =_=Calculus and Numerical Method =_=
Calculus and Numerical Method =_=
Fazirah Zyra
 
Zaharescu__Eugen Color Image Indexing Using Mathematical Morphology
Zaharescu__Eugen Color Image Indexing Using Mathematical MorphologyZaharescu__Eugen Color Image Indexing Using Mathematical Morphology
Zaharescu__Eugen Color Image Indexing Using Mathematical Morphology
Eugen Zaharescu
 

Ähnlich wie IEEE CEC 2013 Tutorial on Geometry of Evolutionary Algorithms (20)

The Earth is not flat; but it's not round either (Geography on Boost.Geometry)
The Earth is not flat; but it's not round either (Geography on Boost.Geometry)The Earth is not flat; but it's not round either (Geography on Boost.Geometry)
The Earth is not flat; but it's not round either (Geography on Boost.Geometry)
 
Mesh final pzn_geo1004_2015_f3_2017
Mesh final pzn_geo1004_2015_f3_2017Mesh final pzn_geo1004_2015_f3_2017
Mesh final pzn_geo1004_2015_f3_2017
 
My Report Profile in Math Major 10,11,12
My Report Profile in Math Major 10,11,12My Report Profile in Math Major 10,11,12
My Report Profile in Math Major 10,11,12
 
Lecture co1 math 21-1
Lecture co1 math 21-1Lecture co1 math 21-1
Lecture co1 math 21-1
 
Stolyarevska_IES
Stolyarevska_IESStolyarevska_IES
Stolyarevska_IES
 
The Geometric Characteristics of the Linear Features in Close Range Photogram...
The Geometric Characteristics of the Linear Features in Close Range Photogram...The Geometric Characteristics of the Linear Features in Close Range Photogram...
The Geometric Characteristics of the Linear Features in Close Range Photogram...
 
ideas of mathematics -17tilings (final)
ideas of mathematics -17tilings (final)ideas of mathematics -17tilings (final)
ideas of mathematics -17tilings (final)
 
Taller PII Cabrera_Carlosama_Chavez
Taller PII Cabrera_Carlosama_ChavezTaller PII Cabrera_Carlosama_Chavez
Taller PII Cabrera_Carlosama_Chavez
 
Paso 5-Realizar transferencia del conocimiento.
Paso 5-Realizar transferencia del conocimiento.Paso 5-Realizar transferencia del conocimiento.
Paso 5-Realizar transferencia del conocimiento.
 
Q2_LESSON 1 INTRODUCTION QUADRATIC FUNCTIONS.pptx
Q2_LESSON 1 INTRODUCTION QUADRATIC FUNCTIONS.pptxQ2_LESSON 1 INTRODUCTION QUADRATIC FUNCTIONS.pptx
Q2_LESSON 1 INTRODUCTION QUADRATIC FUNCTIONS.pptx
 
Calculus and Numerical Method =_=
Calculus and Numerical Method =_=Calculus and Numerical Method =_=
Calculus and Numerical Method =_=
 
Zaharescu__Eugen Color Image Indexing Using Mathematical Morphology
Zaharescu__Eugen Color Image Indexing Using Mathematical MorphologyZaharescu__Eugen Color Image Indexing Using Mathematical Morphology
Zaharescu__Eugen Color Image Indexing Using Mathematical Morphology
 
101 Rough Draft
101 Rough Draft101 Rough Draft
101 Rough Draft
 
TIU CET Review Math Session 6 - part 2 of 2
TIU CET Review Math Session 6 - part 2 of 2TIU CET Review Math Session 6 - part 2 of 2
TIU CET Review Math Session 6 - part 2 of 2
 
Maths 12 supporting material by cbse
Maths 12 supporting material by cbseMaths 12 supporting material by cbse
Maths 12 supporting material by cbse
 
geostatistics_for introduction and analysis
geostatistics_for introduction and analysisgeostatistics_for introduction and analysis
geostatistics_for introduction and analysis
 
A Path finding Technique for Open Terrain
A Path finding Technique for Open TerrainA Path finding Technique for Open Terrain
A Path finding Technique for Open Terrain
 
LinearFunctions (1).ppt
LinearFunctions (1).pptLinearFunctions (1).ppt
LinearFunctions (1).ppt
 
R lecture co2_math 21-1
R lecture co2_math 21-1R lecture co2_math 21-1
R lecture co2_math 21-1
 
Integration
IntegrationIntegration
Integration
 

Kürzlich hochgeladen

Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 

Kürzlich hochgeladen (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural ResourcesEnergy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 

IEEE CEC 2013 Tutorial on Geometry of Evolutionary Algorithms

  • 1. The Geometry of Evolutionary Algorithms: Unification & Theory-Laden Design Alberto Moraglio University of Birmingham, UK a.moraglio@cs.bham.ac.uk IEEE CONGRESS ON EVOLUTIONARY COMPUTATION 20 June 2013, Cancun, Mexico 1
  • 2. Instructor Biography Education: • PhD in Computer Science from Essex University, UK (2007) Positions: • Research Fellow, University of Birmingham, UK • Research Fellow, University of Kent, UK • Assistant Professor, University of Coimbra, Portugal Research Interests: • Foundational Principles of Evolutionary Computation • Bridging Theory and Practice in Evolutionary Computation Main contributions to the field: • Geometric View of Evolutionary Algorithms 2
  • 3. Three Questions 1. Are there common principles that explain how all evolutionary algorithms (EAs) work? 2. Can these principles be formalised in a rigorous theory? 3. Can this theory lead to the systematic design of provably good EAs for my favourite problem? Geometric View of Evolutionary Algorithms (>60 publications) 3
  • 4. The Geometric Family – Photo Album 4
  • 5. Contents 1. Geometric Interpretation of Search Operators 2. Unification of Evolutionary Algorithms 3. Principled Design of Crossover Operators 4. Principled Generalization of Search Algorithms 5. Unified Theory of Evolutionary Algorithms 5
  • 6. PART 1: Geometric Interpretation of Search Operators 6
  • 7. Metric Space d ( x, y ) ≥ 0 d ( x, y ) = 0 ⇔ x = y d ( x, y ) = d ( y , x ) d ( x, z ) + d ( z , y ) ≥ d ( x, y ) 7
  • 8. Balls & Segments B ( x; r ) = { y ∈ S | d ( x, y ) ≤ r} [ x; y ] = {z ∈ S | d ( x, z ) + d ( z, y ) = d ( x, y )} 8
  • 9. Squared Balls & Chunky Segments Balls 100 000 101 001 111 110 3 3 010 011 3 3 B((3, 3); 1) Euclidean space B(000; 1) Hamming space B((3, 3); 1) Manhattan space Line segments 100 000 101 001 2 1 110 010 2 1 111 011 [000; 011] = [001; 010] 2 geodesics Hamming space 1 3 [(1, 1); (3, 2)] 1 geodesic Euclidean space 1 3 [(1, 1); (3, 2)] = [(1, 2); (3, 1)] infinitely many geodesics Manhattan space 9
  • 10. Geometric Crossover & Mutation Geometric operators are defined on the structure of the search space by means of simple geometric shapes, like balls and segments. These shapes are used to delimit the region of space that includes all possible offspring with respect to the location of their parents. Geometric crossover: a recombination operator is a geometric crossover under the metric d if all its offspring are in the d-metric segment between its parents. Geometric mutation: a mutation operator is a r-geometric mutation under the metric d if all its offspring are in the d-ball of radius r centred in the parent. 10
  • 11. Example of Geometric Mutation Traditional one-point mutation is 1-geometric under Hamming distance. 101 100 000 001 110 010 111 011 Neighbourhood structure naturally associated with the shortest path distance. 11
  • 12. Example of Geometric Crossover The traditional crossover is geometric under the Hamming distance. 1 A B X 0 1 1 0 1 2 B 1 1 0 1 1 3 A X 0 1 0 1 1 H(A,X) + H(X,B) = H(A,B) 12
  • 13. Uniform Crossover & Uniform Mutation Uniform geometric crossover: fUX ( z | x, y ) = Pr{UX = z | P1 = x, P 2 = y} = δ ( z ∈ [ x, y ]) | [ x, y ] | Im[UX ( x, y)] = {z ∈ S | fUX ( z | x, y) > 0} = [ x, y] Uniform geometric ε-mutation: f UM ε ( z | x ) = Pr{ UM = z | P = x } = δ ( z ∈ B ( x , ε )) | B ( x,ε ) | Im[UMε ( x)] = {z ∈ S | f Mε ( z | x) > 0} = B( x, ε ) Example: Traditional uniform crossover for binary strings is uniform geometric crossover under Hamming distance. 13
  • 14. Representation-Search Space Duality Cartesian duality: via equating points in the plane and their coordinate, geometric object have algebraic dual. y = 2x - 3 14
  • 15. Representation-Search Space Duality REPRESENTATION SEARCH SPACE Vector of Coordinates (x,y) Point in Cartesian Plane Syntactic configuration (e.g., binary string) Point in search space (e.g., point in Hamming space) Search Operator (algebraic): defined in terms of manipulation of the representation Search Operator (geometric): defined in terms of spatial relationship Operational/Concrete Declarative/Specification Representation-specific Representation-independent Example: traditional uniform crossover can be defined: (i) geometrically: pick offspring points uniformly at random in the Hamming segment between parent points (ii) algebraically: generate a random recombination mask that is used to position-wise select the bits of the parent binary strings to form the offspring binary string 15
  • 16. Fitness landscapes & search operators What is the fitness landscape seen by a search algorithm? Fitness landscape = Solution set + Fitness function + Search space structure The search space structure is induced by the search operators MUTATION (traditional view): • the space structure is a graph • nodes represent candidate solutions • weighted edges indicate the probability of producing a certain offspring given a certain parent 16
  • 17. Crossover Landscape What is the structure induced by crossover? As crossover has two parents, each pair of nodes are linked by edges to nodes representing possible offspring. This structure is not a graph, it is an hyper-graph. Problem with traditional view: the natural spatial interpretation of graph is lost, these fitness landscapes have difficult interpretation. 17
  • 18. Geometric Interpretation of Landscape The structure of the landscape is given by the distance associated with the geometric operators. As mutation and crossover operator can be defined using the same distance they see the same simple fitness landscape, which is also the landscape seen by the search algorithm. Mutation and crossover navigate the same search space in different ways, as mutation produces offspring (i.e., accesses) a ball around the parent, and crossover accesses the segment between the parents. Probabilities of accessing offspring are spatial distributions (weights on nodes) on balls and segments. 18
  • 19. PART 2: Geometric Unification of Evolutionary Algorithms 19
  • 20. Motivations: Fragmentation Different flavors of (traditional) Evolutionary Algorithms: • Very many variations on each flavors • It is desirable to have a coherent picture (De Jong) Evolutionary Algorithms are very similar: • Algorithmically irrelevant differences (e.g., application domain and phenotype interpretation) • Algorithmic elements that can be freely exchanged (e.g., selection scheme) Real difference: • Solution representation (e.g., binary strings, real vectors) • Search operators (i.e., mutation and crossover) Is there a deeper unity encompassing all Evolutionary Algorithms beyond the specific representation? 20
  • 21. Minkowski spaces – real vectors Balls 2 2 2 2 2 2 B((2, 2); 1) Euclidean space B((2, 2); 1) Manhattan space B((2, 2); 1) Chessboard space Segments 2 2 2 1 1 1 1 3 [(1, 1); (3, 2)] 1 geodesic Euclidean space 1 3 1 3 [(1, 1); (3, 2)] = [(1, 2); (3, 1)] [(1, 1); (3, 2)] infinitely many geodesics infinitely many geodesics Manhattan space Chessboard space 21
  • 22. Pre-existing operators – real vectors Mutations: • bounded spherical mutation: geometric under Euclidean distance • creep mutation: geometric under Chessboard distance Recombinations: • blend crossover: geometric under Euclidean distance • box crossover: geometric under Manhattan distance • discrete crossover: geometric under Manhattan distance • extended-line & extended-box crossovers: non-geometric 22
  • 23. Hamming spaces – n-ary strings 100 101 00 01 02 10 11 12 20 000 21 22 001 110 111 011 010 B(00;1) Hamming space H(2,3) B(000; 1) Hamming space H(3,2) 100 101 00 11 12 20 21 22 001 111 11 0 010 02 10 000 01 011 [000; 011] = [001; 010] 2 geodesics Hamming space H(3,2) [00;11]=[01;10] 2 geodesics Hamming space H(2,3) 23
  • 24. Pre-existing operators – n-ary strings Mutations: • point-mutations for binary and n-ary strings: 1-geometric mutation under Hamming distance • position-wise mutations: n-geometric mutation under Hamming distance (with probability distribution only function of the distance) Recombinations: • all mask-based crossovers (including 1-point, 2-point, uniform) for binary and n-ary strings: geometric crossover under Hamming distance • intermediate recombination for integer vectors: geometric crossover under Manhattan distance on integer vectors 24
  • 25. Cayley spaces - permutations abc abc abc bac bac bac cba cab acb cab bca acb bca acb cab bca cba cba B(abc; 1) Adjacent swap space B(abc; 1) Swap space abc abc bac abc acb cab bca B(abc; 1) Insertion space bac bca cba cab acb cab cba cba [abc; bca] 1 geodesic Adjacent swap space acb bca bac [abc; bca] 3 geodesics Swap space [abc; bca] 1 geodesic Insertion space 25
  • 26. Pre-existing operators – permutations Mutations: • single edit-move mutations: 1-geometric mutation under corresponding edit distance Recombinations: • PMX: geometric crossover under swap distance • Cycle crossover: geometric crossover under swap distance & Hamming distance (restricted to permutations) • Cut-and-fill crossovers (adaptations of 1-point crossover): geometric crossovers under swap and adjacent swap distances • Merge crossover: geometric crossover under insertion distance • Davis’s order crossover: non-geometric crossover 26
  • 27. Syntactic tree spaces – Homologous Crossover Parent 1 Parent 2 + * sin * + x x x y * y x y Alignment Crossover Point Swap y Offspring 2 Offspring 1 * + sin x * + * * x y * y y y x x 27
  • 28. Pre-existing operators – syntactic trees Mutations: • point and sub-tree mutations: geometric mutation under structural Hamming distance on trees (mutations towards the root have larger radius) Recombinations: • Koza’s sub-tree swap crossover: non-geometric • Homologous crossover: geometric under structural Hamming distance 28
  • 29. Variable length sequence spaces – Homologous Recombination Parent1=AGCACACA Parent2=ACACACTA best inexact alignment (with gaps): AGCA|CAC-A A-CA|CACTA Child1=AGCACACTA Child2=ACACACA 29
  • 30. Pre-existing operators – sequences: Biological Recombination Mutation: • insertion, deletion or substitution of a single amino acid: 1-geometric mutation under Levenshtein distance Recombination: • Homologous recombination for variable length sequences (1-point, 2-points, n-points, uniform): geometric crossover under Levenshtein distance • More realistic models of homologous biological recombination with respects to gap size and base-pairs matching preference: geometric crossovers under weighted and block-based Levenshtein distance 30
  • 31. Significance of Unification Most of the existing crossover operators for major representations fit the geometric definition Established existing operators have emerged from experimental work done by generations of practitioners over decades Geometric crossover compresses in a simple formula an empirical phenomenon 31
  • 32. PART 3: Principled Design of Crossover Operators 32
  • 33. Motivations: ad-hoc crossover design For every new problem and new solution representation search operators are designed ad-hoc No systematic way of designing new search operators • Only informal rule-of-thumbs (heuristic) • Not applicable to all representations/problems (limited scope) • Mostly for mutation and less for crossover (simple operators) • Application of guidelines to specific representation is a black art (vague) Can we formally derive good representationspecific crossovers for any target representation? 33
  • 34. Crossover Principled Design Domain specific solution representation is effective Problem: for non-standard representations it is not clear how crossover should look like But: given a problem you may know already a good neighbourhood structure/distance/mutation Geometric Interpretation of Crossover: • your representation and space structure • specific geometric crossover by plugging the space structure in the definition • operational definition of crossover manipulating the underlying representation 34
  • 35. Crossover Design: Graph Example + =? 35
  • 36. Non-labelled graph neighbourhood 2 3 2 0 1 1 MOVE: Insert/remove an edge Edit distance: minimum number of moves to transform a graph to the other 36
  • 38. Operational Geometric Crossover Edit distance has a natural dual interpretation: • measure of distance in the search space • measure of similarity on the underlying representation • this can be used to help identifying an operational definition of crossover (implementation) which corresponds to its geometric definition in terms of distance (specification) For graphs under ins/del edge edit distance the operational crossover is as follows: • Pair up the nodes of the parent graphs such that there are the minimum number of edges mismatches • Recombine the aligned parent graphs using a recombination mask on the edges • This recombination implements the geometric crossover 38
  • 39. Crossover Design: TSP Example Edit distance duality for permutations: • producing offspring in the segment between parents on a space generated by moves of type x (e.g., swaps) • producing offspring permutations on minimal sorting trajectories to sort a parent permutation into the other using move of type x Sorting Crossovers: • Geometric crossover for permutations can be implemented using traditional sorting algorithms and returning as offspring a partially sorted permutation • Adj. Swap -> bubble sort • Swap -> selection sort, • Insertion ->insertion sort 39
  • 40. Crossover Design: TSP example A known good neighbourhood structure for TSP is 2opt structure = space of circular permutations endowed with reversal edit distance Geometric crossover for TSP = picking offspring on the minimal sorting trajectories by sorting one parent circular permutation toward the other parent by reversals (sorting circular permutations by reversals) 40
  • 41. 41
  • 42. Operational Geometric Crossover for TSP BAD NEWS: sorting circular permutations by reversals is NPHard! GOOD NEWS: there are approximation algorithms that sort within a bounded error to optimality A 2-approximation algorithm sorts by reversals using sorting trajectories that are at most twice the length of the minimal sorting trajectories Approximation algorithms can be used to build approximated geometric crossovers for TSP In experiments, this crossover beats Edge Recombination which is the best for TSP 42
  • 43. Product Geometric Crossover It is a simple and general method to build more complex geometric crossovers from simple geometric crossovers GX1:AxA A geometric under d1 GX2:BxB B geometric under d2 A product crossover of GX1 and GX2 is an operator defined on the cartesian product of their domains PGX:(A,B)x(A,B) (A,B) that applies GX1on the first projection and GX2 on the second projection. GX1 and GX2 do not need to be independent and can be based on different representations. Theorem: PGX is a geometric crossover under the distance d = d1+d2 43
  • 44. Crossover Design: Sudoku Example Fill in the grid so that every row, every column, and every 3x3 box contains the digits 1 through 9 4 types of constraints: 1) Fixed Elements 2) Rows are permutations 3) Columns are permutations 4) Boxes are permutations 44
  • 45. Crossover Design: Sudoku Example We start from an initial population of solutions (filled grids) correct with respect to constraints 1) and 2) We want a geometric crossover defined on the entire Sudoku grid that preserves constraints 1) and 2) so that we search a smaller search space Constraints 3) and 4) are treated as soft constrains and the fitness of a solution is the number of unsatisfied constraints (to minimze) The Hamming distance between grids gives rise to a smooth landscape because close grids have similar fitness 45
  • 46. Crossover Design: Sudoku Example The cycle crossover on a row preserves constraints 1) and 2) and it is geometric under Hamming distance For the product geometric crossover theorem, the row-wise cycle crossover is geometric under Hamming distance on the entire grid The fitness landscape seen by this crossover is “smooth” This crossover performed very well in experiments compared with other recombinations 46
  • 47. PART 4: Principled Generalization of Search Algorithms 47
  • 48. Motivations Problem: ad hoc extensions of continuous search algorithms to combinatorial spaces. Is there a formal & systematic way of generalizing search algorithms for specific search spaces to formal meta-heuristics? Solution: Principled generalization: formal generalization of continuous search algorithm via geometric interpretation of operators Applied to • Particle Swarm, Differential Evolution, Nelder&Mead • Binary strings, Permutations, GP trees 48
  • 49. Generalization Methodology 1. Take a continuous optimization algorithm 2. Rewrite search operators using geometric objects as functions of only the Euclidean distance 3. Substitute Euclidean distance with a generic metric geometric algorithm 4. Plug a new distance in the formal algorithm algorithm for a new space 5. Rewrite the search operators getting rid of the distance and using the associated representation formal instance of the 49
  • 52. Convex Combination & Extension Ray Convex Combination Extension Ray B=? A C C=? B A C=CX(A,B) B=ER(A,C) • Extension ray is the inverse operation of convex combination • They are well-defined in any metric space 52
  • 53. Differential Mutation Construction of U using convex combination and extension ray 53
  • 54. Formal Geometric Differential Evolution DM DX 54
  • 55. Specialization (Hamming space) The GDE is a formal algorithm that is specialized to the Hamming space once all its operators (DM and DX) are specialized to the Hamming space DM and DX can be rewritten solely in terms of convex combination and extension ray combination So, to obtain the specialization of the GDE to the Hamming space, we only need the specializations of convex combination and extension ray 55
  • 56. Convex Combination & Extension Ray (Hamming space) Convex combination: it is a form of biased uniform crossover which prefers bits form one or the other parents according to their weights Extension ray recombination: the offspring C of binary extension ray originating in parent A and passing through parent B can be obtained by starting from B and with a suitable probability flipping those bits that, at the same time, increase the Hamming distance form B and from A These operators are provably conforming to the geometric formal definitions of convex combination and extension ray under Hamming distance 56
  • 57. Results When ported from continuous to Hamming space all the algorithms (DE, PSO, NM) worked very well out-of-the-box. This shows that continuous algorithm can be ported using this methodology to discrete spaces. When specified to permutations and GP trees spaces a number of surprising behaviours appeared. As we applied the very same algorithms to different spaces, the cause of their specific behaviours are specific geometric properties of the underlying search space they are applied to. Taxonomy of spaces based on effect on search behaviour. Relevant properties: symmetry, curvature, deformation. 57
  • 58. PART 5: Unified Theory of Evolutionary Algorithms 58
  • 59. Motivations Is a general, representation-independent, rigorous theory of Evolutionary Algorithms possible? The NFL theorem implies that evolutionary algorithms can perform better than random search only on a restricted, wellmatched class of problems What are the “topographic features” of fitness landscapes and “behavioural features” of all evolutionary algorithms that alone explain/lead to good performance? 59
  • 60. Formal Evolutionary Algorithm Geometric Crossover can be understood as a functional form taking the distance d as argument. Functional Interpretation: An evolutionary algorithm with geometric crossover can be understood as a function of the metric d (d is a parameter as e.g., the mutation rate). Axiomatic Interpretation: An evolutionary algorithm with geometric crossover with any metric is a representationindependent formal specification of a search algorithms whose properties derive form the metric axioms. What happens if we “run” a formal evolutionary algorithm? 60
  • 61. Abstract Convex Evolutionary Search co ( pop n +1 ) ⊆ co ( pop n ) ⊆ K ⊆ co ( pop1 ) ⊆ co ( pop 0 ) It holds across representations for any EA with crossover & selection (shown using a generic distance, i.e., metric axioms) 61
  • 62. Abstract Concave Fitness Landscapes What topographic feature of the landscape is a good match for the convex behavioural feature of the search (when maximising)? Concave landscapes can be defined in a representation-independent way (i.e., on a generic metric space) 62
  • 63. Abstract vs. Specific Analysis Abstract performance: performance as a function of the underlying metric space and solution representation.
  • 64. Abstract Convex Search Algorithm Initialise Population Uniformly at Random Until Population has converged to the same individual • Rank individuals on fitness • Remove all individuals with the worst fitness (when there are at least two fitness values in the population) • Apply the Convex Hull Uniform Recombination to the remaining individuals to create the next population Return individual in the last population
  • 65. Abstract Concave Landscape Concave landscape: all level sets are convex sets A concave landscape on a combinatorial space is a “Tower of Hanoi” of convex sets Polynomial Concave Landscape: • Not too many levels: the number of possible fitness values (level sets) is polynomial in the problem size • Not too sudden shrinking: the rate between areas of successive level sets is polynomial
  • 66. Computational Complexity Analysis The algorithm does not converge to the optimum all the time With a large enough population the algorithm converges to the optimum most of the times The probability of convergence and the convergence time are expressions that hold for all metric spaces, and are functions of a single “convexity number” of the specific metric space When specified to Hamming space, a small population size (i.e., log n) suffices to get to the optimum with high probability in linear number of generation (i.e., n). 66
  • 67. Work in Progress Specification of results for other spaces (i.e., continuous, permutations) Analysis of standard EAs: How can mutation be naturally included in this framework? Analysis of rugged concave landscapes Analysis of combinatorial problems: big valley hypothesis is an informal notion of convexity of fitness landscapes that holds for interesting problems (e.g., TSP) How far can a theory be pushed forward at this level of abstraction? 67
  • 69. Summary Motivations: • fragmentation, no formal design, no general theory. Geometric Operators: • Search operators can be defined formally across representations using simple geometric shapes. Unification: • Many crossover operators across representations are geometric crossover under some distance. 69
  • 70. Summary Crossover Principled Design: • Plugging in an edit distance associated with a new representation it is possible to derive operational definition of the specific geometric crossover. Principled Generalization of Search Algorithms: • Generalization by replacing the Euclidean distance in continuous search algorithm with a generic metric. Unified Theory of Evolutionary Algorithms: • All evolutionary algorithms with geometric crossover do a form of convex search. They work well on concave-like landscapes. 70
  • 71. A Dream: Bridging Theory & Practice Gap PRACTITIONER: “I want to use EAs to solve my problem” BLACK ART: Ad-hoc design based on a random intuition had before breakfast THEORETICIAN: “I want to do rigorous analysis of EAs” TOY PROBLEMS: Yet another rigorous analysis of ONEMAX IDEAL GEOMETRIC FRAMEWORK: Rigorous theoretical framework for provably good systematic EAs design for your problem Automated design & implementation of provably good custom EA for your problem 71
  • 72. Take home message There are fundamental geometric principles behind all evolutionary algorithms across representations. The geometric view is a unifying way of thinking about evolutionary algorithms which is general, rigorous and intuitive at the same time, with the potential to bridge theory and practice. I hope from now on you will think geometrically about whatever aspect of evolution interests you! Collaborations are welcome! Thank you! 72
  • 73. References A. Moraglio, “Geometric Theory of Representations for Evolutionary Algorithms”, Springer (forthcoming) A. Moraglio, D. Sudholt "Runtime Analysis of Convex Evolutionary Search", Evolutionary Computation Journal, MIT Press, 2013 (accepted for publication) A. Moraglio, J. Togelius, S. Silva "Geometric Differential Evolution for Combinatorial and Programs Spaces", Evolutionary Computation Journal, 2012 H-Y. Kim, Y. Yoon, A. Moraglio, B-R. Moon “Geometric Crossover for Real-coded Genetic Algorithms”, Information Sciences Journal, 2010 Y. Yoon, Y.-H. Kim, A. Moraglio, B.-R. Moon, "Geometric Interpretation of Genotype-Phenotype Mapping and Induced Crossovers", Theoretical Computer Science Journal, 2010 A. Moraglio, R. Poli “Topological Crossover for the Permutation Representation", Italian Journal Intelligenza Artificiale, 2010 73
  • 74. References A. Moraglio, C. Di Chio, J. Togelius, R. Poli “Geometric particle swarm optimisation”, Journal of Artificial Evolution and Applications, online article ID 143624, 14 pages, Volume 2008, 2008 A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon “Geometric Crossovers for Multiway Graph Partitioning”, Evolutionary Computation Journal, volume 15, issue 4, pages 445-474, 2007 Moraglio, A. Mambrini "Runtime Analysis of Mutation-Based Geometric Semantic Genetic Programming for Basis Functions Regression", Genetic and Evolutionary Computation Conference, 2013 A. Moraglio, A. Mambrini, L. Manzoni “Runtime Analysis of Mutation-Based Geometric Semantic Geometric Programming on Boolean Functions”, Foundations of Genetic Algorithms, 2013 74
  • 75. References A. Moraglio, D. Sudholt "Runtime Analysis of Convex Evolutionary Search", Genetic and Evolutionary Computation Conference, pages 649-656, 2012 A. Moraglio, K. Krawiec, C. Johnson “Geometric Semantic Genetic Programming”, Proceedings of Parallel Problem Solving from Nature, pages 21-31, 2012 A. Moraglio, D. Sudholt “Runtime Analysis of Convex Evolutionary Search”, 6th Workshop on Theory of Randomized Search Heuristics, 2012 A. Moraglio, K. Krawiec, C. Johnson “Geometric Semantic Genetic Programming”, 5th Workshop on Theory of Randomized Search Heuristics, 2011 A. Moraglio, S. Silva “Geometric Nelder-Mead Algorithm on the Space of Genetic Programs”, Genetic and Evolutionary Computation Conference, pages 1307-1314, 2011 75
  • 76. References A. Moraglio, H-Y. Kim, Y. Yoon “Geometric Surrogate-Based Optimisation for Permutation-Based Problems”, GECCO 2011 A. Moraglio, A. Kattan “Geometric Generalisation of Surrogate Model Based Optimisation to Combinatorial Spaces”, European Conference on Combinatorial Optimisation, 2011 A. Moraglio "Abstact Evolutionary Convex Search", Workshop on the Foundations of Genetic Algorithms, 2011 A. Alentorn, A. Moraglio, C. G. Johnson “Binary Nelder-Mead Algorithm for Market Neutral Portfolio Optimization”, IEEE UK Conference on Computational Intelligence, 2010 A. Moraglio "One-Point Geometric Crossover", Proceedings of Parallel Problem Solving from Nature 2010 76
  • 77. References A. Moraglio, J. Togelius "Geometric Nelder-Mead Algorithm for the Permutation Representation", Proceedings of IEEE World Conference on Computational Intelligence 2010 A. Moraglio, S. Silva "Geometric Differential Evolution on the Space of Genetic Programs", Proceedings of European Conference on Genetic Programming, pages 171-183, 2010 A. Moraglio, C. Johnson "Geometric Generalization of NelderMead Algorithm", Proceedings of European Conference on Evolutionary Computation in Combinatorial Optimisation, pages 190-201, 2010 A. Moraglio, J. Togelius “Geometric Differential Evolution”, Genetic and Evolutionary Computation Conference, pages 1705-1712, 2009 A. Moraglio, J. Togelius “Inertial Geometric Particle Swarm Optimization”, IEEE Congress on Evolutionary Computation, pages 1973-1980, 2009 77
  • 78. References A. Moraglio, Y. Borenstein “A Gaussian Random Field Model of Smooth Fitness Landscapes”, Workshop on Foundations of Genetic Algorithms, pages 171-182, 2009 J. Togelius, R. De Nardi, A. Moraglio “Geometric PSO + GP = Particle Swarm Programming”, IEEE Congress on Evolutionary Computation, pages 3594-3600, 2008 C. Di Chio, A. Moraglio, R. Poli “Geometric Particle Swarm Optimization on Binary and Real Spaces: from Theory to Practice”, Particle Swarms: the Second Decade – Genetic and Evolutionary Computation Conference workshop, 2007 A. Moraglio, J. Togelius “Geometric PSO for the Sudoku Puzzle”, Genetic and Evolutionary Computation Conference, pages 118 125, 2007 Y. Yoon, H-Y. Kim, A. Moraglio, B-R. Moon “Geometric Crossover for Real-Vector Representation”, Genetic and Evolutionary Computation Conference, page 1539, 2007 78
  • 79. References A. Moraglio, C. Di Chio, R. Poli “Geometric particle swarm optimisation”, European Conference on Genetic Programming, pages 125-136, 2007 A. Moraglio, R. Poli “Inbreeding Properties of Geometric Crossover and Non-geometric Recombinations”, Foundations of Genetic Algorithms, pages 1-14, 2007 A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon, R. Poli “Cycle Crossover for Permutations with Repetitions: Application to Graph Partitioning”, Evolutionary Algorithms: Bridging Theory and Practice - Parallel Problem Solving from Nature workshop, 2006 A. Moraglio, R. Poli “Geometric Crossover for Sets, Multisets and Partitions”, Parallel Problem Solving from Nature, pages 10381047, 2006 A. Moraglio, R. Poli “Product Geometric Crossover”, Parallel Problem Solving from Nature, pages 1018-1027, 2006 79
  • 80. References A. Moraglio, R. Poli “Inbreeding Properties of Geometric Crossover and Non-geometric Recombinations”, Evolutionary Computation Workshop - European Conference on Artificial Intelligence, 2006 R. Seehuus, A. Moraglio "Geometric Crossover for Protein Motif Discovery", Workshop on Adaptive Representations - Genetic and Evolutionary Computation Conference, 2006 A. Moraglio, R. Poli, R. Seehuus “Geometric Crossover for Biological Sequences", Workshop on Adaptive Representations - Genetic and Evolutionary Computation Conference, 2006 A. Moraglio, J. Togelius, S. Lucas "Product Geometric Crossover for the Sudoku Puzzle", IEEE Congress on Evolutionary Computation, pages 470-476, 2006 A. Moraglio, H-Y. Kim, Y. Yoon, B-R. Moon, R. Poli "Generalized Cycle Crossover for Graph Partitioning", Genetic and Evolutionary Computation Conference, pages 1421-1422, 2006 80
  • 81. References H-Y. Kim, Y. Yoon, A. Moraglio, B-R. Moon "Geometric Crossover for Multiway Graph Partitioning", Genetic and Evolutionary Computation Conference, pages 1217-1224, 2006 A. Moraglio “Geometric Unification of Evolutionary Algorithms", European Graduate Student Workshop on Evolutionary Computation – European Conference on Genetic Programming, 2006 A. Moraglio, R. Poli, R. Seehuus “Geometric Crossover for Biological Sequences”, European Conference on Genetic Programming, pages 121-132, 2006 A. Moraglio, R. Poli “Topological Crossover for the Permutation Representation”, Italian Workshop on Evolutionary Computation Italian Association of Artificial Intelligence Conference, 2005 A. Moraglio, R. Poli “Geometric Landscape of Homologous Crossover for Syntactic Trees”, IEEE Congress on Evolutionary Computation, pages 427- 434, 2005 81
  • 82. References A. Moraglio, R. Poli “Topological Crossover for the Permutation Representation", Workshop on Theory of Representations Genetic and Evolutionary Computation Conference, 2005 A. Moraglio “Geometric Unification of Evolutionary Algorithms”, British Colloquium for Theoretical Computer Science, page 251, 2005 A. Moraglio, R. Poli “Topological Interpretation of Crossover", Genetic and Evolutionary Computation Conference, pages 1377-1388, 2004 A. Moraglio “Towards a Geometric Unification of Evolutionary Algorithms”, PhD thesis, University of Essex, 2007 82