Final evaluation report update

UPDATE
PROJECT

FINAL EVALUATION REPORT

Unveiling European Union citizenship rights through Powerful messages,
Developed in Attractive Technological Environment (2012 - 2013)

Final Evaluation Report UPDATE

UPDATE PROJECT 2012-2013
Unveiling European Union citizenship rights through Powerful messages,
Developed in Attractive Technological Environment

Project Manager UPDATE
Open Youth
Mr. Daniel Vankov
j.k. Darvenitsa, 6 Kanarche Str. entr. B app. 7
1756 Sofia, Bulgaria
chairman@open-youth.org

External Evaluator
Vriestyle Projects
LL.M Jetty de Vries
Workum
The Netherlands
jetty@vriestyle.com

2

OUTLINE
1 | EXECUTIVE SUMMARY ...............................................................................................................

4

2 | INTRODUCTION .........................................................................................................................

6

3 | SHORT DISCRIPTION OF THE PROJECT .....................................................................................

7

4 | CONTENTS AND IMPLEMENTATION OF THE EVALUATION .....................................................
4.1 |Design of evaluation .........................................................................................................
4.2 | Indicators and instruments of Evaluation ........................................................................

8
8
8

5 | RESULTS OF QUANTITATIVE EVALUATION..............................................................................
5.1 | General quantitative goals .............................................................................................
5.2 | Realised products ...........................................................................................................
5.3 | Number of trained volunteers .......................................................................................
5.4 | Number of local actions, material and (in)direct participants .......................................
5.5 | Conclusion quantitative results .....................................................................................

10
10
10
12
12
14

6 | RESULTS OF QUIZ ABOUT EUROPEAN CITIZEN RIGHTS .........................................................
6.1 | The interactive quiz .......................................................................................................
6.2 | The Knowledge of volunteers about European Rights ..................................................
6.3 | The knowledge of the citizens about their European rights .........................................
6.4 | Statistical report on the data collected from 2845 quiz cards ......................................

15
15
15
20
22

7 | RESULTS OF VISIBILITY AND DISSEMINATION ........................................................................
7.1 | The visibility of the project and the activities in the media ..........................................
7.2 | The visibility of the project and the activities by the general public ............................
7.3 | The online visibility .......................................................................................................
7.4 | The visibility of the project and the activities by the networks ....................................

30
30
31
31
32

8 | PROCESS EVALUATION ............................................................................................................
8.1 | Event Number 8: Evaluation ...........................................................................................
8.2 | Proces evaluation of the Project management .............................................................
8.3 | Proces evaluation of the project team meetings ...........................................................
8.4 | Proces evaluation of the development of the used material .........................................
8.5 | Proces evaluation of the organising of the local actions ................................................

33
33
34
34
35
35

9 | CONCLUSIONS AND RECOMMENDATIONS .............................................................................

36

Annexes ...........................................................................................................................................
A. Update Material Counting (EVA1)
B. Form to filled after the action by volunteers (EVA2)
C. Form to be filled after the action by coordinator of the volunteer (EVA3)
D. Process evaluation (EVA 4)
E. Evaluation of the volunteers
F. Quiz questions
G. Quiz results Bulgaria 2008-2012-2013
H. Examples of statements in the media
I. Results Process Evaluation (EVA4)

38


3

1

EXECUTIVE SUMMARY

The executive summary aims to summarize the most important objectives and results mentioned
in the work plan of the project and assessed by evaluating the project. It is aimed to clarify the
Evaluation Report in order to have a clear picture of the results reached or may be not reached
during the project.
The project "Unveiling European Union citizenship rights through Powerful messages, developed in
Attractive Technological Environment” (UPDATE) was successful. The project partners were from
Bulgaria, Hungary, Belgium and the Netherlands. The goal was to develop an original comic book,
explaining to the young people their basic European citizens’ rights in an interesting and
understandable way and to reach the tech-savvy youth wherever they are, combining the message
with this risk-free traffic participation one.
The objectives, mentioned in the work plan were:
Development and production of information and communication material
Accomplished! After development of the visual concept, the information cards, the interactive quiz,
the comic book, the online comic application, the local stands, the shirts and pens have been
produced.
Development of website
Accomplished! In the languages English, Bulgarian, Hungarian, French and Dutch.
80 trained local volunteers
Accomplished! There were 105 trained volunteers in total.
16 successful local actions
Accomplished! All actions were performed successfully. For UPDATE there have been 23 actions
in total.
Publications to be distributed during the project
The products, developed during the project were distributed. These products were:
information cards (24.320), interactive quiz, quiz cards (2.845), comic books (2.552) and pens (1.275).
2.400 direct participants quiz cards
Accomplished! In total, there were 2.845 (young) direct participants (face-to-face approach):
During 23 local events, the quiz cards were completed by these young participants.
24.000 indirect participants
Accomplished! 24.320 informative cards have been distributed during the campaign.
50.000 people reached through media
Accomplished! Good press contacts were maintained during the campaigns, which resulted in: 93
Internet articles, 18 press articles in newspapers, 15 radio announcements, 8 TV reportages on
national and local television and 7 information agency reports  Estimated audience = about
1.720.332 people.


4

50.000 people through the website
Although all performance indicators were met, the number of website visitors was below the
expectations. 1.900 people visited the website of which 531 people completed the quiz queries and
downloaded the comic book. From the total number of downloaded online applications, 406 were
done for Android while Apple store does not provide download information for free apps. But the
UPDATE application received a review of 4+. This shortcoming is offset by targeted efforts in the
online social media (e.g. Facebook). The online campaign triggered 14.537 people to interact with
the provided content. 740.246 were reached indirectly. Still the main purpose of these tools, i.e. to
bring sustainability of the project results after its completion, is to be explored in the future.

To inform the target audience about the awareness message: EU rights
The target group of youngsters < 30 years old was approached using the quiz cards and information
cards, holding the message about their EU rights.
On a scale of 1 to 5 the volunteers evaluate their knowledge of EU rights at 3 before training and at 4
after training.
Results quiz cards: 2.845 quiz cards x 8 questions= 22.760 questions. 66% of these questions were
answered correctly. Bulgarian participants with a score of 77% achieved the best result. This best
scores may have been the result of earlier awareness campaigns of Open Youth in 2008 and 2012.

UPDATE action in Bulgaria


5

2

INTRODUCTION

The UPDATE project is an European project in which four European partners cooperate. The reason
the partners were chosen as such is their long lasting fruitful cooperation with the project leader
and for variety of experience, they bring. All organizations are experienced in working with young
people but their experience defers. TOP-25 (BE) is a big organization with a long history, huge
volunteer base and a strong professional team. OY (BG) is an organization, developed by young
enthusiasts, and it is mainly based on volunteer efforts. RYD (NL) is representing a developed
country with strong corporate spirit. HAHA (HU) is a university student association.

Open Youth
Bulgaria
Project Manager

TOP 25
Belgium
Project Partner

HAHA
Hungary
Project Partner

Responsible Young
Drivers
The Netherlands
Project Partner

Timetable of the project is form 01.08.2012 to 31.01.2014
In this period the listed numbered events have been completed.
Event Number 1: Project Management
Event Number 2: Preparation meeting Brussel
Event Number 3: Development and production of information and communication materials
Event Number 4: Training for trainers
Event Number 5: Pilot action
Event Number 6: Local actions
Event Number 7: Media relations
Event Number 8: Evaluation
Event Number 9: Dissemination
Event Number 10: Evaluation Meeting

This evaluation report will address all events. The event numbers 3-4-5-6 will be addressed in the
chapters 5 and 6 (QUANTITAVE RESULTS). The event numbers 7-9 will be addressed in Chapter
7 (RESULTS OF VISIBILITY AND DISSEMINATION). The event numbers 1, 2 and 10, including the
whole project, will be part of the Process Evaluation. This report is the result of event number 8.
Chapter 4 (CONTENTS AND IMPLEMENTATION OF THE EVALUATION) describes the build up of the
evaluation.


6

3

SHORT DISCRIPTION OF THE PROJECT PROPOSAL

„Media tablets are poised for strong growth with worldwide end user sales projected to total 54.8
million units in 2011, up 181 percent from 2010, and surpass 208 million units in 2014.” (Gartner)
According to some analysts the total number of sold smart phones worldwide is expected to surpass
875 million in 2014 from “only” 267 million in 2010. The number of downloads is expected to almost
double in 2011, reaching 18.1 billion from 9.5 in 2010, according to IHS Screen Digest. The expected
figure for 2014 is 33 billion.
This is a very powerful base for reaching tech savvy young people wherever they are. But it is still
underused due to lack of information and experience. The project consortium believes that there are
synergies that can be explored by cross-fertilizing regular channels with those innovative ones for
promoting European citizenship rights to young Europeans.
UPDATE aims to develop a genuine comics book, explaining to the young people in an interesting and
understandable way their basic EU rights and how they can appeal to the European Ombudsman,
and to adapt it to the world of mobile devices using AppStore platform as a pilot as it holds 75% of
that market. The comics book will be promoted offline, through regular people-to-people public
awareness raising activities, and online through a shared Internet marketing campaign.
The developed comics book will be disseminated in at least 16 local actions in four different EU
Member States. During the project we will train 80 volunteers, involve 2 400 direct participants and
reach more than 24 000 indirectly.
The project is based mainly on the developed capacity in the field of awareness raising campaigns
and developing high-tech applications, built by the HEROES project (an EAHC co-funded initiative
cross-fertilizing road safety, alcohol, drugs and AIDS prevention messages) and “European
citizenship… not only words but concrete rights” campaign (a DG JLS funded communication
campaign in Bulgaria).


7

4

CONTENTS AND IMPLEMENTATION OF THE EVALUATION

4.1 | Design of evaluation
The evaluation of the UPDATE project consist of the following:
- Internal process evaluation (chapter 8)
- Internal evaluation on the knowledge and views of the volunteers, implementing the actions
on site (chapter 6)
- External evaluation on the knowledge by the youngsters of the European rights for young
people itself (Chapter 6)
- Visibility of the project in the media (chapter 7)
The process evaluation data is collected from the Process Evaluation Form (EVA4), which is
completed during the final meeting in Sofia by each partners coordinator. Also the external
evaluator has observed the state of affairs during the whole project and has drawn her conclusions.
The internal evaluations amongst the volunteer team is done using forms, completed by the
volunteers (EVA2) and the action coordinators EVA3), before and after each local action.
The external evaluation on the knowledge of the youngsters under the age of 30 of the European
human rights is done, based on the results of the interactive quiz. These results are entered by each
country in a system, analysed by the external evaluator and summarized in this report.
The external evaluation on the visibility of the project Update in the media is based on the actual
media attention for this project. Each partner has collected their media coverage.

4.2 | Indicators and instruments of evaluation
As a part of the work plan the evaluation indicators were assessed and the evaluation instruments
were designed to measure them. The table shows the indicators and the related evaluation
instruments to assess, whether the targets of the project have been reached.
specific objective

Process Indicator

Outcome Indicator

Target

Evaluation
Instrument

To train local volunteers

Number of volunteers
active during the field
activities

Volunteers can disperse
and share the knowledge
of the European human
rights under the
youngsters

80

EVA4

To create successful local
awareness actions

Number of local activities
implemented

Number of different
activities organized

16

EVA1, EVA3

To reach participants on
the local actions

Number of people met
during the field
implementations

Handover the knowledge
of the European rights to
the youngsters

2.400

Quiz cards


8

To inform the target
audience about the
project and awareness
message

Number of distributed
information cards

Knowledge of the
awareness message
among the target
audience

24.000

Counting

To inform the general
public about the project
and field activities

Number of collected press
articles, radio and TV
interviews. Internet
audience.

Publications in local and
national media, 50 000
people reached through
media and 50.000 online

50.000

Media
Coverage

50.000

& Internet
Website

During and after the
project an external
evaluator evaluates the
project

Evaluation report

To analyse the process of
the European project
UPDATE


EVA4
Final
Evaluation
Meeting

9

5

RESULTS OF QUANTITATIVE EVALUATION

5.1 | General quantitative goals
According Event Number 3 of the plan of action the needed material for the project is developed
between 01.10.2012 and 31.03.2013. This contains the information and communication materials to
be used during the local actions.
-

development of website;
production of visual concept;
production of 2.400 comic book;
production of 40 project t-shirts;
production of 24.000 information cards;
production of 2.400 quiz cards;
production of interactive quiz;
production of AppStore comics application;
production of 2.400 pens;
production of stands for the local actions.

5.2 | Realised products
During the Start Up meeting in Brussels (24-26.09.2012) the process of
developing and producing of the needed materials is discussed and the tasks
handed out.
Development of the website, the visual concept, the interactive quiz and the
AppStore comics applications have been started up by the project manager and c
ompleted by the participating countries.
The concept was to have a Young man called Eugene come alive in the comics and have him return
in the visuals. Each partner wrote a story for the comic book and developed its local material. An
online application was created for iPhone, iPad and Android platforms and is downloadable through
AppStore and PlayStore. Everything was developed in time before the start of the pilot actions.
During the pilot actions the material was tested and put straight for using it in the four countries.

Production of the
comic book and the
information and quiz
cards


10

The online
applications in
AppStore

The UPDATE
website

USED MATERIAL UPDATE
30000
25000
20000
15000

used

10000

indicator

5000

Material
update
Comic book
Info cards
Quiz cards
Pens

Project
indicator
2.400
24.000
2.400
2.400

Used
material
2.552
24.320
2.845
1.275

0
comic
books

info
card

quiz
card

Pens

This table shows the amount of material used in all 23 local actions.
Of all produced material, more is deployed than calculated during the UPDATE project. 2.552 comic
books, 2.845 quiz cards, 23.320 information cards and 1.275 pens were disseminated. Paragraph 5.4
will give more information on the dissemination of the material per action.


11

5.3 | Number of trained volunteers
Event Number 4
On March 15, 2013 the meeting “Training for trainers” was held. Each partner had sent a delegate who
can educate its own team of volunteers in a later stage to benefit the performance during the local
actions. Chapter 7 gives the process evaluation of this meeting. This addresses the quantitative
evaluation of the number of educated local volunteers.
According to the project, the target indicator was “educating and training of 80 volunteers” this is 20
volunteers for each partner. All partners together have 105 volunteers, educated and deployed during
the local actions. The table below shows that Bulgaria educated 36 volunteers, Hungary - 25, Belgium 24 and The Netherlands - 20. The average age of all the volunteers was 21 years, the youngest was 15
years old and the oldest was 30 years old. 75% of all the volunteers were students. The total group of
volunteers nicely met the target group of the UPDATE project: youngsters < 30 years!

20
25

24

BE
BU

36

HU

105 TRAINED VOLLUNTEERS
• range of age 15 - 30
• average age 21
• 76% are students
• 23% are (un)employed

NL

We also asked the volunteers about their knowledge on the European human rights before and
after the actions. This qualitative data will be addressed in Chapter 6.

5.4 | Number of local actions, material and (in)direct participants
Event Number 5

A pilot action will be organized by each partner in order to test the developed
method and products. Each action has to attract at least 150 people to complete
the interactive quiz.
Event Number 6 Taking into account the result from the pilot action and implementing changes
where necessary, each partner will have to implement three more actions,
using the developed in Event 5 approach.
Expected results 16 successful local actions, 80 trained youth volunteers, 2.400 direct participants
on the interactive quiz; 24.000 indirect participants, informed by the
project materials
Between 01.03.2013 and 31.10.2013 the partners have organised and implemented the local
actions. The table below outlines the quantitative data on the actions:
- Number of actions
- Dates and locations of the actions
- Number of trained volunteers
- Number of direct participants on the interactive quiz
- Number of indirect participants


12

LOCAL ACTIONS IN BELGIUM (information form of the coordinator of the volunteers)
Action

Date

Location

1

31.05-2013
02.06.2013
28.06.2013
30.06.2013
26.07.2013
28.07.2013
19.10.2013

Francorchamps

2
3
4
total

Number of
trained
volunteers
6

Number of direct
participants on the
interactive quiz
141

Number of
indirect
participants
1.000

Brussel

6

136

1.000

Marche-enFamenne
Brussel

6

87

1.000

6
24

236
600

1.000
4000

LOCAL ACTIONS IN BULGARIA (information form of the coordinator of the volunteers)
Action

Date

Location

1

22.04.2013
23.04.2013
07.05.2013
08.05.2013
09.05.2013
18.05.2013
10.08.2013
17.09.2013
18.09.2013
19.09.2013
20.09.2013

Blagoevgrad

2
3
4
5
6
7
8

Number of
trained
volunteers
6

Number of direct
particpants on the
interactive quiz
206

Number of
indirect
participants
1.050

Vratsa

4

107

954

Belogradchik
Sofia
Pernik
Smolyan
Stara Zagora
Pleven

5
5
5
4
7
0

85
176
26
102
25
207

912
1.100
730
988
960
986

36

934

7.680

total

LOCAL ACTIONS IN HUNGARY (information form of the coordinator of the volunteers)
Action

Date

Location

Number of
trained volunteers

1

17.07.2013
20.07.2013
10.08.2013
11.08.2013
18.08.2013
01.10.2013
02.10.2013
03.10.2013
04.10.2013
12.10.2013
14.10.2013
18.10.2013

Debrecen

2

3

4
5
6
7
total

8

Number of direct
particpants on the
interactive quiz
394

Number of
indirect
participants
4.000

Debrecen

5

94

1.230

Debrecen

3

109

1.300

Debrecen
Hajdúszoboszló
Debrecen
Balmazújváros

2
2
2
3
25

26
21
26
41
711

550
575
490
495
8.640


13

LOCAL ACTIONS IN THE NETHERLAND (information form of the coordinator of the
volunteers)
Action

Date

Location

1
2
3
4
total

20.07.2013
30.07.2013
18.09.2013
19.10.2013

De Veenhoop
Franeker
Franeker
Drachten

Number of
trained
volunteers
4
6
5
5
20

Number of direct
particpants on the
interactive quiz
163
219
167
51
600

Number of
indirect
participants
1.000
1.000
1.000
1.000
4.000

TOTAL OF LOCAL ACTIONS: PARTICIPANTS AND MATERIAL
BE
Actions
Volunteers
Participants male
Participants female
Participants total <30*
Indirect participants
Comic books
Info cards
Quiz cards
Pens

BU

HU

NL

TOTAL

4 (6 days)
24
336
257
600
4.000
560
4.000
600
180

8 (12 days)
36
458
472
934
7.680
1.030
7.680
934
622

7 (14 days)
25
436
247
711
8.640
442
8.640
711
157

4
20
328
266
600
4.000
520
4.000
600
316

23
105
1.558
1.242
2.845
24.320
2.552
24.320
2.845
1.275

PROJECT
INDICATOR
16
80
1.200
1.200
2.400
24.000
2.400
24.000
2.400
2.400

* According to the collected quiz cards.The sum differs from the reported distribution by gender,
because 45 people did not report gender (7 for BE, 4 for BG, 28 for HU and 6 for NL).

5.5 | Conclusions of quantitative results
The above mentioned paragraphs show that the quantitative scorecard indicators
have been met extensively. In total 23 local actions were accomplished (score card
indicator was 16) in which 105 trained volunteers were deployed (score card indicator
was 80).
The target was that the partners should directly address in total 2.400 youngsters <
30 years using the quiz cards. Effectively the partners have addressed 2.845 youngsters.
The final result is that the UPDATE project directly addressed 14% more youngsters on the European
rights than originally targeted.
24.320 youngsters were reached by using and distributing the same number of information cards.


14

6

RESULTS OF THE QUIZ ABOUT EUROPEAN CITIZEN RIGHTS

6.1 | THE INTERACTIVE QUIZ
Inventory on the knowledge of the youngsters is done by using an interactive quiz. For this purpose
a quiz card was developed containing 8 queries. The quiz card was completed by youngsters < 30
years. Apart from these quiz cards, the queries could also be answered online. The results of the
answered quiz cards were entered in the system by the four partners.
The results are used to draw the conclusions on the level of knowledge the youngsters have on their
European rights which are presented in this chapter. 2.845 quiz results were used.

Topics of the interactive quiz
1. Move and reside freely within the EU
2. Vote for and stand as a candidate in European Parliament and municipal elections
3. Be protected by the diplomatic and consular authorities of any other EU country
4. Petition the European Parliament and complain to the European Ombudsman.
The volunteers were trained before the local actions. The training did not only focus on the
communication skills towards the youngsters but also on the target group knowledge of the
European rights, giving the volunteers the ability to educate the message.
As a surplus value of the project a conclusion can be made that 105 volunteers have more
knowledge on the European rights now.
In the project, after the training and any local action, the volunteers were interviewed on their
experience and knowledge. The results are presented in paragraph 6.2.
Paragraph 6.3 presents the results on the interactive quiz about the knowledge of youngsters
on their own European rights.

6.2 |THE KNOWLEGDE OF VOLUNTEERS ABOUT EUROPEAN RIGHTS
The results below are based on the interview results of the 105 volunteers. The age group of the
volunteers is between 15 and 30 years old with an average of 21 years. A number of questions were
asked (see Annex B EVA2 form “to be filled in after the action”) This paragraph presents the results
of this questionnaire. Annex E presents the full results.
Knowlegde volunteers about European Rights before and after the training
1. What’s your knowledge about the EU rights before the training?
2. What’s your knowledge about the EU rights after the training?
3. Do you find the knowledge about EU rights important?


15

knowlegde EU rights volunteers
100%

5

5

5

5

4

4

4

4

80%
60%

important
after training

40%
20%

3

2

3

before training

3

0%
BE

BU

HU

NL

Some reasons why EU rights are important according to the volunteers:

Everyone in our country need to know their rights;
Every person must have know about EU rights;
Because we are country member of the EU;
Because it is important;
It is our right!!;
Because we are real Europeans;
Yes, it can help when we are abroad;
Because it is important for Young people;
It could be useful in life;
For the education of Young people;
I will need it in the future;
Citizenship obligation.

Needed European Rights for now and in the future?
1. Have you ever needed EU rights?
2. Do you think you will ever need the EU rights?
3. Do you find this awareness campaign about EU rights useful?

 yes  no
 yes  no
 yes  no

Will you need EU rights in the future?

needed before

4%
23%
77%


yes
no

yes
96%

no

16

awareness campaign EU rights
1%
campaign useful
99%

99% of all the volunteers consider
the awareness campaign on the
European rights to be useful!

campaign not
useful

What was, to your sense, the most interesting part for the participant (as the volunteer)?
- get new information
- to do the quiz
- get the comic book
- other.....

interesting part for the participant
1%
33%

35%

information
quiz

31%

comic book
other

89% of the volunteers were satisfied with the actions of the awareness campaign.

11% of the volunteers recommend to improve the approach to the visitors.
campaing


17

Knowledge about the EU rights from the participants before the action, according the volunteers.
Knowledge about the EU rights from the participants after the action, according the volunteers.

knowlegde participants before & after the action
4
3,5
3

To the opinion of the volunteers,
the knowledge on the European
rights the youngsters has
increased after the actions.
On a scale from 1 to 5, the
general knowledge prior to the
awareness action was 2.4 and 3.7
after it.

2,5
2
1,5
1
0,5
0
before

after

Which part of the project was for the volunteer personally the most interesting?
Most interest part of the project for the volunteers
team volunteers

29%

contact visitors
training EU rights

To the opinion of the volunteers,
working as a team was
considered to be the most
interesting part.

25%
16%

learning EU rights

15%

tools project

15%


18

Conclusions over the volunteers
A total number of 105 volunteers have been educated by the 4
partners to facilitate successful realisation of the actions.
The age of the volunteers was between 15 and 30 years with an
Conclusion
average age of 21.
On a scale from 1 to 5 the general knowledge on the European rights
of the volunteers during the project increased by 1 point.
All volunteers consider the knowledge on the European rights
important for the purpose of travelling, education or simply for the
feeling of being part of the European community.
No less than 77% of the volunteers have never needed their European rights. The remaining 23% did
mostly while travelling or studying in other countries. 95% of the volunteers expects to make use of
the European rights in the future. 99% of the volunteers find this awareness campaign useful.
We also questioned the volunteers about the combination/relation of the various implemented
campaign materials. This resulted in the opinion that the interconnection and relation of the 3
products (quiz card, comic book en information card) was considered to be very good and have
resulted in a successful and complete awareness campaign. No less than 89% of the volunteers
judged both the campaign and the actions as very useful and satisfactory.
To the opinion of the volunteers the knowledge of the participants clearly increased, too.
This knowledge increased with more than 1 point on a scale of 0 to 5.
Finally we also asked the volunteers what they thought to be the most interesting aspects of the
project for themselves. Almost one third (29%) enjoyed most the team work, while 25% judged the
contact with the participants as most interesting. The training (16%), the knowledge on the
European rights (15%) as well as the used campaign material (15%) was considered to be less
interesting for the volunteers.


19

6.3 | THE KNOWLEDGE OF THE CITIZENS ABOUT THEIR EUROPEAN RIGHTS
Statistical report on the data collected from 2.845 quiz cards, completed by youngsters < 30 years.
Topics of the interactive quiz (the complete quiz can be seen in Annex F)
1. Move and reside freely within the EU
2. Vote for and stand as a candidate in European Parliament and municipal elections
3. Be protected by the diplomatic and consular authorities of any EU country
4. Petition the European Parliament and complain to the European Ombudsman.
Number and profile of participants on the interactive quiz
The knowledge of the youngsters on the European rights is investigated by using an interactive quiz.
Completing the quiz is done both offline during actions and online. The results presented below are
based on the outcome of the 2.845 completed quiz cards.
All information from the quiz is processed on the basis of the participating country. This paragraph
presents an overview of the processed information.

Participants by country
participants by country
21%

BELGIUM

21%

BULGARIA
25%

Bulgaria
Belgium
Hungary
The Netherlands
Total


HUNGARY
33%

NETHERLANDS

The biggest number of
reached youngsters was
accomplished by Bulgaria
(33% of all youngsters).
Belgium, Hungary and
the Netherlands reached
about the same number
of youngsters. All
participating countries
have met the
performance indicator.

934 participants
600 participants
711 participants
600 participants
2.845 participants

20

Participants by gender
56% of the Total
participants were male
(1.558) and 44% were
female (1.242).

2.845 participants: female of male

44%

female

56%

male

Participants per country by gender
Gender
BE
BU
Female
257
472
Male
336
458
Unknown
7
4
600
934

HU
247
436
28
711

NL
266
328
6
600

TOTAL
1.242
1.558
45
2.845

Participants by age

age of the 2845 participants

The age groups of the
queried participants by
country

350
300
250

BEL

200

BUL

150

HUN

100

NL

50
0
unknown

12-17

18-20

21-24

25-30

Conclusions on the profile of the participants
1) 1.558 of the 2.845 quiz card were completed by male participants and 1.242 by female
participants. For 45 participants the gender was not specified. In Bulgaria the number of
queried female and male participants was almost equal. In Hungary 189 more male than
female participants were queried (total 711). In Belgium and the Netherlands also more
male than female participants were queried, but the difference was marginal.
2) The age Group 21-24 years was the most represented one in all 4 countries, also the age
Group 18-20 years has a good representation.
A remarkable representation of the age group 12-17 years can be seen in Bulgaria in
comparison with the other countries.

21

6.4 | STATISTICAL REPORT ON THE DATA COLLECTED FROM 2.845 QUIZ CARDS
The quiz card holds 8 questions on the European rights. The full outline of the quiz queries can be
found in Annex E.
In the context of the project 2.845 quiz cards were completed. Each quiz card has 8 questions,
which puts the total number of questions at 22.760. From these 66% were answered correctly.

Averaged over all questions

34%
correct

66%

The individual correct scores
per country are:
Bulgaria
77%
Netherland
66%
Belgium
62%
Hungary
54%

wrong

Average

66%

The table below presents the percentage of correct answers by question number and country.
Bulgaria had a reasonable high score in all questions, bringing their correct score to 77%! All
countries scored very well on questions 7 and 8. The questions 3 and 6 turned out to be the most
difficult ones for all countries. Hungary showed the lowest total score which one can see in most of
the individual scores (red bar).

good answers in %

quiz results by country
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%

BE
BU
HU
NL

1

2

3

4

5

6

7

8

the questions


22

CORRECT ANSWERS BY QUESTION AND BY COUNTRY
Question 1 - The term "freedom of movement" in the European Union affects:
Answer 1: all together capital, goods, services and people
Answer 2: only capital
Answer 3: only services
Answer 4: only goods
Explanation:
The so-called "four freedoms" are
freedom of movement, of goods, of
services, of capital and people.

Question 1: correct answers
100%
80%
60%
40%

89%

79%

62%

20%

31%

0%
BE

BU

HU

NL

Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in
Germany?
Answer 1: "He should apply for a visa at the German consulate."
Answer 2: "He must ask permission from the municipality he lives in."
Answer 3: "He must have a valid passport or identity card to be able to cross the border."
Answer 4: "He must prove he has sufficient funds."
Explanation:
To cross the border, he must
present his passport or ID card.

100%
92%

80%
60%

86%

77%
52%

40%
20%
0%
BE

BU


HU

NL

23

Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament,
which of the following statements is true?
Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in
Bulgaria."
Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the
Spanish Embassy."
Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years."
Answer 4: "I can run for the next European parliament elections in Bulgaria."
Explanation:
Every citizen of the Union has the
right to vote and to stand as a
candidate at elections to the
European Parliament in the
Member State, in which he or she
resides, under the same conditions
as nationals of that State.

60%
50%
49%

40%
30%

50%

38%

20%
10%

7%

0%
BE

BU

HU

NL

(Article 39 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand
as a candidate at elections to the European Parliament).
(http://www.europarl.europa.eu/charter/default_en.htm)

Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is
true?
Answer 1: "I have no right to vote in local elections."
Answer 2: "I have no right to stand in local elections."
Answer 3: "I have the right to vote and stand in local elections, but not to be elected as mayor."
Answer 4: "I have the right to vote and stand in local elections and even to be elected as mayor."

100%
80%
60%

72%

81%
66%
54%

40%
20%
0%
BE

BU


HU

NL

Explanation:
Every citizen of the Union has the
right to vote and to stand as a
candidate at municipal elections in
the Member State in which he or
she resides under the same
conditions as nationals of that
State. (Article 40 of the Charter of
Fundamental Rights of the
European Union - Right to vote and
to stand as a candidate at
municipal elections).

24

Question 5 - If a citizen of the European Union has a problem in a third country in which his
country has no consular service, he is entitled to:
Answer 1: go to a consular office where his native language is spoken
Answer 2: cry
Answer 3: contact the embassy or consulate of any European Union country
Answer 4: go to a consular office of a country which is close to his own one

Explanation:
Every citizen of the Union shall, in
100%
the territory of a third country in
which the Member State of which
80%
86%
84%
he or she is a national is not
77%
60%
represented, be entitled to
protection by the diplomatic or
40%
consular authorities of any
40%
20%
Member State, on the same
conditions as the nationals of that
0%
Member State.
BE
BU
HU
NL
(Article 46 of the Charter of
Fundamental Rights of the European Union - Diplomatic and consular protection).
(Http://www.europarl.europa.eu/charter/default_en.htm)


Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the:
Answer 1: Member State in question
Answer 2: person himself
Answer 3: European institutions
Answer 4: Member State and European institutions
Explanation:
The answer of the question
whether a person can acquire
citizenship of a Member State
depends entirely on the national
legislation of that Member State.

70%
60%
50%
40%
30%
20%
10%
0%

65%

36%
5%
BE

8%
BU


HU

NL

25

Question 7 - The right to petition the European Parliament:
Answer 1: belongs to all nations of the earth
Answer 2: belongs to every citizen and every resident in a Member State of the European Union
Answer 3: belongs to the large companies
Answer 4: belongs to God

88%
86%
84%
82%
80%
78%
76%
74%

87%

Explanation:
Any citizen of the European Union
and any person residing in a
Member State has the right to
petition the European Parliament.

83%
79%

BE

79%

BU

HU

NL

Question 8 - In the event of maladministration by the European Union institutions I have the right
to:
Answer 1: appeal to the U.S. Supreme Court
Answer 2: turn to the Belgian Embassy
Answer 3: stop paying my taxes
Answer 4: complain to the European Ombudsman

95%
93%

90%

90%
85%
85%
80%

83%

Explanation:
In case of maladministration by
European Union institutions (with
the exception of the Court of
Justice), citizens and residents of
the European Union are entitled to
complain to the European
Ombudsman.

75%
BE

BU


HU

NL

26

Conclusions quiz results
Conclusion

Bulgaria with 77% correct answers had the best score. The
Netherlands with 66% scored second, followed by Belgium with
62% and Hungary with 54%.
Some questions showed differences by country. I.e. The
Netherlands had a very low score on question 3 (only 7%) and also
for question 6 we see big differences for individual countries. An
explanation for this could not be found.

In an earlier stage, Open Youth carried out extensive awareness
campaigns on the European rights in Bulgaria. This was done in
2008 and in 2012. The results of these two campaigns were
compared with the results of UPDATE in 2013. The major
increase of correct answers compared with the results of the
earlier campaigns is remarkable. Annex G presents the
differences between the various campaigns by year.


27

Quiz results by gender
The avarage score on correct answers by gender show no dramatic differences. Both genders
scored with an avarage of 66%. This concludes that the level of knowledge on European rights is the
same for both females and males.

quiz results: female versus male
Correct answers in %

100%
80%
60%
female

40%

male
20%
0%
1

2

3

4

5

6

7

8

questions

Quiz results by age
By registering the age of the participants, a comparison can be made with the number of correct
answers within the age group. The relatively high score of the age group 12-17 years is remarcable.
With a correct score of 72% this group scored far better than all others. The remaining 3 groups
had almost the same score. Age group "18-20 years" has an average correct score of 64%, age
group "21-24 years" - 66% and age group "25-30 years" - 64%.

Correct answers in %

Quiz results by age
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%

12-17 yrs
18-20 yrs
21-24 yrs
25-30 yrs
1

2

3

4

5

6

7

8

the questions


28

questions
1
2
3
4
5
6
7
8
average

12-17 yrs
83%
90%
40%
68%
77%
55%
78%
84%
72%

18-20 yrs
61%
74%
37%
67%
69%
33%
83%
87%
64%

21-24 yrs
67%
77%
38%
70%
75%
26%
84%
90%
66%

25-30 yrs
68%
77%
34%
67%
72%
24%
83%
88%
64%

Conclusions results of the quiz
1) 2.845 quiz cards, all together with 22.760 queries,
were completed. 66% of the answers were correct.
Conclusion
2) Bulgaria had the highest score with 77% followed by the
Netherlands with 66%, Belgium with 62% and Hungary with 54%,
meaning that the youngsters European rights knowledge level is
reasonably high in the participating countries.
3) The question “Vote for and stand as candidate in European
Parliament and municipal elections” (no. 3) resulted in a low
score of correct answers of 33%.
4) Also the question “protection by the diplomatic and consular authorities of any other
EU country” (no. 6) seemed to be difficult. Only 33% gave a correct answer.
5) The two questions on the European Ombudsman (no. 7 and 8) scored the best with
respectively 82% end 87% correct answers.
6) Not much difference was encountered in the overall result between male and female
participants. Both had an average score of 66%
7) Remarkable in a positive way were the quiz results of the age group 12-17 years. This group
scored with 72% correct answers. The other age categories scored almost equal: 64% for the
age groups 18-20 years and 25-30 years and 66% for the age group 21-24 years.
8) Open Youth organised awareness campaigns in Bulgaria on this subject before and this
presumably explains the higher scores compared with the other 3 countries.
This proves that the knowledge of youngsters is increased by these campaigns.


29

7

RESULTS OF VISIBILITY AND DISSEMINATION

Event Number 7: Media relations
The project partners will list medias both on national as on local level in chosen cities for local
actions. Those will be contacted on regular basis to allow them to follow the development of the
project and its results.
Expected results: Publications in local and national media, 50.000 people reached through media
Event Number 9: Dissemination
The project result will be disseminated by the project partners throughout their various networks,
covering the whole European Union (e.g. the European Youth Forum for Road Safety, the INSIDE
network, the “Youth for Europe” online community of more than 3.000 active entities from all over
Europe). Each partner will also have a dedicated budget for developing a local Internet marketing
campaign, disseminating information about the comics for mobile devices.
Expected results: The project results are disseminated EU wide.

7.1 | The visibility of the project and the activities in the media
Press releases had been sent by the 4 partners to national and regional press during all actions. The
table below presents the number of media contact of each partner. The second table presents the
actual appearances in the media. With the experience that the partners have with the media, they
knew how to find the way inside the media organisations and how to make the project visible for
the public. Annex H presents a number of examples of published media content.
Number of media contacts
Local level
National level
575
188
0
0
0
0
26
29

Bulgaria
Belgium*
Hungary**
The Netherlands

* During one action Belgium received a vist of their Minister of Road Safety and Agriculture, Mr. Carlo di Antonio.
**Hungary did the final closing event of the project on December 16th, 2013 and gave a short presentation about the
results for the regional and local NGOs. A final article will be published in the February edition of their University Journal.

Bulgaria
Belgium
Hungary
The Netherlands

TV
7
0
0
1


Radio
14
0
0
1

Number and type of publiciations
Newspaper
News agencies
8
7
0
0
0
0
10
0

Internet
77
0
0
16

30

Participants by media
A calculation is made for the number of individuals that
encountered an appearance or broadcast about the UPDATE
project. In our context these are named indirect participants.
Bulgaria made a detailed calculation on the indirect outreach of
people through media coverage. Only in Bulgaria this resulted in
an indirect reach of 1.478.332 people. This calculation is based
on reported audience by the diffent media and does not account
for any possible overlap.
The Netherlands also made a calculation of the media based on
the total number of inhabitants as well as the various reaches per
individual utterance. This resulted in a reach through the media of
242.000 indirect participants.

In Bulgaria

1.478.332
indirect participants
by media!

In The Netherlands

242.000
indirect participants
by media!

7.2 | The visibility of the project and the activities by the general public
The project went extremely well for the visibility under a big group of spectators. The big booth used
during the actions already draws public attention. Also the distribution of the information cards
about the European rights contributed to good visibility and spreading out information to the public.
The voluntear teams are trained to address big groups of public at big events in which many
youngsters participate. After completing the quiz card each participant received a comic book to
take home. The after effect of distributing the information card and the comic book unfortunately is
hard to measure, but must be a multiple of the total distributed materials (24.320 information cards
and 2.552 comic books).

7.3 | The online visibility
Although all performance indicators were met, the number of website visitors was below the
expectations. 1.900 people visited the website of which 531 people completed the quiz queries and
downloaded the comic book. From the total number of downloaded online applications, 406 were
done for Android. The Apple store does not provide download information for free apps, but the
UPDATE application received a user review of 4+.
In the period between March 12 and May 5, Bulgaria launched an internet marketing campaign using
2 facebook pages: Open Youth and Youth for Europe. By using this campaign, 14.537 people were
reached directly (i.e. interacted with the provided content) and 740.246 people were reached
indirectly (i.e. saw the content).


31

7.4 | The visibility of the project and the activities by the networks
The partners of UPDATE are part of big (inter)national networks and participate in multiple
international projects.
Project UPDATE was disseminated at the following conferences:

Name
Location & date
Number of participants

‘Traffic Police’ Media Seminar
Hisar (Bulgaria), 14 of june 2013
100 participants

Name
Location
Date

‘Speed Management’ Training Courses
Sofia, Veliko Tarnovo, Varna, Burgas, Plovdiv (Bulgaria)
26-30.08.2013
109 participants

Name
Location & date

‘Employability of Young People’ Conference at EESC, CCMI,
Brussels (Belgium) 22 of November 2013
150 participants

Name
Location & date
Number of media relations

European Youth Forum for Road Safety (EYFRS)
Crotone (Italy) 26, 27, 28 of November 2013
100 participants a day
50 local journalists, 5 local TV stations, 1 national TV station

Name
Location & date
Reason

Bulgarian Forum for Road Safety
Sofia (Bulgaria) / 04th of December 2013
UPDATE press-conference
114 participants

Conclusion visibility
The ultimate goal was to reach 100.000 people, from which 50.000 through direct media and 50.000
through online media. The UPDATE project reached in total:
Medium and products
2.552 comic books
Quiz Cards
Information Cards
Online web and app
Media
Networks partners


Reach
2.552 direct participants
2.845 direct participants
1.720.322 indirect participants
Unkown

32

8

PROCESS EVALUATION

8.1 | Event Number 8: Evaluation
The project envisages the implementation of an integrated evaluation system foreseeing an
INTERNAL EVALUATION (progress evaluation) + AN EXTERNAL EVALUATION (final evaluation) whose
objectives are:
- to analyze the level of implementation of the working programme at each stage;
- to verify the achievements that could affect the implementation of each subsequent activity;
- to collect information about the effectiveness of the work in each partner’s context.
Expected results

Evaluation report for the project achievements; project manual, describing the
project process; statistical report on the data, collected from 2 400 quiz cards,
giving information on the concrete knowledge of the ordinary citizens about their
European rights.
Another evaluation will be done on the experience of the involved volunteers.
The evaluation will be subcontracted to an experienced external evaluator who
will also participate at the preparation and evaluation meetings.

The chapters 4 and 5 outlined the external evaluation. This chapter will deal with the
internal evaluation, the process evaluation of the project UPDATE.
On a periodic basis all partners were asked to complete an evaluation form to collect the needed
data for the process evaluation. All answered questions are assembled in evaluation form EVA4
(Annex D). Finally the process of the project UPDATE was discussed and evaluated during the Final
Meeting in Sofia (BG) between all partners. Annex I presents the results of the process evaluation.
This chapter presents the conclusions of these 2 evaluations.
The process evaluation is presented in 4 paragraphs:
1) Project management
2) Meetings of the project team
3) Development of the used material
4) Organisatiion of the local actions
On the evaluation form the partners could give their judgement about a subject on a scale of 0 to 5
(Very bad 0-1-2-3-4-5 Excellent) about a subject. This judgement is used in the process evaluation.


33

8.2 | Proces evaluation of the Project management
The description of the task for process management is as follows:
The project will be coordinated and managed internationally by Open Youth in its capacity as leading
partner. The project coordinator plays a strategic role in meeting the objectives that have been set
and in achieving results which can be useful and transferable at a European level.
1. The coordinator will be in charge of managing the relationships with EACEA .
2. The other project partners will be actively involved in this work package. Each will appoint a
person, who will be responsible.
Expected results

Sound project management process allowing all activities to be implemented as
foreseen and the aims to be achieved; activities and financial reports.

Open Youth performed its job very well and reached an avarage score of 4.7 on this item.
The information about the project itself, as well as the involvement of the partners, the task
balancing between the partners and the goals of achievement have been expierenced as positive and
clear.
Also the information about how to organise local actions and the method of reporting the results
was clear. A strong advantage for this was that the partners are well known with the awareness
campaigns for youngsters and also cooperate together within other projects. The effect of this is a
flexible running process and a efficient performing of tasks by each partner.

8.3 | Proces evaluation of the project team meetings
Within the project 3 team meetings were held.
Preparation Meeting in Brussel
24-26.09.2012
Training for the trainers in Amsterdam
15.03.2013
Final Meeting in Sofia
03-04.12.2013
Thanks to the project management these meetings were organised within the established time
table and the proposed results were met.
In the preparation meeting, the project partners will discuss and develop the project strategy in
details, including information materials, project logic, defining the locations for the local actions,
recruitment of local youth volunteers.
After the training for the trainers meeting each partner will have a well prepared trainer who will be
responsible for training a team of volunteers for the implementation of each local actions in the
different partner's settings.
At the end of the project the participants will meet to discuss the project achievements. They will do
analysis of project development, discussion of project results, evaluation of project communication
activities, instructions for final report (activities and financial), discussion of future project
development. A press conference will be organized to inform the media about the project results.
The Preparation meeting in Brussels reached a score of 4.35 where the Train the trainers meeting
reached a score of 4.7. This means that the information about the development of the needed
material was accomplished very well both at project and partner level. Each partner wrote its own
EU story and all these were united in the comic book.


34

The Training for trainers meeting in Amsterdam was also successful. The partners were already well
experienced in training volunteers in a way that actions could get performed well. For this reason
the Training for the trainers meeting had been run efficiently and fast.
The Final meeting in Sofia also went well. During this meeting the partners shared and evaluated
their experiences within the local actions. On the second day of the Final meeting Open Youth
organised a press conference. The results of this press conference is presented in chapter 7.

8.4 | Process evaluation of the development of the used material
Development of the material to be used by the project was done well and all was realised well
before the start of the first pilot actions. On local level all partners have developed their material and
produced it with the branding of the project.
The material used by the project received a high avarage score of 4.3 from which the comic book
unanimous scored 5.
Also the booth used by the actions had a very high avarage score of 4.75 and the avarage score of
4.0 for the “Appstore application comic book” is remarkable, too. In general all the project material
was received very positive by the partners.

8.5 | Proces evaluation of the organising of the local actions
Organising a pilot action and 3 local actions are described in Event Numbers 5 and 6
Event Number 5: A pilot action will be organized by each partner in order to test the developed
method and products. Each of them will be for three days - an orientation one, a training for at least
5 local youth volunteers, enabling them to successfully implement the next day action, and the local
action itself, implemented by the volunteers, supported by the trainer and the country project
manager. Each action has to attract at least 150 people to complete the interactive quiz.
Event Number 6: Taking into account the result from the pilot action and implementing changes
where necessary, each partner will have to implement three more actions, using the developed in
Event 5 approach.
All partners of project UPDATE are well experienced in organising awareness campaigns and
actions for youngsters. They can make use of many contacts and networks to choose, organise and
realise local actions by trained volunteers.
The quantitative data is presented in chapter 5 and, effectively, is higher than the pre-defined
performance indicators. This part of the project was run without any problems by all partners who
gave an avarage score of 4.5 for this process.


35

9

CONCLUSIONS AND RECOMMENDATIONS

General conclusions
The project UPDATE was finalised successful. The quantitative
indicators were widely met. Development of information and
Conclusion
communication materials was done in accordance with the agreements
and the plan of action.
For the local actions all materials like the web site, the comic book, the
information cards, the quiz cards, the booth, the T-shirts and pens were
prepared and ready to use on time. Also the online versions of the
comic book were developed on time and in accordance with the plan of action.
The project trained 105 volunteers for realising the 23 local actions. During these local actions 2.845
quiz cards were completed and 24.320 information cards distributed.
The specially developed comic book and the connected online applications addressed the young
target group very well. The great experience of the participating partners concluded in a successful
realisation of the project UPDATE, within the given time frame and meeting the predefined targets.

Specific conclusions about European Rights
The aim of the UPDATE project was to explain the fundamental European rights to the youngsters.
This explanation was realised by using a specially developed comic book offline with a real book and
online using special apps. In this way the maximum possible number of youngsters was reached.
Since many awareness actions for road safety target the aimed group of youngsters < 30 years, a
combination with these awareness campaigns was often made by the project UPDATE.
Both the volunteers and the participants were questioned about their knowledge on European
rights. The most interesting conclusions on the knowledge on European rights of the volunteers is as
follows:
1) 77% of the volunteers have never used their EU rights, but 96% think that they will need
them in the future;
2) On a scale of 0 to 5 they evaluate their knowledge of EU rights at 3 before training and at 4
after it;
3) On a scale of 1 to 5 they evaluate the knowledge of the young project participants about
their European rights at 2.4 before the respective campaign and at 3.7 after it;
4) 89% of the volunteers were satisfied with the actions of the awareness campaign.
From the completed quiz cards by the 2.845 young participants the following conclusions can
be drawn:
1) The total proportion of given correct answer is 66%;
2) There is no gender difference, the proportions of correct answers given by boys and girls
was 66%;
3) Most correct answers are given by the youngest participants, aged 12 to 17 years: 72%;
4) The Bulgarian participants had the greatest knowledge on the European rights: They scored
77% correct answers, with the Dutch scoring 66%, the Belgiums scoring 62% and the
Hungarians scoring 54%.
5) The score about the freedom of movement in the European Union (question 1) was very
high, although Hungary had a relatively low score of 31% correct answers on this topic.

36

6) Also 77% of the youngsters is aware of the need of a valid ID card or passport while travelling
to another European Union country for i.e. holidays (question 2)
7) The question “Vote and stand as candidate in the European Parliament” is more complex.
33% correct answers were given to this question (no. 3).
8) 68% of the youngsters are aware that they have the right to vote at local elections and also
that they can stand for mayor in the place where they live, independently their nationality
(question no. 4)
9) Question 5 “Protection by the diplomatic and consular authorities” was more complex,
this query had an average score of 33% correct answers.
10) The question about the European Parliament had a correct score of 82% (question 7).
11) The youngsters showed to be well informed about the European Ombudsman. This
question received a score of 88% correct answers (question 8).

Recommendations
1) The project UPDATE was very successful which was caused by both the big experience and
great networks of the partners within the project. The partners are also experienced in
training and working with volunteers inside a project, organising awareness campaigns and
with communicating with and informing youngsters.
2) Cooperation between the partners was very good (this scored high in the process
evaluation). Having worked together before in various projects eased helping and
approaching each other.
3) The general knowledge about the European rights of the young participants is relatively
high. The average score was 66% correct answers.
4) Open Youth already conducted 2 awareness campaigns in Bulgaria in 2008 and 2012 and
from the results one can clearly see that the knowledge of the European rights strongly
increased. Bulgaria finished in the total results as the country with the best results.
5) A conclusion can be drawn that an awareness campaign, such as the one realised by
project UPDATE, is useful and successful and that the knowledge on the European rights
increased for the target group.


37

ANNEXES
UPDATE PROJECT
ANNEXES

A. Update Material Counting (EVA1)
B. Form to filled after the action by volunteers (EVA2)
C. Form to be filled after the action by coordinator of the volunteer
(EVA3)
D. Process evaluation (EVA 4)
E. Evaluation of the volunteers
F. Quiz questions
G. Quiz results Bulgaria 2008-2012-2013
H. Examples of statements in the media
I. Results Process Evaluation (EVA4)


38

Annex A: Update Material Counting (EVA1)

EVA 1. Form to be filled before and after the action
Date :

Country:

Place:

Time :

Material UPDATE
Comic books

Quiz
cards

Information cards

pens

Number
before the
action (a)
Number after
the action (b)
Number
distributed (c)
(c) = (a) – (b)
On average 150 people per action to complete the interactive quiz


39

Annex B: Form to filled after the action by volunteers (EVA2)

EVA2. Form to be filled after the action
by the VOLUNTEERS

Date :

Country:

Name of the Volunteer
Age of the volunteer
Identity
Your Coordinator on the action
Your number off action

1

2

3

Place:

 student

 employed

Time :

 unemployed

 first  second  third  fourth  fifth

Your knowledge about EU
rights before the training

Negative 0___1___2___3___4___5 Positive

Your knowledge about EU
rights after the training


4

Do you find the knowledge
about the EU right
important?
If yes, why?

5

If no, why not?

6

Have you ever needed the
EU rights?
Do you think you ever need
the EU rights?
Do you find this awareness
campaign about EU rights
useful?
How many participants /
visitors did you talk to
during the action today?
(on the average)

7
8

9


 yes  no
 yes  no
 yes  no

 less than 20
 between 20 & 50
 between 50 & 100
 more than 100

10 What was at you sense the  Get new information
most interesting part for  Do the quiz
the visitors you talked to?
 Get the comic book
 Others: .......................................

40

3

The knowledge about EU
right from the visitors
before the action (your
assumption)
4 The knowledge about EU
right from the visitors after
the action (your
assumption)
13 I recommend to change the
activities in part
14



 yes  no

If YES, what changes do you  the given information
have in mind:
 the tools
 the approach of the visitors
 others: ..................................

15 Which part of the project  the contacts with visitors/youngsters
was for you personally most  learning about EU rights
of interest?
 the team of volunteers
 the training
 the tools
 others: ..................................


41

Annex C: Form to be filled after the action by coordinator (EVA3)

EVA3. Form to be filled after the action
by coordinator off the volunteers

Date :

Country:

Place:

Time :

profile youngsters: peer-to-peer
Total Male
Total female
Total yougsters < 30

material update
Total comics
Total information cards
Total quiz cards
Total pens

knowledge about EU rights
Youngsters
General knowledge:


volunteers
General knowledge:

42

Annex D: Process evaluation (EVA 4)

EVA4. Process evaluation update
to be filled in by the country project manager
Name of the evaluator
Name of the organisation
Date

Project Management
Information about the project
Clear objectives
Achievable objectives
Information about local actions
Information about the reports
Partners actively involved by the project

Very bad
Very bad
Very bad
Very bad
Very bad
Very bad

0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5

Excellent
Excellent
Excellent
Excellent
Excellent
Excellent

Start Up Meeting Brussel (24-26.09.2013)
Clear project strategy
Information about develop material
Information about develop comic book/story
Information about local actions
Information about recruitment local volunteers

Very bad
Very bad
Very bad
Very bad
Very bad

0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5

Excellent
Excellent
Excellent
Excellent
Excellent

Training for the trainers Amsterdam (15.03.2013)
Instructions about the training local volunteers
Instructions about communicating young people
Instructions about working with the interactive quizzes
Instructions about the administration of the quizcard
Instructions about dissemination of the project material
Instructions about the collection of data

Very bad
Very bad
Very bad
Very bad
Very bad
Very bad

0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5

Excellent
Excellent
Excellent
Excellent
Excellent
Excellent

Very bad
Very bad
Very bad
Very bad
Very bad
Very bad
Very bad
Very bad

0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5

Excellent
Excellent
Excellent
Excellent
Excellent
Excellent
Excellent
Excellent

How would you rate the material (useful)
Website
Comic book
Informations cards
Interactive quizcards
Appstore comics applications
Pens
Projects shirts
Local stands


43

How would you rate the locale action organization &
visuals?
The preparation
The material used (the tools)
The visibility
The welcoming of the visitors
The involvement of the NGO
The location

Very bad
Very bad
Very bad
Very bad
Very bad
Very bad

0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5
0___1___2___3___4___5

Excellent
Excellent
Excellent
Excellent
Excellent
Excellent

Pilot & local actions
Number of trained volunteers
Number of successful actions
Number of participants on the interactive quiz
Other questions
Your knowledge about EU rights before the project


Your knowledge about EU rights after the project


Do you find this awareness campaign about European
rights is useful?
I recommend to change the activities in the project
If yes, what changes do you have in mind?

 yes  no

Media: were there publications in the local media about
Update?

If yes, wil you mail this to Daniel of Jetty


 yes  no

44

Annex E: Evaluation of the volunteers
EVALUATIONS OF THE VOLTUNEERS

Number of volunteers
Average age
Range of age
Student
(Un)employed
Knowledge volunteer before
training*
Knowledge volunteer after
training*
Knowledge important according
the volunteer*
Ever needed EU rights?
Need EU rights in the future?
Campaign EU rights useful?
Interest part for the visitor
according to the volunteer**

Knowledge visitor befor the action*
Knowledge visitor after the action*
Change activities awareness
campaign
Most interest part of the project
for the volunteer**

BE
24
22
21 - 29
66%
34%
2.5

NL
20
21
17-24
85%
15%
2.7

ALL
105
21
15 - 30
76%
23%
2.5

4

4

3.9

4

4.4

yes
no
contact visitor
learning EU rights
team volunteers
training
tools

HU
25
22,5
17 - 27
68%
32%
2.4

4.1

yes
no
yes
no
yes
no
new info
quiz
comic book
other

BU
36
20
15 - 30
86%
14%
2.4

4.3

4.8

4.8

4.6

20%
80%
100%
0%
100%
0%
31%
28%
39%
2%
2.4
3.6
8%
92%
30%
16%
29%
19%
6%

3%
97%
97%
3%
97%
3%
40%
27%
31%
2%
2.5
3.8
14%
86%
22%
16%
25%
13%
24%

8%
92%
100%
0%
100%
0%
27%
38%
35%
0%
2.3
3.7
12%
88%
18%
11%
22%
25%
24%

15%
85%
100%
0%
100%
0%
32%
31%
37%
0%
2.5
3.7
10%
90%
31%
17%
40%
7%
5%

11,5%
99%
1%
99%
1%
33%
31%
35%
1%
2.4
3.7
11%
89%
25%
15%
29%
16%
15%

* negative 0__1__2__3___4__5 positive
** multiple answers possible


45

Annex F: Quiz questions

quiz to be filled during the action
Form to be filled for each group or person met
Date :

Country:

Place:

Time :

PROFILE YOUNG EU CITYZEN
Sex
Male: ......... Female: ..........
Total : ........

Age
 12-17
 Unknown

 18-20
 Various

 20-24

 25-30

INTERACTIVE QUIZ
1. MOVE AND RESIDE FREELY WITHIN THE EU
1.1 The term 'freedom of movement' in the European Union affects:
 A: altogether capital, goods, services and people
 B: only capital
 C: only services
 D: only goods
Explanation: The so-called "four freedoms" are freedom of movement of goods, services, capital and
people.
1.2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in
Germany?
 A: "He should apply for a visa at the German consulate."
 B: "He must ask permission from the municipality he lives in."
 C: "He must have a valid passport or identity card to be able to cross the border."
 D: "He must prove He has sufficient funds."
Explanation: For the need of border crossing, he must present his passport or ID card.


46

2. VOTE FOR AND STAND AS A CANDIDATE IN EUROPEAN PARLIAMENT AND MUNICIPAL
ELECTIONS
2.1 I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of
the following statements is true?
 A: "Unfortunately, I cannot stand for elections for members of the European parliament in
Bulgaria."
 B: "I can stand for European parliament elections in Bulgaria if I have permission from the
Spanish Embassy."
 C: "I can run for the next European parliament elections in Bulgaria after 10 years."
 D: "I can run for the next European parliament elections in Bulgaria."
Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections
to the European Parliament in the Member State, in which he or she resides, under the same
conditions as nationals of that State. Article 39 of the Charter of Fundamental Rights of the European
Union
2.2 Which of the following statements of Bulgarian citizens living in a village in Germany is true?
 A: "I have no right to vote in local elections."
 B: "I have no right to stand in local elections."
 C: "I have the right to vote and stand in local elections, but not to be elected as mayor."
 D: "I have the right to vote and stand in local elections and even to be elected as mayor."
Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal
elections in the Member State in which he or she resides under the same conditions as nationals of
that State. Article 40 of the Charter of Fundamental Rights of the European Union

3. BE PROTECTED BY THE DIPLOMATIC AND CONSULAR AUTHORITIES OF ANY OTHER EU COUNTRY
3.1 If a citizen of the European Union has a problem in a third country in which his country has no
consular service, he is entitled to:
 A: go to a consular office of a country which is close to his own one
 B: cry
 C: contact the embassy or consulate of any European Union country
 D: go to a consular office where his native language is spoken
Explanation: Every citizen of the Union shall, in the territory of a third country in which the Member
State of which he or she is a national is not represented, be entitled to protection by the diplomatic
or consular authorities of any Member State, on the same conditions as the nationals of that
Member State. Article 46 of the Charter of Fundamental Rights of the European Union
3.2 Acquisition of citizenship of a Member State of the European Union depends on the:
 A: Member State in question
 B: person himself
 C: European institutions
 D: Member State and European institutions
Explanation: The answer of the question whether a person can acquire citizenship of a Member State
depends entirely on the national legislation of that Member State.


47

4. PETITION THE EUROPEAN PARLIAMENT AND COMPLAIN TO THE EUROPEAN OMBUDSMAN.
4.1 - The right to petition the European Parliament:
 A: belongs to all nations of the earth
 B: belongs to every citizen and every resident in a Member State of the European Union
 C: belongs to the large companies
 D: belongs to God
Explanation: Any citizen of the European Union and any person residing in a Member State has the
right to petition the European Parliament.
4.2 - In the event of maladministration by the European Union institutions I have the right to:






A:
B:
C:
D:

appeal to the U.S. Supreme Court
turn to the Belgian Embassy
stop paying my taxes
complain to the European Ombudsman

Explanation: In case of maladministration by the and European Union institutions (with the exception
of the Court of Justice), citizens and residents of the European Union are entitled to complain to the
European Ombudsman.


48

Annex G: Quiz results Bulgaria 2008-2012-2013
Question 1 - The term "freedom of movement" in the European Union affects:
Answer 1:
Answer 2:
Answer 3:
Answer 4:

100
90
80
70
60
50
40
30
20
10
0

altogether capital, goods, services and people
only capital
only services
only goods
96
85

Explanation: The so-called
"four freedoms" are
freedom of movement of
goods, services, capital
and people.

89

7

Answer 1

1

4

3

Answer 2
2008

1

5

Answer 3
2012

4

2

3

Answer 4

2013

Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in
Germany?
Answer 1: "He should apply for a visa at the German consulate."
Answer 2: "He must ask permission from the municipality he lives in."
Answer 3: "He must have a valid passport or identity card to be able to cross the border."
Answer 4: "He must prove He has sufficient funds."
Explanation: For the need
of border crossing, he
must present his passport
or ID card.

94 92

100
69

80
60
40

17
20

7

2

1

7

2

3

2

4

0
Answer 1

Answer 2
2008


Answer 3
2012

Answer 4

2013

49

Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament,
which of the following statements is true?
Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in
Bulgaria."
Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the
Spanish Embassy."
Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years."
Answer 4: "I can run for the next European parliament elections in Bulgaria."
Explanation: Every citizen
of the Union has the right
46
50
to vote and to stand as a
45
39
candidate at elections to
40
the European Parliament
35
27
in the Member State, in
30
24
23
20
25
which he or she resides,
19
18
17
20
under the same
11
15
conditions as nationals of
7
10
that State.
5
(Article 39 of the Charter
0
of Fundamental Rights of
Answer 1
Answer 2
Answer 3
Answer 4
the European Union 2008
2012
2013
Right to vote and to stand
as a candidate at elections
to the European Parliament). (http://www.europarl.europa.eu/charter/default_en.htm)
49

Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is
true?
Answer 1:
Answer 2:
Answer 3:
Answer 4:

"I have no right to vote in local elections."
"I have no right to stand in local elections."
"I have the right to vote and stand in local elections, but not to be elected as mayor."
"I have the right to vote and stand in local elections and even to be elected as mayor."
66

70
60

47

50
40
30
20

38
27
19
13

24
16 16 16

9

9

10
0
Answer 1

Answer 2
2008

Answer 3
2012

2013

Answer 4

of the Union has the right
to vote and to stand as a
candidate at municipal
elections in the Member
State in which he or she
resides under the same
conditions as nationals of
that State.
(Article 40 of the Charter
of Fundamental Rights of
the European Union Right to vote and to stand
as a candidate at

municipal elections).

50

Question 5 - If a citizen of the European Union has a problem in a third country in which his
country has no consular service, he is entitled to:
Answer 1: cry
Answer 2: go to a consular office where his native language is spoken
Answer 3: go to a consular office of a country which is close to his own one
Answer 4: contact the embassy or consulate of any European Union country
of the Union shall, in the
89
100
84
territory of a third country
73
80
in which the Member
State of which he or she is
60
a national is not
40
represented, be entitled
14
9
to protection by the
7 6
20
4 1 5
3 5
diplomatic or consular
0
authorities of any
Answer 1
Answer 2
Answer 3
Answer 4
Member State, on the
same conditions as the
2008
2012
2013
nationals of that Member
State. (Article 46 of the Charter of Fundamental Rights of the European Union - Diplomatic and
consular protection).
(Http://www.europarl.europa.eu/charter/default_en.htm)

Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the:
Answer 1:
Answer 2:
Answer 3:
Answer 4:

Member State in question
person himself
European institutions
Member State and European institutions

65

70
52

60
50

41

40 40

40
24

30
20

9

4

10

10

6

4

Explanation: The answer
of the question whether a
person can acquire
citizenship of a Member
State depends entirely on
the national legislation of
that Member State.

5

0
Answer 1

Answer 2
2008


Answer 3
2012

Answer 4

2013

51

Question 7 - The right to petition the European Parliament:
Answer 1:
Answer 2:
Answer 3:
Answer 4:

belongs to all nations of the earth
belongs to every citizen and every resident in a Member State of the European Union
belongs to the large companies
belongs to God

89

100

Explanation: Any citizen
of the European Union
and any person residing in
a Member State has the
right to petition the
European Parliament.

83

72

80
60
40

16

9

20

7

4

5

6

3

2

4

0
Answer 1

Answer 2
2008

Answer 3
2012

Answer 4

2013

Question 8 - In the event of maladministration by the European Union institutions I have the right
to:
Answer 1:
Answer 2:
Answer 3:
Answer 4:

appeal to the U.S. Supreme Court
turn to the Belgian Embassy
stop paying my taxes
complain to the European Ombudsman
89

90

85

75

80
70
60
50
40
30

17

20
10

3

4

5

4

7

5

2

4

Explanation: In case of
maladministration by the
an European Union
institutions (with the
exception of the Court of
Justice), citizens and
residents of the European
Union are entitled to
complain to the European
Ombudsman.

0
Answer 1

Answer 2
2008


Answer 3
2012

Answer 4

2013

52

Annex H: Examples of statements in the media

Newspaper: Local action in Franeker,
The Netherlands, 30.07.2013

Newspaper: Local action Pleven
Bulgaria, 20.09.2013

Website
Local action Blagoevgrad
Bulgaria 22-23.04.2013

Website
Local action Vratsa
Bulgaria 07-08.05.2013


53

Local action
Hungaria


54

Annex I: Results Process Evaluation (EVA4)
EVA 4 Process evaluation Update
Project Management
Information about the project
Clear objectives
Achievable objectives
Info about local actions
Info about the reports
Partners actively involved by the project

BE
5
5
5
4
5
5

BU
5
5
5
5
5
5

HU
5
5
4
4
4
5

NL
5
5
4
4
4
5

average
5
5
4,5
4,25
4,5
5

Start Up Meeting Brussel
Clear project strategy
Info about develop material
Info about develop comic book story
Info abtou local actions
Info about recruitment local volunteers

5
5
5
4
4

5
5
5
5
5

4
3
3
4
4

4
5
4
4
4

4,5
4,5
4,25
4,25
4,25

Training for the trainers Amsterdam
Instructions about the training local volunteers
Instructions about communicating young people
Instructions about working with the interactive quiz
Instructions about the administration of the quizcards
Instructions about dissemination of the quizcard
Instructions about the collection of data

4
5
5
5
5
5

5
5
5
5
5
5

5
5
4
5
4
5

4
4
5
5
4
4

4,5
4,75
4,75
5
4,5
4,75

How would you rate the material (useful)
Website
Comic book
Information card
Interactive quiz card
AppStore comics applications
Pens
Project shirt
Local stands

4
5
4
4
5
4
4
5

4
5
5
5
4
4
3
5

5
5
4
5
4
5
3
4

3
5
4
4
3
5
5
5

4
5
4,25
4,5
4
4,5
3,75
4,75

How would you rate the actions organisation & visuals
The preparation
The material used (the tools)
The visibility
The welcoming of the visitors
The involvement of the NGO
The location

4
4
4
5
5
5

5
5
5
5
5
4

4
5
5
4
4
4

4
5
4
5
5
4

4,25
4,75
4,5
4,75
4,75
4,25

4
5
yes
no

5
5
yes
no

3
4
yes
no

1
5
yes
no

3,25
4,75
100% yes
100% no

Other questions
Your knowledge about EU rights before the project
Your knowledge about EU rights after the project
Do you find this awareness campaign useful
I recommend to change the activities in the project


55

Project
Title
Commissioned by
Author and external evaluator
Translator
Date

UPDATE
Project Manager Update, Mr. Daniel Vankov
LL.M Jetty de Vries, Workum, The Netherlands
jetty@vriestyle.com
Mr. Eric Mehlbaum
07.01.2014

Final evaluation report update

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (14)

Ähnlich wie Final evaluation report update

Ähnlich wie Final evaluation report update (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Final evaluation report update