Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Predicting Time Periiods of Excessive Price Volatility: The Case of Rice- Ramon Clarete and Alfonso Labao
1. Predicting Time Periods of Excessive Price Volatility:
The Case of Rice
Dr. Ramon Clarete Alfonso Labao
University of the Philippines, School of Economics
September 25, 2013
5. Overview:
Importance of being forewarned of extreme food price-volatility:
provides time to undertake cooperation
prevent herding and self-fulfilling crises
avoid repetition of 2008 rice crisis
prevent welfare costs for the poor
6. Overview:
Importance of being forewarned of extreme food price-volatility:
provides time to undertake cooperation
prevent herding and self-fulfilling crises
avoid repetition of 2008 rice crisis
prevent welfare costs for the poor
G20 report stresses importance of accurate and timely market information
22. Methodology:
MTY’s Two-step method:
Construct a nonparametric trend via spline-backfitted-kernel:
rt = m0 +
d
a=1
ma(Xta) + (h0 +
d
a=1
ha(Xta)1/2
) t
Estimate the high-order 95 percent quantile via Generalized Pareto Distribution (GPD):
ˆqt(α) = ˆk+1 +
ˆβt
ˆγt
((
(1 − α)
(k/N)
)−ˆγt
− 1)
23. Methodology:
MTY’s Two-step method:
Construct a nonparametric trend via spline-backfitted-kernel:
rt = m0 +
d
a=1
ma(Xta) + (h0 +
d
a=1
ha(Xta)1/2
) t
Estimate the high-order 95 percent quantile via Generalized Pareto Distribution (GPD):
ˆqt(α) = ˆk+1 +
ˆβt
ˆγt
((
(1 − α)
(k/N)
)−ˆγt
− 1)
Estimated 95 percent Conditional Quantiles:
ˆqt(α/rt−1, rt−2) = ˜m(rt−1, rt−2) + [(˜h(rt−1, rt−2))1/2
ˆqt(α)]
24. How are Time Periods of Excessive Price Volatility (EPV) defined?
25. How are Time Periods of Excessive Price Volatility (EPV) defined?
Martins-Filho, Maximo Torero and Feng Yao’s definition of time periods of EPV:
EPV Definition:
Time-Periods whereby the preceding 60 days experienced a significantly high amount
of extreme positive price returns over the 95 percent conditional quantile.
26. How are Time Periods of Excessive Price Volatility (EPV) defined?
Martins-Filho, Maximo Torero and Feng Yao’s definition of time periods of EPV:
EPV Definition:
Time-Periods whereby the preceding 60 days experienced a significantly high amount
of extreme positive price returns over the 95 percent conditional quantile.
... at least 7 instances of extreme positive price returns within a span of 60 days
27. 1st (Jul 1993 - Feb 1994) and 2nd (Jul 1994 - Oct 1994) EPV cluster:
28. 1st (Jul 1993 - Feb 1994) and 2nd (Jul 1994 - Oct 1994) EPV cluster:
3rd (Mar 1999 - Sep 1999) and 4th (Jun 2001 - Aug 2001) EPV cluster:
29. 5th (Jul 2002 - Aug 2002) and 6th (May 2003 - Oct 2003) EPV cluster:
30. 5th (Jul 2002 - Aug 2002) and 6th (May 2003 - Oct 2003) EPV cluster:
7th (Mar 2008 - Nov 2008) and 8th (Apr 2009 - May 2009) EPV cluster:
47. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
48. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
Window of Observation
49. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
Window of Observation
Lower-Order Quantile Level
50. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
Window of Observation
Lower-Order Quantile Level
Frequency of Breach
51. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
Window of Observation
Lower-Order Quantile Level
Frequency of Breach
Scope
52. Next Task: Looking for a Good Early Warning Signal
Parameters of the Early Warning Signals:
Window of Observation
Lower-Order Quantile Level
Frequency of Breach
Scope
Together, these parameters generate a time-based variable, namely...
53. Next Task: Looking for a Good Early Warning Signal
... the scope’s time-coverage
55. What makes a good early warning signal:
accurate: scope’s time-coverage covers an EPV cluster, minimal false alarms
56. What makes a good early warning signal:
accurate: scope’s time-coverage covers an EPV cluster, minimal false alarms
good lead time: there’s reasonable lead time before EPV cluster
57. What makes a good early warning signal:
accurate: scope’s time-coverage covers an EPV cluster, minimal false alarms
good lead time: there’s reasonable lead time before EPV cluster
comprehensive: signals pre-empt almost all EPV clusters
58. What makes a good early warning signal:
accurate: scope’s time-coverage covers an EPV cluster, minimal false alarms
good lead time: there’s reasonable lead time before EPV cluster
comprehensive: signals pre-empt almost all EPV clusters
Basically...
We create a new set of trends (using spbk) and solve for parameters that meet above
requirements
59. We expressed the criteria (accurate, comprehensive, good lead time), into a single
additive objective function that can be minimized:
Objective Function for Minimization:
f (X) = [(
count1
laghvp
) ∗ 1.35] + [
count2
hvp
] + [(accuracy) ∗ 1.35]+
[(
totalews
totaldays
) ∗ 1.25] + [
totalscope
totaldays
]
60. We expressed the criteria (accurate, comprehensive, good lead time), into a single
additive objective function that can be minimized:
Objective Function for Minimization:
f (X) = [(
count1
laghvp
) ∗ 1.35] + [
count2
hvp
] + [(accuracy) ∗ 1.35]+
[(
totalews
totaldays
) ∗ 1.25] + [
totalscope
totaldays
]
Where:
count1: total no. of lagged mirror-images of time periods of EPV not covered by
the scopes of the signals
laghvp: total no. of lagged mirror-images of time periods of EPV
count2: total no. of actual time periods of EPV not covered by the scopes’
time-coverage of the early warning signals
hvp: total no. of actual time periods of EPV
accuracy: predictive accuracy of the early warning signal with following ratio:
[1-((no.of high.vol.periods captured by scope’s time-coverage) / (hvp)].
total ews: total no. of early warning signals
total scope: total no. of days covered by the scopes’ time-coverage of the early
warning signals
total days: total no. of days within the sample timeframe (1991 to 2013): 5407
future days
61. We expressed the criteria (accurate, comprehensive, good lead time), into a single
additive objective function that can be minimized:
Objective Function for Minimization:
f (X) = [(
count1
laghvp
) ∗ 1.35] + [
count2
hvp
] + [(accuracy) ∗ 1.35]+
[(
totalews
totaldays
) ∗ 1.25] + [
totalscope
totaldays
]
62. We expressed the criteria (accurate, comprehensive, good lead time), into a single
additive objective function that can be minimized:
Objective Function for Minimization:
f (X) = [(
count1
laghvp
) ∗ 1.35] + [
count2
hvp
] + [(accuracy) ∗ 1.35]+
[(
totalews
totaldays
) ∗ 1.25] + [
totalscope
totaldays
]
First two (2) terms - optimize good lead-time and comprehensiveness
63. We expressed the criteria (accurate, comprehensive, good lead time), into a single
additive objective function that can be minimized:
Objective Function for Minimization:
f (X) = [(
count1
laghvp
) ∗ 1.35] + [
count2
hvp
] + [(accuracy) ∗ 1.35]+
[(
totalews
totaldays
) ∗ 1.25] + [
totalscope
totaldays
]
First two (2) terms - optimize good lead-time and comprehensiveness
Last three (3) terms - minimize false alarms and improve accuracy.
64. We use R’s PSO package to minimize the objective function...
65. We use R’s PSO package to minimize the objective function...
PSO: Particle Swarm Optimization
PSO is a meta-heuristic designed for functions that are hard to optimize using
traditional optimization procedures (due to several peaks, non-linearities, long-forms,
etc..)
66. We use R’s PSO package to minimize the objective function...
PSO: Particle Swarm Optimization
PSO is a meta-heuristic designed for functions that are hard to optimize using
traditional optimization procedures (due to several peaks, non-linearities, long-forms,
etc..)
PSO Parameter Search Range:
67. We use R’s PSO package to minimize the objective function...
PSO: Particle Swarm Optimization
PSO is a meta-heuristic designed for functions that are hard to optimize using
traditional optimization procedures (due to several peaks, non-linearities, long-forms,
etc..)
PSO Parameter Search Range:
Window of Observation: from 1 to 40 future days
Quantile Level: from 50 percent to 99 percent quantile
Frequency of Breach: from 1 to 5
Scope of Early Warning Signal: from 60 to 250 future days
69. After 1000 iterations, we obtain the following optimal solution:
Optimal Solution:
Window of Observation: 11.61 future days
Quantile Level: 91.31 percent
Frequency of Breach: 4.18
Scope of Early Warning Signal: 107.06 future days
70. After 1000 iterations, we obtain the following optimal solution:
Optimal Solution:
Window of Observation: 11.61 future days
Quantile Level: 91.31 percent
Frequency of Breach: 4.18
Scope of Early Warning Signal: 107.06 future days
Given these parameters, an early warning signal will be activated...
71. After 1000 iterations, we obtain the following optimal solution:
Optimal Solution:
Window of Observation: 11.61 future days
Quantile Level: 91.31 percent
Frequency of Breach: 4.18
Scope of Early Warning Signal: 107.06 future days
Given these parameters, an early warning signal will be activated...
... once the 91.31 percent conditional quantile is breached five (5) times within
11.61 future days..
73. Just a review...
What makes a good early warning signal:
accurate: scope’s time-coverage covers an EPV cluster, minimal false alarms
good lead time: there’s reasonable lead time before EPV cluster
comprehensive: signals pre-empt almost all EPV clusters
75. We obtain these Performance Statistics:
accuracy of ews: 94.44 percent predictive power
comprehensiveness: 99.40 percent of time periods of EPV are covered
lead-time before EPV cluster: average of 43 days from the earliest signal to start of
high-volatility time-period
76. Below is a summary of the different EPV clusters and the lead-times of the ews:
77. Below is a summary of the different EPV clusters and the lead-times of the ews:
Total of 125 early warning signals activated from Sep 1991 to Mar 2013.
78. Below is a summary of the different EPV clusters and the lead-times of the ews:
Total of 125 early warning signals activated from Sep 1991 to Mar 2013.
This is only 2.3 percent of the time.
79. Below is a summary of the different EPV clusters and the lead-times of the ews:
Average of 43 days between earliest ews and start of an EPV cluster
80. Below is a summary of the different EPV clusters and the lead-times of the ews:
Average of 43 days between earliest ews and start of an EPV cluster
But among the four (4) severe EPV clusters, there is an average lead-time of 61
days
81. Below is a summary of the different EPV clusters and the lead-times of the ews:
Average of 43 days between earliest ews and start of an EPV cluster
But among the four (4) severe EPV clusters, there is an average lead-time of 61
days
The unflagged 2011 EPV cluster is not severe..
82. Below is a summary of the different EPV clusters and the lead-times of the ews:
Average of 43 days between earliest ews and start of an EPV cluster
But among the four (4) severe EPV clusters, there is an average lead-time of 61
days
The unflagged 2011 EPV cluster is not severe..
All EPV are sufficiently covered from beginning till end by the scopes of the
ews..