SlideShare a Scribd company logo
1 of 1
Download to read offline
Assume that a finite state continuous time Markov chain has a rate matrix that can be written in
block form (as was done in class) Q = where A describes the transition rates between transient
states and B describes the transition rates from transient to absorbing states. Also assume that the
row vector a is of the length of the transient states and includes the initial probabilities for each
of those states. Find the general formula for the mean of the time to absorption. Find the general
formula for the variance of the time to absorption. Now, assume for the set up of the previous
problem that you have the following specific matrices (you may want to use R for this part). (The
states are described by 0,1,2,3,4,5.) A = and B = Give the mean value of the time to absorption
if you are twice as likely to start in state one than in either state zero or state two. Given that you
start in state 1, what is the probability of being absorbed in state 4? What is the probability of
being absorbed in state 5 if you have the initial values described in the previously described in
(a).
Solution
http://www.scopenvironment.org/downloadpubs/scope34/chapter6.html#t6.2 this
link has what is required for you to answer your homework! even other qstns! Hope ths helps..
Good luck for your final exam! :)

More Related Content

Similar to Assume that a finite state continuous time Markov chain has a rate ma.pdf

Volume_7_avrami
Volume_7_avramiVolume_7_avrami
Volume_7_avrami
John Obuch
 
129966864599036360[1]
129966864599036360[1]129966864599036360[1]
129966864599036360[1]
威華 王
 
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
Pourya Jafarzadeh
 
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
ArchiLab 7
 

Similar to Assume that a finite state continuous time Markov chain has a rate ma.pdf (20)

Discrete state space model 9th &10th lecture
Discrete  state space model   9th  &10th  lectureDiscrete  state space model   9th  &10th  lecture
Discrete state space model 9th &10th lecture
 
CFDSCFINAL_2014
CFDSCFINAL_2014CFDSCFINAL_2014
CFDSCFINAL_2014
 
Hadronic1z 1
Hadronic1z  1 Hadronic1z  1
Hadronic1z 1
 
Volume_7_avrami
Volume_7_avramiVolume_7_avrami
Volume_7_avrami
 
Quantum mechanical resonance
Quantum mechanical resonanceQuantum mechanical resonance
Quantum mechanical resonance
 
Hw4 2016 | Applied Stochastic process MTH 412 IIT Kanpur
Hw4 2016 | Applied Stochastic process MTH 412 IIT KanpurHw4 2016 | Applied Stochastic process MTH 412 IIT Kanpur
Hw4 2016 | Applied Stochastic process MTH 412 IIT Kanpur
 
4 forced vibration of damped
4 forced vibration of damped4 forced vibration of damped
4 forced vibration of damped
 
129966864599036360[1]
129966864599036360[1]129966864599036360[1]
129966864599036360[1]
 
Cosmology from quantum_potential
Cosmology from quantum_potentialCosmology from quantum_potential
Cosmology from quantum_potential
 
Quantum algorithm for solving linear systems of equations
 Quantum algorithm for solving linear systems of equations Quantum algorithm for solving linear systems of equations
Quantum algorithm for solving linear systems of equations
 
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
A-Hybrid-Approach-Using-Particle-Swarm-Optimization-and-Simulated-Annealing-f...
 
Lec4
Lec4Lec4
Lec4
 
multi-field-inflation
multi-field-inflationmulti-field-inflation
multi-field-inflation
 
On the dynamics of distillation processes
On the dynamics of distillation processesOn the dynamics of distillation processes
On the dynamics of distillation processes
 
Application of finite markov chain to a model of schooling
Application of finite markov chain to a model of schoolingApplication of finite markov chain to a model of schooling
Application of finite markov chain to a model of schooling
 
TIME-ABSTRACTING BISIMULATION FOR MARKOVIAN TIMED AUTOMATA
TIME-ABSTRACTING BISIMULATION FOR MARKOVIAN TIMED AUTOMATATIME-ABSTRACTING BISIMULATION FOR MARKOVIAN TIMED AUTOMATA
TIME-ABSTRACTING BISIMULATION FOR MARKOVIAN TIMED AUTOMATA
 
Bay's marko chain
Bay's marko chainBay's marko chain
Bay's marko chain
 
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
Erwin. e. obermayer k._schulten. k. _1992: self-organising maps_stationary st...
 
Chap 2 discrete
Chap 2 discreteChap 2 discrete
Chap 2 discrete
 
E05112433
E05112433E05112433
E05112433
 

More from aimeetradesolutions

Answer the question below. Then complete the sentences that address t.pdf
 Answer the question below. Then complete the sentences that address t.pdf Answer the question below. Then complete the sentences that address t.pdf
Answer the question below. Then complete the sentences that address t.pdf
aimeetradesolutions
 

More from aimeetradesolutions (12)

At the end of the 2014 annual reporting period, Barnard Corporation.pdf
 At the end of the 2014 annual reporting period, Barnard Corporation.pdf At the end of the 2014 annual reporting period, Barnard Corporation.pdf
At the end of the 2014 annual reporting period, Barnard Corporation.pdf
 
At December 31, 2014, Hyasaki Corporation has the following account b.pdf
 At December 31, 2014, Hyasaki Corporation has the following account b.pdf At December 31, 2014, Hyasaki Corporation has the following account b.pdf
At December 31, 2014, Hyasaki Corporation has the following account b.pdf
 
Assume an 0, bn 0. and bn converges. Show that if lim anbn = 0,.pdf
 Assume an  0, bn  0. and  bn converges. Show that if lim anbn = 0,.pdf Assume an  0, bn  0. and  bn converges. Show that if lim anbn = 0,.pdf
Assume an 0, bn 0. and bn converges. Show that if lim anbn = 0,.pdf
 
As generally used in accounting, what is depreciation It is a proce.pdf
 As generally used in accounting, what is depreciation  It is a proce.pdf As generally used in accounting, what is depreciation  It is a proce.pdf
As generally used in accounting, what is depreciation It is a proce.pdf
 
area of a trapezoidSolution The area of a Tra.pdf
 area of a trapezoidSolution                     The area of a Tra.pdf area of a trapezoidSolution                     The area of a Tra.pdf
area of a trapezoidSolution The area of a Tra.pdf
 
Anglea owned the following lots of Azure Corporation stock. On Octob.pdf
 Anglea owned the following lots of Azure Corporation stock.  On Octob.pdf Anglea owned the following lots of Azure Corporation stock.  On Octob.pdf
Anglea owned the following lots of Azure Corporation stock. On Octob.pdf
 
Answer the question below. Then complete the sentences that address t.pdf
 Answer the question below. Then complete the sentences that address t.pdf Answer the question below. Then complete the sentences that address t.pdf
Answer the question below. Then complete the sentences that address t.pdf
 
An oil slick lies on a puddle of water. From it, you see a multi-colo.pdf
 An oil slick lies on a puddle of water. From it, you see a multi-colo.pdf An oil slick lies on a puddle of water. From it, you see a multi-colo.pdf
An oil slick lies on a puddle of water. From it, you see a multi-colo.pdf
 
Analyze the effect of Davis Consultings transaction on the account .pdf
 Analyze the effect of Davis Consultings transaction on the account .pdf Analyze the effect of Davis Consultings transaction on the account .pdf
Analyze the effect of Davis Consultings transaction on the account .pdf
 
Andy Capp has told Flo that he will go to the pub only if he gets a.pdf
 Andy Capp has told Flo that he will go to the pub only if he gets a.pdf Andy Capp has told Flo that he will go to the pub only if he gets a.pdf
Andy Capp has told Flo that he will go to the pub only if he gets a.pdf
 
An urn contains three grey mice and one white mouse. A cat puts her p.pdf
 An urn contains three grey mice and one white mouse. A cat puts her p.pdf An urn contains three grey mice and one white mouse. A cat puts her p.pdf
An urn contains three grey mice and one white mouse. A cat puts her p.pdf
 
An urn contains 10 balls labeled 1 through 10. You randomly select th.pdf
 An urn contains 10 balls labeled 1 through 10. You randomly select th.pdf An urn contains 10 balls labeled 1 through 10. You randomly select th.pdf
An urn contains 10 balls labeled 1 through 10. You randomly select th.pdf
 

Recently uploaded

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Krashi Coaching
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Recently uploaded (20)

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 

Assume that a finite state continuous time Markov chain has a rate ma.pdf

  • 1. Assume that a finite state continuous time Markov chain has a rate matrix that can be written in block form (as was done in class) Q = where A describes the transition rates between transient states and B describes the transition rates from transient to absorbing states. Also assume that the row vector a is of the length of the transient states and includes the initial probabilities for each of those states. Find the general formula for the mean of the time to absorption. Find the general formula for the variance of the time to absorption. Now, assume for the set up of the previous problem that you have the following specific matrices (you may want to use R for this part). (The states are described by 0,1,2,3,4,5.) A = and B = Give the mean value of the time to absorption if you are twice as likely to start in state one than in either state zero or state two. Given that you start in state 1, what is the probability of being absorbed in state 4? What is the probability of being absorbed in state 5 if you have the initial values described in the previously described in (a). Solution http://www.scopenvironment.org/downloadpubs/scope34/chapter6.html#t6.2 this link has what is required for you to answer your homework! even other qstns! Hope ths helps.. Good luck for your final exam! :)