SlideShare ist ein Scribd-Unternehmen logo
1 von 1
Downloaden Sie, um offline zu lesen
Question 1. Consider the discrete-time dynamical system xk+1=xk+uk+wk,k=0,1,2,3, where the
state xk, the control uk, and the random parameter wk are all integers. The initial state is x0=5,
and the cost function is k=03(xk2+uk2) Apply the DP algorithm (show steps) and compute the
optimal policy (minimize the expected cost function) for the following case. For k=0,1,2,3, - State
space: Sk={0,1,2,3,4,5} - Control constraint set: Uk(xk)={u0xk+u5,u : integer } - If 0<xk+uk<5, wk={
11withprobability1/2withprobability1/2 otherwise (i.e. when xk+uk=0 or xk+uk=5)wk=0 with
probability 1.

Weitere ähnliche Inhalte

Mehr von ynitin691

Question 16 The three basic shapes of prokaryotes are and Q.pdf
Question 16 The three basic shapes of prokaryotes are and Q.pdfQuestion 16 The three basic shapes of prokaryotes are and Q.pdf
Question 16 The three basic shapes of prokaryotes are and Q.pdf
ynitin691
 

Mehr von ynitin691 (20)

Question 2 5 points Jenny is now ready to perform the chem.pdf
Question 2 5 points Jenny is now ready to perform the chem.pdfQuestion 2 5 points Jenny is now ready to perform the chem.pdf
Question 2 5 points Jenny is now ready to perform the chem.pdf
 
QUESTION 2 25 Marks Undertake a literature review of quie.pdf
QUESTION 2 25 Marks Undertake a literature review of quie.pdfQUESTION 2 25 Marks Undertake a literature review of quie.pdf
QUESTION 2 25 Marks Undertake a literature review of quie.pdf
 
Question 2 21 During the process of gene expression two ma.pdf
Question 2 21 During the process of gene expression two ma.pdfQuestion 2 21 During the process of gene expression two ma.pdf
Question 2 21 During the process of gene expression two ma.pdf
 
Question 2 15 points Suppose the government decides to red.pdf
Question 2 15 points Suppose the government decides to red.pdfQuestion 2 15 points Suppose the government decides to red.pdf
Question 2 15 points Suppose the government decides to red.pdf
 
QUESTION 2 13 MARKS 21 Differentiate between fibrous prot.pdf
QUESTION 2 13 MARKS 21 Differentiate between fibrous prot.pdfQUESTION 2 13 MARKS 21 Differentiate between fibrous prot.pdf
QUESTION 2 13 MARKS 21 Differentiate between fibrous prot.pdf
 
QUESTION 2 28 marks You are an employee at a medium sized .pdf
QUESTION 2 28 marks You are an employee at a medium sized .pdfQUESTION 2 28 marks You are an employee at a medium sized .pdf
QUESTION 2 28 marks You are an employee at a medium sized .pdf
 
Question 2 10 point Consider a broadcast channel with N no.pdf
Question 2 10 point Consider a broadcast channel with N no.pdfQuestion 2 10 point Consider a broadcast channel with N no.pdf
Question 2 10 point Consider a broadcast channel with N no.pdf
 
Question 2 15 MARKS The following is Ubuntu statement of f.pdf
Question 2 15 MARKS The following is Ubuntu statement of f.pdfQuestion 2 15 MARKS The following is Ubuntu statement of f.pdf
Question 2 15 MARKS The following is Ubuntu statement of f.pdf
 
Question 2 14 points The simplest way to virtualize memor.pdf
Question 2 14 points The simplest way to virtualize memor.pdfQuestion 2 14 points The simplest way to virtualize memor.pdf
Question 2 14 points The simplest way to virtualize memor.pdf
 
Question 2 15 Marks The plans which are derived for the o.pdf
Question 2 15 Marks The plans which are derived for the o.pdfQuestion 2 15 Marks The plans which are derived for the o.pdf
Question 2 15 Marks The plans which are derived for the o.pdf
 
Question 2 The Emergence of Global Institutions Ch 1 Why.pdf
Question 2  The Emergence of Global Institutions Ch 1 Why.pdfQuestion 2  The Emergence of Global Institutions Ch 1 Why.pdf
Question 2 The Emergence of Global Institutions Ch 1 Why.pdf
 
Question 19 A malware that encrypts your computers data and.pdf
Question 19 A malware that encrypts your computers data and.pdfQuestion 19 A malware that encrypts your computers data and.pdf
Question 19 A malware that encrypts your computers data and.pdf
 
Question 19 10pts Find the present worth of the cash rece.pdf
Question 19 10pts Find the present worth of the cash rece.pdfQuestion 19 10pts Find the present worth of the cash rece.pdf
Question 19 10pts Find the present worth of the cash rece.pdf
 
Question 19 2 points The process scope diagram looks pri.pdf
Question 19 2 points   The process scope diagram looks pri.pdfQuestion 19 2 points   The process scope diagram looks pri.pdf
Question 19 2 points The process scope diagram looks pri.pdf
 
Question 19 5 Minutes and 5 Points Consider the followin.pdf
Question 19 5 Minutes and 5 Points Consider the followin.pdfQuestion 19 5 Minutes and 5 Points Consider the followin.pdf
Question 19 5 Minutes and 5 Points Consider the followin.pdf
 
QUESTION 18 Jer works in a Home and Community Care environme.pdf
QUESTION 18 Jer works in a Home and Community Care environme.pdfQUESTION 18 Jer works in a Home and Community Care environme.pdf
QUESTION 18 Jer works in a Home and Community Care environme.pdf
 
Question 16 1 point Table Fazio and Gabriellas opportun.pdf
Question 16 1 point Table Fazio and Gabriellas opportun.pdfQuestion 16 1 point Table Fazio and Gabriellas opportun.pdf
Question 16 1 point Table Fazio and Gabriellas opportun.pdf
 
Question 16 The three basic shapes of prokaryotes are and Q.pdf
Question 16 The three basic shapes of prokaryotes are and Q.pdfQuestion 16 The three basic shapes of prokaryotes are and Q.pdf
Question 16 The three basic shapes of prokaryotes are and Q.pdf
 
Question 18 4 points What is the output of the following c.pdf
Question 18 4 points What is the output of the following c.pdfQuestion 18 4 points What is the output of the following c.pdf
Question 18 4 points What is the output of the following c.pdf
 
Question 16 2 points BPMN provides businesses with the c.pdf
Question 16 2 points   BPMN provides businesses with the c.pdfQuestion 16 2 points   BPMN provides businesses with the c.pdf
Question 16 2 points BPMN provides businesses with the c.pdf
 

Kürzlich hochgeladen

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Kürzlich hochgeladen (20)

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 

Question 1 Consider the discretetime dynamical system xk+1.pdf

  • 1. Question 1. Consider the discrete-time dynamical system xk+1=xk+uk+wk,k=0,1,2,3, where the state xk, the control uk, and the random parameter wk are all integers. The initial state is x0=5, and the cost function is k=03(xk2+uk2) Apply the DP algorithm (show steps) and compute the optimal policy (minimize the expected cost function) for the following case. For k=0,1,2,3, - State space: Sk={0,1,2,3,4,5} - Control constraint set: Uk(xk)={u0xk+u5,u : integer } - If 0<xk+uk<5, wk={ 11withprobability1/2withprobability1/2 otherwise (i.e. when xk+uk=0 or xk+uk=5)wk=0 with probability 1.