SlideShare ist ein Scribd-Unternehmen logo
1 von 63
Downloaden Sie, um offline zu lesen
Bayesian Model Comparison in Cosmology




                Bayesian Model Comparison in Cosmology
                      with Population Monte Carlo
                           Monthly Notices Royal Astronomical Soc. 405 (4), 2381 - 2390, 2010




                                           Christian P. Robert
                                   Universit´ Paris Dauphine & CREST
                                            e
                                http://www.ceremade.dauphine.fr/~ xian


         Joint works with D., Benabed K., Capp´ O., Cardoso J.F., Fort G., Kilbinger M.,
                                              e
                               [Marin J.-M., Mira A.,] Prunet S., Wraith D.
Bayesian Model Comparison in Cosmology




Outline

      1   Cosmology background

      2   Importance sampling

      3   Application to cosmological data

      4   Evidence approximation

      5   Cosmology models

      6   lexicon
Bayesian Model Comparison in Cosmology
  Cosmology background




Cosmology

      A large part of the data to answer some of the major questions in cosmology
      comes from studying the Cosmic Microwave Background (CMB) radiation
      (fossil heat released circa 380,000 years after the BB).
      Huge uniformity of the CMB. Only very sensitive instruments like such as
      WMAP (NASA, 2001) can detect fluctuations CMB temperature
      e.g minute temperature variations: one part of the sky has a temperature of 2.7251
      Kelvin (degrees above absolute zero), while another part of the sky has a temperature
      of 2.7249 Kelvin
Bayesian Model Comparison in Cosmology
  Cosmology background




Cosmology
           A large part of the data to answer some of the major questions in cosmology
           comes from studying the Cosmic Microwave Background (CMB) radiation
           (fossil heat released circa 380,000 years after the BB).
     1.0




                                                      5
     0.8




                                                      4
     0.6




                                                      3
     0.4




                                                      2
     0.2




                                                      1
                                                      0
     0.0




           0.0   0.2     0.4    0.6      0.8   1.0        −0.1   0.0   0.1   0.2     0.3   0.4   0.5   0.6

                                                                               CMB



                                                     [Marin & CPR, Bayesian Core, 2007]
Bayesian Model Comparison in Cosmology
  Cosmology background




Plank


      Temperature variations are related to fluctuations in the density of
      matter in the early universe and thus carry information about the
      initial conditions for the formation of cosmic structures such as
      galaxies, clusters, and voids for example.
      Planck
      Joint mission between the European Space Agency (ESA) and NASA, launched in
      May 2009. The Planck mission plans to provide datasets of nearly 5 × 1010
      observations to settle many open questions with CMB temperature data. Rather than
      scalar valued observations, Planck will provide tensor-valued data and thus is likely to
      also open up this area of statistical research.
Bayesian Model Comparison in Cosmology
  Cosmology background




Plank


      Temperature variations are related to fluctuations in the density of
      matter in the early universe and thus carry information about the
      initial conditions for the formation of cosmic structures such as
      galaxies, clusters, and voids for example.
      Planck
      Joint mission between the European Space Agency (ESA) and NASA, launched in
      May 2009. The Planck mission plans to provide datasets of nearly 5 × 1010
      observations to settle many open questions with CMB temperature data. Rather than
      scalar valued observations, Planck will provide tensor-valued data and thus is likely to
      also open up this area of statistical research.
Bayesian Model Comparison in Cosmology
    Cosmology background




.
Bayesian Model Comparison in Cosmology
  Cosmology background




Some questions in cosmology


              Will the universe expand forever, or will it collapse?
              Is the universe dominated by exotic dark matter and what is
              its concentration?
              What is the shape of the universe?
              Is the expansion of the universe accelerating rather than
              decelerating?
              Is the “flat ΛCDM paradigm” appropriate or is the curvature
              different from zero?
                                         [Adams, The Guide [a.k.a. H2G2], 1979]
Bayesian Model Comparison in Cosmology
  Cosmology background




Statistical problems in cosmology
              Potentially high dimensional parameter space [Not considered
              here]
              Immensely slow computation of likelihoods, e.g WMAP, CMB,
              because of numerically costly spectral transforms [Data is a
              Fortran program]
              Nonlinear dependence and degeneracies between parameters
              introduced by physical constraints or theoretical assumptions


                                                                         2.5
                                0.0




                                                                         2.0
                                −1.0
                           w0




                                                                     α
                                                                         1.5
                                −2.0




                                                                         1.0
                                −3.0




                                       0.0 0.2 0.4 0.6 0.8 1.0 1.2             19.1   19.3    19.5   19.7
                                                   Ωm                                        −M
Bayesian Model Comparison in Cosmology
  Importance sampling




Importance sampling solutions

      1   Cosmology background

      2   Importance sampling
            Adaptive importance sampling
            Adaptive multiple importance sampling

      3   Application to cosmological data

      4   Evidence approximation

      5   Cosmology models

      6   lexicon
Bayesian Model Comparison in Cosmology
  Importance sampling




Importance sampling 101

      Importance sampling is based on the fundamental identity

                                                                  π(x)
                        π(f ) =          f (x)π(x) dx =   f (x)        q(x) dx
                                                                  q(x)

      If x1 , . . . , xN are drawn independently from q,
                               N
                                                             π(xn )/q(xn )
                  π (f ) =
                  ˆ                 f (xn )wn ;
                                           ¯      wn =
                                                  ¯        N
                                                                             ,
                              n=1                          m=1 π(xm )/q(xm )

      provides a converging approximation to π(f ) (independent of the
      normalisation of π).
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Initialising importance sampling
      PMC/AIS offers a solution to the difficulty of picking q through
      adaptivity:
      Given a target π, PMC produces a sequence q t of importance
      functions (t = 1, . . . , T ) aimed at approximating π
      First sample produced by a regular importance sampling scheme,
      x1 , . . . , x1 ∼ q 1 , associated with importance weights
        1           N


                                          1     π(x1 )n
                                         wn =
                                                q 1 (x1 )
                                                      n

                                        ¯1
      and their normalised counterparts wn , providing a first
      approximation to a sample from π.
      Moments of π can then be approximated to construct an updated
      importance function q 2 , &c.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Adaptive importance sampling


      Optimality criterion?

      The quality of approximation can be measured in terms of the
      Kullback divergence from the target,

                                                   π(x)
                               D(π q t ) =   log             π(x)dx,
                                                   q t (x)

      and the density q t can be adjusted incrementally to minimize this
      divergence.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



PMC – Some papers

              Capp´ et al (2004) - J. Comput. Graph. Stat.
                   e
              Outline of Population Monte Carlo but missed main point
              Celeux et al (2005) - Comput. Stat. & Data Analysis Rao-Blackwellisation for
              importance sampling and missing data problems
              Douc et al (2007) - ESAIM Prob. & Stat. and Annals of Statistics
              Convergence issues proving adaptation is positive where q is a mixture density of
              random-walk proposals (mixture weights varied)
              Capp´ et al (2007) - Stat. & Computing
                  e
              Adaptation of q (mixture density of independent proposals), where weights and
              parameters vary
              Wraith et al (2009) - Physical Review D
              Application of Capp´ et al (2007) to cosmology and comparison with MCMC
                                  e
              Beaumont et al (2009) - Biometrika
              Application of Capp´ et al (2007) to ABC settings
                                 e
              Kilbinger et al (2010) - Month. N. Royal Astro. Soc.
              Application of Capp´ et al (2007) to model choice in cosmology
                                  e
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Adaptive importance sampling (2)
      Use of mixture densities
                                                       D
                                t           t   t
                              q (x) = q(x; α , θ ) =          d
                                                                      t
                                                             αt ϕ(x; θd )
                                                       d=1
                                                                            [West, 1993]
      where
              αt = (αt , . . . , αt ) is a vector of adaptable weights for the D
                     1            D
              mixture components
              θ t = (θ1 , . . . , θD ) is a vector of parameters which specify the
                      t            t

              components
              ϕ is a parameterised density (usually taken to be multivariate
              Gaussian or Student-t, the later preferred)
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Capp´ et al (2007) optimal scheme
    e

      Update q t using an integrated EM approach minimising the KL
      divergence at each iteration

                                                      π(x)
                        D(π q t ) =      log    D
                                                                   π(x)dx,
                                                     t       t
                                                d=1 αd ϕ(x; θd )

      equivalent to maximising
                                               D
                          ℓ(α, θ) =      log         αd ϕ(x; θd ) π(x) dx
                                               d=1

      in α, θ.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



PMC updates

      Maximization of Lt (α, θ) leads to closed form solutions in
      exponential families (and for the t distributions)
      For instance for Np (µd , Σd ):

              αt+1 =
               d               ρd (x; αt , µt , Σt )π(x)dx,

                              xρd (x; αt , µt , Σt )π(x)dx
              µt+1 =
               d                                           ,
                                        αt+1
                                           d
                              (x − µt+1 )(x − µt+1 )T ρd (x; αt , µt , Σt )π(x)dx
              Σt+1 =
               d
                                    d          d
                                                                                  .
                                                 αt+1
                                                    d
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Empirical updates


      And empirical versions,
                                    N
                        αt+1 =
                                    X
                         d                ¯t
                                          wn ρd (xt ; αt , µt , Σt )
                                                  n
                                    n=1
                                    PN
                                             wn xt ρd (xt ; αt , µt , Σt )
                                             ¯t n       n
                        µt+1 =
                         d
                                      n=1
                                                    αt+1
                                                     d
                        Σt+1
                         d  =
                           PN
                               n=1   wn (xt − µt+1 )(xt − µt+1 )T ρd (xt ; αt , µt , Σt )
                                     ¯t n      d      n    d           n
                                                            αt+1
                                                             d
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Banana benchmark
                                                2
      Twisted Np (0, Σ) target with Σ = diag(σ1 , 1, . . . , 1), changing the
                                       2    2
      second co-ordinate x2 to x2 + b(x1 − σ1 )




                                               20
                                               10
                                               0
                                               −10
                                          x2

                                               −20
                                               −30
                                               −40




                                                     −40   −20   0    20   40

                                                                 x1




                                                  2
                                         p = 10, σ1 = 100, b = 0.03
                                                                                [Haario et al. 1999]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Simulation

                         20




                                                         20
                         10




                                                         10
                         0




                                                         0
                         −20




                                                         −20
                         −40




                                                         −40
                               −40   −20   0   20   40         −40   −20   0   20   40
                         20




                                                         20
                         10




                                                         10
                         0




                                                         0
                         −20




                                                         −20
                         −40




                                                         −40
                               −40   −20   0   20   40         −40   −20   0   20   40
                         20




                                                         20
                         10




                                                         10
                         0




                                                         0
                         −20




                                                         −20
                         −40




                                                         −40




                               −40   −20   0   20   40         −40   −20   0   20   40
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Monitoring by perplexity

      Stop iterations when further adaptations do not improve D(π q t ).
      The transform exp[−D(π q t )] may be estimated by the normalised
      perplexity p = exp(Ht )/N, where
                          N

                                                  N
                                         Ht = −
                                          N             ¯t     ¯t
                                                        wn log wn
                                                  n=1

      is the Shannon entropy of the normalised weights
      Thus, minimization of the Kullback divergence can be
      approximately connected with the maximization of the perplexity
      (normalised) (values closer to 1 indicating good agreement
      between q and π).
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Monitoring by ESS



      A second criterion is the effective sample size (ESS)

                                                    N            −1
                                                             2
                                         ESSt
                                            N   =         ¯t
                                                          wn
                                                    n=1

      which can be interpreted as the number of equivalent iid sample
      points.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Simulation


                                      0.8
                                      0.6
                             NPERPL

                                      0.4
                                      0.2
                                      0.0




                                            1   2   3   4   5    6    7    8    9   10
                                      0.8
                                      0.6
                             NESS

                                      0.4
                                      0.2
                                      0.0




                                            1   2   3   4   5    6    7    8    9   10




      Normalised perplexity (top panel) and normalised effective sample size(ESS/N) (bottom panel) estimates for the
      first 10 iterations of PMC
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Comparison to MCMC
      Adaptive MCMC: Proposal is a multivariate Gaussian with Σ
      updated/based on previous values in the chain. Scale and update
      times chosen for optimal results.
                                              PMC                       MCMC
                                                        fa                         fa




                                                        fb                         fb




      Evolution of π(fa ) (top panels) and π(fb ) (bottom panels) from 10k points to 100k points for both PMC (left
      panels) and MCMC (right panels).
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive importance sampling



Simulation



                                                                    0.74
                                                                                           fc                 fe                      fh


                                    Propoportion of points inside

                                                                    0.70
                                                                    0.66
                                                                    0.62




                                                                             PMC
                                                                           d10 PMC     MCMC
                                                                                     d10 MCMC    PMC
                                                                                                d2 PMC    MCMC
                                                                                                         d2 MCMC    PMC
                                                                                                                   d1 PMC    MCMC
                                                                                                                            d1 MCMC
                                                                    1.00




                                                                                           fd                 fg                      fi
                                    Propoportion of points inside

                                                                    0.96
                                                                    0.92
                                                                    0.88




                                                                             PMC
                                                                           d10 PMC     MCMC
                                                                                     d10 MCMC    PMC
                                                                                                d2 PMC    MCMC
                                                                                                         d2 MCMC    PMC
                                                                                                                   d1 PMC    MCMC
                                                                                                                            d1 MCMC




      Results showing the distributions of the PMC and the MCMC estimates. All estimates are based on 500 simulation
      runs.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Adaptive multiple importance sampling


      Full recycling:
      At iteration t, design a new proposal qt based on all previous
      samples
                          x1 , . . . , x1 , . . . , xt−1 , . . . , xt−1
                           1            N            1              N




              At each stage, the whole past can be used: if un-normalised
              weights ωi,t are preserved along iterations, then all xt ’s can be
                                                                     i
              pooled together
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Adaptive multiple importance sampling


      Full recycling:
      At iteration t, design a new proposal qt based on all previous
      samples
                          x1 , . . . , x1 , . . . , xt−1 , . . . , xt−1
                           1            N            1              N




              At each stage, the whole past can be used: if un-normalised
              weights ωi,t are preserved along iterations, then all xt ’s can be
                                                                     i
              pooled together
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Caveat

      When using several importance functions at once, q0 , . . . , qT , with
      samples x0 , . . . , x0 0 , . . ., xT , . . . , xT T and importance weights
                1            N            1            N
        t
      ωi = π(xt )/qt (xt ), merging thru the empirical distribution
               i           i

                                              t                  t
                                             ωi δxt (x)
                                                  i
                                                                ωi ≈ π(x)
                                       t,i                t,i

      Fails to cull poor proposals: very large weights do remain large in
      the cumulated sample and poorly performing samples
      overwhelmingly dominate other samples in the final outcome.
      c Raw mixing of importance samples may be harmful, compared
      with a single sample, even when most proposals are efficient.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Caveat

      When using several importance functions at once, q0 , . . . , qT , with
      samples x0 , . . . , x0 0 , . . ., xT , . . . , xT T and importance weights
                1            N            1            N
        t
      ωi = π(xt )/qt (xt ), merging thru the empirical distribution
               i           i

                                              t                  t
                                             ωi δxt (x)
                                                  i
                                                                ωi ≈ π(x)
                                       t,i                t,i

      Fails to cull poor proposals: very large weights do remain large in
      the cumulated sample and poorly performing samples
      overwhelmingly dominate other samples in the final outcome.
      c Raw mixing of importance samples may be harmful, compared
      with a single sample, even when most proposals are efficient.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Deterministic mixtures

      Owen and Zhou (2000) propose a stabilising recycling of the
      weights via deterministic mixtures by modifying the importance
      density qt (xt ) under which xt was truly simulated to a mixture of
                   i                i
      all the densities that have been used so far
                                                    T
                                              1
                                             T
                                                          Nt qt (xT ) ,
                                                                  i
                                             j=0 Nj t=0

      resulting into the deterministic mixture weight
                                                               T
                               t                    1
                              ωi   =     π(xt )
                                            i      T
                                                                   Nt qt (xt ) .
                                                                           i
                                                   j=0 Nj t=0
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Unbiasedness

      Potential to exploit the most efficient proposals in the sequence
      Q0 , . . . , QT without rejecting any simulated value nor sample.
      Poorly performing importance functions are simply eliminated
      through the erosion of their weights
                                                    T
                                              1
                                    π(xt )
                                       i     T
                                                          Nl ql (xt )
                                                                  i
                                             j=0 Nj l=0

      as T increases.
      Paradoxical feature of competing acceptable importance weights
      for the same simulated value well-understood in the cases of
      Rao-Blackwellisation and of Population Monte Carlo. More
      intricated here in that only unbiasedness remains [fake mixture]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Unbiasedness

      Potential to exploit the most efficient proposals in the sequence
      Q0 , . . . , QT without rejecting any simulated value nor sample.
      Poorly performing importance functions are simply eliminated
      through the erosion of their weights
                                                    T
                                              1
                                    π(xt )
                                       i     T
                                                          Nl ql (xt )
                                                                  i
                                             j=0 Nj l=0

      as T increases.
      Paradoxical feature of competing acceptable importance weights
      for the same simulated value well-understood in the cases of
      Rao-Blackwellisation and of Population Monte Carlo. More
      intricated here in that only unbiasedness remains [fake mixture]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



AMIS


      AMIS (or Adaptive Multiple Importance Sampling) uses
      importance sampling functions (qt ) that are constructed
      sequentially and adaptively, using past t − 1 weighted samples.
          i    weights of all present and past variables xl
                                                          i
               (1 ≤ l ≤ t , 1 ≤ j ≤ Nt ) are modified, based on the current
               proposals
          ii   the entire collection of importance samples is used to build
               the next importance function.
                                             [Parallel with IMIS: Raftery & Bo, 2010]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



The AMIS algorithm

      Adaptive Multiple Importance Sampling
      At iteration t = 1, . . . , T
                                                          ˆ
          1) Independently generate Nt particles xt ∼ q(x|θ t−1 )
                                                  i
                                                                                               t ˆl−1
          2) For 1 ≤ i ≤ Nt , compute the mixture at xi δi = N0 q0 (xt ) +
                                                         t                          Pt
                                           ffi          t              i               l=1 Nl q(xi ; θ  ) and derive the
                        t    t      t ‹ t            Pt
             weight of xi , ωi = π(xi ) [δi {N0 + l=0 Nl }] .

          3) For 0 ≤ l ≤ t − 1 and 1 ≤ i ≤ Nl , actualise past weights as

                                                                                            t
                               l    l      l ˆt−1                      l      l ‹ l‹
                                                                                            X
                              δi = δi + q(xi ; θ  )           and     ωi = π(xi ) [δi {N0 +   Nl }] .
                                                                                                    l=0


                                            ˆ
          4) Compute the parameter estimate θ t based on

                                      0   0           0       0            t    t           t         t
                                 ({x1 , ω1 }, . . . , {xN , ωN }, . . . , {x1 , ω1 }, . . . , {xN , ωN })
                                                          0       0                             t         t



                             [Cornuet, Marin, Mira & CPR, 2009, arXiv:0907.1254]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Studentised AMIS

      When the proposal distribution qt is a Student’s t proposal,

                                                   T3 (µ, Σ)

      mean µ and covariance Σ parameters can be updated by
      estimating first two moments of the target distribution Π
                 Pt PNl l l                               Pt     PNl
                   l=0  i=1 ω x                    ˆ       l=0      ωi (xl − µt )(xl − µt )T
                                                                      l      ˆ         ˆ
             µt = Pt PN i i
             ˆ                               and   Σt =           i=1    i
                                                                   Pt PNl l
                                                                                   i
                                                                                             .
                           l  l
                    l=0  i=1 ωi                                     l=0    i=1 ωi

       i.e. using optimal update of Capp´ et al. (2007)
                                        e

      Obvious extension to mixtures [and again optimal update of Capp´
                                                                     e
      et al. (2007)]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Studentised AMIS

      When the proposal distribution qt is a Student’s t proposal,

                                                   T3 (µ, Σ)

      mean µ and covariance Σ parameters can be updated by
      estimating first two moments of the target distribution Π
                 Pt PNl l l                               Pt     PNl
                   l=0  i=1 ω x                    ˆ       l=0      ωi (xl − µt )(xl − µt )T
                                                                      l      ˆ         ˆ
             µt = Pt PN i i
             ˆ                               and   Σt =           i=1    i
                                                                   Pt PNl l
                                                                                   i
                                                                                             .
                           l  l
                    l=0  i=1 ωi                                     l=0    i=1 ωi

       i.e. using optimal update of Capp´ et al. (2007)
                                        e

      Obvious extension to mixtures [and again optimal update of Capp´
                                                                     e
      et al. (2007)]
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Simulations
      Same banana benchmark
                                     Target function   p    AMIS      Capp´’07
                                                                          e
                                                        5   0.06558   0.06879
                                      E(x1 ) = 0       10   0.06388   0.11051
                                                       20   0.09167   0.17912
                                                        5   0.10215   0.11583
                                      E(x2 ) = 0       10   0.21421   0.22557
                                                       20   0.25316   0.29087
                                   P5
                                        E(xi ) = 0      5   0.00478   0.00927
                                   Pi=3
                                    10
                                        E(xi ) = 0     10   0.00902   0.02099
                                   Pi=3
                                    20
                                    i=3 E(xi ) = 0     20   0.01666   0.04208
                                                        5   2.60672   3.92650
                                    var(x1 ) = 100     10   7.06686   7.48877
                                                       20   8.20020   9.71725
                                                        5   2.10682   2.96132
                                     var(x2 ) = 19     10   3.76660   5.08474
                                                       20   4.85407   5.98031
                                 P5
                                       var(xi ) = 3     5   0.00645   0.01196
                                 Pi=3
                                   10
                                   i=3 var(xi ) = 8
                                 P20
                                                       10   0.01370   0.02636
                                  i=3 var(xi ) = 18    20   0.04609   0.06424



      Root mean square errors calculated over 10 replications for different target functions
      and dimensions p.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Simulation (cont’d)




      10 replicate ESSs for AMIS (left) and PMC (right) for p = 5, 10, 20.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Simulation (cont’d)




      10 replicate absolute errors associated to the estimations of E(x1 ) (left column),
      E(x2 ) (center column) and p E(xi ) (right column) using AMIS (left in each
                                   P
                                      i=3
      block) and PMC (right) for p = 5, 10, 20.
Bayesian Model Comparison in Cosmology
  Importance sampling
     Adaptive multiple importance sampling



Simulation (cont’d)




      10 replicate absolute errors associated to the estimations of var(x1 ) (left column),
      var(x2 ) (center column) and p var(xi ) (right column) using AMIS (left in each
                                     P
                                       i=3
      block) and PMC (right) for p = 5, 10, 20.
Bayesian Model Comparison in Cosmology
  Application to cosmological data




Cosmological data




      Posterior distribution of cosmological parameters for recent
      observational data of CMB anisotropies (differences in temperature
      from directions) [WMAP], SNIa, and cosmic shear.
      Combination of three likelihoods, some of which are available as
      public (Fortran) code, and of a uniform prior on a hypercube.
Bayesian Model Comparison in Cosmology
  Application to cosmological data




Cosmology parameters
      Parameters for the cosmology likelihood
      (C=CMB, S=SNIa, L=lensing)

                    Symbol      Description                    Minimum   Maximum    Experiment
                    Ωb          Baryon density                 0.01      0.1       C          L
                    Ωm          Total matter density           0.01      1.2       C    S     L
                    w           Dark-energy eq. of state       -3.0      0.5       C    S     L
                    ns          Primordial spectral index      0.7       1.4       C          L
                    ∆2R         Normalization (large scales)                       C
                    σ8          Normalization (small scales)                       C          L
                    h           Hubble constant                                    C          L
                    τ           Optical depth                                      C
                    M           Absolute SNIa magnitude                                 S
                    α           Colour response                                         S
                    β           Stretch response                                        S
                    a                                                                         L
                    b           galaxy z-distribution fit                                      L
                    c                                                                         L


      For WMAP5, σ8 is a deduced quantity that depends on the other parameters
Bayesian Model Comparison in Cosmology
  Application to cosmological data




Adaptation of importance function
Bayesian Model Comparison in Cosmology
  Application to cosmological data




Estimates
                                     Parameter   PMC              MCMC


                                     Ωb          0.0432+0.0027
                                                       −0.0024    0.0432+0.0026
                                                                        −0.0023
                                     Ωm          0.254+0.018
                                                      −0.017
                                                                  0.253+0.018
                                                                       −0.016
                                     τ           0.088+0.018
                                                      −0.016      0.088+0.019
                                                                       −0.015
                                                                        +0.059
                                     w           −1.011 ± 0.060   −1.010−0.060
                                     ns          0.963+0.015
                                                      −0.014      0.963+0.015
                                                                       −0.014
                                     109 ∆2
                                          R      2.413+0.098
                                                      −0.093      2.414+0.098
                                                                       −0.092
                                     h           0.720+0.022
                                                      −0.021      0.720+0.023
                                                                       −0.021
                                     a           0.648+0.040
                                                      −0.041      0.649+0.043
                                                                       −0.042
                                     b           9.3+1.4
                                                    −0.9          9.3+1.7
                                                                     −0.9
                                     c           0.639+0.084
                                                      −0.070      0.639+0.082
                                                                       −0.070
                                                                         +0.029
                                     −M          19.331 ± 0.030   19.332−0.031
                                     α           1.61+0.15
                                                     −0.14        1.62+0.16
                                                                      −0.14
                                     −β          −1.82+0.17
                                                      −0.16
                                                                  −1.82 ± 0.16
                                     σ8          0.795+0.028
                                                      −0.030      0.795+0.030
                                                                       −0.027



      Means and 68% credible intervals using lensing, SNIa and CMB
Bayesian Model Comparison in Cosmology
  Application to cosmological data




Advantage of AIS and PMC?



              Parallelisation of the posterior calculations
              - For the cosmological examples, we used up to 100 CPUs on a computer cluster to explore the cosmology
              posteriors using AIS/PMC. Reducing the computational time from several days for MCMC to a few hours
              using PMC.

              Low variance of Monte Carlo estimates
              - For PMC and q closely matched to π, significant reductions in the variance of the Monte Carlo
              estimates are possible compared to estimates using MCMC. Also translating into a computational saving,
              with further savings possible by combining samples across iterations

              Simple diagnostics of ‘convergence’ (perplexity)
              - For PMC, the perplexity provides a relatively simple measure of sampling adequacy to the target density
              of interest
Bayesian Model Comparison in Cosmology
  Evidence approximation




Evidence/Marginal likelihood/Integrated Likelihood ...
      Central quantity of interest in (Bayesian) model choice

                                                        π(x)
                                E=        π(x)dx =           q(x)dx.
                                                        q(x)

      expressed as an expectation under any density q with large enough
      support.
      Importance sampling provides a sample x1 , . . . xN ∼ q and
      approximation of the above integral,
                                                   N
                                             E≈         wn
                                                  n=1

                                π(xn )
      where the wn =            q(xn )   are the (unnormalised) importance weights.
Bayesian Model Comparison in Cosmology
  Evidence approximation




Evidence/Marginal likelihood/Integrated Likelihood ...
      Central quantity of interest in (Bayesian) model choice

                                                        π(x)
                                E=        π(x)dx =           q(x)dx.
                                                        q(x)

      expressed as an expectation under any density q with large enough
      support.
      Importance sampling provides a sample x1 , . . . xN ∼ q and
      approximation of the above integral,
                                                   N
                                             E≈         wn
                                                  n=1

                                π(xn )
      where the wn =            q(xn )   are the (unnormalised) importance weights.
Bayesian Model Comparison in Cosmology
  Evidence approximation




Back to the banana ...

      Centred d-multivariate normal, x ∼ Nd (0, Σ) with covariance
                 2
      Σ = diag(σ1 , 1, . . . , 1), which is slightly twisted in the first two
                                                       1
                                                            2
      dimensions by changing x2 to be x2 + β(x2 − σ1 ). where σ1 = 100   2

      and β controls the degree of curvature.
      We integrate over the unormalised target density

                                         E=    π(β)f (x|β, Σ) dβ

      or
                                          E=     π(x|β, Σ) dx.
Bayesian Model Comparison in Cosmology
  Evidence approximation




Simulation results (1)



                                                      10




                                                                                                                   10
                                                      0




                                                                                                                   0
                                                      −10




                                                                                                                   −10
                                    x2




                                                                                                  x2
                                                      −20




                                                                                                                   −20
                                                      −30




                                                                                                                   −30
                                                                −40    −20     0      20     40                               −40    −20     0      20     40

                                                                              x1                                                            x1
                                                      0.03004




                                                                                                                   −264.028
                                Posterior mean of β




                                                                                                  Evidence (log)
                                                      0.03000




                                                                                                                   −264.032
                                                      0.02996




                                                                                                                   −264.036
                                                      0.02992




                                                                      After 10th iteration                                          After 10th iteration




                                                                                   β unknown
Bayesian Model Comparison in Cosmology
  Evidence approximation




Simulation results (2)




                                                                                                                                   0.8
                                                0.8




                                                                                                                                   0.6
                                                0.6
                               Perplexity




                                                                                                    NESS
                                                                                                                                   0.4
                                                0.4




                                                                                                                                   0.2
                                                0.2




                                                                                                                                   0.0
                                                       1   2   3   4    5   6      7   8   9   10                                                  1   2   3   4     5   6     7   8   9   10

                                                                       Iteration                                                                                   Iteration




                                                                                                    Evidence (log): final sample
                                                0.2




                                                                                                                                   0.015
                               Evidence (log)
                                                0.1




                                                                                                                                   0.005
                                                0.0




                                                                                                                                   −0.015 −0.005
                                                −0.1




                                                       1   2   3   4    5   6      7   8   9   10

                                                                       Iteration                                                                           After 10th iteration




                                                                         β = 0.015 known
Bayesian Model Comparison in Cosmology
  Cosmology models




Back to cosmology questions

      Standard cosmology successful in explaining recent observations,
      such as CMB, SNIa, galaxy clustering, cosmic shear, galaxy cluster
      counts, and Lyα forest clustering.
      Flat ΛCDM model with only six free parameters
                          (Ωm , Ωb , h, ns , τ, σ8 )
      Extensions to ΛCDM may be based on independent evidence
      (massive neutrinos from oscillation experiments), predicted by
      compelling hypotheses (primordial gravitational waves from
      inflation) or reflect ignorance about fundamental physics
      (dynamical dark energy).
      Testing for dark energy, curvature, and inflationary models
Bayesian Model Comparison in Cosmology
  Cosmology models




Back to cosmology questions

      Standard cosmology successful in explaining recent observations,
      such as CMB, SNIa, galaxy clustering, cosmic shear, galaxy cluster
      counts, and Lyα forest clustering.
      Flat ΛCDM model with only six free parameters
                          (Ωm , Ωb , h, ns , τ, σ8 )
      Extensions to ΛCDM may be based on independent evidence
      (massive neutrinos from oscillation experiments), predicted by
      compelling hypotheses (primordial gravitational waves from
      inflation) or reflect ignorance about fundamental physics
      (dynamical dark energy).
      Testing for dark energy, curvature, and inflationary models
Bayesian Model Comparison in Cosmology
  Cosmology models




Extended models

      Focus on the dark energy equation-of-state parameter, modeled as

                         w = −1                      ΛCDM
                         w = w0                      wCDM
                         w = w0 + w1 (1 − a)      w(z)CDM

      In addition, curvature parameter ΩK for each of the above is either
      ΩK = 0 (‘flat’) or ΩK = 0 (‘curved’).
      Choice of models represents simplest models beyond a
      “cosmological constant” model able to explain the observed,
      recent accelerated expansion of the Universe.
Bayesian Model Comparison in Cosmology
  Cosmology models




Cosmology priors


      Prior ranges for dark energy and curvature models. In case of w(a)
      models, the prior on w1 depends on w0
       Parameter Description                    Min.       Max.
       Ωm            Total matter density       0.15       0.45
       Ωb            Baryon density             0.01       0.08
       h             Hubble parameter           0.5        0.9
       ΩK            Curvature                  −1         1
       w0            Constant dark-energy par. −1          −1/3
       w1            Linear dark-energy par.    −1 − w0 −1/3−w0
                                                             1−aacc
Bayesian Model Comparison in Cosmology
  Cosmology models




Cosmology priors (2)

      Component to the matter-density tensor with w(a) < −1/3 for
      values of the scale factor a > aacc = 2/3. To limit the state
      equation from below, we impose the condition w(a) > −1 for all a,
      thereby excluding phantom energy.
      Natural limit on the curvature is that of an empty Universe, i.e.
      upper boundary on the curvature ΩK = 1. A lower boundary
      corresponds to an upper limit on the total matter-energy density:
      ΩK > −1, excluding high-density Universe(s) which are ruled out
      by the age of the oldest observed objects.
      Alternative prior on ΩK could be derived from the paradigm of inflation, but most
      scenarios imply the curvature to be , on the order of 10−60 . The likelihood over such
      a prior on ΩK is essentially flat for any current and future experiments, hence cannot
      be assessed.
Bayesian Model Comparison in Cosmology
  Cosmology models




Cosmology priors (2)

      Component to the matter-density tensor with w(a) < −1/3 for
      values of the scale factor a > aacc = 2/3. To limit the state
      equation from below, we impose the condition w(a) > −1 for all a,
      thereby excluding phantom energy.
      Natural limit on the curvature is that of an empty Universe, i.e.
      upper boundary on the curvature ΩK = 1. A lower boundary
      corresponds to an upper limit on the total matter-energy density:
      ΩK > −1, excluding high-density Universe(s) which are ruled out
      by the age of the oldest observed objects.
      Alternative prior on ΩK could be derived from the paradigm of inflation, but most
      scenarios imply the curvature to be , on the order of 10−60 . The likelihood over such
      a prior on ΩK is essentially flat for any current and future experiments, hence cannot
      be assessed.
Bayesian Model Comparison in Cosmology
  Cosmology models




PMC setup
              q 0 is a Gaussian mixture model with D components randomly
              shifted away from the MLE and covariance equal to the
              information matrix.
              For the dark-energy and curvature models number of
              iterations T equal to 10, unless perplexity indicated the
              contrary. Average number of points sampled under an
              individual mixture-component, N/D, controlled for stable
              updating component (N = 7 500 and D = 10).
              For the primordial models T = 5, N = 10 000 and D between
              7 and 10, depending on the dimensionality.
              Parameters controlling the initial mixture means and
              covariances, chosen as fshift = 0.02, and fvar between 1 and
              1.5. Final iteration run with a five-times larger sample
Bayesian Model Comparison in Cosmology
  Cosmology models




Results


      In most cases evidence in favour of the standard model. especially
      when more datasets/experiments are combined.
      Largest evidence is ln B12 = 1.8, for the w(z)CDM model and
      CMB alone. Case where a large part of the prior range is still
      allowed by the data, and a region of comparable size is excluded.
      Hence weak evidence that both w0 and w1 are required, but
      excluded when adding SNIa and BAO datasets.
      Results on the curvature are compatible with current findings:
      non-flat Universe(s) strongly disfavoured for the three dark-energy
      cases.
Bayesian Model Comparison in Cosmology
  Cosmology models




Evidence
                                                                   Evidence (reference model ΛCDM flat)

                                                                                             CMB




                                              mod.
                                         4                                                CMB+SN
                                                                                      CMB+SN+BAO




                                              weak inconcl. weak
                                         2                                            w(z) flat
                                                                                      w(z) flat
                                                                       w0 flat
                                         0
                                                                                      w(z) flat
                                                                                                              w(z) curved
                                ln B12




                                         -2                            Λ curved
                                                                       w0 flat
                                                                                      w0 curved
                                              mod.




                                         -4                                                                   w(z) curved
                                                                       Λ curved                               w(z) curved
                                                                       Λ curved
                                              strong




                                         -6

                                                                                      w0 curved
                                         -8                                           w0 curved

                                                                   4                5                     6
                                                                                   npar
Bayesian Model Comparison in Cosmology
  Cosmology models




Posterior outcome
      Posterior on dark-energy parameters w0 and w1 as 68%- and 95% credible regions for
      WMAP (solid blue lines), WMAP+SNIa (dashed green) and WMAP+SNIa+BAO
      (dotted red curves). Allowed prior range as red straight lines.

                                         2.0


                                         1.5


                                         1.0
                                 w1




                                         0.5


                                         0.0


                                      −0.5
                                          −1.0 −0.9 −0.8 −0.7 −0.6 −0.5 −0.4
                                                           w0
Bayesian Model Comparison in Cosmology
  Cosmology models




PMC stability

                                         wCDM flat                                              wCDM curvature
                 −8.5




                                                                              −10
                 −9.0




                                                                              −11
                 −9.5
          ln E




                                                                       ln E
                 −10.0




                                                                              −12
                                                                              −13
                 −11.0




                                                                              −14
                         1   2   3   4     5    6     7   8   9   10                1   3   5    7   9   11 13 15 17 19

                                          iteration                                                  iteration




      Distribution of 25 PMC samplings of two dark-energy models, flat wCDM (left panel)
      and curved wCDM (right panel). Log-evidence
Bayesian Model Comparison in Cosmology
  Cosmology models




PMC stability

                                             wCDM flat                                                    wCDM curvature




                                                                                        0.5
                       0.8




                                                                                        0.4
                       0.6
          perplexity




                                                                           perplexity

                                                                                        0.3
                       0.4




                                                                                        0.2
                       0.2




                                                                                        0.1
                       0.0




                                                                                        0.0
                             1   2   3   4     5    6     7   8   9   10                      1   3   5    7   9   11 13 15 17 19

                                              iteration                                                        iteration




      Distribution of 25 PMC samplings of two dark-energy models, flat wCDM (left panel)
      and curved wCDM (right panel). Perplexity
Bayesian Model Comparison in Cosmology
  lexicon




lexicon


              BAO, baryon acoustic oscillations
              CMB, cosmic microwave background radiation
              COBE, cosmic background explorer
              ΛCDM, lambda-cold dark matter
              Lyα, Lyman-alpha
              SNIa, type Ia supernovae
              WMAP, Wilkinson microwave anisotropy probe

Weitere ähnliche Inhalte

Was ist angesagt?

accurate ABC Oliver Ratmann
accurate ABC Oliver Ratmannaccurate ABC Oliver Ratmann
accurate ABC Oliver Ratmannolli0601
 
prior selection for mixture estimation
prior selection for mixture estimationprior selection for mixture estimation
prior selection for mixture estimationChristian Robert
 
ABC based on Wasserstein distances
ABC based on Wasserstein distancesABC based on Wasserstein distances
ABC based on Wasserstein distancesChristian Robert
 
Delayed acceptance for Metropolis-Hastings algorithms
Delayed acceptance for Metropolis-Hastings algorithmsDelayed acceptance for Metropolis-Hastings algorithms
Delayed acceptance for Metropolis-Hastings algorithmsChristian Robert
 
Coordinate sampler: A non-reversible Gibbs-like sampler
Coordinate sampler: A non-reversible Gibbs-like samplerCoordinate sampler: A non-reversible Gibbs-like sampler
Coordinate sampler: A non-reversible Gibbs-like samplerChristian Robert
 
Multiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximationsMultiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximationsChristian Robert
 
Unbiased Bayes for Big Data
Unbiased Bayes for Big DataUnbiased Bayes for Big Data
Unbiased Bayes for Big DataChristian Robert
 
random forests for ABC model choice and parameter estimation
random forests for ABC model choice and parameter estimationrandom forests for ABC model choice and parameter estimation
random forests for ABC model choice and parameter estimationChristian Robert
 
Inference in generative models using the Wasserstein distance [[INI]
Inference in generative models using the Wasserstein distance [[INI]Inference in generative models using the Wasserstein distance [[INI]
Inference in generative models using the Wasserstein distance [[INI]Christian Robert
 
Laplace's Demon: seminar #1
Laplace's Demon: seminar #1Laplace's Demon: seminar #1
Laplace's Demon: seminar #1Christian Robert
 
better together? statistical learning in models made of modules
better together? statistical learning in models made of modulesbetter together? statistical learning in models made of modules
better together? statistical learning in models made of modulesChristian Robert
 
MCMC and likelihood-free methods
MCMC and likelihood-free methodsMCMC and likelihood-free methods
MCMC and likelihood-free methodsChristian Robert
 
Convergence of ABC methods
Convergence of ABC methodsConvergence of ABC methods
Convergence of ABC methodsChristian Robert
 
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithms
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithmsRao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithms
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithmsChristian Robert
 

Was ist angesagt? (20)

accurate ABC Oliver Ratmann
accurate ABC Oliver Ratmannaccurate ABC Oliver Ratmann
accurate ABC Oliver Ratmann
 
prior selection for mixture estimation
prior selection for mixture estimationprior selection for mixture estimation
prior selection for mixture estimation
 
ABC based on Wasserstein distances
ABC based on Wasserstein distancesABC based on Wasserstein distances
ABC based on Wasserstein distances
 
ABC in Venezia
ABC in VeneziaABC in Venezia
ABC in Venezia
 
Delayed acceptance for Metropolis-Hastings algorithms
Delayed acceptance for Metropolis-Hastings algorithmsDelayed acceptance for Metropolis-Hastings algorithms
Delayed acceptance for Metropolis-Hastings algorithms
 
ABC-Gibbs
ABC-GibbsABC-Gibbs
ABC-Gibbs
 
Coordinate sampler: A non-reversible Gibbs-like sampler
Coordinate sampler: A non-reversible Gibbs-like samplerCoordinate sampler: A non-reversible Gibbs-like sampler
Coordinate sampler: A non-reversible Gibbs-like sampler
 
Multiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximationsMultiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximations
 
Unbiased Bayes for Big Data
Unbiased Bayes for Big DataUnbiased Bayes for Big Data
Unbiased Bayes for Big Data
 
ABC-Gibbs
ABC-GibbsABC-Gibbs
ABC-Gibbs
 
random forests for ABC model choice and parameter estimation
random forests for ABC model choice and parameter estimationrandom forests for ABC model choice and parameter estimation
random forests for ABC model choice and parameter estimation
 
Inference in generative models using the Wasserstein distance [[INI]
Inference in generative models using the Wasserstein distance [[INI]Inference in generative models using the Wasserstein distance [[INI]
Inference in generative models using the Wasserstein distance [[INI]
 
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
 
Laplace's Demon: seminar #1
Laplace's Demon: seminar #1Laplace's Demon: seminar #1
Laplace's Demon: seminar #1
 
Nested sampling
Nested samplingNested sampling
Nested sampling
 
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
 
better together? statistical learning in models made of modules
better together? statistical learning in models made of modulesbetter together? statistical learning in models made of modules
better together? statistical learning in models made of modules
 
MCMC and likelihood-free methods
MCMC and likelihood-free methodsMCMC and likelihood-free methods
MCMC and likelihood-free methods
 
Convergence of ABC methods
Convergence of ABC methodsConvergence of ABC methods
Convergence of ABC methods
 
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithms
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithmsRao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithms
Rao-Blackwellisation schemes for accelerating Metropolis-Hastings algorithms
 

Andere mochten auch

Simulation (AMSI Public Lecture)
Simulation (AMSI Public Lecture)Simulation (AMSI Public Lecture)
Simulation (AMSI Public Lecture)Christian Robert
 
Bayesian Data Analysis for Ecology
Bayesian Data Analysis for EcologyBayesian Data Analysis for Ecology
Bayesian Data Analysis for EcologyChristian Robert
 
Semi-automatic ABC: a discussion
Semi-automatic ABC: a discussionSemi-automatic ABC: a discussion
Semi-automatic ABC: a discussionChristian Robert
 
Omiros' talk on the Bernoulli factory problem
Omiros' talk on the  Bernoulli factory problemOmiros' talk on the  Bernoulli factory problem
Omiros' talk on the Bernoulli factory problemBigMC
 
Introducing Monte Carlo Methods with R
Introducing Monte Carlo Methods with RIntroducing Monte Carlo Methods with R
Introducing Monte Carlo Methods with RChristian Robert
 
A Vanilla Rao-Blackwellisation
A Vanilla Rao-BlackwellisationA Vanilla Rao-Blackwellisation
A Vanilla Rao-BlackwellisationChristian Robert
 
Monte Carlo Statistical Methods
Monte Carlo Statistical MethodsMonte Carlo Statistical Methods
Monte Carlo Statistical MethodsChristian Robert
 
Presentation of Bassoum Abou on Stein's 1981 AoS paper
Presentation of Bassoum Abou on Stein's 1981 AoS paperPresentation of Bassoum Abou on Stein's 1981 AoS paper
Presentation of Bassoum Abou on Stein's 1981 AoS paperChristian Robert
 
Reading Birnbaum's (1962) paper, by Li Chenlu
Reading Birnbaum's (1962) paper, by Li ChenluReading Birnbaum's (1962) paper, by Li Chenlu
Reading Birnbaum's (1962) paper, by Li ChenluChristian Robert
 
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013Christian Robert
 
Reading the Lindley-Smith 1973 paper on linear Bayes estimators
Reading the Lindley-Smith 1973 paper on linear Bayes estimatorsReading the Lindley-Smith 1973 paper on linear Bayes estimators
Reading the Lindley-Smith 1973 paper on linear Bayes estimatorsChristian Robert
 
Course on Bayesian computational methods
Course on Bayesian computational methodsCourse on Bayesian computational methods
Course on Bayesian computational methodsChristian Robert
 
Theory of Probability revisited
Theory of Probability revisitedTheory of Probability revisited
Theory of Probability revisitedChristian Robert
 
Testing point null hypothesis, a discussion by Amira Mziou
Testing point null hypothesis, a discussion by Amira MziouTesting point null hypothesis, a discussion by Amira Mziou
Testing point null hypothesis, a discussion by Amira MziouChristian Robert
 
Reading Efron's 1979 paper on bootstrap
Reading Efron's 1979 paper on bootstrapReading Efron's 1979 paper on bootstrap
Reading Efron's 1979 paper on bootstrapChristian Robert
 

Andere mochten auch (20)

Simulation (AMSI Public Lecture)
Simulation (AMSI Public Lecture)Simulation (AMSI Public Lecture)
Simulation (AMSI Public Lecture)
 
Bayesian Data Analysis for Ecology
Bayesian Data Analysis for EcologyBayesian Data Analysis for Ecology
Bayesian Data Analysis for Ecology
 
Semi-automatic ABC: a discussion
Semi-automatic ABC: a discussionSemi-automatic ABC: a discussion
Semi-automatic ABC: a discussion
 
Omiros' talk on the Bernoulli factory problem
Omiros' talk on the  Bernoulli factory problemOmiros' talk on the  Bernoulli factory problem
Omiros' talk on the Bernoulli factory problem
 
Shanghai tutorial
Shanghai tutorialShanghai tutorial
Shanghai tutorial
 
Introducing Monte Carlo Methods with R
Introducing Monte Carlo Methods with RIntroducing Monte Carlo Methods with R
Introducing Monte Carlo Methods with R
 
Savage-Dickey paradox
Savage-Dickey paradoxSavage-Dickey paradox
Savage-Dickey paradox
 
A Vanilla Rao-Blackwellisation
A Vanilla Rao-BlackwellisationA Vanilla Rao-Blackwellisation
A Vanilla Rao-Blackwellisation
 
Monte Carlo Statistical Methods
Monte Carlo Statistical MethodsMonte Carlo Statistical Methods
Monte Carlo Statistical Methods
 
Jsm09 talk
Jsm09 talkJsm09 talk
Jsm09 talk
 
Presentation of Bassoum Abou on Stein's 1981 AoS paper
Presentation of Bassoum Abou on Stein's 1981 AoS paperPresentation of Bassoum Abou on Stein's 1981 AoS paper
Presentation of Bassoum Abou on Stein's 1981 AoS paper
 
Reading Birnbaum's (1962) paper, by Li Chenlu
Reading Birnbaum's (1962) paper, by Li ChenluReading Birnbaum's (1962) paper, by Li Chenlu
Reading Birnbaum's (1962) paper, by Li Chenlu
 
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013
Reading Testing a point-null hypothesis, by Jiahuan Li, Feb. 25, 2013
 
Reading the Lindley-Smith 1973 paper on linear Bayes estimators
Reading the Lindley-Smith 1973 paper on linear Bayes estimatorsReading the Lindley-Smith 1973 paper on linear Bayes estimators
Reading the Lindley-Smith 1973 paper on linear Bayes estimators
 
ABC in Roma
ABC in RomaABC in Roma
ABC in Roma
 
Course on Bayesian computational methods
Course on Bayesian computational methodsCourse on Bayesian computational methods
Course on Bayesian computational methods
 
Reading Neyman's 1933
Reading Neyman's 1933 Reading Neyman's 1933
Reading Neyman's 1933
 
Theory of Probability revisited
Theory of Probability revisitedTheory of Probability revisited
Theory of Probability revisited
 
Testing point null hypothesis, a discussion by Amira Mziou
Testing point null hypothesis, a discussion by Amira MziouTesting point null hypothesis, a discussion by Amira Mziou
Testing point null hypothesis, a discussion by Amira Mziou
 
Reading Efron's 1979 paper on bootstrap
Reading Efron's 1979 paper on bootstrapReading Efron's 1979 paper on bootstrap
Reading Efron's 1979 paper on bootstrap
 

Ähnlich wie Bayesian model choice in cosmology

R. Sheth - The Phenomenology of Large Scale Structure
R. Sheth - The Phenomenology of Large Scale StructureR. Sheth - The Phenomenology of Large Scale Structure
R. Sheth - The Phenomenology of Large Scale StructureSEENET-MTP
 
Bruce Bassett - Constraining Exotic Cosmologies
Bruce Bassett - Constraining Exotic CosmologiesBruce Bassett - Constraining Exotic Cosmologies
Bruce Bassett - Constraining Exotic CosmologiesCosmoAIMS Bassett
 
Cosmological parameter
Cosmological parameterCosmological parameter
Cosmological parameterSubhasis Shit
 
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...SEENET-MTP
 
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...SEENET-MTP
 
The significance of_the_integrated_sachs_wolfe_effect_revisited
The significance of_the_integrated_sachs_wolfe_effect_revisitedThe significance of_the_integrated_sachs_wolfe_effect_revisited
The significance of_the_integrated_sachs_wolfe_effect_revisitedSérgio Sacani
 
Predicting neutrino mass constraints from galaxy cluster surveys
Predicting neutrino mass constraints from galaxy cluster surveysPredicting neutrino mass constraints from galaxy cluster surveys
Predicting neutrino mass constraints from galaxy cluster surveysjlynnmuir
 
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...SEENET-MTP
 
The multiverse interpretation of quantum mechanics
The multiverse interpretation of quantum mechanicsThe multiverse interpretation of quantum mechanics
The multiverse interpretation of quantum mechanicsSérgio Sacani
 
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)SEENET-MTP
 
The distribution and_annihilation_of_dark_matter_around_black_holes
The distribution and_annihilation_of_dark_matter_around_black_holesThe distribution and_annihilation_of_dark_matter_around_black_holes
The distribution and_annihilation_of_dark_matter_around_black_holesSérgio Sacani
 
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...JeremyHeyl
 
CS221: HMM and Particle Filters
CS221: HMM and Particle FiltersCS221: HMM and Particle Filters
CS221: HMM and Particle Filterszukun
 
The Physics of Gas Sloshing in Galaxy Clusters
The Physics of Gas Sloshing in Galaxy ClustersThe Physics of Gas Sloshing in Galaxy Clusters
The Physics of Gas Sloshing in Galaxy ClustersJohn ZuHone
 
Neutron Skin Measurements at Mainz
Neutron Skin Measurements at MainzNeutron Skin Measurements at Mainz
Neutron Skin Measurements at MainzConcettina Sfienti
 
Dark energy by david spergel
Dark energy by david spergelDark energy by david spergel
Dark energy by david spergelKumar
 
Bp219 04-13-2011
Bp219 04-13-2011Bp219 04-13-2011
Bp219 04-13-2011waddling
 

Ähnlich wie Bayesian model choice in cosmology (20)

R. Sheth - The Phenomenology of Large Scale Structure
R. Sheth - The Phenomenology of Large Scale StructureR. Sheth - The Phenomenology of Large Scale Structure
R. Sheth - The Phenomenology of Large Scale Structure
 
Bruce Bassett - Constraining Exotic Cosmologies
Bruce Bassett - Constraining Exotic CosmologiesBruce Bassett - Constraining Exotic Cosmologies
Bruce Bassett - Constraining Exotic Cosmologies
 
Cosmological parameter
Cosmological parameterCosmological parameter
Cosmological parameter
 
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...
H. Stefancic: The Accelerated Expansion of the Universe and the Cosmological ...
 
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...
R. Jimenez: Fundamental Physics Beyond the Standard Model from Astronomical O...
 
The significance of_the_integrated_sachs_wolfe_effect_revisited
The significance of_the_integrated_sachs_wolfe_effect_revisitedThe significance of_the_integrated_sachs_wolfe_effect_revisited
The significance of_the_integrated_sachs_wolfe_effect_revisited
 
Predicting neutrino mass constraints from galaxy cluster surveys
Predicting neutrino mass constraints from galaxy cluster surveysPredicting neutrino mass constraints from galaxy cluster surveys
Predicting neutrino mass constraints from galaxy cluster surveys
 
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...
D. Vulcanov: Symbolic Computation Methods in Cosmology and General Relativity...
 
Causal csa
Causal csaCausal csa
Causal csa
 
Gct sfp cp-25112015
Gct sfp cp-25112015Gct sfp cp-25112015
Gct sfp cp-25112015
 
The multiverse interpretation of quantum mechanics
The multiverse interpretation of quantum mechanicsThe multiverse interpretation of quantum mechanics
The multiverse interpretation of quantum mechanics
 
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)
Introduction to cosmology and numerical cosmology (with the Cactus code) (1/2)
 
The distribution and_annihilation_of_dark_matter_around_black_holes
The distribution and_annihilation_of_dark_matter_around_black_holesThe distribution and_annihilation_of_dark_matter_around_black_holes
The distribution and_annihilation_of_dark_matter_around_black_holes
 
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...
Gwendolyn Eadie: A New Method for Time Series Analysis in Astronomy with an A...
 
CS221: HMM and Particle Filters
CS221: HMM and Particle FiltersCS221: HMM and Particle Filters
CS221: HMM and Particle Filters
 
The Physics of Gas Sloshing in Galaxy Clusters
The Physics of Gas Sloshing in Galaxy ClustersThe Physics of Gas Sloshing in Galaxy Clusters
The Physics of Gas Sloshing in Galaxy Clusters
 
Neutron Skin Measurements at Mainz
Neutron Skin Measurements at MainzNeutron Skin Measurements at Mainz
Neutron Skin Measurements at Mainz
 
Dark energy by david spergel
Dark energy by david spergelDark energy by david spergel
Dark energy by david spergel
 
Bp219 04-13-2011
Bp219 04-13-2011Bp219 04-13-2011
Bp219 04-13-2011
 
Bachelor's Thesis
Bachelor's ThesisBachelor's Thesis
Bachelor's Thesis
 

Mehr von Christian Robert

Asymptotics of ABC, lecture, Collège de France
Asymptotics of ABC, lecture, Collège de FranceAsymptotics of ABC, lecture, Collège de France
Asymptotics of ABC, lecture, Collège de FranceChristian Robert
 
Workshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinWorkshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinChristian Robert
 
How many components in a mixture?
How many components in a mixture?How many components in a mixture?
How many components in a mixture?Christian Robert
 
Testing for mixtures at BNP 13
Testing for mixtures at BNP 13Testing for mixtures at BNP 13
Testing for mixtures at BNP 13Christian Robert
 
Inferring the number of components: dream or reality?
Inferring the number of components: dream or reality?Inferring the number of components: dream or reality?
Inferring the number of components: dream or reality?Christian Robert
 
Testing for mixtures by seeking components
Testing for mixtures by seeking componentsTesting for mixtures by seeking components
Testing for mixtures by seeking componentsChristian Robert
 
discussion on Bayesian restricted likelihood
discussion on Bayesian restricted likelihooddiscussion on Bayesian restricted likelihood
discussion on Bayesian restricted likelihoodChristian Robert
 
CISEA 2019: ABC consistency and convergence
CISEA 2019: ABC consistency and convergenceCISEA 2019: ABC consistency and convergence
CISEA 2019: ABC consistency and convergenceChristian Robert
 
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment models
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment modelsa discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment models
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment modelsChristian Robert
 
Poster for Bayesian Statistics in the Big Data Era conference
Poster for Bayesian Statistics in the Big Data Era conferencePoster for Bayesian Statistics in the Big Data Era conference
Poster for Bayesian Statistics in the Big Data Era conferenceChristian Robert
 
short course at CIRM, Bayesian Masterclass, October 2018
short course at CIRM, Bayesian Masterclass, October 2018short course at CIRM, Bayesian Masterclass, October 2018
short course at CIRM, Bayesian Masterclass, October 2018Christian Robert
 

Mehr von Christian Robert (18)

Asymptotics of ABC, lecture, Collège de France
Asymptotics of ABC, lecture, Collège de FranceAsymptotics of ABC, lecture, Collège de France
Asymptotics of ABC, lecture, Collège de France
 
Workshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinWorkshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael Martin
 
discussion of ICML23.pdf
discussion of ICML23.pdfdiscussion of ICML23.pdf
discussion of ICML23.pdf
 
How many components in a mixture?
How many components in a mixture?How many components in a mixture?
How many components in a mixture?
 
restore.pdf
restore.pdfrestore.pdf
restore.pdf
 
Testing for mixtures at BNP 13
Testing for mixtures at BNP 13Testing for mixtures at BNP 13
Testing for mixtures at BNP 13
 
Inferring the number of components: dream or reality?
Inferring the number of components: dream or reality?Inferring the number of components: dream or reality?
Inferring the number of components: dream or reality?
 
CDT 22 slides.pdf
CDT 22 slides.pdfCDT 22 slides.pdf
CDT 22 slides.pdf
 
Testing for mixtures by seeking components
Testing for mixtures by seeking componentsTesting for mixtures by seeking components
Testing for mixtures by seeking components
 
discussion on Bayesian restricted likelihood
discussion on Bayesian restricted likelihooddiscussion on Bayesian restricted likelihood
discussion on Bayesian restricted likelihood
 
eugenics and statistics
eugenics and statisticseugenics and statistics
eugenics and statistics
 
ABC-Gibbs
ABC-GibbsABC-Gibbs
ABC-Gibbs
 
asymptotics of ABC
asymptotics of ABCasymptotics of ABC
asymptotics of ABC
 
the ABC of ABC
the ABC of ABCthe ABC of ABC
the ABC of ABC
 
CISEA 2019: ABC consistency and convergence
CISEA 2019: ABC consistency and convergenceCISEA 2019: ABC consistency and convergence
CISEA 2019: ABC consistency and convergence
 
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment models
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment modelsa discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment models
a discussion of Chib, Shin, and Simoni (2017-8) Bayesian moment models
 
Poster for Bayesian Statistics in the Big Data Era conference
Poster for Bayesian Statistics in the Big Data Era conferencePoster for Bayesian Statistics in the Big Data Era conference
Poster for Bayesian Statistics in the Big Data Era conference
 
short course at CIRM, Bayesian Masterclass, October 2018
short course at CIRM, Bayesian Masterclass, October 2018short course at CIRM, Bayesian Masterclass, October 2018
short course at CIRM, Bayesian Masterclass, October 2018
 

Kürzlich hochgeladen

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfSanaAli374401
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 

Kürzlich hochgeladen (20)

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 

Bayesian model choice in cosmology

  • 1. Bayesian Model Comparison in Cosmology Bayesian Model Comparison in Cosmology with Population Monte Carlo Monthly Notices Royal Astronomical Soc. 405 (4), 2381 - 2390, 2010 Christian P. Robert Universit´ Paris Dauphine & CREST e http://www.ceremade.dauphine.fr/~ xian Joint works with D., Benabed K., Capp´ O., Cardoso J.F., Fort G., Kilbinger M., e [Marin J.-M., Mira A.,] Prunet S., Wraith D.
  • 2. Bayesian Model Comparison in Cosmology Outline 1 Cosmology background 2 Importance sampling 3 Application to cosmological data 4 Evidence approximation 5 Cosmology models 6 lexicon
  • 3. Bayesian Model Comparison in Cosmology Cosmology background Cosmology A large part of the data to answer some of the major questions in cosmology comes from studying the Cosmic Microwave Background (CMB) radiation (fossil heat released circa 380,000 years after the BB). Huge uniformity of the CMB. Only very sensitive instruments like such as WMAP (NASA, 2001) can detect fluctuations CMB temperature e.g minute temperature variations: one part of the sky has a temperature of 2.7251 Kelvin (degrees above absolute zero), while another part of the sky has a temperature of 2.7249 Kelvin
  • 4. Bayesian Model Comparison in Cosmology Cosmology background Cosmology A large part of the data to answer some of the major questions in cosmology comes from studying the Cosmic Microwave Background (CMB) radiation (fossil heat released circa 380,000 years after the BB). 1.0 5 0.8 4 0.6 3 0.4 2 0.2 1 0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 −0.1 0.0 0.1 0.2 0.3 0.4 0.5 0.6 CMB [Marin & CPR, Bayesian Core, 2007]
  • 5. Bayesian Model Comparison in Cosmology Cosmology background Plank Temperature variations are related to fluctuations in the density of matter in the early universe and thus carry information about the initial conditions for the formation of cosmic structures such as galaxies, clusters, and voids for example. Planck Joint mission between the European Space Agency (ESA) and NASA, launched in May 2009. The Planck mission plans to provide datasets of nearly 5 × 1010 observations to settle many open questions with CMB temperature data. Rather than scalar valued observations, Planck will provide tensor-valued data and thus is likely to also open up this area of statistical research.
  • 6. Bayesian Model Comparison in Cosmology Cosmology background Plank Temperature variations are related to fluctuations in the density of matter in the early universe and thus carry information about the initial conditions for the formation of cosmic structures such as galaxies, clusters, and voids for example. Planck Joint mission between the European Space Agency (ESA) and NASA, launched in May 2009. The Planck mission plans to provide datasets of nearly 5 × 1010 observations to settle many open questions with CMB temperature data. Rather than scalar valued observations, Planck will provide tensor-valued data and thus is likely to also open up this area of statistical research.
  • 7. Bayesian Model Comparison in Cosmology Cosmology background .
  • 8. Bayesian Model Comparison in Cosmology Cosmology background Some questions in cosmology Will the universe expand forever, or will it collapse? Is the universe dominated by exotic dark matter and what is its concentration? What is the shape of the universe? Is the expansion of the universe accelerating rather than decelerating? Is the “flat ΛCDM paradigm” appropriate or is the curvature different from zero? [Adams, The Guide [a.k.a. H2G2], 1979]
  • 9. Bayesian Model Comparison in Cosmology Cosmology background Statistical problems in cosmology Potentially high dimensional parameter space [Not considered here] Immensely slow computation of likelihoods, e.g WMAP, CMB, because of numerically costly spectral transforms [Data is a Fortran program] Nonlinear dependence and degeneracies between parameters introduced by physical constraints or theoretical assumptions 2.5 0.0 2.0 −1.0 w0 α 1.5 −2.0 1.0 −3.0 0.0 0.2 0.4 0.6 0.8 1.0 1.2 19.1 19.3 19.5 19.7 Ωm −M
  • 10. Bayesian Model Comparison in Cosmology Importance sampling Importance sampling solutions 1 Cosmology background 2 Importance sampling Adaptive importance sampling Adaptive multiple importance sampling 3 Application to cosmological data 4 Evidence approximation 5 Cosmology models 6 lexicon
  • 11. Bayesian Model Comparison in Cosmology Importance sampling Importance sampling 101 Importance sampling is based on the fundamental identity π(x) π(f ) = f (x)π(x) dx = f (x) q(x) dx q(x) If x1 , . . . , xN are drawn independently from q, N π(xn )/q(xn ) π (f ) = ˆ f (xn )wn ; ¯ wn = ¯ N , n=1 m=1 π(xm )/q(xm ) provides a converging approximation to π(f ) (independent of the normalisation of π).
  • 12. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Initialising importance sampling PMC/AIS offers a solution to the difficulty of picking q through adaptivity: Given a target π, PMC produces a sequence q t of importance functions (t = 1, . . . , T ) aimed at approximating π First sample produced by a regular importance sampling scheme, x1 , . . . , x1 ∼ q 1 , associated with importance weights 1 N 1 π(x1 )n wn = q 1 (x1 ) n ¯1 and their normalised counterparts wn , providing a first approximation to a sample from π. Moments of π can then be approximated to construct an updated importance function q 2 , &c.
  • 13. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Adaptive importance sampling Optimality criterion? The quality of approximation can be measured in terms of the Kullback divergence from the target, π(x) D(π q t ) = log π(x)dx, q t (x) and the density q t can be adjusted incrementally to minimize this divergence.
  • 14. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling PMC – Some papers Capp´ et al (2004) - J. Comput. Graph. Stat. e Outline of Population Monte Carlo but missed main point Celeux et al (2005) - Comput. Stat. & Data Analysis Rao-Blackwellisation for importance sampling and missing data problems Douc et al (2007) - ESAIM Prob. & Stat. and Annals of Statistics Convergence issues proving adaptation is positive where q is a mixture density of random-walk proposals (mixture weights varied) Capp´ et al (2007) - Stat. & Computing e Adaptation of q (mixture density of independent proposals), where weights and parameters vary Wraith et al (2009) - Physical Review D Application of Capp´ et al (2007) to cosmology and comparison with MCMC e Beaumont et al (2009) - Biometrika Application of Capp´ et al (2007) to ABC settings e Kilbinger et al (2010) - Month. N. Royal Astro. Soc. Application of Capp´ et al (2007) to model choice in cosmology e
  • 15. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Adaptive importance sampling (2) Use of mixture densities D t t t q (x) = q(x; α , θ ) = d t αt ϕ(x; θd ) d=1 [West, 1993] where αt = (αt , . . . , αt ) is a vector of adaptable weights for the D 1 D mixture components θ t = (θ1 , . . . , θD ) is a vector of parameters which specify the t t components ϕ is a parameterised density (usually taken to be multivariate Gaussian or Student-t, the later preferred)
  • 16. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Capp´ et al (2007) optimal scheme e Update q t using an integrated EM approach minimising the KL divergence at each iteration π(x) D(π q t ) = log D π(x)dx, t t d=1 αd ϕ(x; θd ) equivalent to maximising D ℓ(α, θ) = log αd ϕ(x; θd ) π(x) dx d=1 in α, θ.
  • 17. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling PMC updates Maximization of Lt (α, θ) leads to closed form solutions in exponential families (and for the t distributions) For instance for Np (µd , Σd ): αt+1 = d ρd (x; αt , µt , Σt )π(x)dx, xρd (x; αt , µt , Σt )π(x)dx µt+1 = d , αt+1 d (x − µt+1 )(x − µt+1 )T ρd (x; αt , µt , Σt )π(x)dx Σt+1 = d d d . αt+1 d
  • 18. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Empirical updates And empirical versions, N αt+1 = X d ¯t wn ρd (xt ; αt , µt , Σt ) n n=1 PN wn xt ρd (xt ; αt , µt , Σt ) ¯t n n µt+1 = d n=1 αt+1 d Σt+1 d = PN n=1 wn (xt − µt+1 )(xt − µt+1 )T ρd (xt ; αt , µt , Σt ) ¯t n d n d n αt+1 d
  • 19. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Banana benchmark 2 Twisted Np (0, Σ) target with Σ = diag(σ1 , 1, . . . , 1), changing the 2 2 second co-ordinate x2 to x2 + b(x1 − σ1 ) 20 10 0 −10 x2 −20 −30 −40 −40 −20 0 20 40 x1 2 p = 10, σ1 = 100, b = 0.03 [Haario et al. 1999]
  • 20. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Simulation 20 20 10 10 0 0 −20 −20 −40 −40 −40 −20 0 20 40 −40 −20 0 20 40 20 20 10 10 0 0 −20 −20 −40 −40 −40 −20 0 20 40 −40 −20 0 20 40 20 20 10 10 0 0 −20 −20 −40 −40 −40 −20 0 20 40 −40 −20 0 20 40
  • 21. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Monitoring by perplexity Stop iterations when further adaptations do not improve D(π q t ). The transform exp[−D(π q t )] may be estimated by the normalised perplexity p = exp(Ht )/N, where N N Ht = − N ¯t ¯t wn log wn n=1 is the Shannon entropy of the normalised weights Thus, minimization of the Kullback divergence can be approximately connected with the maximization of the perplexity (normalised) (values closer to 1 indicating good agreement between q and π).
  • 22. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Monitoring by ESS A second criterion is the effective sample size (ESS) N −1 2 ESSt N = ¯t wn n=1 which can be interpreted as the number of equivalent iid sample points.
  • 23. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Simulation 0.8 0.6 NPERPL 0.4 0.2 0.0 1 2 3 4 5 6 7 8 9 10 0.8 0.6 NESS 0.4 0.2 0.0 1 2 3 4 5 6 7 8 9 10 Normalised perplexity (top panel) and normalised effective sample size(ESS/N) (bottom panel) estimates for the first 10 iterations of PMC
  • 24. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Comparison to MCMC Adaptive MCMC: Proposal is a multivariate Gaussian with Σ updated/based on previous values in the chain. Scale and update times chosen for optimal results. PMC MCMC fa fa fb fb Evolution of π(fa ) (top panels) and π(fb ) (bottom panels) from 10k points to 100k points for both PMC (left panels) and MCMC (right panels).
  • 25. Bayesian Model Comparison in Cosmology Importance sampling Adaptive importance sampling Simulation 0.74 fc fe fh Propoportion of points inside 0.70 0.66 0.62 PMC d10 PMC MCMC d10 MCMC PMC d2 PMC MCMC d2 MCMC PMC d1 PMC MCMC d1 MCMC 1.00 fd fg fi Propoportion of points inside 0.96 0.92 0.88 PMC d10 PMC MCMC d10 MCMC PMC d2 PMC MCMC d2 MCMC PMC d1 PMC MCMC d1 MCMC Results showing the distributions of the PMC and the MCMC estimates. All estimates are based on 500 simulation runs.
  • 26. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Adaptive multiple importance sampling Full recycling: At iteration t, design a new proposal qt based on all previous samples x1 , . . . , x1 , . . . , xt−1 , . . . , xt−1 1 N 1 N At each stage, the whole past can be used: if un-normalised weights ωi,t are preserved along iterations, then all xt ’s can be i pooled together
  • 27. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Adaptive multiple importance sampling Full recycling: At iteration t, design a new proposal qt based on all previous samples x1 , . . . , x1 , . . . , xt−1 , . . . , xt−1 1 N 1 N At each stage, the whole past can be used: if un-normalised weights ωi,t are preserved along iterations, then all xt ’s can be i pooled together
  • 28. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Caveat When using several importance functions at once, q0 , . . . , qT , with samples x0 , . . . , x0 0 , . . ., xT , . . . , xT T and importance weights 1 N 1 N t ωi = π(xt )/qt (xt ), merging thru the empirical distribution i i t t ωi δxt (x) i ωi ≈ π(x) t,i t,i Fails to cull poor proposals: very large weights do remain large in the cumulated sample and poorly performing samples overwhelmingly dominate other samples in the final outcome. c Raw mixing of importance samples may be harmful, compared with a single sample, even when most proposals are efficient.
  • 29. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Caveat When using several importance functions at once, q0 , . . . , qT , with samples x0 , . . . , x0 0 , . . ., xT , . . . , xT T and importance weights 1 N 1 N t ωi = π(xt )/qt (xt ), merging thru the empirical distribution i i t t ωi δxt (x) i ωi ≈ π(x) t,i t,i Fails to cull poor proposals: very large weights do remain large in the cumulated sample and poorly performing samples overwhelmingly dominate other samples in the final outcome. c Raw mixing of importance samples may be harmful, compared with a single sample, even when most proposals are efficient.
  • 30. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Deterministic mixtures Owen and Zhou (2000) propose a stabilising recycling of the weights via deterministic mixtures by modifying the importance density qt (xt ) under which xt was truly simulated to a mixture of i i all the densities that have been used so far T 1 T Nt qt (xT ) , i j=0 Nj t=0 resulting into the deterministic mixture weight T t 1 ωi = π(xt ) i T Nt qt (xt ) . i j=0 Nj t=0
  • 31. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Unbiasedness Potential to exploit the most efficient proposals in the sequence Q0 , . . . , QT without rejecting any simulated value nor sample. Poorly performing importance functions are simply eliminated through the erosion of their weights T 1 π(xt ) i T Nl ql (xt ) i j=0 Nj l=0 as T increases. Paradoxical feature of competing acceptable importance weights for the same simulated value well-understood in the cases of Rao-Blackwellisation and of Population Monte Carlo. More intricated here in that only unbiasedness remains [fake mixture]
  • 32. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Unbiasedness Potential to exploit the most efficient proposals in the sequence Q0 , . . . , QT without rejecting any simulated value nor sample. Poorly performing importance functions are simply eliminated through the erosion of their weights T 1 π(xt ) i T Nl ql (xt ) i j=0 Nj l=0 as T increases. Paradoxical feature of competing acceptable importance weights for the same simulated value well-understood in the cases of Rao-Blackwellisation and of Population Monte Carlo. More intricated here in that only unbiasedness remains [fake mixture]
  • 33. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling AMIS AMIS (or Adaptive Multiple Importance Sampling) uses importance sampling functions (qt ) that are constructed sequentially and adaptively, using past t − 1 weighted samples. i weights of all present and past variables xl i (1 ≤ l ≤ t , 1 ≤ j ≤ Nt ) are modified, based on the current proposals ii the entire collection of importance samples is used to build the next importance function. [Parallel with IMIS: Raftery & Bo, 2010]
  • 34. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling The AMIS algorithm Adaptive Multiple Importance Sampling At iteration t = 1, . . . , T ˆ 1) Independently generate Nt particles xt ∼ q(x|θ t−1 ) i t ˆl−1 2) For 1 ≤ i ≤ Nt , compute the mixture at xi δi = N0 q0 (xt ) + t Pt ffi t i l=1 Nl q(xi ; θ ) and derive the t t t ‹ t Pt weight of xi , ωi = π(xi ) [δi {N0 + l=0 Nl }] . 3) For 0 ≤ l ≤ t − 1 and 1 ≤ i ≤ Nl , actualise past weights as t l l l ˆt−1 l l ‹ l‹ X δi = δi + q(xi ; θ ) and ωi = π(xi ) [δi {N0 + Nl }] . l=0 ˆ 4) Compute the parameter estimate θ t based on 0 0 0 0 t t t t ({x1 , ω1 }, . . . , {xN , ωN }, . . . , {x1 , ω1 }, . . . , {xN , ωN }) 0 0 t t [Cornuet, Marin, Mira & CPR, 2009, arXiv:0907.1254]
  • 35. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Studentised AMIS When the proposal distribution qt is a Student’s t proposal, T3 (µ, Σ) mean µ and covariance Σ parameters can be updated by estimating first two moments of the target distribution Π Pt PNl l l Pt PNl l=0 i=1 ω x ˆ l=0 ωi (xl − µt )(xl − µt )T l ˆ ˆ µt = Pt PN i i ˆ and Σt = i=1 i Pt PNl l i . l l l=0 i=1 ωi l=0 i=1 ωi i.e. using optimal update of Capp´ et al. (2007) e Obvious extension to mixtures [and again optimal update of Capp´ e et al. (2007)]
  • 36. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Studentised AMIS When the proposal distribution qt is a Student’s t proposal, T3 (µ, Σ) mean µ and covariance Σ parameters can be updated by estimating first two moments of the target distribution Π Pt PNl l l Pt PNl l=0 i=1 ω x ˆ l=0 ωi (xl − µt )(xl − µt )T l ˆ ˆ µt = Pt PN i i ˆ and Σt = i=1 i Pt PNl l i . l l l=0 i=1 ωi l=0 i=1 ωi i.e. using optimal update of Capp´ et al. (2007) e Obvious extension to mixtures [and again optimal update of Capp´ e et al. (2007)]
  • 37. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Simulations Same banana benchmark Target function p AMIS Capp´’07 e 5 0.06558 0.06879 E(x1 ) = 0 10 0.06388 0.11051 20 0.09167 0.17912 5 0.10215 0.11583 E(x2 ) = 0 10 0.21421 0.22557 20 0.25316 0.29087 P5 E(xi ) = 0 5 0.00478 0.00927 Pi=3 10 E(xi ) = 0 10 0.00902 0.02099 Pi=3 20 i=3 E(xi ) = 0 20 0.01666 0.04208 5 2.60672 3.92650 var(x1 ) = 100 10 7.06686 7.48877 20 8.20020 9.71725 5 2.10682 2.96132 var(x2 ) = 19 10 3.76660 5.08474 20 4.85407 5.98031 P5 var(xi ) = 3 5 0.00645 0.01196 Pi=3 10 i=3 var(xi ) = 8 P20 10 0.01370 0.02636 i=3 var(xi ) = 18 20 0.04609 0.06424 Root mean square errors calculated over 10 replications for different target functions and dimensions p.
  • 38. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Simulation (cont’d) 10 replicate ESSs for AMIS (left) and PMC (right) for p = 5, 10, 20.
  • 39. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Simulation (cont’d) 10 replicate absolute errors associated to the estimations of E(x1 ) (left column), E(x2 ) (center column) and p E(xi ) (right column) using AMIS (left in each P i=3 block) and PMC (right) for p = 5, 10, 20.
  • 40. Bayesian Model Comparison in Cosmology Importance sampling Adaptive multiple importance sampling Simulation (cont’d) 10 replicate absolute errors associated to the estimations of var(x1 ) (left column), var(x2 ) (center column) and p var(xi ) (right column) using AMIS (left in each P i=3 block) and PMC (right) for p = 5, 10, 20.
  • 41. Bayesian Model Comparison in Cosmology Application to cosmological data Cosmological data Posterior distribution of cosmological parameters for recent observational data of CMB anisotropies (differences in temperature from directions) [WMAP], SNIa, and cosmic shear. Combination of three likelihoods, some of which are available as public (Fortran) code, and of a uniform prior on a hypercube.
  • 42. Bayesian Model Comparison in Cosmology Application to cosmological data Cosmology parameters Parameters for the cosmology likelihood (C=CMB, S=SNIa, L=lensing) Symbol Description Minimum Maximum Experiment Ωb Baryon density 0.01 0.1 C L Ωm Total matter density 0.01 1.2 C S L w Dark-energy eq. of state -3.0 0.5 C S L ns Primordial spectral index 0.7 1.4 C L ∆2R Normalization (large scales) C σ8 Normalization (small scales) C L h Hubble constant C L τ Optical depth C M Absolute SNIa magnitude S α Colour response S β Stretch response S a L b galaxy z-distribution fit L c L For WMAP5, σ8 is a deduced quantity that depends on the other parameters
  • 43. Bayesian Model Comparison in Cosmology Application to cosmological data Adaptation of importance function
  • 44. Bayesian Model Comparison in Cosmology Application to cosmological data Estimates Parameter PMC MCMC Ωb 0.0432+0.0027 −0.0024 0.0432+0.0026 −0.0023 Ωm 0.254+0.018 −0.017 0.253+0.018 −0.016 τ 0.088+0.018 −0.016 0.088+0.019 −0.015 +0.059 w −1.011 ± 0.060 −1.010−0.060 ns 0.963+0.015 −0.014 0.963+0.015 −0.014 109 ∆2 R 2.413+0.098 −0.093 2.414+0.098 −0.092 h 0.720+0.022 −0.021 0.720+0.023 −0.021 a 0.648+0.040 −0.041 0.649+0.043 −0.042 b 9.3+1.4 −0.9 9.3+1.7 −0.9 c 0.639+0.084 −0.070 0.639+0.082 −0.070 +0.029 −M 19.331 ± 0.030 19.332−0.031 α 1.61+0.15 −0.14 1.62+0.16 −0.14 −β −1.82+0.17 −0.16 −1.82 ± 0.16 σ8 0.795+0.028 −0.030 0.795+0.030 −0.027 Means and 68% credible intervals using lensing, SNIa and CMB
  • 45. Bayesian Model Comparison in Cosmology Application to cosmological data Advantage of AIS and PMC? Parallelisation of the posterior calculations - For the cosmological examples, we used up to 100 CPUs on a computer cluster to explore the cosmology posteriors using AIS/PMC. Reducing the computational time from several days for MCMC to a few hours using PMC. Low variance of Monte Carlo estimates - For PMC and q closely matched to π, significant reductions in the variance of the Monte Carlo estimates are possible compared to estimates using MCMC. Also translating into a computational saving, with further savings possible by combining samples across iterations Simple diagnostics of ‘convergence’ (perplexity) - For PMC, the perplexity provides a relatively simple measure of sampling adequacy to the target density of interest
  • 46. Bayesian Model Comparison in Cosmology Evidence approximation Evidence/Marginal likelihood/Integrated Likelihood ... Central quantity of interest in (Bayesian) model choice π(x) E= π(x)dx = q(x)dx. q(x) expressed as an expectation under any density q with large enough support. Importance sampling provides a sample x1 , . . . xN ∼ q and approximation of the above integral, N E≈ wn n=1 π(xn ) where the wn = q(xn ) are the (unnormalised) importance weights.
  • 47. Bayesian Model Comparison in Cosmology Evidence approximation Evidence/Marginal likelihood/Integrated Likelihood ... Central quantity of interest in (Bayesian) model choice π(x) E= π(x)dx = q(x)dx. q(x) expressed as an expectation under any density q with large enough support. Importance sampling provides a sample x1 , . . . xN ∼ q and approximation of the above integral, N E≈ wn n=1 π(xn ) where the wn = q(xn ) are the (unnormalised) importance weights.
  • 48. Bayesian Model Comparison in Cosmology Evidence approximation Back to the banana ... Centred d-multivariate normal, x ∼ Nd (0, Σ) with covariance 2 Σ = diag(σ1 , 1, . . . , 1), which is slightly twisted in the first two 1 2 dimensions by changing x2 to be x2 + β(x2 − σ1 ). where σ1 = 100 2 and β controls the degree of curvature. We integrate over the unormalised target density E= π(β)f (x|β, Σ) dβ or E= π(x|β, Σ) dx.
  • 49. Bayesian Model Comparison in Cosmology Evidence approximation Simulation results (1) 10 10 0 0 −10 −10 x2 x2 −20 −20 −30 −30 −40 −20 0 20 40 −40 −20 0 20 40 x1 x1 0.03004 −264.028 Posterior mean of β Evidence (log) 0.03000 −264.032 0.02996 −264.036 0.02992 After 10th iteration After 10th iteration β unknown
  • 50. Bayesian Model Comparison in Cosmology Evidence approximation Simulation results (2) 0.8 0.8 0.6 0.6 Perplexity NESS 0.4 0.4 0.2 0.2 0.0 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 Iteration Iteration Evidence (log): final sample 0.2 0.015 Evidence (log) 0.1 0.005 0.0 −0.015 −0.005 −0.1 1 2 3 4 5 6 7 8 9 10 Iteration After 10th iteration β = 0.015 known
  • 51. Bayesian Model Comparison in Cosmology Cosmology models Back to cosmology questions Standard cosmology successful in explaining recent observations, such as CMB, SNIa, galaxy clustering, cosmic shear, galaxy cluster counts, and Lyα forest clustering. Flat ΛCDM model with only six free parameters (Ωm , Ωb , h, ns , τ, σ8 ) Extensions to ΛCDM may be based on independent evidence (massive neutrinos from oscillation experiments), predicted by compelling hypotheses (primordial gravitational waves from inflation) or reflect ignorance about fundamental physics (dynamical dark energy). Testing for dark energy, curvature, and inflationary models
  • 52. Bayesian Model Comparison in Cosmology Cosmology models Back to cosmology questions Standard cosmology successful in explaining recent observations, such as CMB, SNIa, galaxy clustering, cosmic shear, galaxy cluster counts, and Lyα forest clustering. Flat ΛCDM model with only six free parameters (Ωm , Ωb , h, ns , τ, σ8 ) Extensions to ΛCDM may be based on independent evidence (massive neutrinos from oscillation experiments), predicted by compelling hypotheses (primordial gravitational waves from inflation) or reflect ignorance about fundamental physics (dynamical dark energy). Testing for dark energy, curvature, and inflationary models
  • 53. Bayesian Model Comparison in Cosmology Cosmology models Extended models Focus on the dark energy equation-of-state parameter, modeled as w = −1 ΛCDM w = w0 wCDM w = w0 + w1 (1 − a) w(z)CDM In addition, curvature parameter ΩK for each of the above is either ΩK = 0 (‘flat’) or ΩK = 0 (‘curved’). Choice of models represents simplest models beyond a “cosmological constant” model able to explain the observed, recent accelerated expansion of the Universe.
  • 54. Bayesian Model Comparison in Cosmology Cosmology models Cosmology priors Prior ranges for dark energy and curvature models. In case of w(a) models, the prior on w1 depends on w0 Parameter Description Min. Max. Ωm Total matter density 0.15 0.45 Ωb Baryon density 0.01 0.08 h Hubble parameter 0.5 0.9 ΩK Curvature −1 1 w0 Constant dark-energy par. −1 −1/3 w1 Linear dark-energy par. −1 − w0 −1/3−w0 1−aacc
  • 55. Bayesian Model Comparison in Cosmology Cosmology models Cosmology priors (2) Component to the matter-density tensor with w(a) < −1/3 for values of the scale factor a > aacc = 2/3. To limit the state equation from below, we impose the condition w(a) > −1 for all a, thereby excluding phantom energy. Natural limit on the curvature is that of an empty Universe, i.e. upper boundary on the curvature ΩK = 1. A lower boundary corresponds to an upper limit on the total matter-energy density: ΩK > −1, excluding high-density Universe(s) which are ruled out by the age of the oldest observed objects. Alternative prior on ΩK could be derived from the paradigm of inflation, but most scenarios imply the curvature to be , on the order of 10−60 . The likelihood over such a prior on ΩK is essentially flat for any current and future experiments, hence cannot be assessed.
  • 56. Bayesian Model Comparison in Cosmology Cosmology models Cosmology priors (2) Component to the matter-density tensor with w(a) < −1/3 for values of the scale factor a > aacc = 2/3. To limit the state equation from below, we impose the condition w(a) > −1 for all a, thereby excluding phantom energy. Natural limit on the curvature is that of an empty Universe, i.e. upper boundary on the curvature ΩK = 1. A lower boundary corresponds to an upper limit on the total matter-energy density: ΩK > −1, excluding high-density Universe(s) which are ruled out by the age of the oldest observed objects. Alternative prior on ΩK could be derived from the paradigm of inflation, but most scenarios imply the curvature to be , on the order of 10−60 . The likelihood over such a prior on ΩK is essentially flat for any current and future experiments, hence cannot be assessed.
  • 57. Bayesian Model Comparison in Cosmology Cosmology models PMC setup q 0 is a Gaussian mixture model with D components randomly shifted away from the MLE and covariance equal to the information matrix. For the dark-energy and curvature models number of iterations T equal to 10, unless perplexity indicated the contrary. Average number of points sampled under an individual mixture-component, N/D, controlled for stable updating component (N = 7 500 and D = 10). For the primordial models T = 5, N = 10 000 and D between 7 and 10, depending on the dimensionality. Parameters controlling the initial mixture means and covariances, chosen as fshift = 0.02, and fvar between 1 and 1.5. Final iteration run with a five-times larger sample
  • 58. Bayesian Model Comparison in Cosmology Cosmology models Results In most cases evidence in favour of the standard model. especially when more datasets/experiments are combined. Largest evidence is ln B12 = 1.8, for the w(z)CDM model and CMB alone. Case where a large part of the prior range is still allowed by the data, and a region of comparable size is excluded. Hence weak evidence that both w0 and w1 are required, but excluded when adding SNIa and BAO datasets. Results on the curvature are compatible with current findings: non-flat Universe(s) strongly disfavoured for the three dark-energy cases.
  • 59. Bayesian Model Comparison in Cosmology Cosmology models Evidence Evidence (reference model ΛCDM flat) CMB mod. 4 CMB+SN CMB+SN+BAO weak inconcl. weak 2 w(z) flat w(z) flat w0 flat 0 w(z) flat w(z) curved ln B12 -2 Λ curved w0 flat w0 curved mod. -4 w(z) curved Λ curved w(z) curved Λ curved strong -6 w0 curved -8 w0 curved 4 5 6 npar
  • 60. Bayesian Model Comparison in Cosmology Cosmology models Posterior outcome Posterior on dark-energy parameters w0 and w1 as 68%- and 95% credible regions for WMAP (solid blue lines), WMAP+SNIa (dashed green) and WMAP+SNIa+BAO (dotted red curves). Allowed prior range as red straight lines. 2.0 1.5 1.0 w1 0.5 0.0 −0.5 −1.0 −0.9 −0.8 −0.7 −0.6 −0.5 −0.4 w0
  • 61. Bayesian Model Comparison in Cosmology Cosmology models PMC stability wCDM flat wCDM curvature −8.5 −10 −9.0 −11 −9.5 ln E ln E −10.0 −12 −13 −11.0 −14 1 2 3 4 5 6 7 8 9 10 1 3 5 7 9 11 13 15 17 19 iteration iteration Distribution of 25 PMC samplings of two dark-energy models, flat wCDM (left panel) and curved wCDM (right panel). Log-evidence
  • 62. Bayesian Model Comparison in Cosmology Cosmology models PMC stability wCDM flat wCDM curvature 0.5 0.8 0.4 0.6 perplexity perplexity 0.3 0.4 0.2 0.2 0.1 0.0 0.0 1 2 3 4 5 6 7 8 9 10 1 3 5 7 9 11 13 15 17 19 iteration iteration Distribution of 25 PMC samplings of two dark-energy models, flat wCDM (left panel) and curved wCDM (right panel). Perplexity
  • 63. Bayesian Model Comparison in Cosmology lexicon lexicon BAO, baryon acoustic oscillations CMB, cosmic microwave background radiation COBE, cosmic background explorer ΛCDM, lambda-cold dark matter Lyα, Lyman-alpha SNIa, type Ia supernovae WMAP, Wilkinson microwave anisotropy probe