[ADMB Users] mceval output inconsistent with mcmc display

Campbell, Alex Alex.Campbell at deedi.qld.gov.au
Thu Jun 9 21:23:32 PDT 2011


No, I'm concerned that the displayed likelihood is not consistent with
the likelihood corresponding to the parameters obtained via mceval at
that point (at that iteration).  

Here's some output. Beginning of mcmc:

Initial seed value -36519
785.580219414446 785.580219414446
 mcmc sim 1  acceptance rate 0 0
785.580219414446 785.580219414446
 mcmc sim 201  acceptance rate 0 0
decreasing step size -2049.27939913456
750.625386694123 750.625386694123
 mcmc sim 401  acceptance rate 0.0773067331670823 0.155
739.336552314425 739.336552314425
 mcmc sim 601  acceptance rate 0.114808652246256 0.19

Last few hundred iterations:

602.449537531548 602.449537531548
 mcmc sim 999401  acceptance rate 0.036780031238712 0.03
602.366020956481 602.366020956481
 mcmc sim 999601  acceptance rate 0.0367746730945647 0.01
603.32884634525 603.32884634525
 mcmc sim 999801  acceptance rate 0.0367683168950621 0.005

And not much variation in between - lowest likelihood around 590. 

But the likelihood for parameters read from psv by mceval is terrible,
around -600, at least after the first few hundred iterations. 

The trace of primary parameters shows them moving from a sensible region
very quickly to a rubbish region. 


-----Original Message-----
From: dave fournier [mailto:davef at otter-rsch.com] 
Sent: Friday, 10 June 2011 1:08 PM
To: Campbell, Alex
Subject: Re: [ADMB Users] mceval output inconsistent with mcmc display

On 11-06-09 07:34 PM, Campbell, Alex wrote:


So if I understand this you think the value should be closer to the
mode.
Intuition about this is wrong.  In high dimensions you never get
anywhere near the mode.
Think of a standard n dimensional multivariate normal. You can easily
see that the pdf for the distance r from 0 is prop. to
r^{n-1}*exp(-r^2/2}.
Do a quick calc to see what the probability is that you will get to
within distance 1 of 0 when the dimension is 100. You may be surprised.



> Sorry yes it is the log likelihood. I was unclear.
>
> Mode estimate: approx 750 log likelihood. MCMC display output: ranges 
> from 600 to 750 over one million iterations. Parameters read from psv 
> file using mceval: around -600 after the first few hundred iterations.
>
> Thanks Ian that's exactly the sort of investigative tool I think I
need.
>
> -alex
>
> -----Original Message-----
> From: users-bounces at admb-project.org
> [mailto:users-bounces at admb-project.org] On Behalf Of dave fournier
> Sent: Friday, 10 June 2011 8:41 AM
> To: users at admb-project.org
> Subject: Re: [ADMB Users] mceval output inconsistent with mcmc display
>
> Probably better to make a little example first.
> for example
> DATA_SECTION
> PARAMETER_SECTION
>     init_vector x(1,10)
>     sdreport_vector rx(1,10);
>     objective_function_value f
> PROCEDURE_SECTION
>     f=0.5*norm2(x);
>     rx=x;
>     if (mceval_phase())
>     {
>       cout<<  f<<  " "<<  x<<  endl;
>     }
>
> then running it with
>
>    ./small -mcmc 100000 -mcsave 1
>
> and the screen shows
>
> mcmc sim 1  acceptance rate 0 0
> -4.04084 -4.04084
>    mcmc sim 201  acceptance rate 0.169154 0.17
> -2.76404 -2.76404
>    mcmc sim 401  acceptance rate 0.187032 0.205
> -5.52107 -5.52107
>    mcmc sim 601  acceptance rate 0.189684 0.195
> -6.00142 -6.00142
>    mcmc sim 801  acceptance rate 0.187266 0.18
> -4.85913 -4.85913
>    mcmc sim 1001  acceptance rate 0.182817 0.165
> -1.51622 -1.51622
>    mcmc sim 1201  acceptance rate 0.181515 0.175
> -3.43209 -3.43209
>
> So this is the log-likelihood *NOT* minus the log-likelihood. Also it 
> is every 200'th value. (Just printed out for amusement).
>
>
>
>
>
>
>
>
>
>
>
> ~
>
> _______________________________________________
> Users mailing list
> Users at admb-project.org
> http://lists.admb-project.org/mailman/listinfo/users
>
>
> ********************************DISCLAIMER****************************
> The information contained in the above e-mail message or messages 
> (which includes any attachments) is confidential and may be legally 
> privileged.  It is intended only for the use of the person or entity 
> to which it is addressed.  If you are not the addressee any form of 
> disclosure, copying, modification, distribution or any action taken or

> omitted in reliance on the information is unauthorised.  Opinions 
> contained in the message(s) do not necessarily reflect the opinions of

> the Queensland Government and its authorities.  If you received this 
> communication in error, please notify the sender immediately and 
> delete it from your computer system network.
>
>
>



********************************DISCLAIMER****************************
The information contained in the above e-mail message or messages 
(which includes any attachments) is confidential and may be legally 
privileged.  It is intended only for the use of the person or entity 
to which it is addressed.  If you are not the addressee any form of 
disclosure, copying, modification, distribution or any action taken 
or omitted in reliance on the information is unauthorised.  Opinions 
contained in the message(s) do not necessarily reflect the opinions 
of the Queensland Government and its authorities.  If you received 
this communication in error, please notify the sender immediately 
and delete it from your computer system network.





More information about the Users mailing list