Contradiction or misunderstanding

46 views
Skip to first unread message

Tran

unread,
Mar 31, 2017, 6:13:40 AM3/31/17
to Stan users mailing list
Hi all,

In page 325 of the Manual (latest version 2.14.0) I see something that sound contradictory.

A hierarchical model such as the above will suffer from the same kind of inefficiencies as Neal’s funnel, because the values of beta, mu_beta and sigma_beta are highly correlated in the posterior. The extremity of the correlation depends on the
amount of data, with Neal’s funnel being the extreme with no data. In these cases, the non-centered parameterization, discussed in the next section, is preferable; when there is a lot of data, the centered parameterization is more efficient. See Betancourt and Girolami (2013) for more information on the effects of centering in hierarchical
models fit with Hamiltonian Monte Carlo.

Non-Centered Parameterization

When there is a lot of data, such a hierarchical model can be made much more efficient
by shifting the data’s correlation with the parameters to the hyperparameters
. Similar
to the funnel example, this will be much more efficient in terms of effective sample
size when there is not much data


Thus if I understand correctly then in both cases (no data or a lot of data) non-centered parameterization is preferable. Therefore the first statement is contradictory with the second one.

Or do I misunderstand something?

Kind regards,
Tran.

Michael Betancourt

unread,
Mar 31, 2017, 8:39:15 AM3/31/17
to stan-...@googlegroups.com
Sorry, the second paragraph should say “when there is _not_ a lot of data”.

--
You received this message because you are subscribed to the Google Groups "Stan users mailing list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stan-users+...@googlegroups.com.
To post to this group, send email to stan-...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Michael Betancourt

unread,
Mar 31, 2017, 8:39:40 AM3/31/17
to stan-...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages