prior distribution as samples

268 views
Skip to first unread message

Xulong Wang

unread,
Aug 20, 2015, 10:32:23 AM8/20/15
to Stan users mailing list
Hi Stan,

I have a hierarchical model, in which I have the complete sample pool for one of the hyperparameter's prior distribution, instead of a parametric formula. In this case, this prior is very formative. I am not clear how Stan handles this. Do I have to first fit the prior samples with a parametric distribution? 

Best,

Xulong

Krzysztof Sakrejda

unread,
Aug 20, 2015, 1:28:12 PM8/20/15
to Stan users mailing list
On Thursday, August 20, 2015 at 10:32:23 AM UTC-4, Xulong Wang wrote:
Hi Stan,

I have a hierarchical model, in which I have the complete sample pool for one of the hyperparameter's prior distribution, instead of a parametric formula. In this case, this prior is very formative. I am not clear how Stan handles this. Do I have to first fit the prior samples with a parametric distribution? 

Yes, that's likely the best way to do it at the moment, though it can have some issues. I think some folks (Michael and Ben I think) pointed out on a previous question that marginal posteriors used as priors are throwing out a lot of information (e.g., about covariance).

Krzysztof
 

Best,

Xulong

Michael Betancourt

unread,
Aug 20, 2015, 1:31:02 PM8/20/15
to stan-...@googlegroups.com
Yes.  Look into Sequential Monte Carlo if you want to use samples as a prior.

--
You received this message because you are subscribed to the Google Groups "Stan users mailing list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stan-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Xulong Wang

unread,
Aug 20, 2015, 2:40:25 PM8/20/15
to Stan users mailing list
After reading a sequential monte carlo document, together with several previous posts in the mailing list. I would fit the samples to a parametric distribution using methods of moments and continue with Stan.

Thanks Michael and Krzysztof for your quick and precise points.

Daniel Lakeland

unread,
Aug 21, 2015, 2:55:22 PM8/21/15
to Stan users mailing list


On Thursday, August 20, 2015 at 11:40:25 AM UTC-7, Xulong Wang wrote:
After reading a sequential monte carlo document, together with several previous posts in the mailing list. I would fit the samples to a parametric distribution using methods of moments and continue with Stan.

You might take the samples, input them into a Stan program that fits the parametric distribution, and then use the average of the posterior samples of the parameters from this Stan run as constants defining the priors in your next Stan run?

That is, if method of moments doesn't do a good enough job for you.

Xulong Wang

unread,
Aug 21, 2015, 4:47:06 PM8/21/15
to Stan users mailing list
Daniel, tried your method. It works great. The sample distribution and estimated distributions overlap perfectly. I actually like your approach much better than MoM, because now everything is within Stan and sampling.
Reply all
Reply to author
Forward
0 new messages