dataFrame.cache() returning all rows

8 views
Skip to first unread message

benjami...@gmail.com

unread,
Apr 7, 2016, 9:52:47 AM4/7/16
to spark-notebook-user
Hi,

just getting started with spark-notebook, but it seems to me that when I do a cache() or persist() of a data frame, spark-notebook is retrieving all results and trying to show them in a tabular view in the cell output as if it were a collect(), which is not quite appropriate for my usage (presentation). 
Is this something that can be disabled?

Thanks,
benjamin
Reply all
Reply to author
Forward
0 new messages