How to use keytab with Jupyter Notebook

60 views
Skip to first unread message

Raymond Xie

unread,
Aug 13, 2018, 11:17:41 AM8/13/18
to jup...@googlegroups.com, Hui Xie
Hello,

I need to set up a jupyter notebook environment to allow the following:

1. Authentication with Keytab - the cluster has kerberos configured so this is a must.
2. Basic security: SSL and SSO

What I am currently doing is requirement 1
My question is in a notebook, how do I run the kinit keytab command?

Thank you very much.

------------------------------------------------
Sincerely yours,


Raymond

Raymond Xie

unread,
Aug 13, 2018, 11:22:25 AM8/13/18
to jup...@googlegroups.com, Hui Xie
More error encountered:

I ran the kinit in notebook like:

!kinit -kt ......
and then I want to access hdfs file that the keytab has privilege. 
I see this error:

Py4JJavaError: An error occurred while calling o106.csv.
: org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled.  Available:[TOKEN, KERBEROS]





------------------------------------------------
Sincerely yours,


Raymond

Luciano Resende

unread,
Aug 13, 2018, 2:51:15 PM8/13/18
to jup...@googlegroups.com, xie32...@gmail.com
Hi Raymond, 

It looks like you are trying to access resources from a Spark/Hadoop cluster that are protected with Kerberos security. In Jupyter Enterprise Gateway, we enable jupyter kernels to be running remotely, direct into the Spark/YARN cluster leveraging the user impersonation capabilities of the runtime... this might help you and might provide enhanced capabilities for your use case.

Thanks

--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.
To post to this group, send email to jup...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAKZNNLK4hfG1qzv2SB-z%3DQChCmLsychyiDFaKAoagLZw4--X1w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


--

Raymond Xie

unread,
Aug 13, 2018, 4:59:24 PM8/13/18
to Luciano Resende, jup...@googlegroups.com
Thank you Luciano,

Silly question, is Jupyter Enterprise Gateway open source and free downloadable just like jupyter notebook? or something that would incur cost?


------------------------------------------------
Sincerely yours,


Raymond

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.

Luciano Resende

unread,
Aug 13, 2018, 5:06:55 PM8/13/18
to Raymond Xie, jup...@googlegroups.com
Jupyter Enterprise Gateway is open source and freely available:



------------------------------------------------
Sincerely yours,


Raymond

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.

Ziauddin Khazi

unread,
Aug 13, 2018, 8:24:34 PM8/13/18
to jup...@googlegroups.com
I am trying to setup Kerberos for JupyterHub. I am configuring based on the instructions provided in the link below. 


Do I need to know anything besides this? 

Thanks for your support,

Sincerely,
Zia



------------------------------------------------
Sincerely yours,


Raymond

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.
--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.

To post to this group, send email to jup...@googlegroups.com.

Raymond Xie

unread,
Aug 20, 2018, 9:17:40 AM8/20/18
to Luciano Resende, jup...@googlegroups.com
I had a quick reading on the security part: https://jupyter-enterprise-gateway.readthedocs.io/en/latest/getting-started-security.html# 

It mentions  using  EnterpriseGatewayApp.authorized_users and  EnterpriseGatewayApp.unauthorized_users for the acccess control which means LDAP must be in place first but LDAP is not mentioned in the documentation.

Correct me if I am wrong.

Thank you Luciano.



------------------------------------------------
Sincerely yours,


Raymond



------------------------------------------------
Sincerely yours,


Raymond

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages