Drop Python 2 support from GraphFrames?

[Russell Jurney]

So... including the Spark user list for a broader perspective on Python 2 PySpark users.

I want to remove Python 2 support from GraphFrames so I don't have to think about it or work in Python 2... I wrote this up in the issue Drop support for Python 2. Do people really use PySpark 3 [or soon 4] in Python 2? Is this a thing, or is a reference to Python 2 from like GraphFrames' birth in 2016?

Thanks,

Russell Jurney | rju...@graphlet.ai | graphlet.ai | Graphlet AI Blog | LinkedIn | BlueSky

[Russell Jurney]

Oh, wonderful! That should about settle it, then. I am now converting all the nose tests to pytests which will allow GraphFrames to run Python 3.11.

Russell

On Fri, Jan 31, 2025 at 5:20 PM Holden Karau <holden...@gmail.com> wrote:

We no longer support Python 2 in Spark

Twitter: https://twitter.com/holdenkarau

Fight Health Insurance: https://www.fighthealthinsurance.com/

Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 

YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Pronouns: she/her

[Ángel]

Well, if Spark no longer supports Python 2, is there anything left to discuss?

El sáb, 1 feb 2025 a las 8:06, Mich Talebzadeh (<mich.ta...@gmail.com>) escribió:

+1 long overdue

Dr Mich Talebzadeh,

Architect | Data Science | Financial Crime | Forensic Analysis | GDPR

   view my Linkedin profile

 

[Russell Jurney]

No, I’m pulling that code from Python/run-tests.sh and anywhere else I see it.