If you like, yes. Until I can put in the time necessary to modernize
Beautiful Soup, you're welcome to use another package, or none at all,
or to just complain.
lol :-D -- you forgot 'or fork the project and show us how to do it'
I think BS is very nice. I have used it to parse 10,000s of pages and it works fine. HTML is a standard and if someone didn't code to it then we should all expect random results. Just catch the exception and go.
Forking out of spite is never a good idea, but if someone is seriously
interested in making Beautiful Soup work with multiple parsing
libraries, I'd like to talk to them.
I'm working on many other projects. I don't expect you to be
interested in them, but they interest me or pay my bills. Beautiful
Soup development is a chore that doesn't bring in much money. The
reason I haven't packed it in is that, unlike my other open source
projects, a huge number of people depend on Beautiful Soup.
My serious recommendation right now is to use html5lib. I'll try to
make some BS progress next week.