something wrong with getting the right soup

[Rui Wang]

r = requests.get("https://page.auctions.yahoo.co.jp/jp/auction/o1059440738")

soup = BeautifulSoup(r.text, 'html.parser')

when I run above code and get the soup, all the "<", ">" in the the second half of result turns to "&lt;" and "&gt;".

while I can get the right result on other pages of the same site, for examle:

 r = requests.get("https://page.auctions.yahoo.co.jp/jp/auction/q1089626087")

soup = BeautifulSoup(r.text, 'html.parser')

I think this issue is caused by the apostrophe in the paragraph, but I don't know how to solve the problem and get the right result.

could anybody help me about this?

[Unk]

first install lxml package

the change the parser to "lxml"