Dear Community,
Hope you are well. I have run into the following error in my code while running Selenium to scrape Amazon data from Firefox. I am running this Python==3.9.0 script on a Jupyter notebook (with admin access), for Selenium==4.1.3 and Firefox==98.0.1.
It works fine for about 10 minutes, and extracts data without any issues, then crashes with the following ERROR:
My geckdriver.exe is in the same working directory.
'C:\\Users\\"MRROBOT"\\AppData\\Local\\Temp\\tmpeaahbvpx\\webdriver-py-profilecopy'
My configuration code:
options = Options()
options.headless = True
options.add_argument(f'user-agent={userAgent}')
options.add_argument('window-size=1200x1040')
options.binary_location = r'C:/Users/
"MRROBOT" /AppData/Local/Mozilla Firefox/firefox.exe'
#TESTING
#profile_path= r'C:/Users/
"MRROBOT"
/AppData/Roaming/Mozilla/Firefox/Profiles/kw0ipy7w.amazonova'
#ORIGINALCODE
profile = webdriver.FirefoxProfile(r'C:/Users/
"MRROBOT" /AppData/Roaming/Mozilla/Firefox/Profiles/kw0ipy7w.amazonova')
profile.set_preference("geo.wifi.uri", 'data:application/json,{"location": {"lat": 0000, "lng": 00000}, "accuracy": 20.0}')
profile.set_preference("geo.prompt.testing", True)
driver = webdriver.Firefox(profile,options=options)
driver2 = webdriver.Firefox(profile,options=options)
Please help I am a noob when it comes to scraping effectively. Thank you and have a nice day.
Best,
JR