Scraping dynamic page for data per date

[Me Here]

Hi, I just discovered Parsehub and it very quickly helped me scraping energy prices (for private use), from this page:

https://mijn.nextenergy.nl/Website_CW/MarketPrices

The only thing is that my exported data now starts from the current day, and the next 24 points are from the previous day every time.

I could write code to reorder all that, but I thought it would be better to do it in Parsehub itself.

So I would first like to click 'back' x times, and only start scraping when going forward from that date, so the data are ordered well.

I guess I really don't know from the basic tutorials how the actual flow works, so I could use some hints.

Another thing is regex filtering, it did not work for me with regex that works elsewhere?

Thanks for your hints!

[Me Here]

I hacked my way towards something that works:

The user interface is quite... special.

The "save" function is under 'settings', while the file menu only contains 'exit'.

That doing something 10 times requires you to enter $createArray(10) is also not something I would have guessed.

The functionality is really nice, but the logic in the naming of things and the UI could be improved so much.

Even having gotten this project to work as I wanted I have no idea where it gets saved, or under what name.

There is 'export', but no 'import'.

I made that picture to be able to recreate it if a new project overwrites this one.

So I am still curious about how to save a project (or a version of it) and open it later.

Getting the regex to work would be really nice too.

[Melissa Edwards]

Hello, 

Thank you for the feedback. I am happy to go through all your inquiries through a demo. 

https://calendly.com/melissaph/30min

Melissa

[Me Here]

Thank you Melissa, that is very kind of you, but it won't be needed.

The regex works too now, I could still use some pointers on properly saving projects etc.

If I missed the page where it is explained, the link will suffice.

Thanks!

[Melissa Edwards]

Great!

You can save your project by clicking the gear icon on the top left-hand corner and save your project. You can also export your project to your local system in the same menu.

[Me Here]

Thanks, so the regular save is in the cloud?

And is the "project title" what identifies the saved project?

In other words, unless I give the project a new title, it will overwrite/update the existing project?

[Melissa Edwards]

The save from the menu saves on your ParseHub account. You can change the name if you want but either way it will override your current changes. 

[Sauban Abdullahi]

  Hi there! I am a skilled Python developer offering custom automation, Telegram bots, web scraping, and Telegram scraping services tailored to your business needs. My Services Include: Telegram Bots – automated bots for groups, channels, and businesses Web Scraping – structured, accurate data extraction from any website Telegram Scraper – collect users & insights for growth and engagement Web Automation – streamline repetitive tasks and save valuable time Why work with me? Clean, reliable, and scalable code On-time delivery Quick support & revisions 100% satisfaction guaranteed Contact me today and let’s bring your automation ideas to life!Catchy Social Media Ad Automate Your Work – Save Time, Grow Faster!Tired of doing everything manually? I build: Powerful Telegram Bots Smart Web Scrapers Accurate Telegram Scrapers Time-saving Web Automation Tools Boost efficiency, save hours of work, and get results instantly! Let’s make your life easier with Python automation. DM me today to get started https://t.me/Abdullahi_scrapee