Issue with Test Run in Scraping Publisher Data

42 views
Skip to first unread message

Lynn

unread,
Nov 29, 2024, 11:07:33 PM11/29/24
to Web Scraping

Hi everyone,

I was scraping book data from the commercial platform TIKI. Here is the link of my project: https://tiki.vn/nha-sach-tiki/c8322.

While attempting to scrape data for a specific book, I used a click command to navigate to its details page. In that template, I applied a conditional command to extract only the "Nhà xuất bản" (Publisher) field under the "Thông tin chi tiết" (Details) section.

However, during test runs, the scraper did not behave as expected. Instead of selecting the "Nhà xuất bản" data as specified, it skipped over that step and failed to extract the intended information. In particular:
- In the first screenshots, the selection showed 0 results.

- In the second screenshots, when I manually scrolled to the "Thông tin chi tiết" section during the test run, it worked as intended and returned 7 results, as expected, which means that it just worked only when I manually scrolled to the "Thông tin chi tiết" section during the test run process.

Please help me. Thank you!

Screenshot 2024-11-30 103846.png
Screenshot 2024-11-30 103925.png

Andrew11

unread,
Dec 1, 2024, 11:02:49 AM12/1/24
to Web Scraping
Try adapting the following project, written from the perspective of an individual book page, to your needs & let me know if any questions!
tiki.vn_Project.zip

Andrew11

unread,
Dec 1, 2024, 10:44:17 PM12/1/24
to Web Scraping
I'm so sorry -- I dashed that off without doing a trial run in the cloud! It looks like the page only loads the top part until you scroll down, then the rest loads itself. Try this one.
tiki.vn_Project_2.zip

Lynn

unread,
Dec 2, 2024, 4:53:12 AM12/2/24
to Web Scraping
Thank you so much for your help and the detailed explanation. I really appreciate your time and effort. But I’m still quite new to data scraping, I’m finding it a bit challenging to understand the details fully right now. 
Would it be possible for you to share any screenshots of the template or similar examples?  

Vào lúc 10:44:17 UTC+7 ngày Thứ Hai, 2 tháng 12, 2024, Andrew11 đã viết:

Andrew11

unread,
Dec 2, 2024, 6:51:19 AM12/2/24
to Web Scraping
Just download the above attached project2.zip file, decompress and in parsehub app, go to Projects -> import project. 

Melissa Edwards

unread,
Dec 2, 2024, 9:42:23 AM12/2/24
to Web Scraping
Hi Lynn, 

I am more than happy to help you get acquainted with ParseHub. Feel free to book your free product demo with me: https://calendly.com/melissaph/30min

Melissa

Sauban Abdullahi

unread,
Sep 5, 2025, 11:53:15 AMSep 5
to Web Scraping
  Hi there! 👋 I am a skilled Python developer offering custom automation, Telegram bots, web scraping, and Telegram scraping services tailored to your business needs. My Services Include: 🤖Telegram Bots – automated bots for groups, channels, and businesses 🌐Web Scraping – structured, accurate data extraction from any website 📊Telegram Scraper – collect users & insights for growth and engagement ⚡Web Automation – streamline repetitive tasks and save valuable time Why work with me? ✔️ Clean, reliable, and scalable code✔️ On-time delivery ✔️ Quick support & revisions✔️ 100% satisfaction guaranteed 📩 Contact me today and let’s bring your automation ideas to life!🔹Catchy Social Media Ad 🚀Automate Your Work – Save Time, Grow Faster!🚀Tired of doing everything manually? I build: ✅ Powerful Telegram Bots✅ Smart Web Scrapers ✅ Accurate Telegram Scrapers✅ Time-saving Web Automation Tools ⚡ Boost efficiency, save hours of work, and get results instantly! 💻 Let’s make your life easier with Python automation. 📩 DM me today to get started https://t.me/Abdullahi_scrapee
Reply all
Reply to author
Forward
0 new messages