how to extract data from webstites ?

[yaoyao]

without using nokogori or mechanize, regardless of the structure of the web page, some idea ?

[ddoherty03]

Try selenium.  It drives and actual browser, so it is able to work where some others fail.  Start with the firefox plugin for selenium, then look into the Ruby webdriver interface.

Good luck.

[Jacob Tjørnholm]

It's hard to come up with a useful answer without some more detail :)

But for just grabbing the contents of a website, I often use curl. 

/Jacob

[Sathish Kumar]

Hi,
APIfy is a useful service for extracting data from websites as json using simple css/xpath selectors.

Tutorial: http://apify.heroku.com/tutorial/create
Example API: http://apify.heroku.com/resources/4fca535156983f0001000002

Regards,
Sathish

[Lennart Borgman]

To get the CSS/XPath selectors you may use XCPath bookmarklet:

http://dl.dropbox.com/u/848981/it/xp/xp.html

[yao liu]

Extact particular information from website regardless of there css/xpath structure