You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Common Crawl
I am very very new to hive. I want to know that where to get the full index tables of common crawl and how to crawl them with apache hive?? Basically I want to know that is there any tutorial or anythin??
Sebastian Nagel
unread,
Mar 12, 2020, 6:17:53 AM3/12/20
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to common...@googlegroups.com
Hi,
I'm not aware of any tutorial how to use Common Crawl data (in particular, the columnar index) with
Apache Hive.
Hive runs on top of Hadoop. So the first steps would be to become familiar with Hadoop. However,
it's much easier to use a managed NoSQL engine such as Amazon Athena.