Presto query hive parquet table with Alluxion support

[Richard Grossman]

Hi

After a lot of work I've finally Alluxion running I can see the parquet file on HDFS (not hdfs of Alluxion)

I ve created a table using hive like 

CREATE TABLE table(......)

STORED AS PARQUET 

LOCATION '/user/hive/parquet'; 

So hive can access the table.

Now what I'm supposed to do to cache this table in Alluxio Do I need to load all parquet file in memory ?

Actually I'm using Alluxio 1.4 I've also removed all the problem with dependencies with presto.

So Alluxion client is loaded in Presto 

But nothing else now ??

Thanks for help

[Bin Fan]

Hi Richard,

I am not familiar with Presto. But recently there is a doc contributed by users in community about how to setup and use Presto in Alluxio

https://github.com/Alluxio/alluxio/blob/master/docs/en/Running-Presto-with-Alluxio.md

Do you think this doc helpful?

- Bin

[Richard Grossman]

Thanks

I've already tried this but not working for my case. 

may be you can help me regarding caching Hive table.

I'm trying to cache in memory a Parquet table so all the sample talk about loading the data from external file to be be in memory.

In my case I create the table like this

Create Table ... 

STORED AS PARQUET 

LOCATION '/user/hive/parquet';

Now the location is an HDFS location. No matter what I do the data are not in memory they are located on hdfs

Is there any sample to load in memory parquet file with Alluxio ?

 

Thanks

[jh guo]

Hi Richard,

    Firstly, you can use the command "describe formatted tableName" to show whether you table's localtion is on alluxio. If not, means you table is not create on alluxio, So, you can following the guide hive on allxuio http://www.alluxio.org/docs/master/en/Running-Hive-with-Alluxio.html

在 2017年2月28日星期二 UTC+8下午5:10:12，Richard Grossman写道：

[Bin Fan]

Hi Richard,

was jh's answer helpful for your question?

- Bin