connecting redis with hdfs

865 views
Skip to first unread message

ABHISHEK SRIVASTAVA

unread,
Mar 17, 2016, 1:51:58 PM3/17/16
to Redis DB
Hi,
     I am creating a recommendation engine which uses hadoop with redis caching.I am unable to read and write hdfs data to and from redis.
    Is there any way to connect hdfs to redis.Kindly help.Thanks in advance.

Jan-Erik Rediger

unread,
Mar 17, 2016, 2:25:53 PM3/17/16
to redi...@googlegroups.com
Redis is a simple key-value datastore.
You can only access it through sending it commands.
It has no HDFS layer.

You probably need to write a small application that reads data from your
HDFS and sends it to Redis.
> --
> You received this message because you are subscribed to the Google Groups "Redis DB" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to redis-db+u...@googlegroups.com.
> To post to this group, send email to redi...@googlegroups.com.
> Visit this group at https://groups.google.com/group/redis-db.
> For more options, visit https://groups.google.com/d/optout.

Marc Byrd

unread,
Mar 17, 2016, 2:46:37 PM3/17/16
to redi...@googlegroups.com, Jan-Erik Rediger
Redis is NOT a simple key-value datastore.

Memcached is a simple key-value datastore.  Key-value is the only data structure supported by memcached.

Redis is a simple data structure store.  One of the several data structures it can store is key-value.  Others are lists, hashes, unordered sets, geocoded sets, and scored sets.  

Also, it depends on your HDFS use case.  If it's under Spark, you can use this - https://github.com/RedisLabs/spark-redis

m

Reply all
Reply to author
Forward
0 new messages