An issue with PyCurl and DDFS

18 views
Skip to first unread message

Harsh J

unread,
Aug 20, 2010, 7:57:56 AM8/20/10
to disc...@googlegroups.com
Hello disco devs,

I've setup disco in my local cluster and most things seem to work
fine. I thought of moving on with the DDFS, but am facing an issue
with it. Its probably due to curl/pycurl versions installed on my
machine, but I'd just like to confirm.

===========
Some information:
disco@master:~$ curl --version
curl 7.19.7 (x86_64-pc-linux-gnu) libcurl/7.19.7 OpenSSL/0.9.8k
zlib/1.2.3.3 libidn/1.15

disco@master:~$ apt-cache show python-pycurl
Package: python-pycurl
[...]
Architecture: amd64
Version: 7.19.0-3
===========

When I try to push a file onto DDFS I get:
disco@master:~$ ddfs push mytag myfile.txt # myfile is about a gig in size
pushing...
invalid arguments to setopt

With a verbose flag, it looks like this: http://pastie.org/1103952

Does someone know a fix to this? What versions are you all using?

--
Harsh J
www.harshj.com

Harihara Vinayakaram

unread,
Aug 20, 2010, 8:48:10 AM8/20/10
to disc...@googlegroups.com
Hi
   i have pushed files of size 2 GB to DDFS (with the default replication i.e. 3) . i am using Linux 10.04 and the Python that comes with 2.6.5 

--Hari


--
You received this message because you are subscribed to the Google Groups "Disco-development" group.
To post to this group, send email to disc...@googlegroups.com.
To unsubscribe from this group, send email to disco-dev+...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/disco-dev?hl=en.


Prashanth Mundkur

unread,
Aug 25, 2010, 1:21:06 AM8/25/10
to disc...@googlegroups.com
Hi Harsh,

Thanks for reporting this. One possible fix is at:
http://www.pastie.org/1114209

This issue should be fixed in the next release.

--prashanth

Harsh J

unread,
Aug 25, 2010, 1:28:21 AM8/25/10
to disc...@googlegroups.com
Ah I had a hunch it was an encoding thing; giving the file url in
quotes sometimes didn't make it throw up the error.

Thanks for the quick fix Prashanth, much appreciated!

--
Harsh J
www.harshj.com

Reply all
Reply to author
Forward
0 new messages