dre help 64bit, linux

31 views
Skip to first unread message

Ketan Maheshwari

unread,
Mar 7, 2012, 11:15:50 PM3/7/12
to devide...@googlegroups.com
Hi,

I copied the dre binary for 64bit linux from the download page on googlecode website.

I am trying to get started on DeVIDE and need help. I try to run DRE as follows:

[steamroller:devide-re-v12.2.7-lin64]$ pwd
/homes/ketan/devide-re-v12.2.7-lin64
[steamroller:devide-re-v12.2.7-lin64]$ ls
total 33K
drwxr-xr-x  6 ketan    6 2011-12-12 08:03 python
drwxr-xr-x  8 ketan    8 2011-12-12 08:54 dcmtk
drwxr-xr-x  5 ketan    5 2012-01-23 11:37 VTK
drwxr-xr-x  3 ketan    3 2012-01-24 03:00 vtktudoss
drwxr-xr-x  4 ketan    4 2012-01-24 03:01 swig-2.0.1
drwxr-xr-x  5 ketan    5 2012-01-24 03:04 gdcm
drwxr-xr-x  3 ketan    3 2012-01-24 04:48 vtkdevide
drwxr-xr-x  6 ketan    6 2012-01-30 11:15 cmake
drwxr-xr-x  5 ketan    5 2012-01-30 16:10 Insight
drwxr-xr-x  4 ketan    4 2012-01-30 16:15 CableSwig
drwxr-xr-x  4 ketan    4 2012-02-01 15:35 wrapitk
-rwxr-xr-x  1 ketan  458 2012-02-06 09:57 drepython
-rw-r--r--  1 ketan 6.0K 2012-02-06 09:57 dre.py
-rwxr-xr-x  1 ketan  784 2012-02-06 09:57 dre
drwxr-xr-x  6 ketan    6 2012-02-07 07:10 wx
-rw-r--r--  1 ketan  900 2012-03-07 21:47 dre.cfg
drwxr-xr-x 17 ketan   31 2012-03-07 21:55 devide
drwxr-xr-x  2 ketan    7 2012-03-07 22:05 dreams
[steamroller:devide-re-v12.2.7-lin64]$ ./dre devide
[steamroller:devide-re-v12.2.7-lin64]$

As you see, I get the prompt back after the DeVIDE gui starts *momentarily* and quits.

I could not find any logs on what is going on.

Any clues?

Thanks,
Ketan

Charl Botha

unread,
Mar 8, 2012, 3:18:15 AM3/8/12
to devide...@googlegroups.com
Dear Ketan,

It's good to see you again!

On Thu, Mar 8, 2012 at 05:15, Ketan Maheshwari
<ketancma...@gmail.com> wrote:
> [steamroller:devide-re-v12.2.7-lin64]$ ./dre devide
> [steamroller:devide-re-v12.2.7-lin64]$
>
> As you see, I get the prompt back after the DeVIDE gui starts *momentarily*
> and quits.

Dang, it doesn't get very far.

Try some of the following, and please post output to this list:
./dre versions (this should spit out the versions of all included packages)
./dre ipython (should give you an ipython shell, then try:)
>>> import vtk
>>> import itk
>>> import wx

What would also be great, is if you could do an strace:
strace ./dre devide

See you,
Charl

Ketan Maheshwari

unread,
Mar 8, 2012, 12:08:52 PM3/8/12
to devide...@googlegroups.com
Charl,

You remember me!! :)

Here is what I see:

[steamroller:devide-re-v12.2.7-lin64]$ ./dre ipython
WARNING: Readline services not available on this platform.
WARNING: The auto-indent feature requires the readline library
Python 2.7.2 (default, Dec 12 2011, 15:02:30) 
Type "copyright", "credits" or "license" for more information.

IPython 0.10.2 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object'. ?object also works, ?? prints more.

In [1]: quit()
Do you really want to exit ([y]/n)? y
[steamroller:devide-re-v12.2.7-lin64]$ ./dre versions

-= DeVIDE Runtime Environment (DRE) v12.2.7 =-

Platform: Linux 2.6.32-36-generic on x86_64 (64bit)

Basic software:
    cmake 2.8.7

Python software:
    Python 2.7.2 final-0
    numpy 1.6.1
    matplotlib 1.1.0
    wxPython 2.8.11.0
    VTK 5.8.0
    ITK 3.20.0
    gdcm 2.0.17

====================


Here is why we want to use DeVIDE:

We do not want to use DeVIDE for visualization purposes. we are building a network data movement toolkit/kernel. We want to adopt DeVIDE's box and pipe model to use pipes to describe network characteristics: protocols: ftp/tcp/udp/scp etc., data and control. We want to use boxes to describe the executables: /bin/sleep, /bin/cat etc. and the location where to run those binaries in terms of ip addresses. Later, we want to increase the sophistication to branch-out branch-in etc.

Do you think, this is doable? Does DeVIDE use POSIX threads? I heard python interpreter is a single thread environment, they have something like GIL that prevents python apps to really use multiple threads.

Regards,
Ketan


--
You received this message because you are subscribed to the Google Groups "devide-users" group.
To post to this group, send email to devide...@googlegroups.com.
To unsubscribe from this group, send email to devide-users...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/devide-users?hl=en.




--
Ketan


Ketan Maheshwari

unread,
Mar 8, 2012, 12:15:52 PM3/8/12
to devide...@googlegroups.com
PS: I vaguely remember, I had a similar issue when I first started using DeVIDE back in 2006. The solution was pretty straighforward but do not recall what it was.
--
Ketan


Charl Botha

unread,
Mar 9, 2012, 4:14:03 AM3/9/12
to devide...@googlegroups.com
On Thu, Mar 8, 2012 at 18:08, Ketan Maheshwari
<ketancma...@gmail.com> wrote:
> You remember me!! :)

haha of course I do!

> [steamroller:devide-re-v12.2.7-lin64]$ ./dre ipython
> WARNING: Readline services not available on this platform.
> WARNING: The auto-indent feature requires the readline library

That's a bit strange. On a normal Linux machine, readline should be a
standard component. I'd look into this as well.

> Python software:
>     Python 2.7.2 final-0
>     numpy 1.6.1
>     matplotlib 1.1.0
>     wxPython 2.8.11.0
>     VTK 5.8.0
>     ITK 3.20.0
>     gdcm 2.0.17

This means that the DRE can at least import all its own software.

The only thing that stood out from the strace, is that something went
wrong with a child process. dre spawns a python that spawns yet
another python. I'm guessing that some security measure on your system
does not like this. Do you have any of the security extensions
insntalled? You often find these on RedHat systems. If so, you could
try adding an exception for the DeVIDE system.

Another simple test you could try is:
./dre devide/devide.py

> Here is why we want to use DeVIDE:
>
> We do not want to use DeVIDE for visualization purposes. we are building a
> network data movement toolkit/kernel. We want to adopt DeVIDE's box and pipe
> model to use pipes to describe network characteristics: protocols:
> ftp/tcp/udp/scp etc., data and control. We want to use boxes to describe the
> executables: /bin/sleep, /bin/cat etc. and the location where to run those
> binaries in terms of ip addresses. Later, we want to increase the
> sophistication to branch-out branch-in etc.

That's a neat idea. At the moment, the DeVIDE scheduler analyses the
network and executes it in topological order. In your case, it sounds
like you would actually prefer it to be able to execute different
branches of the tree in parallel, as many modules will have to block
waiting for input. The scheduler does not do that yet.

With regard to the GIL: Python can switch between threads, but only
in-between opcodes. It can indeed never execute opcodes truly in
parallel. However, what is often the case with blocking or IO code,
the GIL can be given back to Python whilst the long-running blocking /
IO code does its thing. I've modified the VTK that ships with DeVIDE
in this way, so that you can in fact, from multiple Python threads
execute multiple truly parallel-running VTK threads.

Have fun!
Charl

Ketan Maheshwari

unread,
Mar 15, 2012, 5:29:37 PM3/15/12
to devide...@googlegroups.com
I tried this and this again shows a gui for a moment and then it shuts down.

Are there any other tests I could do? I have my own 64 bit mac. Do you think, DeVIDE will run on it? 
 

> Here is why we want to use DeVIDE:
>
> We do not want to use DeVIDE for visualization purposes. we are building a
> network data movement toolkit/kernel. We want to adopt DeVIDE's box and pipe
> model to use pipes to describe network characteristics: protocols:
> ftp/tcp/udp/scp etc., data and control. We want to use boxes to describe the
> executables: /bin/sleep, /bin/cat etc. and the location where to run those
> binaries in terms of ip addresses. Later, we want to increase the
> sophistication to branch-out branch-in etc.

That's a neat idea. At the moment, the DeVIDE scheduler analyses the
network and executes it in topological order. In your case, it sounds
like you would actually prefer it to be able to execute different
branches of the tree in parallel, as many modules will have to block
waiting for input. The scheduler does not do that yet.

With regard to the GIL: Python can switch between threads, but only
in-between opcodes. It can indeed never execute opcodes truly in
parallel. However, what is often the case with blocking or IO code,
the GIL can be given back to Python whilst the long-running blocking /
IO code does its thing. I've modified the VTK that ships with DeVIDE
in this way, so that you can in fact, from multiple Python threads
execute multiple truly parallel-running VTK threads.

yes, we will certainly want a parallel invocation of branches. I am willing to work on this part with a little bit of support from your side.
 

Have fun!

Charl

--
You received this message because you are subscribed to the Google Groups "devide-users" group.
To post to this group, send email to devide...@googlegroups.com.
To unsubscribe from this group, send email to devide-users...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/devide-users?hl=en.




--
Ketan


Charl Botha

unread,
Mar 16, 2012, 4:24:15 AM3/16/12
to devide...@googlegroups.com
On Thu, Mar 15, 2012 at 22:29, Ketan Maheshwari
<ketancma...@gmail.com> wrote:
>> Another simple test you could try is:
>> ./dre devide/devide.py
>
>
> I tried this and this again shows a gui for a moment and then it shuts down.
>
> Are there any other tests I could do? I have my own 64 bit mac. Do you
> think, DeVIDE will run on it?

You should definitely try it on a completely different machine /
installation. DeVIDE doesn't run on OSX natively, but you could try
parallels / virtualbox with a Linux installation.

Reply all
Reply to author
Forward
0 new messages