[Imdbpy-help] Seg fault

[Stef Hoesli]

Grüezi,

Im running Debian 6.0.7 with mysql 5.1.66, imdbpy 4.6.0 and sqlalchemy 0.6.3 (tried sqlobject first, but that gave me the same error). I downloaded the IMDb plain text data files from April 5th.When I do

imdbpy2sql.py -d <PATH TO MY FILES> -u <MYSQL URI>

Then the script starts to import data into my DB, but after some time it terminates with a Segmentation fault. The last lines that are outputed are:

...
SCANNING actor: Winter, Michael (VIII)
SCANNING actor: Witch, Raymond
 * FLUSHING SQLData...
SCANNING actor: Wogan, Terry
 * FLUSHING CharactersCache...

Before the crash, the python script uses 45.7 %MEM according to top. My machine has 2 GB of RAM, a Intel(R) Atom(TM) CPU D525 @ 1.80GHz, and runs Linux 3.2.0-0.bpo.4-amd64.

Any idea what could be wrong here and more important: Any tips how I can work around that seg fault?

Any input welcome, even a plain ole RTFM, as long as you point out which doc to read more carefully... :-)

Thanks
Stef

[Stef Hoesli]

I ran it again with an "strace -f" wrapped around it. Attached are the last 100 lines if the strace output.

Regards
Stef

[Davide Alberani]

On Sun, Apr 7, 2013 at 1:42 PM, Stef Hoesli <st...@hoes.li> wrote:
>
> Any idea what could be wrong here and more important: Any tips how I can
> work around that seg fault?

IMDbPY 4.6 is way too old. :-)
Please use the latest version in the repository:
https://bitbucket.org/alberanid/imdbpy/src
or
https://github.com/alberanid/imdbpy

Let me know if it still happens.
If it does, you can search for the cutils.so library (somewhere in
the imdb/parser/sql/ directory of your installation) and remove
it (pure-Python versions of some functions will be used: while
they are slower, it's not a big deal)

HTH,

--
Davide Alberani <davide....@gmail.com> [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

------------------------------------------------------------------------------
Minimize network downtime and maximize team effectiveness.
Reduce network management and security costs.Learn how to hire
the most talented Cisco Certified professionals. Visit the
Employer Resources Portal
http://www.cisco.com/web/learning/employer_resources/index.html
_______________________________________________
Imdbpy-help mailing list
Imdbp...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Stef Hoesli]

Hi Davide,

Thanks a lot for your swift response!

I tried with both the default and the stable branch of imdbpy. Both stop with the following error when trying to do "./setup.py install" as root:

---------------------------------------------------------------------------
This script requires setuptools version 0.6c11 to run (even to display
help).  I will attempt to download it for you (from
http://pypi.python.org/packages/2.6/s/setuptools/), but
you may need to enable firewall access for this script first.
I will start the download in 15 seconds.

(Note: if this machine does not have network access, please obtain the file

   http://pypi.python.org/packages/2.6/s/setuptools/setuptools-0.6c11-py2.6.egg

and place it in this directory before rerunning this script.)
---------------------------------------------------------------------------
Downloading http://pypi.python.org/packages/2.6/s/setuptools/setuptools-0.6c11-py2.6.egg
Created locale for: en tr it.
/usr/lib/python2.6/distutils/dist.py:266: UserWarning: Unknown distribution option: 'zip_safe'
  warnings.warn(msg)
Traceback (most recent call last):
  File "./setup.py", line 220, in <module>
    setuptools.setup(**params)
  File "/usr/lib/python2.6/distutils/core.py", line 138, in setup
    ok = dist.parse_command_line()
  File "/home/stef/imdb/imdbpy.stable/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 273, in parse_command_line
  File "/home/stef/imdb/imdbpy.stable/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 377, in _finalize_features
  File "/home/stef/imdb/imdbpy.stable/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 796, in include_in
  File "/home/stef/imdb/imdbpy.stable/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 450, in include
  File "/home/stef/imdb/imdbpy.stable/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 523, in _include_misc
distutils.errors.DistutilsSetupError: install_requires: No such distribution setting

Regards
Stef

[Davide Alberani]

On Sun, Apr 7, 2013 at 5:44 PM, Stef Hoesli <st...@hoes.li> wrote:
>
> I tried with both the default and the stable branch of imdbpy. Both stop
> with the following error when trying to do "./setup.py install" as root:

Use only the default branch.
Try removing line 128 of the setup.py file (I've just updated it on the repo):
'zip_safe': False, # XXX: I guess, at least...

Some versions of setuptools seem to not support it.

--
Davide Alberani <davide....@gmail.com> [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

[Stef Hoesli]

Alreday tried this, yileding in:

Created locale for: en tr it.

Traceback (most recent call last):

  File "./setup.py", line 237, in <module>

    setuptools.setup(**params)
  File "/usr/lib/python2.6/distutils/core.py", line 138, in setup
    ok = dist.parse_command_line()

  File "/home/stef/imdb/imdbpy.default/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 273, in parse_command_line
  File "/home/stef/imdb/imdbpy.default/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 377, in _finalize_features
  File "/home/stef/imdb/imdbpy.default/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 796, in include_in
  File "/home/stef/imdb/imdbpy.default/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 450, in include
  File "/home/stef/imdb/imdbpy.default/setuptools-0.6c11-py2.6.egg/setuptools/dist.py", line 523, in _include_misc

distutils.errors.DistutilsSetupError: install_requires: No such distribution setting

Regards
Stef

[Davide Alberani]

On Sun, Apr 7, 2013 at 8:09 PM, Stef Hoesli <st...@hoes.li> wrote:
>
> distutils.errors.DistutilsSetupError: install_requires: No such distribution
> setting

Hmm... I'm out of ideas. I fear that your setuptools environment
is not too sane.
Maybe you can try to (re)install python-setuptools and/or you can
try using a virtualenv ?

--
Davide Alberani <davide....@gmail.com> [PGP KeyID: 0x465BFD47]
http://www.mimante.net/