mw2slob terminal crashed

[sklart]

Hello!

To create dictionaries I usually use Ubuntu 22.04 installed as a guest in VirtualBox on a Windows 11 23H2 host system. All dictionaries are created successfully except for one.

Cannot create dictionary ru-m-wikisource-org. The process in the terminal continues until a certain time, and then either the terminal quietly closes or the Ubuntu account is logged out.

Сommand that I use

mw2slob scrape http://admin:admin@localhost:5984/ru-m-wikisource-org -a sklart -f common wiki

I don’t know where to collect logs in ubuntu, so I would attach them too

Next, I tried a new method for creating dictionaries using Windows Subsystem for Linux 2. 

And everything also seems to run successfully, but then an error pops up:

BrokenPipeError: [Errno 32] Broken pipe

The attached text files show the WSL2 console output in both attempts to create a dictionary.

Tell me, what could be the reason for the error?

And are the errors in VirtualBox and WSL related?

[Igor Tkach]

On Wed, Nov 15, 2023 at 12:43 AM sklart <skla...@gmail.com> wrote:

Hello!

To create dictionaries I usually use Ubuntu 22.04 installed as a guest in VirtualBox on a Windows 11 23H2 host system. All dictionaries are created successfully except for one.

Cannot create dictionary ru-m-wikisource-org. The process in the terminal continues until a certain time, and then either the terminal quietly closes or the Ubuntu account is logged out.

How do you access this VM? are you logged in via SSH? perhaps your ssh connection is closed (times out due to inactivity or connectivity breakdown) - that would also kill any process launched in that terminal that was using stdin/out. An easy way to ensure your long running process keeps running even if your remote session disconnects is to run it in tmux.

 

Сommand that I use

mw2slob scrape http://admin:admin@localhost:5984/ru-m-wikisource-org -a sklart -f common wiki

I don’t know where to collect logs in ubuntu, so I would attach them too

journalctl

 

Next, I tried a new method for creating dictionaries using Windows Subsystem for Linux 2. 

And everything also seems to run successfully, but then an error pops up:

BrokenPipeError: [Errno 32] Broken pipe

The first thing before the errors start is message

Killed

Looks like linux OOM (out of memory killer) kicked in (there should be something in system logs about this, again journalctl is your friend, or perhaps peek in /var/log/syslog directly). Try giving your VM more RAM.

The attached text files show the WSL2 console output in both attempts to create a dictionary.

Tell me, what could be the reason for the error?

And are the errors in VirtualBox and WSL related?

--
You received this message because you are subscribed to the Google Groups "aarddict" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aarddict+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/aarddict/e8790d5b-a7ac-4940-8cb1-936e214a3771n%40googlegroups.com.

[AardF...@web.de]

To give you a hint from my Debian 11 VM generating the wikipedia slobs:

Memory allocation worked well with 4096 MB with the exception of enwiki. Increasing the memory to 8192 MB helped to have a stable running machine.

The host machine is running with 16 GB on Debian 11 with some other VMs.

Hope this helps