no space left on device while running grammar packer

[Luke Orland]

how can the temp dir used by the grammar packer be specified?

[Juri Ganitkevitch]

The packer itself does not use any explicit temporary storage. It
processes an already-sorted grammar file chunk-wise and fully
in-memory. There's either wrapper scripts that allocate temporary disk
space, or it might be the default system temp directory that is
automatically (ab)used by Java? Can you point me to your run?

On Fri, Mar 8, 2013 at 2:19 PM, Luke Orland <orl...@gmail.com> wrote:
> how can the temp dir used by the grammar packer be specified?
>

> --
> You received this message because you are subscribed to the Google Groups
> "Joshua Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to joshua_suppor...@googlegroups.com.
> To post to this group, send email to joshua_...@googlegroups.com.
> Visit this group at http://groups.google.com/group/joshua_support?hl=en.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

[Luke Orland]

sure, thanks.

The run dir is ~lorland/expts/wmt13/fr-en/1/

These are the messages captured in the files under the .cachepipe/pack-tune/ directory:

=> pack-tune/cmd <==

/home/hltcoe/lorland/apps/joshua-v4.1rc7/scripts/support/grammar-packer.pl -m 16g /home/hltcoe/lorland/expts/wmt13/fr-en/1/data/tune/grammar.filtered.gz /home/hltcoe/lorland/expts/wmt13/fr-en/1/data/tune/

grammar.packed

==> pack-tune/err <==

sort: write failed: /tmp/4223903.1.all.q/sortOl8c4q: No space left on device

Writing dense map file to file 'dense_map'

Use of uninitialized value $line in chomp at /home/hltcoe/lorland/apps/joshua-v4.1rc7/scripts/support/grammar-packer.pl line 74.

Use of uninitialized value $line in split at /home/hltcoe/lorland/apps/joshua-v4.1rc7/scripts/support/grammar-packer.pl line 77.

Use of uninitialized value in split at /home/hltcoe/lorland/apps/joshua-v4.1rc7/scripts/support/grammar-packer.pl line 78.

Packing with java -Xmx16g -cp /home/hltcoe/lorland/apps/joshua-v4.1rc7/class joshua.tools.GrammarPacker -c packer.config.tmp -p /home/hltcoe/lorland/expts/wmt13/fr-en/1/data/tune/grammar.packed -g grammar-labeled.gz

Mar 08, 2013 2:51:07 AM joshua.tools.GrammarPacker <init>

INFO: No alignments file specified, skipping.

Mar 08, 2013 2:51:07 AM joshua.tools.GrammarPacker readConfig

SEVERE: Incomplete quantizer line in config.

mv: accessing `/home/hltcoe/lorland/expts/wmt13/fr-en/1/data/tune/grammar.packed/packer.config': Not a directory

[Juri Ganitkevitch]

The key line is: sort: write failed: /tmp/4223903.1.all.q/sortOl8c4q:

No space left on device

That's the Unix sort utility, which IIRC uses the standard temp
directory for storage. Try redirecting that one and see what happens.

Since we're running the packer with 16G, it might be useful to modify
the pipeline to give sort the same-ish amount of memory – this should
significantly speed up sorting since less would be done in small bites
with on-disk merging.

-- Juri

[Luke Orland]

I will try to use sort with an in-memory buffer of 16g with the option --buffer-size=SIZE