Pilot data issue: output files not available on data store

[Anjani Ragothaman]

Hello,

When I run my jobs(to test, replaced with /bin/echo), the execution is successful and I see the output files in the remote machine, but I'm not getting the output files transferred to the data store. I'm running 16 jobs in series, in a for loop. I'm submitting the jobs to EC2 machine and the data store is at S3. (I can see the input files uploaded)

The code for reference: https://bitbucket.org/anjaniragothaman/e-thread-repo/src/876ae53c8b7531d43b187880af2e02a231df98e7/ethreadall-copy-110.py?at=master

The config file: https://bitbucket.org/anjaniragothaman/e-thread-repo/src/67922a922ffd7a833172c82a8a9d68c21bd7643f/config.cfg?at=master

I'm currently working on one of the 10 modules (the module at line 125)

In case, if you cant view the code, I've attached the same.

--
Best

Anjani

[Mark Santcroos]

Hi Anjani,

(Thanks for getting access to your repo out-of-band)

I suggest you only reply to the bigjob-users@ list after this.

Do you think the error is related to AWS specifically? As in, did you manage to run this application on another infrastructure?

Regardlessly, did you look at the output of the bigjob agent?
If you look in the agent directory, there is a stderr-bj-XXX file, that should have some information on whats going wrong hopefully.

Gr,

Mark

> --
> You received this message because you are subscribed to the Google Groups "bigjob-devel" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bigjob-devel...@googlegroups.com.
> To post to this group, send email to bigjob...@googlegroups.com.
> Visit this group at http://groups.google.com/group/bigjob-devel.
> For more options, visit https://groups.google.com/groups/opt_out.
> <config.cfg><ethreadall-copy-110.py>