Problem running BOSCO (condor_remote_cluster) in a small test environment
14 views
Skip to first unread message
Marco Mambelli
Jul 8, 2026, 10:52:18 AMJul 8
to htcondo...@g-groups.wisc.edu
Greetings,
I'm trying to run BOSCO (condor_remote_cluster) submissions in a small container-based test environment.
The space is small (16GB available disk space) but should be sufficient to run the test jobs.
BOSCO is aborting "because sandbox (6) is too small (<= 104857600)".
Is the requirement 50GB? Where is this check coming from? Can I reduce the space required?
Below is an extract form the FTGahpLog with the error
Thank you,
Marco
07/08/26 04:53:04 [285250] got stdin: COMMANDS
07/08/26 04:53:04 [285250] got stdin: CONDOR_VERSION $CondorVersion:\ 24.0.22\ 2026-06-02\ BuildID:\ 917808\ PackageID:\ 24.0.22-0.917808\ GitSHA:\ d489956d\ DAILY\ $
07/08/26 04:53:04 [285250] got stdin: ASYNC_MODE_ON
07/08/26 04:53:04 [285250] got stdin: CREATE_CONDOR_SECURITY_SESSION XXXXXXXX
07/08/26 04:53:06 [285250] got stdin: DOWNLOAD_SANDBOX 2 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferKey\ =\ "1#6a4dd7b27805be085b4a4ff9";\ TransferOutput\ =\ "";\ TransferSocket\ =\ "<127.0.0.1:41988?addrs=127.0.0.1-41988&alias=factory-workspace.glideinwms.org&noUDP&sock=gridmanager_926_335f_12>";\ TransferExecutable\ =\ false\ ]
07/08/26 04:53:06 [285250] BOSCO: created download_sandbox thread, id: 285300
07/08/26 04:53:06 [285250] FTGAHP: download sandbox
07/08/26 04:53:06 [285250] BOSCO: create, sandbox path: /home/bosco/bosco/sandbox/65b2/65b2a394/factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:53:06 [285250] BOSCO: calling Download files
07/08/26 04:53:06 [285250] got stdin: RESULTS
07/08/26 04:54:04 [285250] got stdin: RESULTS
07/08/26 04:54:11 [285250] got stdin: UPLOAD_SANDBOX 3 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferKey\ =\ "2#6a4dd7f3598f85507a0fa0e4";\ TransferOutput\ =\ "";\ TransferSocket\ =\ "<127.0.0.1:41988?addrs=127.0.0.1-41988&alias=factory-workspace.glideinwms.org&noUDP&sock=gridmanager_926_335f_12>";\ TransferExecutable\ =\ false\ ]
07/08/26 04:54:11 [285250] BOSCO: created upload_sandbox thread, id: 285388
07/08/26 04:54:11 [285250] FTGAHP: upload sandbox
07/08/26 04:54:11 [285250] BOSCO: calling upload files
07/08/26 04:54:11 [285250] Not entering transfer queue because sandbox (6) is too small (<= 104857600).
07/08/26 04:54:11 [285250] got stdin: RESULTS
07/08/26 04:54:16 [285250] got stdin: DESTROY_SANDBOX 4 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferOutput\ =\ "";\ TransferExecutable\ =\ false\ ]
07/08/26 04:54:16 [285250] BOSCO: created destroy_sandbox thread, id: 285389
07/08/26 04:54:16 [285250] FTGAHP: destroy sandbox
07/08/26 04:54:16 [285250] BOSCO: destroy, sandbox id: factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:54:16 [285250] BOSCO: destroy, sandbox path: /home/bosco/bosco/sandbox/65b2/65b2a394/factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:54:16 [285250] got stdin: RESULTS
07/08/26 04:54:21 [285250] EOF reached on DaemonCore pipe 65536
07/08/26 04:54:21 [285250] stdin buffer closed, exiting
07/08/26 04:54:21 [285250] **** condor_ft-gahp (condor_FT_GAHP) pid 285250 EXITING WITH STATUS 1
I'm trying to run BOSCO (condor_remote_cluster) submissions in a small container-based test environment.
The space is small (16GB available disk space) but should be sufficient to run the test jobs.
BOSCO is aborting "because sandbox (6) is too small (<= 104857600)".
Is the requirement 50GB? Where is this check coming from? Can I reduce the space required?
Below is an extract form the FTGahpLog with the error
Thank you,
Marco
07/08/26 04:53:04 [285250] got stdin: COMMANDS
07/08/26 04:53:04 [285250] got stdin: CONDOR_VERSION $CondorVersion:\ 24.0.22\ 2026-06-02\ BuildID:\ 917808\ PackageID:\ 24.0.22-0.917808\ GitSHA:\ d489956d\ DAILY\ $
07/08/26 04:53:04 [285250] got stdin: ASYNC_MODE_ON
07/08/26 04:53:04 [285250] got stdin: CREATE_CONDOR_SECURITY_SESSION XXXXXXXX
07/08/26 04:53:06 [285250] got stdin: DOWNLOAD_SANDBOX 2 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferKey\ =\ "1#6a4dd7b27805be085b4a4ff9";\ TransferOutput\ =\ "";\ TransferSocket\ =\ "<127.0.0.1:41988?addrs=127.0.0.1-41988&alias=factory-workspace.glideinwms.org&noUDP&sock=gridmanager_926_335f_12>";\ TransferExecutable\ =\ false\ ]
07/08/26 04:53:06 [285250] BOSCO: created download_sandbox thread, id: 285300
07/08/26 04:53:06 [285250] FTGAHP: download sandbox
07/08/26 04:53:06 [285250] BOSCO: create, sandbox path: /home/bosco/bosco/sandbox/65b2/65b2a394/factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:53:06 [285250] BOSCO: calling Download files
07/08/26 04:53:06 [285250] got stdin: RESULTS
07/08/26 04:54:04 [285250] got stdin: RESULTS
07/08/26 04:54:11 [285250] got stdin: UPLOAD_SANDBOX 3 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferKey\ =\ "2#6a4dd7f3598f85507a0fa0e4";\ TransferOutput\ =\ "";\ TransferSocket\ =\ "<127.0.0.1:41988?addrs=127.0.0.1-41988&alias=factory-workspace.glideinwms.org&noUDP&sock=gridmanager_926_335f_12>";\ TransferExecutable\ =\ false\ ]
07/08/26 04:54:11 [285250] BOSCO: created upload_sandbox thread, id: 285388
07/08/26 04:54:11 [285250] FTGAHP: upload sandbox
07/08/26 04:54:11 [285250] BOSCO: calling upload files
07/08/26 04:54:11 [285250] Not entering transfer queue because sandbox (6) is too small (<= 104857600).
07/08/26 04:54:11 [285250] got stdin: RESULTS
07/08/26 04:54:16 [285250] got stdin: DESTROY_SANDBOX 4 factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378 [\ In\ =\ "/dev/null";\ Cmd\ =\ "/bin/echo";\ Err\ =\ "_condor_stderr";\ Iwd\ =\ "/var/lib/gwms-factory/test-bosco";\ Out\ =\ "_condor_stdout";\ ProcId\ =\ 0;\ ClusterId\ =\ 24;\ TransferIn\ =\ false;\ TransferOutput\ =\ "";\ TransferExecutable\ =\ false\ ]
07/08/26 04:54:16 [285250] BOSCO: created destroy_sandbox thread, id: 285389
07/08/26 04:54:16 [285250] FTGAHP: destroy sandbox
07/08/26 04:54:16 [285250] BOSCO: destroy, sandbox id: factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:54:16 [285250] BOSCO: destroy, sandbox path: /home/bosco/bosco/sandbox/65b2/65b2a394/factory-workspace.glideinwms.org_9618_factory-workspace.glideinwms.org_24.0_1783486378
07/08/26 04:54:16 [285250] got stdin: RESULTS
07/08/26 04:54:21 [285250] EOF reached on DaemonCore pipe 65536
07/08/26 04:54:21 [285250] stdin buffer closed, exiting
07/08/26 04:54:21 [285250] **** condor_ft-gahp (condor_FT_GAHP) pid 285250 EXITING WITH STATUS 1
Jaime Frey
Jul 8, 2026, 4:56:12 PMJul 8
to Marco Mambelli, htcondo...@g-groups.wisc.edu
That message in the FTGahpLog isn’t an indication of a failure. For jobs with large sandboxes, the Access Point will manage how many transfers can occur in parallel, to avoid overloading the disk (and possibly network). This message indicates that this job’s sandbox is small enough that the transfer can proceed unrestricted.
Are you seeing any other indications that the transfer is failing?
- Jaime
> --
> Archives for older messages are found at https://www-auth.cs.wisc.edu/lists/htcondor-users/
> ---
> You received this message because you are subscribed to the Google Groups "HTCondor Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to htcondor-user...@g-groups.wisc.edu.
> To view this discussion visit https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211*40services.fnal.gov__;JQ!!Mak6IKo!KfJWoJN7Nos1ifMUUbx_IVj5yevDZFuiwwov-hOFYSQ375zUofROSqxwbvxmzNU-94rr8lH1722GsGR1R4nc5PciiijkWZ4Fl_c$ .
Are you seeing any other indications that the transfer is failing?
- Jaime
> Archives for older messages are found at https://www-auth.cs.wisc.edu/lists/htcondor-users/
> ---
> You received this message because you are subscribed to the Google Groups "HTCondor Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to htcondor-user...@g-groups.wisc.edu.
> To view this discussion visit https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211*40services.fnal.gov__;JQ!!Mak6IKo!KfJWoJN7Nos1ifMUUbx_IVj5yevDZFuiwwov-hOFYSQ375zUofROSqxwbvxmzNU-94rr8lH1722GsGR1R4nc5PciiijkWZ4Fl_c$ .
Marco Mambelli
Jul 14, 2026, 1:34:32 PM (9 days ago) Jul 14
to Jaime Frey, htcondo...@g-groups.wisc.edu
Thanks Jaime,
There were also misconfigurations, I was sending tests to this installation and jobs to a non-existing bosco directory.
Fixed that I'm able to run bosco jobs.
Thanks, Marco
On 7/8/26, 3:56 PM, "Jaime Frey" <jf...@cs.wisc.edu <mailto:jf...@cs.wisc.edu>> wrote:
[EXTERNAL] – This message is from an external sender
That message in the FTGahpLog isn’t an indication of a failure. For jobs with large sandboxes, the Access Point will manage how many transfers can occur in parallel, to avoid overloading the disk (and possibly network). This message indicates that this job’s sandbox is small enough that the transfer can proceed unrestricted.
Are you seeing any other indications that the transfer is failing?
- Jaime
> Archives for older messages are found at https://urldefense.proofpoint.com/v2/url?u=https-3A__www-2Dauth.cs.wisc.edu_lists_htcondor-2Dusers_&d=DwIGaQ&c=gRgGjJ3BkIsb5y6s49QqsA&r=EF06-Wh4L9CNLgD8bnIjNQ&m=2fgrLOS63VfsSDw6We1VzKVYT_ABmcLqJ-cB7r-TqlxbHN_0Lg3XtNfEJ_VtlKy-&s=8ZwgwbsjPWhEwTPA35cefON1BRLBgNgjGDaIIzskcVA&e= <https://urldefense.proofpoint.com/v2/url?u=https-3A__www-2Dauth.cs.wisc.edu_lists_htcondor-2Dusers_&d=DwIGaQ&c=gRgGjJ3BkIsb5y6s49QqsA&r=EF06-Wh4L9CNLgD8bnIjNQ&m=2fgrLOS63VfsSDw6We1VzKVYT_ABmcLqJ-cB7r-TqlxbHN_0Lg3XtNfEJ_VtlKy-&s=8ZwgwbsjPWhEwTPA35cefON1BRLBgNgjGDaIIzskcVA&e=>
> To view this discussion visit https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211 <https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211>*40services.fnal.gov__;JQ!!Mak6IKo!KfJWoJN7Nos1ifMUUbx_IVj5yevDZFuiwwov-hOFYSQ375zUofROSqxwbvxmzNU-94rr8lH1722GsGR1R4nc5PciiijkWZ4Fl_c$ .
There were also misconfigurations, I was sending tests to this installation and jobs to a non-existing bosco directory.
Fixed that I'm able to run bosco jobs.
Thanks, Marco
On 7/8/26, 3:56 PM, "Jaime Frey" <jf...@cs.wisc.edu <mailto:jf...@cs.wisc.edu>> wrote:
[EXTERNAL] – This message is from an external sender
That message in the FTGahpLog isn’t an indication of a failure. For jobs with large sandboxes, the Access Point will manage how many transfers can occur in parallel, to avoid overloading the disk (and possibly network). This message indicates that this job’s sandbox is small enough that the transfer can proceed unrestricted.
Are you seeing any other indications that the transfer is failing?
- Jaime
> ---
> You received this message because you are subscribed to the Google Groups "HTCondor Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to htcondor-user...@g-groups.wisc.edu <mailto:htcondor-user...@g-groups.wisc.edu>.
> You received this message because you are subscribed to the Google Groups "HTCondor Users" group.
> To view this discussion visit https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211 <https://urldefense.com/v3/__https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/E0357E84-9D86-4B70-94B2-AAF094F0C211>*40services.fnal.gov__;JQ!!Mak6IKo!KfJWoJN7Nos1ifMUUbx_IVj5yevDZFuiwwov-hOFYSQ375zUofROSqxwbvxmzNU-94rr8lH1722GsGR1R4nc5PciiijkWZ4Fl_c$ .
Reply all
Reply to author
Forward
0 new messages