[Condor-users] Restrict Condor to don't use X cores in a multicore node.

65 views
Skip to first unread message

Edier Zapata

unread,
Jun 28, 2011, 11:00:40 AM6/28/11
to condor-users
Good morning,
 Is there a way to avoid the use of X cores by Condor?
 Example:
  I have a 8 cores node, but I want Condor to use only the cores 3 to 8 and have cores 1 and 2 free of Condor's processing.
 Is there a way to do this?

Thanks.
--
Edier Alberto Zapata Hernández
Ingeniero de Sistemas
Universidad de Valle

Ian Chesal

unread,
Jun 28, 2011, 11:10:05 AM6/28/11
to Condor-Users Mail List

On Tuesday, June 28, 2011 at 11:00 AM, Edier Zapata wrote:

Good morning,
 Is there a way to avoid the use of X cores by Condor?
 Example:
  I have a 8 cores node, but I want Condor to use only the cores 3 to 8 and have cores 1 and 2 free of Condor's processing.
 Is there a way to do this?
Add:

NUM_SLOTS = 6

to the condor_config.local file for the machine and it will only advertise 6 slots instead of 8. That's the quick way to do it. If you want 1/8th of the memory per slot instead of 1/6th you need to define a new slot type:

SLOT_TYPE_1 = 1/8
NUM_SLOTS_TYPE_1 = 6
NUM_SLOTS = 6

I think you need the NUM_SLOTS in there still to keep Condor from using the 2 additional CPUs you didn't use with TYPE_1 -- play around with that one. It's been a while since I divided things any way other than evenly.


Regards,
- Ian

---
Ian Chesal

Cycle Computing, LLC
Leader in Open Compute Solutions for Clouds, Servers, and Desktops
Enterprise Condor Support and Management Tools


 

Thanks.
--
Edier Alberto Zapata Hernández
Ingeniero de Sistemas
Universidad de Valle
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-use...@cs.wisc.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/

Lukas Slebodnik

unread,
Jun 28, 2011, 11:17:25 AM6/28/11
to Condor-Users Mail List
Another approch is set variable NUM_CPUS, it can be used to lie to the
condor_startd daemon about how many CPUs a machine has.

After setting this variable Condor must be restarted. Reconfiguration using
condor_reconfig will not be enough.

http://www.cs.wisc.edu/condor/manual/v7.4/3_3Configuration.html#16457

NUM_CPUS = 6

Regards,
Lukas

> > To unsubscribe, send a message to condor-use...@cs.wisc.edu (mailto:condor-use...@cs.wisc.edu) with a

Dan Bradley

unread,
Jun 28, 2011, 11:28:17 AM6/28/11
to Condor-Users Mail List

Also, keep in mind that simply advertising 6 cores doesn't force jobs to
only use 6 cores. The default assumption is that jobs are well-behaved
and will only use as many resources as advertised in their ClassAd. If
you wish to restrict the job running in slot X to only use core X, you
can use ENFORCE_CPU_AFFINITY.

--Dan

Edier Zapata

unread,
Jul 27, 2011, 3:02:50 PM7/27/11
to Condor-Users Mail List
Good afternoon,
Thanks to every body for your help, finally I got it running, but now
I have another question:
I'd define two slot types, SLOT_TYPE_1 with 2/8 of total resources and
SLOT_TYPE_2 with 1/8 of total resources, I add 1 TYPE_1 slot and 6
TYPE_2 slots.
Now I want to prevent Condor to use slot1 (the SLOT_TYPE_1 slot) is

there a way to do this?

This is the condor_status output:
Name OpSys Arch State Activity LoadAv Mem ActvtyTime
sl...@master.ciat. LINUX X86_64 Owner Idle 0.010 8012 0+00:10:04
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:06
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:07
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:08
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:09
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:10
sl...@master.ciat. LINUX X86_64 Unclaimed Idle 0.000 4006 0+02:20:11

I want to do this, because the our master/submit node have 8 cores and
we want to process tasks in the other cores while we sent jobs from
the same server without produce a job's preemption.

Thanks

To unsubscribe, send a message to condor-use...@cs.wisc.edu with a

Dan Bradley

unread,
Jul 27, 2011, 3:23:50 PM7/27/11
to condor...@cs.wisc.edu

On 7/27/11 2:02 PM, Edier Zapata wrote:
> Good afternoon,
> Thanks to every body for your help, finally I got it running, but now
> I have another question:
> I'd define two slot types, SLOT_TYPE_1 with 2/8 of total resources and
> SLOT_TYPE_2 with 1/8 of total resources, I add 1 TYPE_1 slot and 6
> TYPE_2 slots.
> Now I want to prevent Condor to use slot1 (the SLOT_TYPE_1 slot) is
> there a way to do this?

Append this to your condor configuration:

START = ($(START)) && SlotId != 1

--Dan

Edier Zapata

unread,
Jul 27, 2011, 3:30:03 PM7/27/11
to Condor-Users Mail List
Thanks Dan, can I change it to this:
START = (TRUE) && SlotId != 1 ?

To unsubscribe, send a message to condor-use...@cs.wisc.edu with a

Dan Bradley

unread,
Jul 27, 2011, 3:42:46 PM7/27/11
to Condor-Users Mail List

On 7/27/11 2:30 PM, Edier Zapata wrote:
> Thanks Dan, can I change it to this:
> START = (TRUE)&& SlotId != 1 ?
Yes. --Dan

>
> On Wed, Jul 27, 2011 at 2:23 PM, Dan Bradley<d...@hep.wisc.edu> wrote:
>>
>> On 7/27/11 2:02 PM, Edier Zapata wrote:
>>> Good afternoon,
>>> Thanks to every body for your help, finally I got it running, but now
>>> I have another question:
>>> I'd define two slot types, SLOT_TYPE_1 with 2/8 of total resources and
>>> SLOT_TYPE_2 with 1/8 of total resources, I add 1 TYPE_1 slot and 6
>>> TYPE_2 slots.
>>> Now I want to prevent Condor to use slot1 (the SLOT_TYPE_1 slot) is
>>> there a way to do this?
>> Append this to your condor configuration:
>>
>> START = ($(START))&& SlotId != 1
Reply all
Reply to author
Forward
0 new messages