Group_by taking 4 minutes for 2800 servers

[Dag Wieers]

Hi,

Is it normal for group_by to take 4 minutes to evaluate 2800 servers ?

We often start off with a group_by to simplify the playbook (and not
overdesign our inventory script) and have noticed that with a large number
of systems it doesn't scale very well.

--
Dag

[Michael DeHaan]

Starter question:  "ansible --version"

?

--
Dag

--
You received this message because you are subscribed to the Google Groups "Ansible Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscribe@googlegroups.com.
To post to this group, send email to ansible-project@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/alpine.LRH.2.02.1410071701390.28571%40pikachu.3ti.be.
For more options, visit https://groups.google.com/d/optout.

[Dag Wieers]

On Thu, 9 Oct 2014, Michael DeHaan wrote:

> Starter question: "ansible --version"

It was version 1.6.3, but meanwhile it seems that 1.7.2 has this fixed
although I haven't confirmed it for every use-case in production. Will
check on Monday.

--
Dag

[Michael DeHaan]

Good deal, my other thing I'd suggest checking is whether the inventory script has the "_meta" optimization, as it may be trying to get hostvars on those hosts it has not asked about it yet.

http://docs.ansible.com/developing_inventory.html#tuning-the-external-inventory-script

--
Dag

--
You received this message because you are subscribed to the Google Groups "Ansible Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscribe@googlegroups.com.
To post to this group, send email to ansible-project@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/alpine.LRH.2.02.1410092242161.28571%40pikachu.3ti.be.

[Dag Wieers]

On Thu, 9 Oct 2014, Michael DeHaan wrote:

> On Thu, Oct 9, 2014 at 4:44 PM, Dag Wieers <d...@wieers.com> wrote:
>
>> On Thu, 9 Oct 2014, Michael DeHaan wrote:
>>
>> Starter question: "ansible --version"
>>>
>>
>> It was version 1.6.3, but meanwhile it seems that 1.7.2 has this fixed
>> although I haven't confirmed it for every use-case in production. Will
>> check on Monday.

> Good deal, my other thing I'd suggest checking is whether the inventory
> script has the "_meta" optimization, as it may be trying to get hostvars on
> those hosts it has not asked about it yet.

Yes, we use _meta. The 4min to 5min delay we have been seeing was very
clearly during the group_by task, and not the inventory-stage.

If this still poses a problem with 1.7.2, I will let you know.

--
Dag