rebar3 - slow in Analyzing applications...

51 views
Skip to first unread message

Marc Worrell

unread,
Apr 15, 2021, 7:20:28 AM4/15/21
to Erlang
Hi,

I have (quite suddenly actually) a build problem with rebar3.
It is the newest version.

The "Analyzing applications…” phase seems to take forever.

Is there a method to see what it is doing and what might be the cause of this?

DEBUG=1 doesn’t help.

Cheers,

Marc

Fred Hebert

unread,
Apr 15, 2021, 12:37:38 PM4/15/21
to Marc Worrell, Erlang
This is a full graph analysis of all files to figure out what depends on what. The first run should be slower than before, but the follow-up runs much faster as we'll only rebuild the files that have changed (along with the files that depend on the files that have changed).
A lot of the work in the application analysis was done to initially speed up large builds in companies like WhatsApp while fixing correctness at no major cost for smaller projects.

That being said, if you have a very large project with non-standard setups, you should probably come talk to us about that, it's hard to know what could be to blame there, and it's possible some options tweaking could solve a bunch of stuff, especially when you have older carryovers from rebar 2.x

Eric Pailleau

unread,
Apr 15, 2021, 1:11:36 PM4/15/21
to Erlang Questions, Marc Worrell

Hi marc

Using strace may help sometime.


Envoyé depuis mon mobile



---- Marc Worrell a écrit ----

Marc Worrell

unread,
Apr 16, 2021, 6:12:09 AM4/16/21
to Erlang Questions
Hi,

Thanks for the answers.

In the end I have removed the _build directory.
After this the first compile was indeed slow, and the next ones were ok.
Apparently something was corrupted.

Cheers, Marc

Fred Hebert

unread,
Apr 17, 2021, 10:58:19 AM4/17/21
to Marc Worrell, Erlang Questions
Interesting. I've just had a similar report from someone who saw a similar issue, and managed to save the DAG.

I'm unsure what could get corrupted and how in there since things ought to be quite repeatable, but we'll have to wait for more analyzable data to pin things properly.

Marc Worrell

unread,
Apr 17, 2021, 11:42:12 AM4/17/21
to Fred Hebert, Erlang Questions
Next time I will save the DAG and send it to you.

Thinking of it, there was one moment two rebar3 compile actions were running in parallel. This might be the cause of the corrupted file.

Thanks for your help!

Cheers, Marc


Sent from my iPad

On 17 Apr 2021, at 16:58, Fred Hebert <mono...@ferd.ca> wrote:


Reply all
Reply to author
Forward
0 new messages