fetch chromium displays no terminal output while its running in background

[Zeeshan Mahmood]

I am trying to get Chromium code using command "fetch --nohooks chromium". It does not display any terminal output and seems to stuck here:



When I cancel it using "ctrl = c" then the last few progress statues show immediately.



I want to see these progress statuses while fetching the code. How can I do this?

[Primiano Tucci]

Once fetch creates the .gclient file, you can CTRL+C that and just run gclient sync -njv  , the -v will give you the verbosity you want

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev

[Zeeshan Mahmood]

I tried gclient sync -v, it shows some messages like this after some time:

[0:01:00] Still working on:
[0:01:00] src

Is it fine?

[Primiano Tucci]

BCC: chromium-dev, +infra-dev

Ok this seems definitely an issue. I filed crbug.com/585094
Something is keeping an output buffer somewhere where it shouldn't

Even gclient sync -j1 -v I don't see any output until I ctrl+c I seem to remember that it was not the case a while ago.

Thanks for reporting this.

[Zeeshan Mahmood]

Thanks.

I thought I might be doing wrong.

I also tried it couple of months ago, and at that time I faced the same issue. I could not pursue it again until today.

Let me know if there is any workaround available.

[WC Leung]

From your screenshot I guess you're suffering from slow internet connections. Fetching chromium involves gigabytes of data, and your screenshot shows <3% of progress.

I guess you'd better try "fetch --nohooks --no-history chromium". Anyway delete your partial checkout before trying fetch again. AFAIK fetch does not support resuming.

[Primiano Tucci]

That is not really the issue. The problem is that git is outputting log with status update but gclient is holding it and not spitting it out on the tty.

--
You received this message because you are subscribed to the Google Groups "infra-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-dev+...@chromium.org.
To post to this group, send email to infr...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/cbf61aff-a477-499f-ab73-6c3277fd26eb%40chromium.org.

[Aaron Gable]

Let's continue discussion on that bug. It should get triaged today, and someone familiar with depot_tools should look in to it.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/CA%2ByH71eh5ZVcDiXawompRm7uAWj6tYRNCmnkWWaaofiidmZn8Q%40mail.gmail.com.

[WC Leung]

While your concern is about the bug that prevent the messages being displayed (the bug needs to be fixed anyway), I believe that Zeeshan's concern is to check out chromium successfully. That's why I've made my last reply.

[Aaron Gable]

Thanks, that's actually a good point :)

Yeah, Zeeshan, even if gclient is eating the output, the sync should still be working in the background. And yeah, it can take a really long time (keep in mind that chromium, which now includes blink, is something like 8GB of data if you download the whole thing). So do the fetch with --no-history, and I hope that works for you!

--
You received this message because you are subscribed to the Google Groups "infra-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-dev+...@chromium.org.
To post to this group, send email to infr...@chromium.org.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/7609fe5c-7848-4b0d-9e82-8a1ace34c3a5%40chromium.org.

[Qiang Li]

Years later, it is still a problem. For people who came to this page looking for ways to monitor the progress instead of ctrl-c. Here is a woraround:

run fetch in background and: 

while true; do du -sh .; sleep 60; done

[Qiang Li]

for the record, here is a sample terminal output:

while true; do du -sh .; sleep 60; done

311M .

485M .

741M .

805M .

813M .

813M .

813M .

813M .

813M .

1.1G .

1.4G .

1.9G .

2.3G .

3.3G .

5.7G .

8.0G .

8.6G .

Running: git submodule foreach 'git config -f $toplevel/.git/config submodule.$name.ignore all'

Running: git config --add remote.origin.fetch '+refs/tags/*:refs/tags/*'

Running: git config diff.ignoreSubmodules all

[1]+  Done                    fetch --nohooks --no-history chromium

8.7G .