Forge repository timeout

[Raphaël Hoareau]

Hi all,

I'm trying to synchronize the Forge repository (https://forge.puppet.com) into my Katello install but it fail with connection errors (it was working a few weeks ago).

When trying to download https://forge.puppet.com/modules.json, a simple curl/wget tries multiple times before getting the file (and Katello simply fails).

[rhoareau@glados ~]$ wget -S https://forge.puppet.com/modules.json

--2017-10-11 10:45:00-- https://forge.puppet.com/modules.json

Résolution de forge.puppet.com (forge.puppet.com)… 52.10.130.237

Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… connecté.

requête HTTP transmise, en attente de la réponse… 

HTTP/1.0 504 Gateway Time-out

Cache-Control: no-cache

Connection: close

Content-Type: text/html

Nouvel essai.

--2017-10-11 10:46:32-- (essai : 2) https://forge.puppet.com/modules.json

Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… connecté.

requête HTTP transmise, en attente de la réponse… 

HTTP/1.0 504 Gateway Time-out

Cache-Control: no-cache

Connection: close

Content-Type: text/html

Nouvel essai.

--2017-10-11 10:48:05-- (essai : 3) https://forge.puppet.com/modules.json

Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… connecté.

requête HTTP transmise, en attente de la réponse… 

HTTP/1.1 504 Gateway Time-out

Server: nginx

Date: Wed, 11 Oct 2017 08:49:36 GMT

Content-Type: text/html

Content-Length: 176

X-App-Server: forge/forge-i-437e8aec_forgenext-app04-prod.ops.puppetlabs.net

X-Lb-Server: forgenext-lb02-prod.ops.puppetl

X-UUID: 25AB0F9B:F43F_0AE00633:01BB_59DDDAC6_EF89F2B:01F1

Nouvel essai.

--2017-10-11 10:49:39-- (essai : 4) https://forge.puppet.com/modules.json

Réutilisation de la connexion existante à forge.puppet.com:443.

requête HTTP transmise, en attente de la réponse… 

Taille : non indiqué

Sauvegarde en : « modules.json.1 »

modules.json.1 [ <=> ] 1,67M --.-KB/s ds 68s 

2017-10-11 10:50:48 (25,0 KB/s) - « modules.json.1 » sauvegardé [1749112]

Any information on that ?

Raphaël.

[David Schmitt]

Hi Raphaël,

please use the API v3 (described at https://forgeapi.puppetlabs.com/) to programmatically access the forge. Using the pagination parameters (offset and limit) allows much faster and safer traversing of the results. With the increasing number of modules on the forge, I'm not sure we'll be able to keep the generated all-in-one JSON around for much longer.

Cheers, David

--
You received this message because you are subscribed to the Google Groups "Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/8b5540ef-5110-40d5-80d7-639006084e2c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.