Repo_sync crashes following server rebuild.

[Simon Weaver]

Hi,

I'm struggling with repo_sync following a rebuild of the server. 

I got this error when ran first time...

repo_sync run started

Downloading 2199760 bytes from http://swscan.apple.com/content/catalogs/others/index-lion-snowleopard-leopard.merged-1.sucatalog...

572 products found in http://swscan.apple.com/content/catalogs/others/index-lion-snowleopard-leopard.merged-1.sucatalog

Downloading 5079 bytes from http://swcdn.apple.com/content/downloads/30/42/041-0259/qptvjgjq5474oeefdbjnltv7udxkvlpex4/041-0259.English.dist...

Downloading 5072 bytes from http://swcdn.apple.com/content/downloads/57/42/041-0260/i4hr4ndourabmvja7o3gm3bkau7yjth0bh/041-0260.English.dist...

Downloading 3566 bytes from http://swcdn.apple.com/content/downloads/11/05/041-0925/g27es04pw9re5ggrfp3vuf8ew6r53asfz8/041-0925.English.dist...

Downloading 5093 bytes from http://swcdn.apple.com/content/downloads/09/60/041-3127/ijewgysp6mkwmtxvus763gj3lg8x9aa6af/041-3127.English.dist...

Downloading 454245 bytes from http://swcdn.apple.com/content/downloads/41/26/041-3633/9wojm65c7neiocqb9yrnzwfdohplc9241j/041-3633.en.dist...

Downloading 3583 bytes from http://swcdn.apple.com/content/downloads/55/51/041-3891/se4uhpqng48t842cdsosqh28lft54fmswl/041-3891.English.dist...

Downloading 131072 bytes from http://swcdn.apple.com/content/downloads/14/09/041-3895/9zeav40ts92sovsa2xbbbz74etormhzt6e/041-3895.en.dist...

Traceback (most recent call last):

  File "./repo_sync", line 710, in <module>

    main()

  File "./repo_sync", line 706, in main

    download_packages=download_packages)

  File "./repo_sync", line 633, in sync

    dist = parseSUdist(preferred_dist)

  File "./repo_sync", line 106, in parseSUdist

    dom = minidom.parse(filename)

  File "/usr/lib/python2.7/xml/dom/minidom.py", line 1920, in parse

    return expatbuilder.parse(file)

  File "/usr/lib/python2.7/xml/dom/expatbuilder.py", line 924, in parse

    result = builder.parseFile(fp)

  File "/usr/lib/python2.7/xml/dom/expatbuilder.py", line 211, in parseFile

    parser.Parse("", True)

xml.parsers.expat.ExpatError: no element found: line 811, column 10884

my preferences plist is as follows (I'm only after lion updates)

<?xml version="1.0" encoding="UTF-8"?>

<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">

<plist version="1.0">

<dict>

<key>LocalCatalogURLBase</key>

<string></string>

<key>UpdatesMetadataDir</key>

<string>/var/www/swupdate/metadata</string>

<key>UpdatesRootDir</key>

<string>/var/www/swupdate/html</string>

    <key>AppleCatalogURLs</key>

    <array>

        <string>http://swscan.apple.com/content/catalogs/others/index-lion-snowleopard-leopard.merged-1.sucatalog</string>

    </array>

</dict>

</plist>

I'm sure I've done something daft but just can't see it.

Thanks,

Simon.

[Matt Hansen]

Simon,

I had the same issue with the 041-3895 en.dist see this thread - https://groups.google.com/forum/?fromgroups#!topic/reposado/oTn0I9xvC3w

Check the .dist file link in Safari and it should contain 1030 lines, and if not copy the valid file from the thread into your repo and set the permissions.

xml.parsers.expat.ExpatError: no element found: line 811, column 10884

-Matt

[Stephan Peterson]

Matt,

Thanks for this. I've been seeing the same issue. Will doing a
repo_sync --recheck undo this bandaid fix?

Thanks,
Stephan

[Simon Weaver]

Many thanks Matt, thats fixed it.

[Greg Neagle]

This won't fix the underlying problem, but I pushed a fix to GitHub so that you get an error message if a dist file is corrupt and repo_sync will attempt to continue instead of exiting ungracefully.

-Greg

[Matt Hansen]

Remember to file a bug report (bugreport.apple.com) and you can mention radar #11829688

Apple Engineering responded stating they couldn't reproduce the issue on their end.

-Matt

[Greg Neagle]

Not everyone is seeing it. I suspect it has to do with which Akamai mirror you happen to be hitting.

-Greg