Unable to load Apple Updates Catalog Admin

[a...@bdsolutions.co.uk]

Hello

I Have been experimenting with the current build of Simian. Most of the basics seem to be working but I'm having trouble with the Apple Updates.

When i tried to access the apple updates Catalog Admin pages in simian, initially i received an Exceeded soft private memory limit but subsequently, the page waits for a while then throws the traceback error below

looking at other posts on this forum i can see that the private was a common issue on the standard F1 instance so i enabled billing and recompiled Simian onto an F4 instance via app.yaml but this did not appear to have resolved the issues

I have also tried editing applesus.py and to remove older OS versions ( have 10.9-10.12)  from the catalog then make a new release, to reduce resources consumed but no luck

in the apple updates log in the simian admin i can see  there are 2025 apple updates listed (inc some for 10.7  flagged as new or deprecated) but the catalog admin page just will not load

I have also tried throwing away the name=10.*_untouched AppleSUS catalogs from the datastore then triggering the apple catalog sync Cron Job manually (which seems to run fine) then left it for 24 hrs, but sitill cannot access the catalog admin page in simian nor does my client receive any apple updates (the Managed software centre produces  the error Could not download Apple SUS catalog & error 404

heres the error displayed in the browser

Traceback (most recent call last):

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py", line 267, in Handle

    result = handler(dict(self._environ), self._StartResponse)

  File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1529, in __call__

    rv = self.router.dispatch(request, response)

  File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1278, in default_dispatcher

    return route.handler_adapter(request, response)

  File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1102, in __call__

    return handler.dispatch()

  File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 570, in dispatch

    return method(*args, **kwargs)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/admin/applesus.py", line 180, in get

    self._DisplayMain()

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/admin/applesus.py", line 196, in _DisplayMain

    p.stable_promote_date = applesus.GetAutoPromoteDate(common.STABLE, p)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/common/applesus.py", line 350, in GetAutoPromoteDate

    previous_track_date = GetAutoPromoteDate('testing', applesus_product)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/common/applesus.py", line 330, in GetAutoPromoteDate

    days = settings.APPLE_UNSTABLE_GRACE_PERIOD_DAYS

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/settings.py", line 372, in __getattr__

    return self._Get(str(k).lower())

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/settings.py", line 800, in _Get

    item, unused_mtime = self._module.models.Settings.GetItem(k)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/models/settings.py", line 277, in GetItem

    value, mtime = cls.GetSerializedItem(name)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/models/base.py", line 685, in GetSerializedItem

    entity = cls.MemcacheWrappedGet(key)

  File "/base/data/home/apps/s~simian-mycompany/3517a00030ea.397283085967901153/simian/mac/models/base.py", line 109, in MemcacheWrappedGet

    entity = cls.get_by_key_name(key_name)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/ext/db/__init__.py", line 1282, in get_by_key_name

    return get(keys[0], **kwargs)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/ext/db/__init__.py", line 1540, in get

    return get_async(keys, **kwargs).get_result()

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 613, in get_result

    return self.__get_result_hook(self)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1648, in __get_hook

    self.check_rpc_success(rpc)

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1369, in check_rpc_success

    rpc.check_success()

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 577, in check_success

    self.wait()

  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 551, in wait

    assert self.__rpc.state != apiproxy_rpc.RPC.IDLE, repr(self.state)

DeadlineExceededError: The overall deadline for responding to the HTTP request was exceeded.

any advice or pointers on how to diagnose the cause and rectify this would be greatly appreciated

Many thanks

Alasdair

[Allister Banks]

Hey, you should remove any software update catalogs for OSes you do not support. I believe there are either previous mails to this list or issues filed on github that can provide more assistance.
Allister

--
You received this message because you are subscribed to the Google Groups "Simian Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to simian-discus...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Will Jenkins]

You need to edit the OS_VERSIONS constant and potentially bump the instance class in the app.yaml file.

I've found that in order to have just 10.11 and 10.12 catalogs, you need to have at least an instance class of F2.

It would be better if the defaults worked out of the box, and if OS_VERSIONS wasn't buried so deep in the code - perhaps it could be moved to simian/settings.py?

To unsubscribe from this group and stop receiving emails from it, send an email to simian-discuss+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

You received this message because you are subscribed to the Google Groups "Simian Discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to simian-discuss+unsubscribe@googlegroups.com.

[a...@bdsolutions.co.uk]

Thanks

I had already tried uping the instance type to F4 and removing the 10.6-10.8 Catalogs from  mac/cron/applesus.py

will try editing the OS_versions constant in mac/common/applesus.py and report back 

thanks

[Alasdair Tod]

Thank you that worked.

i created a brand new clean instance with just 10,11 and 10.12 catalog and OS_versions on an F2 instance and it worked pretty  much immediately

also after changing those setting my original test instance, running the catalogsync cron job and and waiting a day or so on , the old instance is also behaving and i can access the Catalog admin pages without error

Is there any way to safely purge the older 10.7-10.10 updates and catalog summaries from my original instance?