trac.sagemath.org unreachable

117 views
Skip to first unread message

Emmanuel Charpentier

unread,
Aug 31, 2022, 2:45:29 AM8/31/22
to sage-devel
This morning (Aug 31, 2022, 8:43), any attempt to reach `trac.sagemath.org` ends up displayong a Python trace :

```
Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/trac/web/api.py", line 602, in send_error data, 'text/html') File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 1104, in render_template template = self.load_template(filename, method=method) File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 1053, in load_template self.get_all_templates_dirs(), auto_reload=self.auto_reload, File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 758, in get_all_templates_dirs for provider in self.template_providers: File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 82, in extensions components = [component.compmgr[cls] for cls in classes] File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 208, in __getitem__ component = cls(self) File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 144, in __call__ self.__init__() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 195, in __init__ self._init_gitolite_admin() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 66, in wrapper ret = inner_wrapper(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/fasteners/lock.py", line 302, in wrapper return f(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 52, in inner_method return method(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 226, in _init_gitolite_admin self._update_gitolite_admin() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 287, in _update_gitolite_admin 'repository'.format(out)) TracError: Error updating the gitolite-admin repository: Host key verification failed. fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. ; you may have to manually clean up or re-clone the repository
```

Any idea ?

Dima Pasechnik

unread,
Aug 31, 2022, 2:48:19 AM8/31/22
to sage-devel
new ssh keys on the server, don't know how to tell this to "git trac"

--
You received this message because you are subscribed to the Google Groups "sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sage-devel/0c956548-4fa6-4970-8662-84de5b6975f0n%40googlegroups.com.

enriqu...@gmail.com

unread,
Aug 31, 2022, 3:00:45 AM8/31/22
to sage-devel
Probably unrelated because I was able to access the web page after the update but right now I get from the browser (chrome and firefox):

Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/trac/web/api.py", line 602, in send_error data, 'text/html') File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 1104, in render_template template = self.load_template(filename, method=method) File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 1053, in load_template self.get_all_templates_dirs(), auto_reload=self.auto_reload, File "/usr/local/lib/python2.7/dist-packages/trac/web/chrome.py", line 758, in get_all_templates_dirs for provider in self.template_providers: File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 82, in extensions components = [component.compmgr[cls] for cls in classes] File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 208, in __getitem__ component = cls(self) File "/usr/local/lib/python2.7/dist-packages/trac/core.py", line 144, in __call__ self.__init__() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 195, in __init__ self._init_gitolite_admin() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 66, in wrapper ret = inner_wrapper(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/fasteners/lock.py", line 302, in wrapper return f(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 52, in inner_method return method(self, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 226, in _init_gitolite_admin self._update_gitolite_admin() File "/usr/local/lib/python2.7/dist-packages/sage_trac/sshkeys.py", line 287, in _update_gitolite_admin 'repository'.format(out)) TracError: Error updating the gitolite-admin repository: Host key verification failed. fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. ; you may have to manually clean up or re-clone the repository

Kwankyu Lee

unread,
Aug 31, 2022, 3:01:54 AM8/31/22
to sage-devel
This seems a different problem. The website is not accessible.

Emmanuel Charpentier

unread,
Aug 31, 2022, 3:02:53 AM8/31/22
to sage-devel
Ditto from Git via SSH :

```charpent@zen-book-flip:/usr/local/sage-9$ git fetch
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that a host key has just been changed.
The fingerprint for the ECDSA key sent by the remote host is
SHA256:29lzUeszegCYCnVMOJ+Ts/IlCwojLuf03NnVoLlONEs.
Please contact your system administrator.
Add correct host key in /home/charpent/.ssh/known_hosts to get rid of this message.
Offending ECDSA key in /home/charpent/.ssh/known_hosts:14
  remove with:
  ssh-keygen -f "/home/charpent/.ssh/known_hosts" -R "trac.sagemath.org"
Host key for trac.sagemath.org has changed and you have requested strict checking.
Host key verification failed.
fatal: Impossible de lire le dépôt distant.

Veuillez vérifier que vous avez les droits d'accès
et que le dépôt existe.
```

Removing the old SSH key cleared git access.

Emmanuel Charpentier

unread,
Aug 31, 2022, 3:04:43 AM8/31/22
to sage-devel
The Web site is still unreachable.

Emmanuel Charpentier

unread,
Aug 31, 2022, 3:10:34 AM8/31/22
to sage-devel
And an attempt to fetch a ticket also failed for related reasons :

charpent@zen-book-flip:/usr/local/sage-9$ git trac checkout 34457
Loading ticket #34457...

Traceback (most recent call last):
  File "/home/charpent/Dev/git-trac-command/git_trac/digest_transport.py", line 106, in single_request
    return self.parse_response(response)
  File "/usr/lib/python3.10/xmlrpc/client.py", line 1354, in parse_response
    return u.close()
  File "/usr/lib/python3.10/xmlrpc/client.py", line 668, in close
    raise Fault(**self._stack[0])
xmlrpc.client.Fault: <Fault 1: "'Error updating the gitolite-admin repository: Host key verification failed.\nfatal: Could not read from remote repository.\n\nPlease make sure you have the correct access rights\nand the repository exists.\n; you may have to manually clean up or re-clone the repository' while executing 'ticket.changeLog()'">

During handling of the above exception, another exception occurred:


Traceback (most recent call last):
  File "/usr/local/bin/git-trac", line 17, in <module>
    cmdline.launch()
  File "/home/charpent/Dev/git-trac-command/git_trac/cmdline.py", line 239, in launch
    app.checkout(args.ticket_or_branch, args.branch_name)
  File "/home/charpent/Dev/git-trac-command/git_trac/app.py", line 118, in checkout
    self._checkout_ticket(int(ticket_or_branch), branch_name)
  File "/home/charpent/Dev/git-trac-command/git_trac/app.py", line 125, in _checkout_ticket
    ticket = self.trac.load(ticket_number)
  File "/home/charpent/Dev/git-trac-command/git_trac/trac_server.py", line 133, in load
    ticket = TracTicket(ticket_number, self.anonymous_proxy)
  File "/home/charpent/Dev/git-trac-command/git_trac/trac_ticket.py", line 155, in TracTicket
    change_log = server_proxy.ticket.changeLog(ticket_number)
  File "/usr/lib/python3.10/xmlrpc/client.py", line 1122, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib/python3.10/xmlrpc/client.py", line 1464, in __request
    response = self.__transport.request(
  File "/usr/lib/python3.10/xmlrpc/client.py", line 1166, in request
    return self.single_request(host, handler, request_body, verbose)
  File "/home/charpent/Dev/git-trac-command/git_trac/digest_transport.py", line 108, in single_request
    raise TracInternalError(e)
git_trac.trac_error.TracInternalError: <Fault 1: "'Error updating the gitolite-admin repository: Host key verification failed.\nfatal: Could not read from remote repository.\n\nPlease make sure you have the correct access rights\nand the repository exists.\n; you may have to manually clean up or re-clone the repository' while executing 'ticket.changeLog()'">

Of note : I could create a new ticket (the one I was trying to fetch) yesterday afternoon. This might be a problem distinct from the one due to the key change (this week-end, IIUIC).

Kwankyu Lee

unread,
Aug 31, 2022, 3:23:00 AM8/31/22
to sage-devel
Perhaps need to update trac server ssh keys stored in github?

Jan Groenewald

unread,
Aug 31, 2022, 3:42:30 AM8/31/22
to sage-...@googlegroups.com
Hi

On Wed, 31 Aug 2022 at 09:23, Kwankyu Lee <ekwa...@gmail.com> wrote:
Perhaps need to update trac server ssh keys stored in github?

This is quite likely. Who has access, where is this done?

Regards,
Jan


 
--
You received this message because you are subscribed to the Google Groups "sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.


--
  .~.
  /V\     Jan Groenewald
 /( )\    www.aims.ac.za
 ^^-^^ 

Dima Pasechnik

unread,
Aug 31, 2022, 3:46:59 AM8/31/22
to sage-devel

Emmanuel Charpentier

unread,
Aug 31, 2022, 5:25:04 AM8/31/22
to sage-devel


Le mercredi 31 août 2022 à 09:46:59 UTC+2, dim...@gmail.com a écrit :
roll back.

Do you mean 
  - you plan to roll back, or
  - suggest that someone else rolls back ?

In either case, as of 11:23 CET, still no access from a different machine (SSH key not yet updated)..

Frédéric Chapoton

unread,
Aug 31, 2022, 5:41:19 AM8/31/22
to sage-devel
just be patient and spend your day doing something else, please

Kwankyu Lee

unread,
Aug 31, 2022, 7:34:36 AM8/31/22
to sage-devel
On Wednesday, August 31, 2022 at 6:41:19 PM UTC+9 Frédéric Chapoton wrote:
just be patient and spend your day doing something else, please

It is a day to think about how precious our trac is. Just be careful when you touch its soft database.  

Dima Pasechnik

unread,
Aug 31, 2022, 9:31:24 AM8/31/22
to sage-devel
no, it's the day to finally pull our **** together and decide to move
to a platform which is not held together by mud, python2.7, sticks,
and chewing gum,
a platform noone here knows how it works.


>
> --
> You received this message because you are subscribed to the Google Groups "sage-devel" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-devel/cba0380e-c379-4b96-adce-43ea88754dccn%40googlegroups.com.

Kwankyu Lee

unread,
Aug 31, 2022, 9:54:06 AM8/31/22
to sage-devel
Trac is back. 

Anything lost?

Dima Pasechnik

unread,
Aug 31, 2022, 9:56:56 AM8/31/22
to sage-devel
On Wed, Aug 31, 2022 at 2:54 PM Kwankyu Lee <ekwa...@gmail.com> wrote:
>
> Trac is back.
>
> Anything lost?

Trac is a timesink.
Time spent on looking for fixes for it is time lost, that's for sure.

>
> --
> You received this message because you are subscribed to the Google Groups "sage-devel" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-devel/966c2ada-da30-4ef9-84f6-64b9e47f6285n%40googlegroups.com.

Kwankyu Lee

unread,
Aug 31, 2022, 10:14:34 AM8/31/22
to sage-devel


On Wednesday, August 31, 2022 at 10:56:56 PM UTC+9 dim...@gmail.com wrote
Trac is a timesink.
Time spent on looking for fixes for it is time lost, that's for sure.

The trac project seems not well maintained, according to its website. 

We may need to plan migration while trac is still breathing...

Kwankyu Lee

unread,
Aug 31, 2022, 10:27:42 AM8/31/22
to sage-devel
On Wednesday, August 31, 2022 at 11:14:34 PM UTC+9 Kwankyu Lee wrote:

We may need to plan migration while trac is still breathing...


seems a successor of trac. 

 

Dima Pasechnik

unread,
Aug 31, 2022, 10:28:06 AM8/31/22
to sage-devel
On Wed, Aug 31, 2022 at 3:14 PM Kwankyu Lee <ekwa...@gmail.com> wrote:
>
>
>
> On Wednesday, August 31, 2022 at 10:56:56 PM UTC+9 dim...@gmail.com wrote
>>
>> Trac is a timesink.
>> Time spent on looking for fixes for it is time lost, that's for sure.
>
>
> The trac project seems not well maintained, according to its website.

this is only 10% of the probem - the real one is that we are many
versions behind its current 1.4, with various custom
hacks nobody knows about any more. And an attempt to update did not
seem to work.

By the way, I'm currently looking at a way to import trac wiki,
something we use quite a bit, into GitHub.

>
> We may need to plan migration while trac is still breathing...
>
> --
> You received this message because you are subscribed to the Google Groups "sage-devel" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-devel/e135af15-faf7-4df4-9883-b6784734207bn%40googlegroups.com.

Jan Groenewald

unread,
Aug 31, 2022, 12:00:23 PM8/31/22
to sage-...@googlegroups.com
Hi



On Wed, 31 Aug 2022 at 16:28, Dima Pasechnik <dim...@gmail.com> wrote:
On Wed, Aug 31, 2022 at 3:14 PM Kwankyu Lee <ekwa...@gmail.com> wrote:
>
>
>
> On Wednesday, August 31, 2022 at 10:56:56 PM UTC+9 dim...@gmail.com wrote
>>
>> Trac is a timesink.
>> Time spent on looking for fixes for it is time lost, that's for sure.
>
>
> The trac project seems not well maintained, according to its website.

this is only 10% of the probem - the real one is that we are many
versions behind its current 1.4, with various custom
hacks nobody knows about any more. And an attempt to update did not
seem to work.

By the way, I'm currently looking at a way to import trac wiki,
something we use quite a bit, into GitHub.

Or into gitlab, which we can host ourselves,


(I have no experience with tracboat)

regards,
Jan



>
> We may need to plan migration while trac is still breathing...
>
> --
> You received this message because you are subscribed to the Google Groups "sage-devel" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-devel/e135af15-faf7-4df4-9883-b6784734207bn%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.

Kwankyu Lee

unread,
Aug 31, 2022, 5:05:39 PM8/31/22
to sage-devel
On Thursday, September 1, 2022 at 1:00:23 AM UTC+9 j...@aims.ac.za wrote:
Or into gitlab, which we can host ourselves,


(I have no experience with tracboat)

Whether we upgrade trac or migrate to other platform, the process should be gradual so  that we run an experimental new server along with the present trac server, sharing the (copied) database, for some (or long) time.

If we upgrade trac, the process could be 1.1 -> 1.2 -> 1.3 -> 1.4.
 

Jan Groenewald

unread,
Aug 31, 2022, 6:05:37 PM8/31/22
to sage-...@googlegroups.com
Hi

The current version is 1.1.6. the packaged version for the new server is 1,.2, It seems even numbers are stable but the next and latest packaged version on debian/ubuntu is 1.5.3; 1.5+ is python3.

Trac upgrade guide is 1.0 -> 1.2 -> 1.4

Maybe the OS package upgrades support 1.2 -> 1.5.3.

I am going to look at 1.1.6 -> 1.2 packaged version on a trac-test copy of the VM but I must say the gitolite error put me off a bit, even if it is just disabling sshkeys.py for a bit. Then Frederic found other problems in ticket_branch.py/pygit2.

Regards,
Jan
Reply all
Reply to author
Forward
0 new messages