Hi Anton,
Pyglet is just a normal X application under Linux, wrapping xlib with ctypes. This means that it's definitely possible to do this, but there is no current high-level abstraction written in pyglet to do it.
There is a gist here that shows a C example (which you may have seen already):
https://gist.github.com/je-so/903479From what I can tell, you need to set a few different flags in the window attributes. If you want to have a try getting it working, you can find the code in
pyglet/window/xlib/__init__.pyIt would be a nice feature to have at some point, which would allow pyglet to be used for different types of on screen display projects.