Adding synthetic screens (random openings of menu/console/cutscene) to the gameplay

[Bahadır Başaran]

Hello everyone!

I'd like to use ViZDoom and the pre-trained agent "Arnold" together for my research. For my purpose, my first goal is to enrich the game screens by adding synthetic screens during the gameplay (random openings of the menu, console and some short cutscenes).

To summarize, I want to make the pre-trained agent "Arnold" play the game and during the gameplay, sometimes (randomly) the menu, the console and a pre-defined cutscene will be seen by the agent.
For example, in random intervals:

• pause the game -> open the menu
• pause the game -> open the console
• pause the game -> play a cutscene

for random x seconds -> resume the game and the agent continues to play where it left.

I had a look at the tutorial, ACS scripting and etc. for this purpose but I couldn't find what I want.

Any suggestion would help me a lot. Thanks!