What we do, is that we set our dynamic inventories having the whole ProxyCommand indicating the jumphost, so for example:
[server1]
server1.domain ansible_ssh_common_args='-i <path-to-your-ssh-key> -o IdentitiesOnly=yes -o ProxyCommand="ssh -A -W %h%p -p 22 -o User=<user> -o IdentitiesOnly=yes -i <path-to-your-key> <bastion-host-ip>"'
You can create a volume for the docker container to load your shared ssh keys, for example.
-Cesar