I haven't built brotli for Mac, and I suspect the Telerik team hasn't yet either. You may wish to propose a "Support Brotli decompression on OS X and Linux" item here:
https://fiddler.ideas.aha.io
For now, the workaround would be to write a little bit of FiddlerScript that removes "br" from outbound Accept-Encoding headers, which should prevent servers from using that compression method when you're intercepting traffic.