I2C multiplexers are not supported by Tasmota. One reason for this is that devices need to be detected at boot time, meaning that some scheme you may want to switch to another bus would be broken from the start. Another reason is that many drivers keep track of config/state data per device, which would break in case of the bus being switched.
In principle, it would of course be possible to significantly change Tasmota to actively support cycling through many busses, and also support multiple of the same device on the same address, but that's not a likely thing to be done.
If you want to talk natively to I2C devices from Tasmota, the new feature of the Berry scripting language for Tasmota on ESP32 does support coding device drivers in this easy-to-access language. I'm just playing with coding a device driver for an otherwise unsupported sensor. Nothing would stop you from using this to control a multiplexer, but do not just expect other drivers to work seamlessly with that. With Tasmota32, you can also to some extent have two I2C busses active on dedicated gpio pins, including support from Berry.