So you never require an attendees voice in the recording? if your not having a conversation with attendees. why not just join them listen only...
freeswitch can record the write path of a channel before it goes into the mixer to ensure no other audio. modifications to dialplan and a way to identify which channels need this recording.. Not very cpu/io friendly if you record every channel stream in prod server.
Then you can use this file in place of the mixed output with changes to recording processing.
Regards,
Stephen