I'm guessing your first offer/answer has two `m=` lines, and you're
trying to set it to audio only by making another offer with just one
`m=` line?
According to the RFC (3264), an updated session description must have
the same number of `m=` lines as the previous one, or more. It's not
allowed to simply remove a media section.
So the correct way to remove a media section is to leave it in place but
set the port to zero. Alternatively you can leave it intact entirely but
flag it as `a=inactive`.
Cheers