It sounds like your server either:
1) does not support range requests
2) or has corrupted range requests.
My guess would be (2) since browsers tend to cope these days if byte range requests are disabled and just load the media url from the start to the end.