I have now seen that this is the response we should use to remove the device from the list. Does your device key change each time you delete and re-download the app? It seems mine keeps changing, I'm guessing that is the reason. We are now getting the following response:
{"error":"Failed to send push to APNS: com.notnoop.exceptions.NetworkIOException: javax.net.ssl.SSLHandshakeException: Remote host closed connection during handshake"}
Would this suggest an error with the p12 files? Can't think what else could be going on. Any help would be gratefully received.