Sure, this will work for HTTPS as well as HTTP; you need Machine A's proxy settings pointed at Machine B.
For HTTPS, you also need to ensure that Machine B uses the same Fiddler root certificate as Machine A (because otherwise Machine A won't trust the certificate used by Machine B), or that Machine A is configured to trust the certificate used by Machine B.
Stepping back a bit though-- why would you want to do this?