On other projects, not in django-oscar but in general, pipenv has given me a lot of problems in Windows.
I went back to venv by default. With venv it works perfectly on Windows (I work with the same stack as you, except for the Windows version, I have pro 20h2)
Try to install wheels manually before call django-oscar, pipenv permits use existeed virtualenv.