Windows not possible, the CRT runtime libraries are different for Release and Debug mode, usually use Release with debug info that's easiest.
You have to write your own CMake script to pickup the proper prebuilt files, that's easier than rely on solution of 3rdparty.