Would it be possible to download just the QT SDK? [ preferably in 64bit] . That way I would not have to deal with 'special' requirements from QT Creator and just hard code from Visual Studio 2013 -64bit.
No, the prebuild installers always install Qt Creator in addition to Qt libraries. You have 2 options:
ignore Qt Creator, install VS Add-in, and use Visual Studio
compile Qt libraries yourself from source, install VS Add-in, use VS
And by the way it's Qt not QT :-).