I had the same goal. I used Docker (Windows 10) and CROPS to run Debian container on Win10 to cross compile.
With a hefty machine (8-12 cores, 32 GB RAM) I am able to cross compile from Win10 to the target (Toradex Colibri) pretty easily
https://docs.yoctoproject.org/dev-manual/start.html#setting-up-to-use-cross-platforms-crops