There are two ways to approach this:
For $500 a pop you can build a pretty decent desktop with current hardware with warranties for that piece of mind. Or, you can head on to eBay and get something like R730 server for $600-$700 with dual 20 core CPUs and decent amount of RAM. Use Free versions of Citrix Hypervisor or XCP-NG as your OS and deploy as many Windows VMs as you need. Then setup snapshot schedule for each vm for backups, configure RDP, and off you go.