You are going to want to just buy a case and a power supply, transfer your current computer to it then install a proper size GPU.

To get the most value out of your money you're going to be wanting to buy used though.