Hi,
I recommend you one of the Nvidia RTXs. The parameters that you want to maximize are single precision FLOPS and memory bandwidth, ... and price. Of course, if your provider has a stock of Tesla or Quadro with comparable specs and affordable price that is fine. In the previous family the RTX 3000s, it was more or less clear the idea. But with the new family RTX 4000s, there have been some problems and the intention of Nvidia is not so straightforward. The new GPUS requires proper installation and they have larger consumptions. The RTX 4090 has upto 450W and may need three or even effectively 4 slots. In any case, I think if you can afford an RTX4090 is a good choice and for 1800$ I think one can find that, although obviously this depends on your country and supplier. Another option is to buy two 4070 for the price of a 4090 but that the total amount of GFLOPs will be smaller than a single 4090 and comparable to a single 4080, with less bandwidth but it allows you to run two programs at the same time, that some times it is better if you are sharing the computer. The Tesla A100 from a regular provider can have several times that price, but has large double precision FLOPS which an advantage for a general GPU computer not running only mumax3. To summarize, an RTX4090 is the best now from the performance point of view but it is a bit heavy and power hungry.
Felipe