VPS for data mining

All the VPS providers I have seen are charging fees for placing there server in chicago and giving Ryzen processor, but their specification and especially Disk IO is not suited for data mining which requires high IOPS, read write bursts. Are there any VPS providers out there that specifically cater to data mining requirement, where processors have low speed more cores, very large RAM even if it is not top notch and a much better IO…basically i am looking at either getting large average RAM spec, or very fast disk IO spec.

Thanks in advance.

1 Like

You should consider talking to the CME directly.

You can use field programmable gate arrays (FPGA) for your purposes and that’ll be about as close as you can get to latency. It’d be possible for retail, but you’d have to make quite a lot of money to get good ROI from the required infrastructure.

Like I mentioned I was looking for computer for data mining, I dont even want it connected to the internet let alone have low latency…thats the exact point of my message all providers are selling low latency, but are their vendors who specifically give options for data mining, in this case disk IO speed and RAM is more important than fast processor or low latency.

This is the message I sent to my VPS provider but they said they cannot help me →

I really want to move to a dedicated box and below is my rationale for wanting to move to a dedicated box → While your DiskSpd benchmarks confirm that the underlying NVMe storage is capable of multi‑GB/s sequential throughput, my workload is not dominated by sequential reads. NinjaTrader, multiple recorders, and my mining pipelines generate heavy random write I/O, which is where the bottleneck appears. In the shared VPS environment, random write performance is throttled to ~6 MB/s, which directly impacts logging and recorder responsiveness. This is the part of I/O that is seizing up for me — not sequential reads, but small‑block random writes under concurrency. On a dedicated box, without noisy neighbors and virtualization limits, random write throughput typically rises to 50–100+ MB/s, eliminating this bottleneck and allowing my workload to perform consistently. That is the advantage I am hoping to achieve by moving to dedicated hardware: stable, predictable random I/O that aligns with the advertised NVMe capabilities and supports the demands of my trading and analytics environment.

Hi @vipinb,

Maybe the best way for you to get the most powerful machine for your specific needs isn’t what is typically called a “VPS provider” among NinjaTrader users. Maybe all you need is to either 1) rent a server with Windows installed from a company that offers this service or 2) just purchase an actual high-performance PC with the best specs specific to your needs at the best price.

Regarding renting a server with high end specs, I forget all the server providers I evaluated a few years ago when trying to decide how to host my website, but some are a lot cheaper than the others. And the cheapest ones are far cheaper than one might think. You could google for something like “dedicated server” or search hacker news ( Hacker News) for “dedicated server” (including the double quotes). I would search hacker news first, as there is a massive amount of high-quality conversations about the most affordable and best way to get powerful servers. One popular topic is how much cheaper simply renting a server is than using AWS and similar cloud computing services.

Regarding purchasing the highest performing PC for the best price, I’ve bought my last 3 high performance PCs from Dell Outlet for Business… they are refurbished so can be bought at a steep discount, and I know that other manufacturers like HP also offer refurbished high performance PCs at a discount as well. Then you wouldn’t need to keep renting the machine.

Wishing you the best in your search for the best solution,

Brook

2 Likes

Thanks a lot Brook for your very insightful answer…helps a lot.

1 Like