This is an automated archive made by the Lemmit Bot.

The original was posted on /r/machinelearning by /u/sgt102 on 2025-02-20 13:44:05+00:00.

Hi,

I’ve estimated the cost/performance of Deepseek 681bn like this :

Huggingface open deepseek blog reported config & performance = 32 H100’s 800tps

1million tokens = 1250s = 21 (ish) , minutes.

69.12 million tokens per day

Cost to rent 32 H100’s per month ~$80000

Cost per million tokens = $37.33 (80000/ 31 days /69.12 )

I know that this is very optimistic (100% utilisation, no support etc.) but does the arithmetic make sense and does it pass the sniff test do you think? Or have I got something significantly wrong?

I guess this is 1000 times more expensive than an API served model like Gemini, and this gap has made me wonder if I am being silly