0

British fintech Revolut slashes AI coding costs 10x by cutting out Claude and going self-hosted

theregister British fintech Revolut slashes AI coding costs 10x by cutting out Claude and going self-hosted www.theregister.com
preview
  • *for certain definition of self hosted.

Developed by Chinese open weights model dev Z.ai, GLM 5.1 isn’t exactly a small model. At roughly 754 billion total parameters (40 billion activated for each token generated), the model requires roughly 380 GB of GPU memory just to hold the weights and another 6-26 GB per user to maintain context depending on precision.

To serve GLM-5.3 at scale, Revolut deployed 56 Nvidia B200 GPUs, equivalent in GPU count to seven eight-GPU DGX B200 systems. But as Abitbol noted, the greatest performance gains didn’t come from adding GPUs, but rather tuning the model’s hyperparameters along with switching to NVFP4 quantization, implementing disaggregated prefill and decode, and tuning context lengths.

  • *for certain definition of self hosted.

Developed by Chinese open weights model dev Z.ai, GLM 5.1 isn’t exactly a small model. At roughly 754 billion total parameters (40 billion activated for each token generated), the model requires roughly 380 GB of GPU memory just to hold the weights and another 6-26 GB per user to maintain context depending on precision.

To serve GLM-5.3 at scale, Revolut deployed 56 Nvidia B200 GPUs, equivalent in GPU count to seven eight-GPU DGX B200 systems. But as Abitbol noted, the greatest performance gains didn’t come from adding GPUs, but rather tuning the model’s hyperparameters along with switching to NVFP4 quantization, implementing disaggregated prefill and decode, and tuning context lengths.

0

Starting from Dec, Codex and Chat will share same token pool. Thanks Sam! EABOD

preview

help.openai.com/…/20001625-understanding-chatgpt-…

Starting in December, Plus, Pro, and Business plans’ usage allowance will be shared across ChatGPT and Codex.

OpenAI confirms that:

  • ChatGPT and Codex will share a token-based allowance.
  • Instant chat will not consume this allowance.
  • More complex tasks and advanced models will consume more tokens.
  • Users can check their remaining allowance under Settings → Usage.
  • Users can purchase extra credits if they exhaust their allowance.

TL;DR - ChatGPT conversations that use advanced reasoning will compete with Codex for the same allowance. And it will be token based, rather then message / turn based. How many tokens? Fuck you, that’s how many. Want a coder and chat with a non brain dead LLM? Pick one.

So, if you’re thinking of re-upping your OpenCode Go or OpenRouter access (or you’re fortunate enough to have a rig that can run Qwen3.8 27B, Flash or the soon to be arriving Qwen 4’s), now’s the time to fuck off jippity.

Personally, I’m going to ditch it for OR credits and selective use of GLM, Kimi etc for code review. I don’t have the rig for a local GLM :(

Ride was always going to end but fortunately, open weight models are a thing.

Now if I could only run Qwen3.8-27b at not minutes-per-token…

help.openai.com/…/20001625-understanding-chatgpt-…

Starting in December, Plus, Pro, and Business plans’ usage allowance will be shared across ChatGPT and Codex.

OpenAI confirms that:

  • ChatGPT and Codex will share a token-based allowance.
  • Instant chat will not consume this allowance.
  • More complex tasks and advanced models will consume more tokens.
  • Users can check their remaining allowance under Settings → Usage.
  • Users can purchase extra credits if they exhaust their allowance.

TL;DR - ChatGPT conversations that use advanced reasoning will compete with Codex for the same allowance. And it will be token based, rather then message / turn based. How many tokens? Fuck you, that’s how many. Want a coder and chat with a non brain dead LLM? Pick one.

So, if you’re thinking of re-upping your OpenCode Go or OpenRouter access (or you’re fortunate enough to have a rig that can run Qwen3.8 27B, Flash or the soon to be arriving Qwen 4’s), now’s the time to fuck off jippity.

Personally, I’m going to ditch it for OR credits and selective use of GLM, Kimi etc for code review. I don’t have the rig for a local GLM :(

Ride was always going to end but fortunately, open weight models are a thing.

Now if I could only run Qwen3.8-27b at not minutes-per-token…