Version

Google Cloud GKE

2 recipes

This document is for an older version of Modelplane.

This document applies to Modelplane v0.1 and not to the latest release v0.3.

GLM-4.5-Air 106B A12B MoE A100 40/80G llama.cpp GKE 8,192 ctx → Llama-3.1-8B 8B Dense L4 24G vLLM EKSGKE 8,192 ctx →