Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

Article URL: https://www.baseten.co/blog/sota-performance-for-gpt-oss-120b-on-nvidia-gpus/

Comments URL: https://news.ycombinator.com/item?id=44819968

Points: 5

# Comments: 0