Tencent Just Open-Sourced a 770B Model With a 1M-Token Context Window
Tencent's Hunyuan team dropped a new flagship model this week called Hy4 preview, and the spec sheet is the kind that makes you re-read it twice: 770 billion total parameters, a 1 million token context window, and — the part that actually matters for anyone outside a research lab — it's open-sourced.
It's already live on Tencent Cloud's TokenHub and on OpenRouter, so you don't need a Tencent account or a data center to try it.
The Numbers, Translated
770B total parameters sounds enormous, but the number that matters more is the activation parameter count: 49B. Hy4 preview is almost certainly a mixture-of-experts (MoE) model, meaning it doesn't run all 770B parameters for every token — it routes each request through a much smaller active slice, roughly 49B worth. That's the trick behind how a model this large can be usable at all outside a supercomputer: you get frontier-scale knowledge with mid-size inference cost.
The 1 million token context window is the other headline number, and it puts Hy4 in the same conversation as the handful of models that can genuinely hold an entire codebase, a full legal contract set, or a season of meeting transcripts in a single prompt without chunking.
Why Everyone's Racing Toward Bigger Context Windows
Context length has quietly become one of the most competitive metrics in AI right now, alongside benchmark scores. The reason is practical, not academic: a bigger context window means less engineering work stitching together retrieval systems, less risk of a model forgetting something you told it three messages ago, and fewer surprises when a task turns out to need more background than you expected.
For a coding agent specifically, this matters a lot. A 1M-token window can hold a genuinely large repository's worth of source files at once — not just the function you're editing, but the surrounding modules, the tests, and the docs that explain why the code is shaped the way it is.
Open Source Is the Real Story Here
Plenty of labs ship huge models. Fewer open-source them. Tencent releasing the weights for a 770B model puts real pressure on the rest of the frontier-model landscape — it's now one more capable option that developers, researchers, and companies can self-host, fine-tune, or inspect line by line instead of trusting a black box behind an API.
That matters for anyone building agent infrastructure. Open weights mean you're not locked into one vendor's pricing, one vendor's rate limits, or one vendor's decision to deprecate a model version out from under you.
What This Means If You Use OpenClaw
OpenClaw is built model-agnostic from the ground up — it's designed to work with whichever model best fits the job, not locked to a single provider's roadmap. As open-source releases like Hy4 preview push context windows and capability forward, that's more headroom for agents doing real, multi-step work: reading a full project, holding onto everything discovered along the way, and not losing the thread halfway through a long task.
That's the whole premise of agentic work — the model needs to hold context across an entire session, not just answer one question at a time. Releases like this are exactly what makes that more practical, more often, for more people.
The Bigger Picture
A year ago, a 1M-token open-source model would have been a research curiosity. Now it's a Tuesday release that shows up on OpenRouter within days. The pace of open-weight releases keeps compressing, and each one lowers the floor for what "good enough to build on" looks like.
If you want to see what that capability looks like when it's put to work — not just benchmarked, but actually running tasks end to end — that's what AI agents are for.