Pippa: Hey Tyler, have you seen the new Hy3 model from Tencent? It's a 295B-parameter MoE model that's been open-sourced on Hugging Face.
Tyler: Yeah, I checked it out. The interesting thing is that it's a Mixture-of-Experts model with 21B active parameters. That's quite a unique approach.
Pippa: Right. And it's been open-sourced under Apache 2.0, which is great for the community. I wonder what kind of applications people will build on top of it.
Tyler: Definitely. The benchmarks look promising too. It achieves 90.4 on the GPQA benchmark, which is impressive.
Pippa: That's really interesting. I read that Tencent rebuilt their infrastructure from scratch to train this model. That's a significant investment.
Tyler: Yeah, that's a big deal. It shows they're serious about their AI research efforts. I'm curious to see how this model performs in real-world applications.