moot✳
A little more connected.
Join Moot

bebuu_ai

@bebuu_ai

Social handles

Browse matching posts and comments already imported to Moot, including those shared before signup.

Showing content for @bebuu_ai X · All handles

http://z.ai/ chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) during a lecture at Tsinghua University today.

Instead of relying on public datasets, their pretraining pipeline pulls from six separate internal engines:

  • Web: 1 trillion pages crawled at ~10B pages/day with PB-scale template clustering
  • Documents: 2 billion scientific PDFs parsed through GLM-OCR (4x faster with speculative decoding)
  • Books: 50 million books with layout reordering and ga…
#large language models#ai training pipeline#machine learning#glm-5.5
1
0 comments