[Paper] Scaling Agents via Continual Pre-training
AgentFounder, a groundbreaking AI agent developed by Alibaba’s Tongyi Lab, introduces Agentic Continual Pre-training (Agentic CPT) to revolutionize AI agent development. This novel three-stage approach incorporates an intermediate training phase focused on agentic behaviors, addressing limitations in current two-stage models. Using innovative data synthesis methods like First-order Action Synthesis and Higher-order Action Synthesis, AgentFounder-30B achieves state-of-the-art performance across multiple benchmarks, surpassing existing open-source models and some proprietary systems. The research demonstrates logarithmic scaling patterns for agentic capabilities and improved fine-tuning efficiency. This work paves the way for more capable, general-purpose AI agents that can autonomously navigate complex information environments and solve multi-step problems.
[Paper] Scaling Agents via Continual Pre-training Read More »










