🛰️ Daily AI Frontier
‹ back to 2026-08-03

Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation

Research LLM Agents

Ranking

Overall 76
Content 80
Popularity 66

Observed public metrics from 1 member.

Representative image for Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation

Merged summary

TL;DR - Data Turnstile is an open-source framework that turns user-supplied API specs into validated synthetic function-calling data, letting sub-billion-parameter models match or beat models 7–53× larger on tool-use benchmarks. It matters because it targets data quality — the main bottleneck for agentic small language models — rather than scale.

  • Decomposes multi-turn tool-use into constrained stepwise generation with validation and error-feedback loops, giving control over API diversity, conversation complexity, and output correctness.
  • On BFCL single-turn, a fine-tuned Qwen3-0.6B (no chain-of-thought) reaches 75.9% overall accuracy vs. 67.4% for the thinking-enabled base, approaching thinking-enabled Qwen3-1.7B (78.4%) and Qwen3-4B (79.9%).
  • On the multi-turn τ²-bench Telecom domain, Turnstile-trained Qwen3-1.7B hits 31.1% pass^1 (4.7× over its 6.6% base), surpassing Qwen2.5-32B-Instruct (27.4%); Qwen3-0.6B reaches 24.6% (7× over base).
  • Released with the framework: a dataset spanning 1,000+ APIs and 100K+ multi-turn interactions.

Sources (1)

Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation

arXiv cs.CL Goutham Ramakrishnan, Megha Sharma 2026-07-31 arXiv:2607.29250
Public signals Hugging Face upvotes 1
Providers: Hugging Face · Upvotes 1 OpenAlex · N/A Publisher · N/A Semantic Scholar · N/A X · N/A Fetched 2026-09-02 14:29:46.297917 UTC

TL;DR - Data Turnstile is an open-source framework that turns user-supplied API specs into validated synthetic function-calling data, letting sub-billion-parameter models match or beat models 7–53× larger on tool-use benchmarks. It matters because it targets data quality — the main bottleneck for agentic small language models — rather than scale.

  • Decomposes multi-turn tool-use into constrained stepwise generation with validation and error-feedback loops, giving control over API diversity, conversation complexity, and output correctness.
  • On BFCL single-turn, a fine-tuned Qwen3-0.6B (no chain-of-thought) reaches 75.9% overall accuracy vs. 67.4% for the thinking-enabled base, approaching thinking-enabled Qwen3-1.7B (78.4%) and Qwen3-4B (79.9%).
  • On the multi-turn τ²-bench Telecom domain, Turnstile-trained Qwen3-1.7B hits 31.1% pass^1 (4.7× over its 6.6% base), surpassing Qwen2.5-32B-Instruct (27.4%); Qwen3-0.6B reaches 24.6% (7× over base).
  • Released with the framework: a dataset spanning 1,000+ APIs and 100K+ multi-turn interactions.
item →