AI Tools / AI products & services
An open-source task generator from Pathway that creates original ARC-AGI-1-style grid puzzles distribution-matched to the public evaluation set. It produces fresh tasks for evaluating models on problems they are unlikely to have encountered, filters near-duplicates and malformed outputs, and writes a tasks.json file in the standard ARC format with train and test sections. The generated tasks are intended for private evaluation and are compatible with existing ARC evaluation harnesses.
Generates fresh grid puzzles matching the measurable characteristics of the public ARC evaluation set without publishing another benchmark. It filters near-duplicates and malformed outputs and emits standard ARC JSON.