This folder contains the results of an experiment to generate textual descriptions of the core-ideas of all ARC-AGI-1 riddles with an LLM (claude-3-5-sonnet-20240620). The hand-crafted generators and verifiers of Michael Hodel's michaelhodel/re-arc were first LLM-augmented with line-by-line source comments and then passed as reference in the prompt to generate the the core idea descriptions.
The core-ideas (together with the annotated generators and verifiers) can for example be used as seed examples for open-ended LLM based synthetic riddle generation.
- Add comments to each generator function in generators.py.
- Add comments to each verifier function in verifiers.py using the commented generator as additional reference.
- Take the annotated generator and verifier pair for each riddle and generate a description of the core-idea.
- annotated_generators.json
- annotated_verifiers.json
- core_idea_samples.json (4 samples per riddle were generated)