ARC Prize Verified (ARC-AGI-Pub) Submissions

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

ARC Prize Verified (formerly ARC-AGI-Pub) is a secondary leaderboard measuring the ARC-AGI public evaluation set. No competitions or prizes are associated with this leaderboard.

This leaderboard imposes no limitations on internet access and few limitations on compute. That means you can utilize state-of-the-art models.

Selected high score claims are verified by ARC Prize using a semi-private evaluation set. New high scores are accepted when there is agreement between the two scores (+/- 10%).

Only new high score claims (e.g., submissions that exceed the current high score by at least 1%) are eligible be verified and published. This is to limit the semi-private evaluation set from leaking into LLM training data.

See more details on the official website.

Please allow 2 weeks to verify submission.

Full Name *

Email *

Country of origin *

Kaggle Submission URL *

Please give the link to your notebook submission. Note: Make sure to set your notebook to 'public.' Private notebook can not be verified.

Score Claimed (ARC-AGI-1)

Please enter the score your submission receives on the ARC-AGI-1 public evaluation set.

Your score should be an value between 0-100

Score Claimed (ARC-AGI-2)

Please enter the score your submission receives on the ARC-AGI-2 public evaluation set.

Your score should be an value between 0-100

Submission Description *

Please describe your submission: Team members, organization (if applicable), novel approach considerations, and other helpful information to understand the context behind your submission

Secrets

To verify your submission for the competition, please provide the secrets (API keys) used. These will be securely deleted after verification. Follow the format below for clarity:

ENVIRONMENT_VARIABLE_NAME_1: YOUR_API_KEY_1

ENVIRONMENT_VARIABLE_NAME_2: YOUR_API_KEY_2

Example:

API_KEY_TWITTER: abc123xyz

DATABASE_PASSWORD: securepassword456

External API calls & closed models

Please describe any external API calls that your submission makes along with closed models used

Ex: GPT-4, Claude

Submit

Clear form

Never submit passwords through Google Forms.

This form was created inside of Ndea.

Does this form look suspicious? Report

Forms