Results
500 photos across 25 dog breeds. 4 models.
| Model | First match | Top three |
|---|---|---|
| GPT-6.1 TerraMedium reasoning | First match | Top three |
| GPT-6.1 SolMedium reasoning | First match | Top three |
| GPT-6 Luna FastMedium reasoning | First match | Top three |
| GPT-6 LunaMedium reasoning | First match | Top three |
Accuracy by breed
Each breed has 20 photos.
Average gives each of the 4 models equal weight.
| Breed | Average | Terra | Sol | Luna Fast | Luna |
|---|---|---|---|---|---|
| Staffordshire Bull Terrier | 46.3%4 models | 60%12/20 | 80%16/20 | 30%6/20 | 15%3/20 |
| English Setter | 62.5%4 models | 90%18/20 | 85%17/20 | 30%6/20 | 45%9/20 |
| American Bulldog | 62.5%4 models | 95%19/20 | 65%13/20 | 45%9/20 | 45%9/20 |
| Miniature Pinscher | 62.5%4 models | 50%10/20 | 90%18/20 | 55%11/20 | 55%11/20 |
| American Pit Bull Terrier | 37.5%4 models | 45%9/20 | 50%10/20 | 40%8/20 | 15%3/20 |
| Havanese | 52.5%4 models | 75%15/20 | 45%9/20 | 50%10/20 | 40%8/20 |
| Keeshond | 82.5%4 models | 95%19/20 | 95%19/20 | 60%12/20 | 80%16/20 |
| Scottish Terrier | 53.8%4 models | 65%13/20 | 70%14/20 | 45%9/20 | 35%7/20 |
| Leonberger | 87.5%4 models | 100%20/20 | 100%20/20 | 70%14/20 | 80%16/20 |
| Soft-coated Wheaten Terrier | 80.0%4 models | 85%17/20 | 95%19/20 | 65%13/20 | 75%15/20 |
| Samoyed | 82.5%4 models | 90%18/20 | 95%19/20 | 75%15/20 | 70%14/20 |
| Chihuahua | 78.8%4 models | 85%17/20 | 65%13/20 | 85%17/20 | 80%16/20 |
| English Cocker Spaniel | 71.3%4 models | 75%15/20 | 80%16/20 | 70%14/20 | 60%12/20 |
| Newfoundland | 86.3%4 models | 80%16/20 | 80%16/20 | 90%18/20 | 95%19/20 |
| Shiba Inu | 82.5%4 models | 90%18/20 | 85%17/20 | 75%15/20 | 80%16/20 |
| Yorkshire Terrier | 85.0%4 models | 95%19/20 | 85%17/20 | 80%16/20 | 80%16/20 |
| Boxer | 81.3%4 models | 85%17/20 | 85%17/20 | 75%15/20 | 80%16/20 |
| Pomeranian | 93.8%4 models | 100%20/20 | 90%18/20 | 95%19/20 | 90%18/20 |
| Basset Hound | 92.5%4 models | 95%19/20 | 90%18/20 | 90%18/20 | 95%19/20 |
| Beagle | 92.5%4 models | 90%18/20 | 95%19/20 | 95%19/20 | 90%18/20 |
| German Shorthaired Pointer | 86.3%4 models | 85%17/20 | 90%18/20 | 85%17/20 | 85%17/20 |
| Great Pyrenees | 92.5%4 models | 95%19/20 | 90%18/20 | 95%19/20 | 90%18/20 |
| Japanese Chin | 86.3%4 models | 90%18/20 | 85%17/20 | 85%17/20 | 85%17/20 |
| Pug | 98.8%4 models | 95%19/20 | 100%20/20 | 100%20/20 | 100%20/20 |
| Saint Bernard | 85.0%4 models | 85%17/20 | 85%17/20 | 85%17/20 | 85%17/20 |
Methodology
Each model evaluated the same 500 photos once. A match requires a valid response with the reference breed first or among the top three. All attempts count.
Dataset credit: Oxford-IIIT Pet dataset (Parkhi, Vedaldi, Zisserman, and Jawahar, 2012), CC BY-SA 4.0. Photo copyrights remain with their owners.