Skip to main content
dbb.

Results

500 photos across 25 dog breeds. 4 models.

Models ranked by first-choice accuracy
ModelFirst matchTop three
GPT-6.1 TerraMedium reasoningFirst match
83.8%
419/500
Top three
94.4%
472/500
GPT-6.1 SolMedium reasoningFirst match
83.0%
415/500
Top three
95.2%
476/500
GPT-6 Luna FastMedium reasoningFirst match
70.8%
354/500
Top three
91.2%
456/500
GPT-6 LunaMedium reasoningFirst match
70.0%
350/500
Top three
92.0%
460/500

Accuracy by breed

Each breed has 20 photos.

Average gives each of the 4 models equal weight.

First match accuracy by breed
BreedAverageTerraSolLuna FastLuna
Staffordshire Bull Terrier
46.3%4 models
60%12/20
80%16/20
30%6/20
15%3/20
English Setter
62.5%4 models
90%18/20
85%17/20
30%6/20
45%9/20
American Bulldog
62.5%4 models
95%19/20
65%13/20
45%9/20
45%9/20
Miniature Pinscher
62.5%4 models
50%10/20
90%18/20
55%11/20
55%11/20
American Pit Bull Terrier
37.5%4 models
45%9/20
50%10/20
40%8/20
15%3/20
Havanese
52.5%4 models
75%15/20
45%9/20
50%10/20
40%8/20
Keeshond
82.5%4 models
95%19/20
95%19/20
60%12/20
80%16/20
Scottish Terrier
53.8%4 models
65%13/20
70%14/20
45%9/20
35%7/20
Leonberger
87.5%4 models
100%20/20
100%20/20
70%14/20
80%16/20
Soft-coated Wheaten Terrier
80.0%4 models
85%17/20
95%19/20
65%13/20
75%15/20
Samoyed
82.5%4 models
90%18/20
95%19/20
75%15/20
70%14/20
Chihuahua
78.8%4 models
85%17/20
65%13/20
85%17/20
80%16/20
English Cocker Spaniel
71.3%4 models
75%15/20
80%16/20
70%14/20
60%12/20
Newfoundland
86.3%4 models
80%16/20
80%16/20
90%18/20
95%19/20
Shiba Inu
82.5%4 models
90%18/20
85%17/20
75%15/20
80%16/20
Yorkshire Terrier
85.0%4 models
95%19/20
85%17/20
80%16/20
80%16/20
Boxer
81.3%4 models
85%17/20
85%17/20
75%15/20
80%16/20
Pomeranian
93.8%4 models
100%20/20
90%18/20
95%19/20
90%18/20
Basset Hound
92.5%4 models
95%19/20
90%18/20
90%18/20
95%19/20
Beagle
92.5%4 models
90%18/20
95%19/20
95%19/20
90%18/20
German Shorthaired Pointer
86.3%4 models
85%17/20
90%18/20
85%17/20
85%17/20
Great Pyrenees
92.5%4 models
95%19/20
90%18/20
95%19/20
90%18/20
Japanese Chin
86.3%4 models
90%18/20
85%17/20
85%17/20
85%17/20
Pug
98.8%4 models
95%19/20
100%20/20
100%20/20
100%20/20
Saint Bernard
85.0%4 models
85%17/20
85%17/20
85%17/20
85%17/20

Methodology

Each model evaluated the same 500 photos once. A match requires a valid response with the reference breed first or among the top three. All attempts count.

Dataset credit: Oxford-IIIT Pet dataset (Parkhi, Vedaldi, Zisserman, and Jawahar, 2012), CC BY-SA 4.0. Photo copyrights remain with their owners.