Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Maniquet2024-tasks_consistency")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.750
2
.748
3
.746
4
.746
5
.745
6
.741
7
.739
8
.738
9
.737
10
.735
11
.734
12
.734
13
.732
14
.729
15
.727
16
.727
17
.724
18
.718
19
.717
20
.716
21
.716
22
.715
23
.715
24
.713
25
.712
26
.712
27
.710
28
.707
29
.705
30
.705
31
.703
32
.701
33
.697
34
.692
35
.692
36
.690
37
.689
38
.688
39
.688
40
.686
41
.685
42
.684
43
.684
44
.683
45
.681
46
.681
47
.680
48
.679
49
.678
50
.678
51
.676
52
.676
53
.676
54
.676
55
.674
56
.674
57
.672
58
.672
59
.671
60
.669
61
.669
62
.668
63
.668
64
.667
65
.667
66
.667
67
.667
68
.667
69
.667
70
.666
71
.666
72
.666
73
.665
74
.663
75
.661
76
.660
77
.660
78
.659
79
.659
80
.658
81
.657
82
.656
83
.656
84
.656
85
.656
86
.656
87
.656
88
.654
89
.653
90
.653
91
.651
92
.650
93
.649
94
.649
95
.649
96
.648
97
.648
98
.648
99
.648
100
.648
101
.647
102
.647
103
.647
104
.647
105
.646
106
.646
107
.646
108
.646
109
.644
110
.644
111
.642
112
.640
113
.638
114
.638
115
.638
116
.635
117
.632
118
.625
119
.625
120
.624
121
.617
122
.617
123
.616
124
.616
125
.615
126
.610
127
.609
128
.606
129
.604
130
.596
131
.576
132
.568
133
.565
134
.565
135
.550
136
.550
137
.549
138
.545
139
.541
140
.541
141
.535
142
.534
143
.531
144
.531
145
.525
146
.521
147
.521
148
.520
149
.507
150
.502
151
.499
152
.498
153
.498
154
.494
155
.484
156
.484
157
.484
158
.482
159
.479
160
.478
161
.476
162
.470
163
.470
164
.462
165
.461
166
.450
167
.437
168
.395
169
.395
170
.383
171
.380
172
.379
173
.367
174
.358
175
.349
176
.349
177
.344
178
.343
179
.341
180
.326
181
.325
182
.323
183
.323
184
.296
185
.266
186
.210
187
X
188
X
189
X
190
X
191
X
192
X
193
X
194
X
195
X
196
X
197
X
198
X
199
X
200
X
201
X
202
X
203
X
204
X
205
X
206
X
207
X
208
X
209
X
210
X
211
X
212
X
213
X
214
X
215
X
216
X
217
X
218
X
219
X
220
X
221
X
222
X

Benchmark bibtex

@article {Maniquet2024.04.02.587669,
	author = {Maniquet, Tim and de Beeck, Hans Op and Costantino, Andrea Ivan},
	title = {Recurrent issues with deep neural network models of visual recognition},
	elocation-id = {2024.04.02.587669},
	year = {2024},
	doi = {10.1101/2024.04.02.587669},
	publisher = {Cold Spring Harbor Laboratory},
	URL = {https://www.biorxiv.org/content/early/2024/04/10/2024.04.02.587669},
	eprint = {https://www.biorxiv.org/content/early/2024/04/10/2024.04.02.587669.full.pdf},
	journal = {bioRxiv}
}

Ceiling

Not available

Data: Maniquet2024

Metric: tasks_consistency