It seems that num_heads for SlotAttention is 1?

[wcarvalho]

I'm a little confused about the code. I'm following this config. It seems that Slot Attention only has 1 head in all configs? If so, does that mean there is only 1 slot? If not, could you help me understand how the number of slots determined in the code?

[ruili3]

The default slot number is shown here. The Slot Attention you mentioned refers to the number of attention modules used in SAVi

[wcarvalho]

Thank you, this answer my question!