Preprint Open access
ProtoSemImage: Image-Valued Prototypes with Deformable Row Alignment for Interpretable Document Classification
Prototypes in classification models are almost always vectors, and a vector has no readable form. This paper asks what happens when a prototype is an image. Documents give the question a natural form, because a document can be rendered as a multi-channel image in which every token becomes a pixel, so a class representa …