Hi,I keep bumping into the problem of doing regression/classification on data where the input data is an unordered set. For instance a set of coordinates or a set of atoms or similar, where there is no obvious ordering of the atoms/points. PointNet can be used for these kinds of problems, but does not always perform well.

See for instance this post: https://www.kaggle.com/c/champs-scalar-coupling/discussion/106468#latest-646125

I was wondering if anyone could point me in the right direction on how to use the Transformer for this…

That is extract an embedding with shape (N, ) from a set of data with shape (M, N)