It used to happen a lot. Havent had it for like 6 months and now its starting to happen again. Mostly with matrix.org users too. No idea what the issue is. Other server make no issues at all so far.