So apparently, there is a bug on youtube now, that removes active subscribers. It happens to everyone, and youtube hasn't fix this yet. Like me for instance, i had 225 subs. And the next day, i suddenly had 220. Also there is this video that talks about it:
So if you are wondering why you are losing subs at a fast rate, this could be the problem.