I think people shat on the Gabanus family generally because you are just a good player and very strategic. In short, you are dangerous to be around. So some people make it a policy to nuke any realm you lead on principle.
You should take that as a badge of honor. And maybe create a new account so you can scheme without people knowing who you are.