Drained

I have spent the last four days completely drained, emotionally and physically.  

I have long acknowledged my status as an ambivert. The ability to recharge by being social or chilling alone was quite helpful in college. However, I've come to realize that there are some people wih whom socializing is only draining. 

Of course these are people I attempted to spend last weekend with. And it has taken over four days to recuperate. The logical thing would be to minimize social interactions with these people (at the very least no more weekend long plans).  

But there is a hefty amount of guilt that accompanies that logic. These are not people I can just completely cut out. So how can I do what's best for me without passing judgment on them? Or can't I? Is it okay to say fuck them, I'm more important? And how do I tell my mother without making her feel bad?