For me personally, it's hard for me to cut ties from someone. Family, it's hard to do that. That's important to me. Like, I have some troublesome brothers, but I still love them as their older brother despite scolding them for making poor decisions.
Friends though, like the comment above, some come and go. But the closest friends are the special ones. Those guys are the ones you can be comfortable around, banter at each other like crazy, or even be your emotional support. They're like an additional family member to you because of the bonds and connection forged over the time, and that's difficult to cut ties with. But, it certainly does hurt if the bond gets thrown away out of the window.
I remember having a toxic friend who I thought I had a close bond with, but it was obvious I just had to cut all ties with him because he wasn't the person I knew back in grade school. The dude cared only himself, self-proclaimed messiah, and manipulative. The guy refused to get help and thought he was his own medicine. There's more to the story, but it's all in the past. I was just done with dealing with him.
In conclusion: Family = no. Friends = maybe.