Affiliate Marketing Secrets

You ever been in a situation where ; people that you want nothing to do with,keep trying to affiliate with you?
how would you deal with that ? i know it probably sounds unusual, but a situation where your not interested in knowing or having anything to do with a set of people….but they keep trying to involve themselves in your life or associate your name with them ?..affiliate with you, connect your identity to theirs ?
i encountered this mainy years ago with some irish people… im non irish, also some british people….im non british, some african americans online…..im non african american .
i kept making it plain and simple that i wanted nothing to do with them…meaning; at all.
but i kept finding out through word of mouth they would talk about me and keep trying to associate my name with theirs ? connecting me to them?……….when their is no connection and never will be.
plus..if i get aggressive with them, that will just further involve me with them..and i dont want THAT.
if anyone has dealt with this, how did you deal with it.