Is this man really a friend?

Wow! How annoying! I think you need to talk to your partner first and let him know the truth about what happened when you two were broken up. Once he's got a complete understanding about that, I think you should ask HIM to talk to his friend. It's HIS friend so he should be the one to put his foot down.