break with

[break with] {v.} To separate yourself from; end membership in; stop friendly association with.

He broke with the Democratic party on the question of civil rights.

He had broken with some friends who had changed in their ideas.