[get off one's case] or [back] or [tail] {v. phr.} To stopbothering and constantly checking up on someone; quit hounding one.
"Get off my case!" he cried angrily. "You're worse than the cops."
Contrast: ON ONE'S CASE.