drive one ape

[drive one ape], [bananas], [crazy], [mad] or [nuts] {v. phr.}, {informal} To irritate, frustrate, or tickle someone's fancy so badly that they think they are going insane.

"Stop teasing me, Mary," John said. "You are driving me nuts."

"You are driving me bananas with all your crazy riddles," Steve said.