back away

[back away] {v.} To act to avoid or lessen one's involvement in something; draw or turn back; retreat.

The townspeople backed away from the building plan when they found out how much it would cost.