How Do You Ban A Peer?

You can add onion addresses of the peers you wish to ignore in Settings.
It is right there near the top bellow Auto select arbitrators checkbox.
I think this will stop those peers from taking your offers as well.

You can always disable your offer when you are not around, but the max trade period should be enough for you to respond anyway.
Btw, security deposits never go to arbitrators, only to other trader for his inconvenience.