Well, even if I'm not directly asked it - my learners just avoid using this (extremely useful!) expression, because they feel that something is not right there, not like in English, but they can't really nail down where the problem lies. Do you know how to say it? :) If not, let me give you a hint - it has nothing to do with "hands"! We are comparing "sides" in Hebrew, not hands! Makes sense, does it? Side in Hebrew - צד (TZAD).
But there is more...