How do we say "go home," then?
For this we need to revert to a form, which is more ancient that ל-! Probably because "home" is such a primary concept, it attracts the form that used to be most natural for Hebrew, but nowadays is used only in certain expressions. Once we used to designate direction not with ל-, but with the ה...ה construction. Today it's still commonly used for the most basic concepts, like "(go) home" - לָלֶכֶת) הַבַּיְתָה) , go outside - לָלֶכֶת הַחוּצָה.
*In English one can find something similar, - the ending "-wards". It's quite active in such word as "towards," less in "homewards" and plain impossible in such a combination as "kitchenwards" :D Same in Hebrew - it is standard to say הביתה, less you'd hear people say העירה, and if you say - אני הולך מטבחה - you would sound as if you walked straight out of the Bible. :)
More examples:
זֶהוּ, סִיַּמְנוּ, חוֹזְרִים הַבַּיְתָה! (That's is, we are done, going home!)
לָמָּה שֶׁלֹּא נִכָּנֵס הַבַּיְתָה בַּדֶּרֶךְ לַמַּכֹּלֶת? (Why not jump home on our way to the store?)
מָה, אַתֶּם כְּבָר הוֹלְכִים הַבַּיְתָה? הַלַּיְלָה עוֹד צָעִיר! (What, you are going home already? The night is still young!)