East is the direction toward which the Earth rotates about its axis, and therefore the general direction from which the Sun appears to rise.
The practice of praying towards the East is older than Christianity, but has been adopted by this religion as the Orient was thought of as containing mankind's original home. Hence, some Christian churches have been traditionally oriented towards the east.