Although you can shoot vertically or horizontally, generally the results will be better if you frame your subject using the horizontal (landscape) orientation. After all, given that we have side-by-side eyes, this is how we see the world.
Even when you need to capture a tall object, instead of shooting vertical, use the tilting trick.