Most amateur/enthusiast photographers typically compose their photos horizontally mostly because that’s the way they hold their camera. However, there are many potential images that lend themselves to a vertical composition. Try shooting for an entire session in vertical orientation and see what you can get. You might be surprised by what results. Here are two examples.
