Preheat your oven to 350 degrees. Line the cupcake tray with liners. Your ingredients should be at room temperature.
Add butter and sugar into a large mixing bowl. Using a mixer, beat for about 2 minutes until just combined. Add lemon zest, vanilla, almond, lemon juice, and brandy if using. Beat for an additional minute just to incorporate. Do not overmix your batter.
Add the eggs one at a time while beating at low speed.
Add the sifted flour one cup at a time, alternating with the milk.
Fill cupcake papers about 3/4 the way up. I like using an ice cream scoop.
Bake for about 18 minutes or until the cupcakes are springy to the touch. Be careful not to burn.