In a bowl, whisk together the flour, graham cracker crumbs (see Notes below), baking powder, and salt. Put aside.
In a mixer or by hand, cream the butter and sugar together for 2-3 minutes. Add the egg, the egg yolk, milk, and vanilla and beat until all the liquid ingredients are fully incorporated, approximately 2 minutes.
With the mixer off, pour the dry ingredients into the mixer bowl over the liquid ingredients. Turn the mixer on the lowest speed and mix just until the dry ingredients are fully incorporated. (Alternatively, you can mix the dry ingredients in by hand using a rubber spatula.) Do not overmix.
Place half the dough on top of a large piece of plastic wrap. Using the plastic wrap, shape the dough into a disk, pushing down on it to thin it out. Fully cover the disk of dough in the plastic wrap and place in the refrigerator for at least two hours and for as long as 48 hours. Repeat with the remaining portion of the dough.
Line 2 or 3 cookie sheets with parchment paper.