I have a question for you, wouldn't it make sense to drill the pin holes in the lower before you "mill" out the FCG area? The filler material would offer additional support for the sides of the lower and be less likely to distort under while drilling.