For what its worth my SBR'd lower is on an Anderson and while the upper to lower fit isn't as tight as my factory Colt I dont have any qualms with it at all.
Are you talking about the wiggle? Get yourself an accu wedge. They're like $5 and work great.