If really doesn't. If you think about it, the rounds are fired from the upper receiver. The lower just serves as a housing for the trigger group and stock/buffer tube, and for a place for the rounds to feed from. As long as the stock is mounted properly then the lower should not affect accuracy. The part that most affects accuracy is the barrel.

I can see a garbage lower having a big impact on reliability, though.