There are some studies regarding individual contamination due to rounds fragmenting in the animal. Sounds like I have more research to do.
This would surprise me unless you actually swallowed a fragment? My (complete layman's) guess is you get more lead in your body walking around a major city for a couple of hours than you do from those 5 deer you shoot and eat every year.