i think he means more like...
okay you have to waer orange, so why wear camo under it?
i gues maybe because those clothes are designed for hunting and outdoor stuff, so it might be better suited for the outdoors.
and it also kind of signifies that "your hunting" just in case the bright orange doesn't say enough.