I think the concern would be the same as the pants I currently wear... they're cotton.
Cotton will take forever to dry if (more like "when") they get wet.
Try to find a pair that is made of a synthetic material or at the very least a blend of some sort.
I have very little experience with synthetic trousers though, so I'm hoping to try a few different pairs out to see how I like them myself.