It's 100 miles from Portland (and the main bridge is closed for the year, requiring an alternate route), but you and the family might enjoy
Maryhill. Great views of the Gorge, a full-scale Stonehenge, and lots of Rodin sculptures. Worth checking out on the way.