Ok, you threw me off on this one. When most guys say "yearling," they really mean a fawn. I figured you knew the difference, but your reference to "no spots" had me thinking that you meant fawn.
I think your logic makes a lot of sense, especially if you're hunting in an area with a sub-par population density. On another note... A buddy of mine owns a deer farm, and he's told me that 60% or so of the genetics passed on are from the doe. I don't know if that's true or not... but, I tell you what, if there's a mature doe standing there that just spit out twin or triplet button bucks, I'm letting her ass walk... she's a fuggin gold mine, man. Bring on the yearling in that case.