Smaller older homes are just as unaffordable to the demographics that should be able to own them. Condos, townhomes, doesn't matter. Its all unaffordable. A better comparison is to look at median household incomes and median home values. In Utah there is a 30-40% disparity in the salary needed to comfortably afford the median price home against the median household income.
Check this out for example: