Win or lose coming off a huge game against Texas, having a short week and facing a hungry Houston team that thinks they should have beaten us last year? I just think that is a recipe for a very tough game. If this game came at a different time during the season, I wouldn't be nearly as worried about it, but the timing of the game is going to make it much more difficult, IMO.
The three road games you mentioned will all be tough, as well. I also won't be surprised if Cal is much improved and actually playing well (at least offensively) by the end of the season.