He said the quiet part out loud. No one that is genuinely pleased with being in a conference would even think to say, "I'm not sure I'm pleased about being in this conference."
That only comes to mind, even in a heated moment feeling like the conference refs threw the game to protect the top team, when you already have misgivings and discontent at being in the conference.