The offense primary goal is to score. The defense primary goal is to stop scores
If the defense prevents the other team from scoring it did is job, just like if the offense scores it did is job. How long either of those endeavors take is really secondary.