Post Superbowl - March Madness and Post NBA finals to NFL opening day.
I would argue to extend both of these, especially this year, because I really don't care about a Steelers/Cardinals Superbowl and the NBA playoffs just take an eternity. So for me it is A.) When the Packers are finished through the start of March Madness and B.) the end of Wimbledon to NFL Kickoff. I'll take a quick look at the pros and cons of these periods.
A.) There is an obvious let down when the Packers are finished, but I will usually watch the NFL playoffs regardless. February is the worst month. It is saved by college basketball conference play and European football (soccer).

And I understand most Americans don't enjoy soccer, but it is great - See future post for more on this.
Feburary is tough, though, because you know what is coming next. March Madness and Baseball opening day. Probably the best time for sports.
B.) July, nothing but baseball and golf. Man, good thing the days are long and the weather is nice. If you are really hurting, the NFL preseaon starts in August, but that may even be more boring to watch on TV than baseball.

The good thing about the summer, though, is that your team could possibly play 29-30 games a month, so there is never really a day where there is nothing to watch. But in a 162 season, no single game really matters. And once every four years is the glory of the World Cup to save the summer.
So, taking everything into account- active sports, TV watching, live watching, fantasy sports, Shaq, your teams- let me know which period you think is worse as a sports fan. Or possibly, you love them all.