"It's tempting, because as one senator said to me, 'We know if we invite baseball down, we'll draw a crowd'."