Karen can also be heard yelling at Rory as he storms off, "I hate this!".
There's also a rumour that Rory does not feature much in the first episode which this could explain very well. They do patch things up on later episodes, however as they appear to be perfectly back in working order. Does this stay though?