Well, there is a difference between being firm and being mean, isn't there? If it was necessary for the time, then he probably realized as much at some point.

[Not that she really knows, it just feels like a good of a guess as anything.]

Still, he didn't sound sour or anything when he was talking about you, so if I had to guess, he probably does think of you at least a little fondly.