Tony: Hey! Why do you always assume I did something? Maybe Cap messed up! | Fury: ... | Tony: Fine! I may have started an inter-team fight over UN accords that were kind of due to some evil Hydra dude's plans... | Fury: *sighs a thousand times*
I also thought of that when I watched the film. I felt like it really reflected the disconnect between Tony and Howard. Sure, we've only really heard Tony speak about his father dismissively, but this time we were able to see it.