This is also true of every other scene in the movie. It's like Stiller and (especially) Black aren't even trying, while Downey is doing all the heavy lifting.
Robert Downey Jr. should get an Oscar nomination for this movie. All bullshit aside it's a pretty accomplished piece of acting, at least in the sense that you can easily forget that it's him.