It's always been a bit fuzzy, but in-universe, I think he's reacting to Garfield's body language. I could plausibly interpret that as "Me!"