Someone on tumblr pointed out that we see Loki shadowing Selvig at the end of the first Thor. If Loki is able to watch Earth through Erik, he will have had opportunities to see Clint in action and so may have already judged him as having heart. (This pseudo-possession may also explain why Selvig is hit so darn hard.) :)