Anderson has done all he needs to do for his p4p legacy. I highly doubt an undefeated (in the UFC) grown man who has (with exception of chael) cruised through his opponents is afraid of anyone to be honest.
What he says makes sense, he wants to keep the 185 belt and defend that. What's so difficult to understand about that?
Sure the GSP fight is being tossed around, GSP is a more liked, bigger name, than Jon Jones. Jon Jones is new news, While Silva and GSP were tearing up their divisions Jones probably wasnt even watching mma haha.
I personally don't think Silva cares much about what me, or anyone else on an internet forum, has to say about his p4p legacy.