You don't like the heat...stay of of the kitchen.  As long as the remarks are not personal in nature (See Brantley calling Coffey a "loser") then there should be no problems.  If you are a bad fielder (see Adum Dunn, Edwin Encarnacion) then you should expect to hear from the masses when you screw up.  If they don't like that, then I suggest they get new careers.  When you get paid Millions of dollars to play a game, people are going to expect you to do well...and when you don't, people are going to be critical.  Hopefully, Adam's mom isn't reading this!