I actually took it as a compliment, because this is one of the very few instances in which an NPC will comment about the quality of your produce.