Yes. You have the right attitude towards disturbing comments of fellow devotees. Lord Caitanya has advised us to always remain more humble than the grasses and more tolerant than the tree, devoid of all sense of false prestige and ready to offer respects to all persons. It is not our policy to reject someone on any personal grounds. Rather it is our duty to encourage him on the common platform of devotional service to Krsna.
I have received very nice reports from all our centers how they are very much appreciating my books and they are understanding association with the Spiritual Master is the same as association with His vani or teachings. This is a transcendental fact.