You’re missing their point, I think, which I believe is essentially “a disparity between how you perceive yourself and how I perceive you does not inherently constitute an injustice on my part”.