Sometimes, it's not that the other person doesn't care about you, but that you care too much about them.
Leadership is about making others better as a result of your presence and making sure that impact lasts in your absence.