Power, as a goal, is, purely and simply, a great evil.
Power, as a side-effect of some action, is, purely and simply, an expression of trust from the people who found that action helpful. (You might call it a social convention, if you like: furthermore, call it a delusion if the person is untrustworthy.)
Funny thing, though, most people just flat don't trust people who see power as a pursuit. That's wise.
Hence the dichotomy you mention. The people who are very vocal about not having power are self-selected as precisely the people who least deserve trust. The people who aren't concerned about power are the people who notice that (for them as for everyone else on earth) there is more good in their power to do, than there is time for them to do it.