I'm not suggesting it works perfectly with canon as-is, but then canon doesn't really work perfectly with itself so not much is different there.
Regardless of whether or not Psynergy Stones affect everyone, the idea is that only someone or something with trained (or otherwise "unlocked") Psynergy will absorb all the energy from them (thus causing them to destabilize and shatter) with mere physical contact.
Regardless of whether or not Psynergy Stones affect everyone, the idea is that only someone or something with trained (or otherwise "unlocked") Psynergy will absorb all the energy from them (thus causing them to destabilize and shatter) with mere physical contact.