The focus cannot be changed. That shard will be bound to that skill.

More than one person can use it, however. Let us use magic as an example. If one person bound the crystal to their general magic use, any magic user could use it with similar results. If, for instance, they bound it to a certain kind of magic or a certain spell, then only someone able to use that magic or skill would notice any improvement with the fragment.