Your magic is not something that can leave you. Sometimes the location of its station may move and you'll have to tune the dial of your frequencies a little differently, to align with it again. It is not a punishment when it moves, it hasn't been taken away. It means that you've graduated and this is an upgrade.