2nd pillar buyback before moving out to EU country

Are you sure you can? If I remember correctly, you can pay max. 20% of your salary into 2nd pillar 5 years after moving to Switzerland, could it be your situation?