If you become self-employed (sole proprietorship), you’ll be eligible for the much higher pillar 3a limit for self-employed persons without a pension fund. This should replace the need for a second pillar.
Alternatively, you can take out a second pillar plan from the Substitute Occupational Benefits Institution. Depending on your profession, you may also be able to join one of the pension funds offered by professional associations. If you do this, you will only get the lower pillar 3a limit for people with a pension fund. So it’s either/or, and in my opinion the pillar 3a with its investment opportunities is preferable to the minimal interest paid by pillar 2 pension plans. The tax benefit is basically the same.
If you found a company and become its employee, then you generally will have to join a pillar 2 pension fund, and get the lower pillar 3a.