You have to have an astral ship. Once your ship is built, the ability to use that portal is unlocked. An easy solution to this is to port to the Isle of Revelation and then click on the option that ports you to Nezebgrad. It is not listed with all of the places to port to, however. It's a specific speaking option when you click on the teleporter.