In case your server is not pure vanilla and you have some modifications, plugins etc.. you will need the client connecting to the server to download everything directly from the server.
This is what the "FastSync" button is for. Every time you add a modification or plugin to the server you need to use this button.

