Supported Terraria extensions such as tModLoader and TShock can be installed from Mod Manager.
Stop the server, open Mod Manager, select the required package, and wait until installation is complete before starting the server.
Removing one of these packages may require a server reinstall. Back up any worlds and configuration files you need before reinstalling.