It took me a fair bit of digging to work out how to enable remote radius disconnections.

I had to add a port number to /etc/chilli/local.conf and then open the firewall to allow packets from the radius server to this port, it would have been nice if there was an option on the web interface for this :)