This is something rarely used, so I thought I’d log it here for reference.

Get the open RDP sessions on the server using qwinsta and make note of the sessionid for the desired connection.

qwinsta /server:<server-name>

use the logoff command and provide the sessionid to logoff that session.

logoff <sessionid> /server:<server-name>