Use "restrict" key option in debbackup authorized_keys