Two more Highland councillors have quit the licensing committee that controversially allowed a convicted rapist to retain his taxi operating license.