"Why is this a factor at all?" the actor, who is slated to play Albus Dumbledore in HBO's upcoming show, said amid Rowling's ...