The Objection is not Race
Simply because a mother or father objects to their white daughter marrying into a race not of their own doesn't make them a racist.
Does a Rabbi who objects to his daughter marrying a gentile hate non Jews? No, the Rabbi does not hate Gentiles. The Rabbi wants his family to carry on the culture, the traditions and lineage of the Jewish people and the Jewish faith.
Does a devout Catholic family, who is devoted to their faith, despise protestants simply because that particular family wants to continue decades of tradition?
Or does a black father hate white people if he wants his daughter to marry a black man, so as to carry on the black experience?
Those who have no objection to interracial marriage aren't considering family, culture, tradition and lineage.