never loved her
I don't think Jack ever loved her, though he may have wanted her to love him. The title seuquence, in which Adrianne is seen in red among an ocean of black umbrellas suggests that she is the "mark" for Jack's latest matrimonial scam. Anyway, a wife knows best about a husband's love, well, usually, and if she believed that he would really hurt Mary at the end of the movie, then it seems unlikely he ever loved either of them. (At least more than his own mother)