“No, we can’t… you’re not my husband,” she softly protested