Madison, a few weeks after she had first met Caleb, decided to finally ask him out to lunch at a din