Tag - Andrew was even pictured moving some of his belongings into Caroline’s house last week