Grover Cleveland

As President Grover Cleveland and his wife were moving out of the White House, she told staff to take care of the place because "We are coming back four years from today." Cleveland won another term and moved back in four years later.