Starting your retirement early can seem ideal. However, there could be downsides to the realities of stopping work ahead of schedule.