It was a difficult time for Vinayakan, his wife left for divorce and the actor went live in tears