Check if external HDD is set as primary boot device in BIOS, or boot from USB is set as primary.I did some trail and error attempts with all your suggestions. Most of the times, if external hard disc is not connected, system is working fine.
Occasionally i had to restart the system one or two times. There are still some issues, but most of the times, it is working fine.
Thanks a lot for all your suggestions