Method 1: Hold CTRL
When you hold the CTRL button on your keyboard when clicking the Outlook shortcut on your Desktop, Taskbar, Start Menu or Start Screen, Outlook will detect this and asks if you want to start Outlook in Safe Mode.
This method works in all versions of Windows and for all versions of Outlook.
Method 2: Windows Vista and Windows 7