Navigate to Apps section and select ‘Apps & features’. Next, locate for ‘Microsoft Office Desktop Apps’ entry and then click on the same to make ‘Advanced options’ link visible.

Designed to replace the current Mail and Calendar apps, the new Outlook can only be removed after it's been installed.