Go here

https://admin.exchange.microsoft.com/#/homepage


Click on Resources.

Make sure the resource doesn't already exist before adding. If it does, just simply edit it.



Click: Add a resource

Follow the prompts.