The icon will only appear if Google tell us they see a device on your network. It will still appear even if you're not allowed to use it - it'll tell you you're not allowed to use it when you tap it.
The fact that it's not appearing means your device can't see it - this isn't uncommon. Try rebooting your phone, your Chromecast, and your router and it'll definitely come back.
