While I could see this being useful, I’d favour simplicity over adding to an ever growing list of options. Having said that, if customizer became smarter with the device preview and was able to only present you with options relevant to the device being previewed I’d definitely be in favour. I hope that make sense.
We tried a similar thing once that the Blog options in Customizer would be hidden when users are not on the blog page. Personally I thought it was a cool idea but we got too many “blog options missing in customizer” topics on here so the experiment was ended 🙂