This is going to far with the customizer in my opinion.

The customizer settings should be focused on theme layout and options, and this is going out of scope. It would be better to focus on the frontend editor plugin, and give users a good, easy UX with it, instead of the strange workaround.