Instead of the extra dim feature being in quick access, why not make it so when you've dragged it to the lowest brightness and release your finger, the slider shrinks and moves to the right and the extra dim button appears at the far left?
Instead of going into quick access