You can try setting theatre mode instead, that let's you set timers to disable, it won't silence your phone though is the only thing.
Edit, I have just tested it. Using "modes and routines" app on your phone, set the "Theatre" one how you want. Under "Turn on Automatically" set for when the mode is active on your watch.