It's not entirely clear how you're using the values. It sounds like you want the value-bound variables to initialize the field, but have the v-model-bound variables update them?
You need to value-bind the variable you want to be tied to the value. If you have initial values, put them into the bound variable. Upd