My two cents.
Since your kids are still young, it is easier to change now than later. Once they are established at school and get older. It would be a little harsh for them to go to a new place and new school. I feel that if you ever want to change, this is the time, follow your heart, plan it well, and do it.
Or, like all other's suggestions, do not even think anout it again in the near future since this idea bothers you. Stay where you are and try to enjoy it.
Whatever you decide, best blessings!
