If you want to shift to an EU place that doesn't belong towards the Schengen location, it is possible that the wife or husband may not demand a visa if she or he holds a national residence allow.
In case you have some other thoughts, be sure to contact the accountable mission abroad to the EU