Yeah don’t use Nexus’ Vortex. It’s very badly optimised and breaks some mods too. Best to install mods manually until a proper mod manager is released.
The team that made the proper mod managers for Skyrim and Fallout are working on one for Starfield.
On that note - using Starfield Script Extender (SFSE)? Click here.