We've never had much luck with upgrades. We just do a clean install every time on new servers and import all the BPs, maps, envelopes, certs, and custom properties files, etc. Once everything is running fine with no issues, we then decommission the old servers.

Did you actually use the Installation Manager? We have to upgrade from 5.6 to the latest version and am debating whether to use the Installation Manager.