SNP’s Linden and Brown scoff as Levelling-Up Minister knocks the party’s electoral popularity