Sport Minister says he is making it a ‘personal priority’ to get more women into sport