Do I need to take an English language test for every visa category?

No — requirements vary. Student, work (Skilled Worker and similar) and most family/settlement routes require evidence of English ability, while most Visitor visas do not.