Regardless of what you think of their other policies, or competence, both Liz Truss and Kemi Badenoch have long been outspoken on single sex spaces and changes in language. Speaking about either of these things is not transphobic. You want it to be regarded as transphobic in order to shut down the discussion.
The fact is that noone needed to talk about any of this 5 years ago because until recently we all knew what 'woman' meant and the rights of women to have single sex spaces was taken for granted. Talking about women's rights isn't transphobic. Men denying them the right to do so is misogyny though.