Look, I would be all for it, if it weren't a calculated business decision to appeal to the vocal minority, but it is.
It may be a vocal minority in your circles, but in the UK more people than not feel that a female Doctor would be great. But for every idea and opinion there is always opposition. Some fanboys (not calling you a fanboy) loved Peter Capaldi's casting as it would stop "stupid little fangirls" watching
their show.
I will say this though, I like Peter's suggestion of who should be the first female Doctor:
“The time felt right to bow out, to let somebody else play this wonderful role and I would like Frances de la Tour to be first female doctor.”
Don't get me wrong, first and foremost (much like any casting in any tv show or movie) they should get the RIGHT person that will be able portray the narrative going forward. As we don't know what that narrative will be, it is hard to talk about right now. However, in the UK, for as long as the show has existed, we have a tradition of speculating about who the new Doctor should be. It's fun.
If they don't cast a female Doctor I won't be up in arms. But if they flat out decide "not" to even consider it or give female actresses the opportunity to go out for the part, then THAT is sexist. Personally I think that having a female Doctor will bring a new and interesting dynamic to the character. And it could be fun and funny.
I find it interesting that you have no problems with an actor of colour playing the role, but changing the gender is an issue. I grew up watching lots of strong female characters (Ripley in Aliens, Sarah Connor, Buffy the Vampire Slayer, Starbuck in BSG, plus so many characters in the comic world). Plus my mother and two sisters are female, so that is my foundation for stating that women are awesome.
However, as I said, you have your opinions, I have mine. It's all subjective.