Amid the growing number of sexual misconduct allegations against Judge Roy Moore, the Alabama Republican candidate for U.S. Senate, another GOP lawmaker has pulled his endorsement.

Sen. John Cornyn (R-TX) released a statement Monday, saying, “I believe the accusations against Roy Moore are disturbing and, if true, disqualifying. The most appropriate course of action, in my view, is to leave the final judgment in the hands of Alabama voters — where it has always belonged — and withdraw my endorsement.”

Only a few U.S. senators specifically endorsed Moore in his race to capture the Senate seat vacated by now Attorney General Jeff Sessions, but one by one, they are now dropping him.

Republican Sens. Ted Cruz (R-TX) and Rand Paul (Ky.) have not yet un-endorsed the troubled candidate.

Monday Senate Majority Leader Mitch McConnell called on Moore to step aside and give up the race. McConnell said, “I believe the women.”

Judge Moore retorted with a Twitter statement, saying McConnell is the one who should step aside.

“The person who should step aside is @SenateMajLdr Mitch McConnell. He has failed conservatives and must be replaced,” Moore tweeted.

He has repeatedly denied the sexual misconduct allegations.

Monday, a fifth woman came forward accusing Moore of a sexual assault against her in 1977, when she was 16 years old.