It came after Terry continued giving evidence this morning, having first been called to the stand on Tuesday after his defence team lost their application to have the case dismissed.
Terry, 31, is accused of maliciously calling the Queens Park Rangers centre-half a "f****** black c***" during a Premier League match at Loftus Road on October 23 last year.
Terry denies a racially aggravated public order offence. He admits saying the words, but claims he was merely repeating the term in a rhetorical manner to deny what he believed Ferdinand had accused him of.
And fellow Chelsea defender Cole told Westminster Magistrates' Court: "I think we shouldn't be sitting here."
He said that while racism should never be tolerated, repeating what you thought someone said was "completely different".
"If I repeated something that I thought you said, that's totally different than if someone just says something," he said.
He told the court he did not hear what John Terry had said during the clash, but that he made out Ferdinand saying the words 'black' and 'c***'.
He added that Terry approached him towards the end of the game and said something along the lines of: "He (Ferdinand) thinks I'm being a racist."
Before giving his evidence, Cole refused the magistrate's request that he stand up in the witness box.
Told that most people would rather he stand to give his testimony, Cole replied: "I'd rather sit down."
Under cross-examination by Duncan Penny, for the Crown, Terry repeatedly rejected the theory he had issued the abuse because he had "lost it" following taunts from Ferdinand.
Mr Penny said: "You lost it and you said 'f****** black c***' because you had had enough of him and he was humiliating you in public."
Terry also said today he was "keen" to speak to police about the claims.
"I knew there was nothing out there that would show that I had done anything wrong," he said.
"I was keen to go forward with my police statement, my FA statement. If I had anything to hide I wouldn't have done that."
He said he made a statement before seeing any film footage of the incident.
Terry went on to reveal he had tried to call Anton Ferdinand's brother Rio in the aftermath of the incident to discuss the matter.
"I did attempt to call Rio and he wouldn't take my call, I didn't have Anton's number," he said.
It comes after a recording of Terry's interview with the Football Association (FA), conducted a week after the incident, was played to the trial on Tuesday.
He told FA investigator Jennifer Kennedy: "I have been called a lot of things in my football career and off the pitch, but being called a racist I am not prepared to take. I have never been accused of that before, inside or outside football.
"I took it to heart. If I had something to hide I wouldn't be projecting it in front of the Sky cameras and the people in the ground.
"I could have easily had my hand over my mouth or whispered in his ear."
The maximum punishment for the offence Terry is charged with is a £2,500 fine.
