According to the BBC, Col Cyrus Oguna revealed that only a small number remained under the control of the militants, who are thought to be from Somalia's al-Shabaab movement, adding that some of those rescued are dehydrated.
At least 68 people have been killed, the report said.
He said that a large part of the building was now under the control of the security forces.
In total about 175 people have been injured, including four soldiers who were taken to hospital, the report added.
Meanwhile, the authorities have asked journalists to exercise caution when reporting military developments because the gunmen might be monitoring the media, the report further said.
There are reports that the gunmen are currently holed up in a supermarket and civilians in the complex are thought either to be held as hostages or in hiding, according to the report.
A heavy military presence remains both in and around the shopping centre and late on Sunday afternoon, a police helicopter and another with military camouflage swept low over the shopping centre, the report mentioned.
--ANI (Posted on 23-09-2013)