Azimio la Umoja Coalition has threatened to halt the ongoing bipartisan talks unless Jubilee party rebels resign and seek a fresh mandate from the people.
Speaking on Monday at the Jubilee National Delegates Conference in Nairobi, Kalonzo said they should respect multiparty democracy.
"If you want bipartisan talks to continue, from today those who have left Jubilee should accept to hold by-elections in their respective areas if they respect multipartsim," Kalonzo said.
Kalonzo also said the talks will stop if the Jubilee faction led by Eala MP Kanini Kega will hold their NDC.
"We shall leave it to them so that they know they don't believe in plural democracy," he said.
This comes as bipartisan talks are in progress to address the issues raised by the Azimio team.
On Wednesday, the bipartisan team announced it had identified reconstitution of the electoral commission as a priority and put it top on its agenda.
It also constituted a sub-committee of six members to discuss IEBC reforms.
During the NDC, Jubilee nominated new members to its National Executive Committee (NEC).
The party's Secretary General Jeremiah Kioni announced that they will replace the rebel members who have joined the Kenya Kwanza coalition.
The new NEC members include Jamleck Kamau (national director of elections), Maison Leshoomo (national women’s league chairperson), Agnes Thumbi (national youth league leader) and Nderitu Mureithi (business council leader).
Beatrice Gabo (deputy party leader strategy), Maoka Maore (deputy party leader operations), David Manje (deputy party leader operations), Kados Muiruri (deputy party leader outreach), Saitoti Torome (chairman), Yasin Noor (deputy secretary general) and Pauline Njoroge (deputy organising secretary).