"The ordinance is not proper... Rahul Gandhi has spoken the right thing," Nitish Kumar told reporters on the sidelines of a function here.
"If you stop an improper action at any stage it does not lower your prestige, but enhances it," Nitish Kumar said.
"As the ordinance is facing criticism across the country, the right step will be its withdrawal. There is still time left as President has not given his approval to the ordinance," he said.
Nitish Kumar said the task of making legislation on such an important issue should be left to the Parliament.
Asked if the ordinance has been aimed at helping RJD chief Lalu Prasad who will face a judgement in fodder scam on Monday, Nitish Kumar said "it's obvious."
Senior BJP leader Sushil Kumar Modi mocked Nitish Kumar for backing Rahul Gandhi and tweeted "JD(U) should openly announce to align with Congress. Nkumar not comfortable with Namo but can chant Rahul zindabad."
Questioning the sincerity in Rahul Gandhi's denouncement of the ordinance, the former deputy chief minister of Bihar said, "Can Rahul Gandhi ask PM to dismiss Kapil Sibal from Cabinet for piloting this ordinance Rahul thinks everybody is fool in this country"
"Kapil Sibal appeared for Lalu in fodder scam case. Lalu nominated him to Rajya Sabha. Now he is helping Lalu by Ordinance," he said.