His observation came when ministers K Chiranjeevi and K S Rao were causing disturbances over Telangana issue.
Leader of Opposition Arun Jaitley invoked rules to say the Congress ministers, being members of Lok Sabha, cannot disturb the Upper House through their protests.
He pointed out that as per rules, ministers are allowed to reply to debates and answer questions in Rajya Sabha but not create disturbances.
Taking cognisance of this, Kurien asked the ministers to take their seats or withdraw from the House.
As the Deputy Chairman continued with the business of the House amid the din, Venkaiah Naidu (BJP) and some other members said the House should be first brought to order and only then can further business be transacted.
Naresh Agarwal (SP) also raised a point of order over the government's effort to introduce the Telangana bill in the House.
He said as per Rule 232, a bill can be introduced in Rajya Sabha only after a day's notice but the Supplementary agenda provided to members this morning mentions the introduction of the crucial Andhra Pradesh Reorganisation Bill in the House today itself, without that notice period.
By doing so members will not get a chance to move the amendments, Agarwal said and asked, "Has the Chairman given any direction that no amendments have to be moved by the members on the Bill"
Kurien said it is the prerogative of the Chairman and he can allow introduction of the bill without notice.
Members asked the Chair to maintain the prestige of the House and not "bulldoze" any bill in the House and protested the move to introduce the Telangana Bill.
The SP members trooped into the Well to join the protesting TDP and Congress members and Deputy Chairman adjourned the House till 3 PM.
When the House reassembled, several members from BJP, AIADMK, DMK, JD(U), SP and Left parties were on their feet raising several issues, while members supporting united Andhra Pradesh were protesting in the Well.
Deputy leader of BJP Ravi Shankar Prasad sought government's reply on corruption in AgustaWestland helicopter deal, while AIADMK and DMK wanted to know India's stand on Tamil fishermen issue in the forthcoming UNHRC session.
Biren Baishya (AGP) demanded a statement from government ensuring safety of northeastern people in Delhi. Left members D Raja and Sitaram Yechury requested that the issue related to assaulting of two MPs be taken up by the Privileges Committee of Rajya Sabha.
When Minister of Housing and Urban Poverty Alleviation Girija Vyas stood up for passage of the Street Vendors Bill amid din, Prasad said there should be order in the House.
Prasad said but corruption in AgustaWestland helicopter deal is also an important issue and sought government's reply.
He also demanded proper discussion on the Telangana bill.
As noisy scenes continued, Minister of State for Parliamentary Affairs Rajiv Shulka assured the House that the Defence Minister is ready to clarify on AgustaWestland helicopter deal.
He said the government wants discussion on the Telangana bill before its passage.
As Chair's repeated pleas for order went unheeded, Kurien adjourned the House till 4 p.m.