Besides, he criticised banks for not extending financial assistance to the micro, small and medium size enterprises (MSMEs) and asked lenders to consider the working dynamics of this sector while extending credit.
"The RBI will soon come out with policy guidelines in differentiated banking licenses within a short period of time", Gandhi told reporters on the sidelines of ICC Banking Summit here today.
Gandhi said that there was need for more variety of banks in the country.
"We intend to give licenses to set up niche banks in the country. These licenses will be given on tap", he said.
On-tap licensing means the RBI window for granting banking permits would be open through the year.
The policy guidelines would be put on the public domain first for inviting suggestions from the stakeholders after which applications would be invited, he said.
The RBI recently awarded licenses to micro-finance institution (MFI) Bandhan and finance major IDFC for setting up full-fledged banks.
On MSME, Gandhi said: "The MSMEs get a raw deal from the banks. The credit flow to the MSMEs are not commensurate with their contribution to the economy."
He said that MSMEs serve the large corporates and their cash flow gets lumpy as they have to depend on payments.
"Banks need to consider this (matter)", he said.