Foreign Minister Surapong Tovichakchaikul was speaking as a delegation of officials, escorted by police and the military, set out for a government office that issues passports to persuade protesters there to leave and allow work to resume.
"If successful, this can be an example for other ministries to follow," Surapong told a news conference.
Asked if the government was now moving to end a blockade of ministries and several key intersections of the city, he said: "Soon. It's about time. We have to start to do something."
Several violent incidents were reported by early afternoon on Friday. In one, at least 10 people were injured when an explosive device was thrown at protesters marching near Chulalongkorn University in the city centre.
Hundreds of people on motorbikes and in other vehicles drove up to a government administrative area occupied by protesters and a confrontation ensued between two groups, National Security Council Secretary-General Paradorn Pattanatabut told Reuters.
"They said they were angry at the anti-government crowd who blocked traffic there and stopped them from getting access to government services, especially the passport office," he said.
The political unrest flared in November and escalated on Monday when demonstrators led by former opposition politician Suthep Thaugsuban brought parts of the capital to a standstill, though the numbers protesting appeared to be dwindling midweek.
The turmoil is the latest episode in an eight-year conflict that pits Bangkok's middle class and royalist establishment against the mostly poorer, rural supporters of Yingluck and her brother, former premier Thaksin Shinawatra.
PM SAYS SHE STILL HAS OVERWHELMING SUPPORT
Speakers at protest sites across central Bangkok have suggested that Yingluck is worn out and eager to quit, but at a news conference on Friday the prime minister maintained that she still enjoyed overwhelming popular support.
Thaksin's rural and working-class support has ensured he or his allies have won every election since 2001 and Yingluck's Puea Thai Party seems certain to win an election she has called for Feb. 2.
The anti-government protesters have rejected the election.
They want to suspend what they say is a fragile democracy destabilised by Thaksin, whom they accuse of nepotism and corruption. Their goal is to eradicate the political influence of his family by altering electoral arrangements, though in ways they have not spelt out, along with other political reforms.
Many ministries and state agencies closed this week to avoid violence, with staff working from home or back-up facilities.
The protesters have set out to paralyse ministries, marching each day from camps they have set up at seven big intersections. On Thursday, they targeted revenue offices.
Foreign Minister Surapong said this week that the closure of the consular department in the main government complex meant that, in the first four days of this week, 16,000 new passports had been delayed.
The security forces have largely kept out of sight since the blockades began this week, with the government keen to avoid any confrontation.
The unrest is hurting the economy. Finance Minister Kittirat Na Ranong said this week it might only grow 3 percent this year rather than the forecast 4.5 percent because of disruption to manufacturing, exports, consumption and tourism.