Benjamin Netanyahu is on his way out as Israel prime minister as the country is set to swear in a new government on Sunday, ending his 12-year stay in office.

Taking Netanyahu’s place is Naftali Bennett, the head of a small ultranationalist party. But Bennett faces challenges in maintaining an unwieldy coalition of parties from the political right, left and center.

The eight parties, including a small Arab faction that is making history by sitting in the ruling coalition, are united in their opposition to Netanyahu and new elections but agree on little else. They are likely to pursue a modest agenda that seeks to reduce tensions with the Palestinians and maintain good relations with the U.S. without launching any major initiatives.

Netanyahu, who is on trial for corruption, remains the head of the largest party in parliament and is expected to vigorously oppose the new government. If just one faction bolts, it could lose its majority and would be at risk of collapse, giving him an opening to return to power.

The country’s deep divisions were on vivid display as Bennett addressed parliament ahead of the vote. He was repeatedly interrupted and loudly heckled by supporters of Netanyahu, several of whom were escorted out of the chamber.

Bennett’s speech mostly dwelled on domestic issues, but he expressed opposition to U.S. efforts to revive Iran’s nuclear deal with world powers.

“Israel will not allow Iran to arm itself with nuclear weapons,” Bennett said, vowing to maintain Netanyahu’s confrontational policy. “Israel will not be a party to the agreement and will continue to preserve full freedom of action.”

Bennett nevertheless thanked President Joe Biden and the U.S. for its decades of support for Israel.

Yohanan Plesner, president of the Israel Democracy Institute, a nonpartisan think tank, said the new government will likely be more stable than it appears.

“Even though it has a very narrow majority, it will be very difficult to topple and replace because the opposition is not cohesive,” he said. Each party in the coalition will want to prove that it can deliver, and for that they need “time and achievements.”

Still, Netanyahu “will continue to cast a shadow,” Plesner said. He expects the incoming opposition leader to exploit events and propose legislation that right-wing coalition members would like to support but can’t — all in order to embarrass and undermine them.

The new government is meanwhile promising a return to normalcy after a tumultuous two years that saw four elections, an 11-day Gaza war last month and a coronavirus outbreak that devastated the economy before it was largely brought under control by a successful vaccination campaign.

The driving force behind the coalition is Yair Lapid, a political centrist who will become prime minister in two years, if the government lasts that long.