TOKYO -- Passengers on the virus-hit cruise ship moored near Tokyo began disembarking on Wednesday, public broadcaster NHK said, after a controversial two-week quarantine that saw more than 500 people infected with the new coronavirus originating in China.

The Diamond Princess, operated by Carnival Corp, has been quarantined in the port of Yokohama since Feb. 3 after a man, who disembarked in Hong Kong before it traveled to Japan, was diagnosed with the virus.

More than 540 people have been infected with the virus on the liner, which originally carried some 3,700 passengers and crew. Many of those infected have already been transfered to hospitals. About half the passengers are Japanese.

Japan, which ranks second in the world after China in number of confirmed virus cases, has come under fire for its handling of the cruise ship quarantine, although top government officials have defended the quarantine and onboard testing operation.

Around 500 people were expected to disembark starting Wednesday, a health ministry official said, with the entire process completed by Friday.

With some passengers planning to stay on the ship it was unclear when the quarantine would end.

The United States evacuated more than 300 nationals on Monday on two chartered flights and six South Koreans and one Japanese spouse flew to South Korea on Wednesday morning on a chartered flight.

Australian Prime Minister Scott Morrison said on Tuesday there were 220 Australians on board. A total of 169 Australians would be evacuated, 36 have the coronavirus and will remain on the ship, and another 15 have elected to stay onboard. Those evacuated will be flown to Darwin, where they will be quarantined for 14 days.

An Australian passenger said Australians had been told they would be pre-screened starting on Wednesday morning and taken to Tokyo’s Haneda airport in the evening for an expected departure early Thursday.

“They told us to pack warm weather clothes for the two weeks in Darwin but who will have that after a cruise in the Japanese winter,” passenger Vicki Presland told Reuters.

A captain’s announcement on the liner said that Hong Kong passengers would also be evacuated over the next 24 hours and that according to information received, a Canadian charter flight would arrive on Friday morning.

Italy and Taiwan were also preparing to evacuate their nationals.

Besides those on the cruise liner and returnees brought home from China’s Wuhan city, the epicenter of the epidemic, about 60 cases of domestic infections have been confirmed in Japan, including 22 in Tokyo, according to NHK public broadcaster.

Amid worries about a contracting economy, the spread of the virus has prompted Tokyo to curb the size of public gatherings and some companies are telling employees to work from home.

The spread of the virus has also raised concerns about the outlook for the Tokyo 2020 Olympics, set to start on July 24, although organizers have said there are no plans to cancel the Summer Games.