"I think it's outrageous that people are still there. They have trashed the facility, they are living in squalor and the Australian taxpayer has paid about 10 million dollars for a new facility and we want people to move," Dutton told 2BG Radio on Thursday.

"Under no circumstance will these people be coming to Australia and that's a final decision."

Kakas said that 35 refugees had voluntarily moved to the new facilities following the police action Thursday.

Damage

A video sent to CNN by an asylum seeker from Pakistan named Naeem ud Din showed destroyed furniture littered throughout the detention center. He said officials were responsible for the destruction.

One asylum seeker at the facility, Walid Zazai, tweeting from the camp, alleged men were beaten.

"We can't take pictures or video. Whole area surrounded by them. When they see anyone filming they catch him, beat him and take him," he wrote, apparently referring to the PNG authorities.

Kakas denied the allegations of violence.

"What you hear is rubbish," he told CNN. "There are 50 of us and 400 of them, how can we use force?"

He says no property was destroyed or damaged.

Kakas insisted officials were only talking to the asylum seekers to convince them to move out.

Asylum seekers who haven't been found to be refugees are being asked to move to a third location, Hillside House.

The men say their safety is at risk at all three centers, which they claim don't offer the same level of security as the fenced detention center.

Turnbull: 'We will not be pressured'

At a press conference Thursday, Australian Prime Minister Malcolm Turnbull urged those remaining at the shuttered facility to "leave and go to the alternative accommodation that has been provided," and added that the men should "obey the law and the lawful authorities of Papua New Guinea."

He added that the protest would not sway Australian authorities into changing immigration policy to admit the protesting men.

"We will not be pressured... our border security, the integrity of our borders is maintained by my government, it is maintained by my government and we will not outsource our migration policy to people smugglers."

The facilities maintained in PNG were set up with the cooperation of Australian authorities, and the center was originally opened in 2001 as part of then-Prime Minister John Howard's "Pacific Solution," to process asylum seekers in offshore facilities.

Offshore facility

The detention center was originally used to process people looking for asylum in Australia between 2001 and 2008. It was reopened in 2012 after a rise in the number of boat arrivals off Australia's shores.

People living in the center who were deemed to be refugees have been asked to move to two other locations in PNG. Asylum seekers who haven't been found to be refugees are being asked to move to a third location.

But all the men who remain who remain in the compound say their safety is at risk at all three locations. They claim the facilities do not offer the same level of security as the detention center.

A tweet from the Australian Federal Police said that no member of its force was present during today's operations.