Story highlights The agreement puts no cap on the number of Rohingya allowed to return to Myanmar

The US and UN have described the situation as ethnic cleansing

(CNN) Details have been revealed of the agreement between Myanmar and Bangladesh to repatriate potentially hundreds of thousands of Rohingya to their homes in Rakhine State.

At least 623,000 Muslim-majority Rohingya have fled across the border into Bangladesh since August when a new round of violence broken out in Myanmar's west.

Under the agreement, the two countries would work together to solve the huge refugee crisis and repatriate Rohingya who wanted to return to Rakhine State.

JUST WATCHED Report: Myanmar military raping Rohingya women Replay More Videos ... MUST WATCH Report: Myanmar military raping Rohingya women 04:12

The refugees have brought stories of mass killings and destruction in their former home state at the hands of the Myanmar military, which US Secretary of State Rex Tillerson labeled "ethnic cleansing" in the past week.

But the Myanmar government has repeatedly denied attacking Rohingya civilians, saying it was waging a campaign against a militant insurgency.

Read More