Indigenous treatment a 'stain on Australia's soul' 04:24
Over a hundred years later, up to 300 indigenous Australians from across the country will gather together Wednesday at a rare meeting in the "spiritual heart" of the nation, Uluru, in a historic bid to be recognized by their own country.
But in 2017, Australia's indigenous population lag behind on basic well-being standards, such as life expectancy, literacy and infant mortality.
"We're not prepared to just take some kind of statement inserted into the constitution or recognizing us because we already know who we are ... We want changes that are going to make changes to our lives and (ensure) we have a say," Referendum Council co-chair and member of the indigenous Alyawarre people, Pat Anderson, told CNN.
In her discussions with the Australia's first citizens, Anderson said she'd hear calls for "substantive, structural reform" to the way they were treated.
Unlike most developed nations, Australia's colonizers never signed a treaty with the native Aboriginal population.
In Australia, changes to the constitution can't be made without a national referendum.
"It's important for Aboriginal and Torres Strait Islanders to know that in our country we are recognized and it does have a massive impact," Tom Calma, co-chair of advocacy group Reconciliation Australia, told CNN.
Torres Strait islanders are the native inhabitants of a string of islands between Papua New Guinea and northern Queensland, which are also claimed by Australia.
After much debate, a 16-member Referendum Council was appointed in 2015 by the Australian Government and Opposition to consult with Australia's indigenous population as to what question should be put to voters.
The First Nations Convention at Uluru will help create the recommendations which will then be given to Australian Prime Minister Malcolm Turnbull.
"It has been truly inspiring," Anderson said. "We are, Aboriginal and Torres Strait Islanders, we're up for this, up for a national conversation
Despite Australia's general affluence and quality of life, the country's indigenous Aboriginal population still falls far behind the rest of the country on a number of social indicators.
But Calma said many of the indicators had been heading in a positive directions in recent years.
"It's all very positive, going from completions of year 12 to university attendance ... we're seeing more people giving up smoking or not taking it up which is a very positive story," he said.
Despite this, Calma said the Australian government needed to do a lot more. "Whichever political party we're talking about, we see glimmers of hope and some attention but none of them you can say in any meaningful way have embraced (Aboriginal assistance)," he said.
Anderson said over the past seven years since Gillard's call for action there had been two reports, both of which had seen no government response.
"Although this is government-funded, they could do like they've done with a whole lot of other stuff -- say thank you very much and pop it in a draw," Anderson said.
"But we're hoping from these three days in Uluru we will build some momentum, not just among our families but also the wider Australia public ... there is a strong desire for change."