In 2003 a mysterious tiny species of hominin (early human) was discovered on the Indonesian island of Flores. It was given the scientific name Homo floresiensis, but it’s better known by its catchy nickname: "the hobbit".

Nothing quite like the hobbit had been observed before in two million years of human evolution. For one, fully grown it was only about 3.5ft (1.1m) tall and would have weighed about 25kg. And, even more unusually, its skull was tiny: the hobbit’s brain would have been no larger than a modern chimpanzee’s.

The hobbit may have lived on Flores for about 100,000 years. About 15-18,000 years ago it disappeared forever.

This makes it the most recent other human species that walked the Earth at the same time as us.

Whether this creature represents a unique species or not remains an area of debate among paleoanthropologists. Some say it was simply a modern human with a form of dwarfism. Others have even proposed that the hobbit’s size – and in particular that tiny skull – was the result of a genetic disorder such as microcephaly or Down's syndrome.

You cannot argue that one feature is the definitive clue

Cut off from the rest of the world on Flores, this isolated habitat is another factor that could have caused it to evolve to such a small size. The island was also home to a dwarf elephant ancestor, for example.

These ideas are heavily debated and a myriad of methods have been used to analyse the shape and size of the hobbit remains.

The problem, says Antoine Balzeau of France’s Natural History Museum, is that many of these assertions focus on aspects of the skull that represent normal variation among hominins.

"You cannot argue that one feature is the definitive clue of the [species] if it's normal for many other fossils," Balzeau told BBC Earth.

A further issue, he says, is that many researchers who have studied the hobbit relied on casts or low resolution scans, which don’t preserve important anatomical details.

None of these features could explain the strange shape of the specimen

Balzeau considers the Flores remains to be the most important fossils discovered in recent years, so he wanted to get to the bottom of some of controversies around their identity.

Together with Philippe Charlier of Paris Descartes University, France, he looked at high-resolution images of the only complete cranium of the group – skull Liang Bua 1 (LB1) – to identify all the various points of thickness and composition of the bone. Even small changes or variation can give clues to which human species the hobbit most closely resembles.

The resolution of the scans they used was about 25 times higher than that used in previous research.

They also looked at the interior parts of the skull to see how the various bone plates of the skull interlocked. "None of these features could explain the strange shape of the specimen," Balzeau says.

"The shape of its skull is definitely not the shape of a modern human skull... Even a human with pathologies [disease]."

Taken together, the results of his study, soon to be published in the Journal of Human Evolution, suggest that there is nothing about the skull that fits with any known population of modern human.

In other words, the hobbit is not a small and diseased member of our species, Homo sapiens. It’s something much more exotic.

Its eyes are very small and its shape is slightly different from H. erectus

Crucially, the hobbit also lacked a chin. And as we have covered before, the very presence of a chin is a defining trait of our species. No other hominins possessed one.

In terms of the overall debate about the hobbit there have been quite a few "final words" on the question of what it was, says Simon Underdown of Oxford Brookes University in the UK

"This paper will please those who agree and probably do nothing to change the mind of those who view the hobbit as a [pygmy or pathological] Homo sapiens."

If anything, the hobbit was most similar to Homo erectus (another species of ancient human which is thought ancestral to us) than any other hominin, says Balzeau. This fits with the idea that the hobbit evolved from a population of this ancient human species.

That being said, the specimen remains strange. "Its eyes are very small and its shape is slightly different from H. erectus," he adds.

Some even argue that H. floresiensis is far too primitive to be attributed to our own genus, Homo at all. Some features of its skeleton seem to be more like those seen in a more "primitive" group of human-like apes called the australopiths. This would make the hobbit a close relative of the famous Lucy fossil, the most well known of all australopiths.

"Many people who think it’s a modern human are medical doctors, so they make a diagnostic based on shared features that fit a certain disease or pathology," says Balzeau.

If we found a modern human that showed the exact same features of the hobbit, then that comparison might be valid.

But, as far as we know, no such human exists.

The debate around the hobbit’s true identity will surely continue

However, Robert Eckhardt of Penn State University, US, maintains that the LBI individual was a modern human with a genetic condition. "The new study does not show that LB1 has a cranial bone thickness that requires its designation as a separate species," he says. There is no evidence that the remaining 11 or 12 individuals appear abnormal.

Further, as there is only one complete hobbit skull, we don't know what the heads of others would have looked like. This makes the designation of a species from only one cranium problematic, adds Eckhardt.

The debate around the hobbit’s true identity will surely continue, in part because of the many different approaches used to study the question.

Chris Stringer of the Natural History Museum of London in the UK, says dating studies might provide new insights, but for now we cannot definitely confirm the hobbit’s species status.

Melissa Hogenboom is @melissasuzanneh on Twitter. Follow BBC Earth on Facebook, Twitter, and Instagram

If you liked this story, sign up for the weekly bbc.com features newsletter.