The British poetry world is “failing to meet even the most basic measurements of inclusivity”, according to a new report which highlights the “systemic exclusion” of poets and critics of colour from UK and Irish poetry magazines.

Collecting data from 29 magazines and websites including PN Review, Poetry Review, the Guardian and Oxford Poetry, the study found that between 2012 and 2018, 9% of almost 20,000 published poems were by poets of colour. Of the 1,819 poems, 502 were published in a single magazine, Modern Poetry in Translation; if this is taken out of the equation, only 7% of poems were by poets of colour. The studyPDF, conducted by poetry reviewer and blogger Dave Coates for Ledbury Emerging Poetry Critics, points out that in contrast, at the 2011 census, 12.9% of the UK population identified as black and minority ethnic (BME).

When the study analysed the race of poetry critics, it found an even starker divide: of almost 3,000 articles written over the period, just 5% were by critics of colour. While around 46% of poems and articles published were by female or non-binary poets and critics, the study found that male critics were twice as likely to review other men than women – a figure that rose to three times as likely at the Guardian, four times at PN Review, and five times at Modern Poetry in Translation.

There has to be the right kind of critical attention – critics knowledgeable about race, culture, identity and belonging

“In order for poets to have a certain prominence there have to be reviews, there has to be a critical evaluation of their work in the contemporary moment in which they exist – otherwise there is just a really skewed picture we have of people’s importance,” said poet and academic Sandeep Parmar, who commissioned the report. “We can see that in the 20th century, and we can see it happening now. There has to be enough critical attention paid, and the right kind of critical attention – critics who are knowledgeable about race and knowledgeable about culture and identity and belonging.”

Parmar said the report had already had an impact, with newspapers including the Guardian and the TLS committing to commissioning more critics of colour. She pointed to the effect of a 2005 report which found that less than 1% of poets published by a major press in the UK were black or Asian; following the launch of diversity mentoring scheme The Complete Works, that figure now stands at almost 10%.

Facebook Twitter Pinterest Forward thinking … former winner Vahni Capildeo is on the shortlist for this year’s Forward prize.

“We’ve hit an important moment in poetry where there are lots of poets of colour who are publishing now, but criticism has not kept up,” said Parmar. “It’s about opening up what we think British poetry is. When I arrived 15 years ago poetry was extremely white, in magazines, criticism and published collections. That’s changed a lot, and it is to do with forward-thinking people.”

She highlighted as an example the work of the Forward prizes, the prestigious awards for the best new poetry published in the British Isles, which have just unveiled a shortlist for the best collection which ranges from the US poet laureate Tracy K Smith, who is African American, to the Trinidadian former winner Vahni Capildeo.

Bidisha, who chairs the jury for the £10,000 prize, said the books “represent the stunning variety and breadth of poetry today, with contemporary international voices that are urgent, engaged and inspirational”.

Smith is shortlisted for Wade in the Water, a confrontation of race and history in America. Capildeo, who took the Forward in 2016 for Measures of Expatriation and who chooses to be identified as “they/them” in the context of their work, makes the shortlist this year for Venus as a Bear, which gives a voice to the inanimate and non-human, from sheep to Roman relics.

The Scottish poet JO Morgan was chosen for Assurances, a response to his father’s role in maintaining Britain’s airborne nuclear deterrent, which imagines the thoughts of civilians, enemy agents and even the bomb itself. The shortlist is completed with the English poet Toby Martinez de las Rivas’s exploration of history and theology Black Sun, and American Danez Smith’s Don’t Call Us Dead, which takes on race and gender in America. Smith, a former world poetry slam finalist whose poem “dear white america” was viewed 300,000 times on YouTube in just a few days after featuring on PBS NewsHour, is African-American, queer, gender-neutral and HIV positive.

“The poets shortlisted explore everything from sexuality and passion to race and identity, nuclear war to motherhood, the ruins of the past and the challenges that lie in the future,” said Bidisha. “Their styles range from controlled elegance to passionate declaration, crisp formalism and conceptual rigour to song-like flow and wry diary-style notes, but are all fiery and joyful in their audacity.”

In all, Bidisha and her fellow judges read more than 200 collections to select their shortlists, enough for her to declare the art form in “roaring health”.

According to Susannah Herbert, the director of the Forward Arts Foundation, poetry “has become the space for articulating the unsayable, the unspoken, the unspeakable and this means its where voices that have been historically silenced finally get to be heard”.

Facebook Twitter Pinterest Danez Smith … Forward shortlisted. Photograph: Richard Saker/The Observer

“No coincidence that sales are rising while those of literary fiction are falling,” Herbert said, “it’s just more exciting right now.” The winners of the Forward prizes will be announced on 18 September.

Writing in the report for Ledbury, Coates argued that excluding writers of differing backgrounds strikes at poetry’s ability to understand “ourselves, other people and the world we live in”.

“A substantial number of talented writers of colour already exist,” he wrote, “and the data in this study makes clear that the systemic exclusion of those writers is very real. I urge poetry editors throughout these islands to take notice and take action.”

The 2018 shortlist for the Forward prize for best collection

Venus as a Bear by Vahni Capildeo (Carcanet)

Assurances by JO Morgan (Cape Poetry)

Black Sun by Toby Martinez de las Rivas (Faber & Faber)

Don’t Call Us Dead by Danez Smith (Chatto & Windus)

Wade in the Water by Tracy K Smith (Penguin UK)