(CNN) Democratic presidential candidate and former vice president Joe Biden on Saturday accused President Donald Trump's administration of endangering the LGBTQ community by failing to defend LGBTQ individuals' rights and safety.

In a speech to the Human Rights Campaign on the first day of Pride Month, Biden described the difficulties still faced by many transgender people, including lack of access to health care and social services, as well as transphobic violence that he said was enabled by the Trump administration.

"We've already had five, just this year, five black transgender women killed violently in 2019 -- that's outrageous. It must, it must, it must end," Biden said as the supportive crowd broke into applause.

Biden argued that the Trump administration was at odds with the notion of America as a beacon of decency and stood "on the wrong side of history."

Read More