Story highlights Sister of American held prisoner says the family is outraged by Rodman

"Do you understand what he did in this country?" Rodman asks CNN about Kenneth Bae

Bill Richardson says Rodman "crossed a line" in his comments from North Korea

The NBA commissioner says he disapproves of the way the trip is being carried out

Eccentric basketball star Dennis Rodman's bizarre outburst about an American citizen jailed in North Korea has drawn widespread criticism, including from the prisoner's family.

Rodman is in North Korea with other former NBA players for a basketball game against a local team that's due to take place Wednesday, the birthday of the country's leader Kim Jong Un.

Rodman, 52, who visited North Korea three times previously in the past year, describes Kim as a beloved friend.

During an exclusive interview from Pyongyang on Tuesday, he reacted angrily to a question from Chris Cuomo of CNN's "New Day" about whether he was planning to ask North Korean leaders about Kenneth Bae, a U.S. citizen who was sentenced to 15 years in a labor camp by North Korea last year on charges he intended to topple the government.

Rodman suggested that Bae, a Korean-American whose health has deteriorated during his imprisonment, had done something wrong, but did not specify what.

Photos: Dennis Rodman's trips to North Korea Photos: Dennis Rodman's trips to North Korea Former NBA basketball star Dennis Rodman is surrounded by North Korean officials and members of the media upon his arrival at Sunan International Airport in Pyongyang, North Korea, on Tuesday, June 13. The trip comes at a time of heightened tension between Washington and Pyongyang. Hide Caption 1 of 19 Photos: Dennis Rodman's trips to North Korea Rodman arrives in North Korea on June 13. When asked if he planned to talk to North Korean officials about the four Americans detained there, Rodman said: "Well that's not my purpose right now. ... My purpose is to go over there and try to see if I can keep bringing sports to North Korea." Hide Caption 2 of 19 Photos: Dennis Rodman's trips to North Korea Rodman waves to photographers at Beijing Capital International Airport ahead of his departure to Pyongyang on June 13. Hide Caption 3 of 19 Photos: Dennis Rodman's trips to North Korea At the Beijing airport, Rodman told CNN he was hoping to do "something that's pretty positive" before boarding a plane bound for North Korea. Hide Caption 4 of 19 Photos: Dennis Rodman's trips to North Korea In a handout photo from the North Korean government, North Korean leader Kim Jong Un talks with Rodman during an exhibition basketball game in Pyongyang on January 8, 2014. Rodman, a former contestant on Donald Trump's pre-presidency reality TV show "Celebrity Apprentice," is one of the few Americans to have met Kim. Hide Caption 5 of 19 Photos: Dennis Rodman's trips to North Korea Rodman sings "Happy Birthday" to Kim before the exhibition game in Pyongyang. In what he calls "basketball diplomacy," Rodman participated in a game between North Korea and a team of former NBA players. Hide Caption 6 of 19 Photos: Dennis Rodman's trips to North Korea A bottle of vodka with illustrations of Rodman, Kim and Rodman's name written in Korean sits on the roof of a car outside a Pyongyang hotel in January 2014. Hide Caption 7 of 19 Photos: Dennis Rodman's trips to North Korea Son Kwang Ho, vice minister of North Korea's Sports Ministry, greets Rodman at the airport in Pyongyang in January 2014. Hide Caption 8 of 19 Photos: Dennis Rodman's trips to North Korea Rodman plays one-on-one with a North Korean player during a practice session in Pyongyang in December 2013. During the session, Rodman selected the members of the North Korean team who would play in Pyongyang against the visiting NBA stars. Hide Caption 9 of 19 Photos: Dennis Rodman's trips to North Korea Rodman holds a cigar as he speaks to North Korean basketball players during the practice session in December 2013. Hide Caption 10 of 19 Photos: Dennis Rodman's trips to North Korea Rodman attracts notice as he enters the Koryo Hotel in Pyongyang in December 2013. Hide Caption 11 of 19 Photos: Dennis Rodman's trips to North Korea Rodman arrives at Beijing's airport before a flight to North Korea in December 2013. Hide Caption 12 of 19 Photos: Dennis Rodman's trips to North Korea Rodman shows photos of himself with Kim while talking to journalists at the Beijing airport in September 2013. It was after his second trip to the reclusive nation. Hide Caption 13 of 19 Photos: Dennis Rodman's trips to North Korea Rodman faces questions about detained American Kenneth Bae at the Beijing airport in September 2013. "It is not my job to talk about Kenneth Bae," he told reporters. Bae was later released from detention in North Korea in 2014. Hide Caption 14 of 19 Photos: Dennis Rodman's trips to North Korea Kim talks with Rodman during a dinner in this undated photo published on the homepage of North Korea's Rodong Sinmun newspaper on September 7, 2013. Hide Caption 15 of 19 Photos: Dennis Rodman's trips to North Korea Rodman arrives at North Korea's Pyongyang airport in September 2013. Hide Caption 16 of 19 Photos: Dennis Rodman's trips to North Korea Airport staff take pictures of the former NBA star at a check-in counter in Beijing in September 2013. Hide Caption 17 of 19 Photos: Dennis Rodman's trips to North Korea Rodman hugs Kim in this photo released by the Korean Central News Agency after a basketball game in Pyongyang in February 2013. Hide Caption 18 of 19 Photos: Dennis Rodman's trips to North Korea A photo released by the Korean Central News Agency shows Kim and Rodman clapping during a basketball game between the Harlem Globetrotters and players from the North Korean University of Physical Education in February 2013. Hide Caption 19 of 19

JUST WATCHED Rodman fiery on Kenneth Bae question Replay More Videos ... MUST WATCH Rodman fiery on Kenneth Bae question 02:27

JUST WATCHED Cuomo: Rodman isn't on cultural exchange Replay More Videos ... MUST WATCH Cuomo: Rodman isn't on cultural exchange 03:40

JUST WATCHED Rodman to CNN: I don't give a s*** Replay More Videos ... MUST WATCH Rodman to CNN: I don't give a s*** 08:25

JUST WATCHED Rodman defiant in odd N. Korea defense Replay More Videos ... MUST WATCH Rodman defiant in odd N. Korea defense 08:11

Photos: Dennis Rodman: Hoops, hair and tattoos Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – During his Hall of Fame basketball career, Dennis Rodman was known for his flashy looks on and off the court. Here, Rodman sports the logo of the Chicago Bulls, who he won the NBA title with in 1996, 1997 and 1998. Hide Caption 1 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman stretches before a game in Seattle in 1996. Hide Caption 2 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman signs his first autobiography, "Bad As I Wanna Be," in a Chicago bookstore in 1996. Hide Caption 3 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman dives for a loose ball during a game in 1997. Rodman is one of the NBA's all-time greatest rebounders, leading the league in that category from 1992 to 1998. Hide Caption 4 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman arrives at the Academy Awards ceremony in 1997. Hide Caption 5 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman appears on "The Tonight Show with Jay Leno" in 1998. Hide Caption 6 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman is hit with a trash can by Curt Hennig during a pro wrestling match in Sydney in 2000. Hide Caption 7 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman rocks gold pants in 2004. Hide Caption 8 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman took part in the 2006 Lingerie Bowl. Hide Caption 9 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman appears in costume for a book signing of his second autobiography, "I Should be Dead by Now," in 2005. Hide Caption 10 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman wears makeup similar to the rock band Kiss in 2006. Hide Caption 11 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman arrives at the Basketball Hall of Fame for his enshrinement in 2011. Hide Caption 12 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman wears face paint in 2011 while playing a basketball game with other NBA greats in Macau. Hide Caption 13 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman puckers his lips and holds the face of writer/director Alex Forstenhausler at the "So You Think You Can Roast?" event at the New York Friars Club in 2013. Hide Caption 14 of 15 Photos: Dennis Rodman: Hoops, hair and tattoos Dennis Rodman: Hoops, hair and tattoos – Rodman attends the finale of the television show "All-Star Celebrity Apprentice" in 2013. Rodman has appeared on several reality TV shows, even winning "Celebrity Mole" in 2004. Hide Caption 15 of 15

Photos: Photos: Former NBA stars in North Korea Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Former basketball star Dennis Rodman plays one-on-one with a North Korean player during a practice session in Pyongyang, North Korea, on December 20, 2013. Rodman and several other former NBA players have arrived in North Korea to take part in a basketball game on Wednesday, January 8, the birthday of North Korean leader Kim Jong Un. Hide Caption 1 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Vin Baker shoots the basketball during a 1998 playoff game in Los Angeles. Baker is one of seven former NBA players taking part in the game in North Korea, according to Rodman's agent, Darren Prince. Baker was a four-time NBA All-Star who averaged 15 points a game during a 13-year career that ended in 2006. Hide Caption 2 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Power forward Charles Smith, dribbling the ball in this photo, played nine NBA seasons after being drafted third overall by the Los Angeles Clippers in 1988. He averaged 14.4 points and 5.8 rebounds during his career. Hide Caption 3 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Craig Hodges played in the NBA for 10 seasons and is most known for winning the league's Three-Point Shootout competition in 1990, 1991 and 1992. Hide Caption 4 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Point guard Kenny Anderson was the second overall pick by the New Jersey Nets in 1991, and he would play on seven more teams before his 15-year career ended in 2005. Anderson, a former All-American at Georgia Tech, averaged 12.6 points and 6.1 assists during his NBA career. Hide Caption 5 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Shooting guard Doug Christie played in the NBA for 15 seasons before retiring in 2007. He averaged 11.2 points per game during his career, and he made the NBA's All-Defensive Team on four occasions. Hide Caption 6 of 7 Photos: Photos: Former NBA stars in North Korea Former NBA stars in North Korea – Clifford Robinson scored nearly 20,000 points during an NBA career that spanned 18 seasons. Robinson was the NBA's Sixth Man of the Year in 1993, when he played with the Portland Trail Blazers. Hide Caption 7 of 7

JUST WATCHED Rodman's North Korea basketball party Replay More Videos ... MUST WATCH Rodman's North Korea basketball party 02:43

"Do you understand what he did in this country?" Rodman asked Cuomo. "No, no, no, you tell me, you tell me. Why is he held captive here in this country, why?"

"I would love to speak on this," Rodman said, before abruptly switching topic to talk about how his fellow basketball players had left their families behind to come to North Korea for the exhibition game.

Prisoner's family 'appalled'

Bae's sister, Terri Chung, told Anderson Cooper 360 that Rodman's comments were shocking and outrageous.

Bae, a married father of three, has suffered a series of health problems during his detention and has been transferred from the labor camp to a hospital.

His mother, Myunghee Bae, who visited in October, told CNN that her son was a devout Christian who had not understood the system in North Korea. North Korea is officially an atheist state and has said religious activities were among Bae's offenses.

Chung said Tuesday she was upset because Rodman didn't use his relationship with Kim to help gain her brother's release from the hospital.

"He was in a position to do some good and to help advocate for Kenneth," she said. "He refused to do so. But then instead he has chosen to hurl these outrageous accusations against Kenneth. He clearly doesn't know anything about Kenneth, about his case. And so we were appalled by that."

She said her brother was in North Korea legally working as a tour operator when he was arrested in November 2012. She said she hoped one of the former basketball players would take a chance to ask for amnesty for him.

"This isn't some game. This is about a person's life," she said.

Rodman 'crossed a line'

Bill Richardson, a former U.S. ambassador to the United Nations, also criticized Rodman's comments, telling CNN he was "disappointed" by the former NBA star's performance.

"I think Dennis Rodman crossed a line this morning by implying that Kenneth Bae might be guilty, by suggesting that there was a crime," said Richardson, who worked to secure the release of an American held in North Korea in 1996. "There is no crime. Kenneth Bae is an American detainee that's been there a year in bad health, who deserves to come home."

Richardson, a former New Mexico governor who has visited North Korea multiple times, said Rodman "drank a little bit too much of the Kool-Aid from the North Koreans."

Rodman's comments Tuesday contrast with a request he made on Twitter in May for Kim to "do me a solid and cut Kenneth Bae loose."

Rodman struck up a friendship with Kim last February, when he first traveled to North Korea with a team of Harlem Globetrotters for an exhibition game that was watched by Kim, who is a basketball fan.

He has described his series of trips to North Korea as a "basketball diplomacy" project.

But U.S. government officials have said that they have nothing to do with the visits and that attention should be focused on the brutality of Kim's regime.

White House spokesman Jay Carney noted that Rodman is on a private trip and that the United States has called for North Korea to release Bae. "Our views about Kenneth Bae have not changed," he said.

"I did not see some of the comments that Mr. Rodman made, but I am not going to dignify that outburst with a response," Carney added. "I am simply going to say that we remain gravely concerned about Kenneth Bae's health and continue to urge the DPRK authorities to grant his amnesty and immediate release on humanitarian grounds."

'I love my friend'

In the interview with Cuomo, Rodman defended the visit to North Korea, saying it was a "great idea for the world."

He became upset when pressed on whether he and the other players should have traveled there, given recent events in the secretive country.

The trip takes place weeks after North Korea announced the purge and execution of leader Kim's once-powerful uncle, Jang Song Thaek.

"I love my friend," Rodman said in a reference to Kim. "This is my friend."

He praised his companions' willingness to visit North Korea.

"You know, you've got 10 guys here, 10 guys here, that have left their families, they've left their damn families, to help this country in a sports venture. That's 10 guys, all these guys here, do anyone understand that?"

"We do," responded Cuomo. "And we appreciate that and we wish them well with cultural exchange."

"No, no, no, no," Rodman continued. "I don't give a rat's ass what the hell you think. I'm saying to you, look at these guys here, look at them ... they dared to do one thing, they came here."

Ready for 'the abuse'

After Rodman's outburst, fellow player Charles D. Smith tried to calm the discussion, but Rodman carried on.

"You're the guy behind the mic right now," he told Cuomo. "We're the guys here doing one thing. We have to go back to America and take the abuse. Do you have to take the abuse? Well, we're going to take it."

Rodman predicted his efforts and those of his fellow athletes would eventually "open the door" to North Korean.

Smith pointed out that the group comprised not only ex-players, but some 40 other people, including a number of other Americans.

Smith defended Rodman, saying the players' visit was about basketball, not politics. "We just hope the results are positive, and we think that they'll be positive," he said, noting that the Americans had interacted earlier in the day with their North Korean counterparts, talking through an interpreter.

North Korea had invited the American players as a kind of "cultural exchange" and to "put smiles on people's faces," not to influence the country's leaders, Smith said.

"We are here because it's about doing great will around the world," he said.

'We're not ambassadors'

Smith outlined the charity projects he has been involved in worldwide through his sport, including visiting typhoon victims in Asia.

"We're doing what we do, we play basketball and that's what we love to do," Smith said.

"We did not know that it was going to take this type of a negative spin on what we were doing because we're not politicians, we're not ambassadors. We're here to do what we've been doing most of our lives."

Smith apologized for "the storm that has been created by our presence." But, he added, "We're not apologizing for doing what we do ... we're connecting people to basketball and people to people."

He cautioned against "playing semantics" when discussing Rodman's use of the word "friend" in describing his relationship with Kim.

"It's an associate," he said. "You met someone once, and it's your friend ... you can't meet someone once or twice and take that enduring step."

Smith added that the players were interested only in using basketball as a bridge to cultural exchange. "None of these guys are here to talk any sense into any politician," he said.

Darren Prince, Rodman's agent for 16 years, told CNN on Sunday that Kenny Anderson, Cliff Robinson, Vin Baker, Craig Hodges, Doug Christie and Smith would play against the North Korean senior national team.

NBA unimpressed

The NBA distanced itself Tuesday from Rodman.

"Dennis will be Dennis, but I think there is a lot at stake here in terms of a ... a very dangerous country," outgoing NBA Commissioner David Stern said on The Situation Room with Wolf Blitzer.

Stern, commissioner for nearly 30 years, said the league has had preliminary discussions in the past with Pyongyang about a cultural exchange but he wouldn't send any players to North Korea without the OK of the White House.

Stern said he believed that these former players agreed to the game for a big payday and didn't think about the political ramifications.

He said that the league didn't sanction the trip or collaborate with Rodman's group.

"Sports diplomacy is a wonderful thing," he said, mentioning that the NBA has hosted teams from China and Iran. "But they should be done in a far more dignified fashion than this particular trip is being carried out."