AUBURN HILLS, Mich. -- Three times Cleveland Cavaliers All-Star Kyrie Irving was given a healthy lead to protect. Three times the lead dwindled on his watch.

Those are the moments where Irving's expected to drive the team, allowing LeBron James to get some well-earned rest. That's why Irving pointed the finger at himself following the Cavs' 106-101 loss to the Detroit Pistons Thursday night.

"A lot of it had to do with my mistakes going into the fourth and not necessarily setting a tone and really coming out and making a stand," Irving explained. "In order for us to be great, we have to be good across the board. I have to demand more out of myself as well as out of my teammates."

The Cavs shook off a sluggish start and surged ahead by 15, using a 22-4 blitz midway through the first quarter. James scored six points during that avalanche. Irving tallied 11.

Then James took a breather. And the Pistons finished the quarter on a 10-2 flurry.

"Tonight it was all about the beginning or end of quarters," James said following the game. "We didn't end the (first) quarter the right way, we were only up seven."

Head coach Tyronn Lue tweaked his rotation a bit to start the second period, putting J.R. Smith in Kyle Korver's spot. But James still led the five-man bench group and by the time he needed another blow, he handed Irving a six-point advantage.

When James returned, the Cavs' lead was just three. The Pistons had seized momentum again with James off the floor.

Not even James' return could change that, as Cleveland went into halftime trailing by three points.

"It was a game of runs and we've got to figure out a way to win," James said. "When it becomes a thunderstorm we've got to kind of weather it, weather the storm, and I don't think we did a good job of that tonight."

Deja vu in the fourth quarter.

James usually rests at some point in the third so he can recharge before starting the fourth. But out of necessity -- and because of his stellar play -- James went the distance in the third, scoring six points and dishing out five (four to Channing Frye) of his game-high 10 assists.

"I just think it was the flow of the game tonight," James said about the rotation tweak. "The lineup we had at the end of the third, we had it flowing. We had the ball moving, Channing was knocking down shots, I was getting to the lane creating for others and we had a great end of that quarter. That's the feel of the game T-Lue had right there and it was the right call, going up seven to end the quarter. Obviously I needed to take a break."

James earned it. He engineered a 22-5 eruption in the final seven minutes of the third period. During that stretch, he scored or assisted on 17 of the team's 22 points. It looked like he had helped the Cavs deliver the knockout punch. They once again had a seven-point lead.

That's when Lue called on Irving, once labeled Mr. 4th Quarter, to close the show. Smith, Derrick Williams, Deron Williams and Tristan Thompson joined him, giving the Cavs a new look to start the period. It backfired.

Detroit scored the first 13 points, turning its seven-point deficit into a six-point lead. That's when Lue summoned James -- after just 3:32 seconds of rest.

During that stretch, Irving went 0-of-3 from the field.

"It starts in that fourth quarter," he said. "There was a swing-swing action and that's an automatic shot and then I turn the ball over and they get a 3 out of it to Reggie Bullock. I take two semi-tough shots and then they go on a little bit of a run and they go 84-80. That's where the tide started to turn. Just can't happen again."

Irving also credited to the tough and physical Pistons, who brought constant pressure and held him to eight points on 3-of-10 from the field in the second half.

"Tonight they played desperation basketball as well as with the intent to execute," Irving said. "Andre (Drummond) was doing his normal things, being around the rim and being physical. Reggie (Jackson) was attacking downhill and hitting some tough floaters and tough shots. They made timely buckets as well going into the fourth when we tried to make a comeback, but it shouldn't have gotten to that point. Going forward just have to be better."

Irving in particular, especially when James is off the floor. Lue has made a point to stagger the minutes, making sure one of his All-Stars is on the floor at all times. Without Kevin Love, who continues to recover from knee surgery, it takes away some of Lue's flexibility with minutes and puts added pressure on Irving and James.

On Thursday night, during those eight minutes and 55 seconds with James catching his wind, the Pistons outscored the Cavs by 23 points. That simply can't happen.

Over the last two games, with James off the floor, the Cavs have been outscored, 64-19.

Players are creatures of habit and they tend to get comfortable in specific roles. While James downplayed the fourth-quarter lineup switch, giving a carefree response, Irving seemed a tad caught off guard by it.

"We flip-flopped again in the third quarter where he finished the quarter and I started the fourth," Irving said. "Being in that position, just gotta be even more well prepared for whatever T. Lue is throwing out there. Being able to execute and being able to demand excellence from the guys I have on the floor. Just really playing with a great pace and defensively being solid. Tonight, I didn't set the tone."