Massachusetts Gov. Charlie Baker says the Cannabis Control Commission, the new state agency in charge of getting retail marijuana shops, should be taking "incremental" steps as it sets up the industry, prioritize the shops and not pot cafes.

More than that could be too much, too fast, according to the governor.

As they write the rules for the industry and speed towards a July 1 opening date for the retail shops, the state's five marijuana commissioners are considering rules that would allow people to buy marijuana and consume it in the cafe, similar to a bar with alcoholic drinks.

They've also opened the door to movie theaters and yoga studios eventually selling single-use portions of marijuana.

But Baker, who opposed legalization and signed into law a bill rewriting the legalization ballot question approved by Bay State voters, said the commission should focus on setting up a seed-to-sale tracking system and the retail shops.

As for things like cannabis cafes, "if that's something they want to come back to at some point, I don't see any reason why they can't," Baker told reporters Thursday.

Baker said he's "deeply" concerned about the commission's moves after he spoke with city and town officials, as well as people in the public health sector.

The concerns are "that if they try to unwrap the entire package straight out of the gate, the role and responsibility they have as an overseer and as a regulator is going to be compromised," the governor said. "And I think it's really important that the launch of this happen on terms that are consistent with the legislation but also with people's expectations."

The main goal is to create a "safe, reliable, legal market" in Massachusetts, according to Baker.

"And our view on that is that means think about it as an incremental approach, do the things you absolutely have to do to get it off the ground and then after you have some experience with that, if you want to expand it in into other areas and circumstances, then by all means have those conversations," he said.

"But trying to do it all at once right off the bat, straight out of the gate, July 1, is a gigantic lift and one that we worry will be one that might not work quite the way people intended," he added.

Asked if he was concerned that pot cafes could catch the attention of the Justice Department as marijuana remains illegal under federal law, Baker said, "No, I just think at this point in time the commission is still a relatively new entity, it has a relatively small staff, it has an enormous portfolio it needs to pursue and our view is it ought to focus on the stuff that's fundamental to the rollout that can be managed and then learn from that and move from there."

Members of the Cannabis Control Commission are holding hearings on the proposed regulations across the state.

Responding to a lengthy letter from Baker's office outlining concerns with some of the regulations, the commission said earlier this week, "It is encouraging that small farmers, businesses, and individuals along with large advocacy groups and government agencies across the state can be equally represented in this open dialogue."