As the House was taking another vote to repeal President Barack Obama’s health care law in mid July 2012, a number of Republicans offered a grim view of the health care system’s future under "Obamacare" by citing poll results that said many doctors were thinking about quitting.



One example: a July 10, 2012, tweet from Rep. Jeff Duncan, R-S.C., who wrote: "83% of doctors have considered leaving the profession because of ‪#Obamacare‬ ‪#repealandreplace."



Many readers urged us to fact-check this statistic, which was circulated widely in the blogosphere in addition to being mentioned by other Republican lawmakers, such as Rep. Cathy McMorris Rogers of Washington state in an MSNBC interview.



We found it came from a survey by the Doctor Patient Medical Association Foundation, a group founded last fall that is opposed to the health care law.



The group asked: "How do current changes in the medical system affect your desire to practice medicine?" According to the group, 83 percent answered, "Makes me think about quitting," 5 percent said, "I’m re-energized," while 13 percent said they were unsure or had no opinion.



So while the number is right, it's important to examine whether Duncan has accurately explained the results.



Are the poll’s respondents actually talking about "Obamacare"?



Despite the linkage by Duncan and other lawmakers to Obama’s Patient Protection and Affordable Care Act (PPACA), as "Obamacare" is officially known, the question actually does not mention the law. In fact, only the final question in the poll mentions anything about it, in passing.



Instead, the question asks about "current changes," which could include not just the law, but many other factors, such as changes driven by insurance companies and hospital systems. There’s no way of knowing what specifically the respondents were referring to.



In an interview, Kathryn Serkes, the founder and CEO of the Doctor Patient Medical Association, emphasized that the group was not asking specifically about the health care law. She noted that other findings in the survey painted a more nuanced picture than pure anti-Obamacare sentiment.



For instance, when asked to provide their top three choices for "who’s most to blame for current problems in medicine," 65 percent of respondents did choose "government involvement in general," but the next three categories were "health plans/insurance," "third-party payers" and "lawyers," with 50 percent, 42 percent and 42 percent, respectively. And while 27 percent cited "president" as one of their three choices, an almost equal number, 26 percent, cited "Congress," which is most visible today for a House Republican leadership that is dead-set against Obama’s health care law.



"What we know from the other answers in this survey is that there are two main things going on for doctors -- government control and corporate control," Serkes said. "The rest of the results in the survey show doctors bemoaning corporatization as a very close second to government control. Many doctors don’t separate the two."



The poll’s sponsor



As with any poll, it’s always important to know who paid for it.



The group’s website says, "It is DPMA's position that PPACA is the Destruction Of Our Medicine, attempting to insert the government and bureaucrats between the relationship and decisions of medical professional and their patient." It was founded by a longtime representative of the Association of American Physicians and Surgeons, a group that stands for "individual liberty, personal responsibility, limited government, and the ability to freely practice medicine according to time-honored Hippocratic principles."



By itself, this doesn’t mean that the poll is untrustworthy. But it's important to consider that the group is strongly opposed to the law.



The poll’s methodology



Survey experts expressed some concerns about its design, noting that it's difficult to get accurate surveys on specific groups and occupations.



The DPMAF was transparent about its methodology. The survey was conducted by fax and online from April 18 to May 22, 2012. Of 16,227 faxes that were successfully delivered to doctors’ offices, 699, or 4.3 percent, submitted responses.



Experts said they were concerned with two aspects of the poll:



• Respondents weren’t given much of a middle ground. The choices for answering this question were "makes me think about quitting," "I’m re-energized" and "unsure/no opinion."



"It’s a poorly worded question that does not offer a complete range of likely alternatives, such as 'no effect,'" said Don Dillman, an expert in mail-based polls and a professor at Washington State University. Charles Franklin, a polling specialist at the University of Wisconsin, agreed that the response categories offered were "odd."



In addition, interpreting the question requires caution, because asking about whether someone has "considered" something as dramatic as quitting their lifelong profession is a long way from saying they will do so.



Serkes acknowledges this. "Do I expect doctors to quit en masse? " she said. "No, I don’t. Doctors don’t do anything en masse in the U.S."



• Because the response rate was only 4.3 percent, it’s hard to gauge how representative the survey was. A different recent survey of doctors with a similar response rate -- conducted by the Deloitte Center for Health Solutions -- took the extra step of weighting their sample "by years in practice, in combination with gender, region, and specialty to reflect the national distribution of physicians in the (American Medical Association) master file." DPMAF did not.



If a respondent knew about or could detect DPMAF’s conservative policy orientation from the questions, or if they learned about the group’s orientation during the weeks-long period they were given to turn in the survey, they might have been likelier to take part. If they disagreed with the group’s stance, they might have been less likely to take part.



Still, there’s no way to prove that DPMAF’s sample was biased. Either way, Serkes noted that her group never claimed scientific authority for the poll. "We didn’t say specifically that this was a scientific poll, nor did we state confidence levels or margins of error," she said. "We were very transparent about that."



Other estimates



We looked for alternative estimates in similar surveys and found that the Deloitte poll asked doctors if they agreed that "physicians currently practicing will stay in practice." Fifty-four percent said yes, while 34 percent said physicians would stop practicing. That's far below the 83 percent who told the DPMAF that they were considering quitting.



Our ruling



Duncan said "83% of doctors have considered leaving the profession because of #Obamacare." But that's an inaccurate description of the foundation’s poll.



The poll did not specifically ask about the federal health care law and was meant to measure concerns about a wide range of changes in health care. Also, it's worth noting that the poll had a small return rate and the group that conducted it is opposed to the law. We rate the claim False.