From trying to stop plain packaging on cigarettes to pushing through HS2 and opening the countryside to fracking, big business employs lobbying companies to persuade government to meet their interests. But what are the tricks of their trade?

What does a tax-avoiding, polluting, privatising corporation have to do to get its way with the British government? "We all know how it works," said David Cameron of lobbying. But do we? Lobbyists are the paid persuaders whose job it is to influence the decisions of government. Typically, they operate behind closed doors, through quiet negotiation with politicians. And the influence they enjoy is constructed very consciously, using a whole array of tactics.

Lobbyists operate in the shadows – deliberately. As one lobbyist notes: "The influence of lobbyists increases when it goes largely unnoticed by the public." But if the reasons why companies lobby are often obscured, it is always a tactical investment. Whether facing down a threat to profits from a corporate tax hike, or pushing for market opportunities – such as government privatisations – lobbying has become another way of making money.

Here are the 10 key steps that lobbying businesses will follow to bend government to their will.

1. Control the ground

Lobbyists succeed by owning the terms of debate, steering conversations away from those they can't win and on to those they can. If a public discussion on a company's environmental impact is unwelcome, lobbyists will push instead to have a debate with politicians and the media on the hypothetical economic benefits of their ambitions. Once this narrowly framed conversation becomes dominant, dissenting voices will appear marginal and irrelevant.

Everybody's doing it, including lobbyists for fracking and nuclear power, public sector reform and bank regulation. It doesn't matter if the new frame relies on fabrication. The referendum on an alternative voting system was not, as anticipated, so much a conversation about the merits of first past the post. No2AV was "very quick off the mark" to make it about cost to the public purse, explains Dylan Sharpe, of the No camp's TaxPayers' Alliance. They led with the claim that switching to AV would deny troops badly needed equipment and sick babies incubators. The Yes camp lost the vote two to one.

David Cameron and John Reid campaign against a proposed change to the UK voting system, April 2011. Photograph: Oli Scarff

2. Spin the media

The trick is in knowing when to use the press and when to avoid it. The more noise there is, the less control lobbyists have. As a way of talking to government, though, the media is crucial. Messages are carefully crafted. Even if the corporate goal is pure, self-interested profit-making, it will be dressed up to appear synonymous with the wider, national interest. At the moment, that means economic growth and jobs.

Get the messaging wrong and you get fiascos such as High Speed 2 (HS2). In early 2011, lobbyist James Bethell of Westbourne Communications was parachuted in to rescue the £43bn project, which had initially been sold by ministers on the marginal benefits to a few commuters. Westbourne reframed the debate to make it about jobs and economic growth. The new messaging focused on a narrative that pitted wealthy people in the Chilterns worried about their hunting rights against the economic benefits to the north. The strategy was "posh people standing in the way of working-class people getting jobs," said Bethell. "Their lawns or our jobs," shouted the ad campaign.

Private healthcare also regrouped after the wrong messages went public. As Andrew Lansley embarked on his radical reforms of the NHS, private hospitals and outsourcing firms were talking to investors about the "clear opportunities" to profit from the changes. After comments by Mark Britnell, the head of health at accountancy giants KPMG giants and a former adviser of David Cameron, hit the headlines in May 2011 – Britnell told an investors' conference that "the NHS will be shown no mercy and the best time to take advantage of this will be in the next couple of years" – the industry got a grip. Lobby group The NHS Partners Network moved quickly to get everyone back on-message and singing from "common hymn sheets", as its chief lobbyist David Worskett explained. The reforms were about the survival of the NHS in straitened times. Just nobody mention the bumper profits.

3. Engineer a following

It doesn't help if a corporation is the only one making the case to government. That looks like special pleading. What is needed is a critical mass of voices singing to its tune. This can be engineered.

The forte of lobbying firm Westbourne is in mobilising voices behind its clients. Thirty economists, for example, signed a letter to the FT in 2011 in support of HS2; 100 businesses endorsed another published in the Daily Telegraph.

Westbourne was also hired in 2011 to lobby against the top rate of tax, although who was behind its "50p tax campaign" remains a mystery. Ahead of the chancellor's annual Budget announcement in early 2012, letters appeared in the press demanding he scrap it. The FT's was signed by 20 economists. The Telegraph's by the bosses of 573 SMEs, described as the "bedrock" of British industry. A quick glance, though, revealed it included five managers from the Switzerland-based banking giant Credit Suisse. The paper's commentary noted the alarm this new call from "ordinary British business" would cause inside government.

4. Buy in credibility

Corporations are one of the least credible sources of information for the public. What they need, therefore, are authentic, seemingly independent people to carry their message for them.

One nuclear lobbyist admitted it spread messages "via third-party opinion because the public would be suspicious if we started ramming pro-nuclear messages down their throats". That's it in a nutshell.

The tobacco companies are pioneers of this technique. Their recent campaign against plain packaging has seen them fund newsagents to push the economic case against the policy and encourage trading standards officers to lobby their MPs. British American Tobacco also currently funds the Common Sense Alliance, which is fronted by two ex-policemen and campaigns against "irrational" regulation. Philip Morris is similarly paying an ex-Met police officer, Will O'Reilly, to front a media campaign linking plain packaging to tobacco smuggling. It is worth noting that a decade ago the tobacco giant coughed up $1.25bn to the European Commission to settle a long-running dispute over its own complicity in the illicit trade.

5. Sponsor a thinktank

"The thinktank route is a very good one," said ex-minister Patricia Hewitt to undercover reporters seeking lobbying advice. Some thinktanks will provide companies with a lobbying package: a media-friendly report, a Westminster event, ear-time with politicians. "The exact same services that a lobbying agency would provide," says one lobbyist. "They're just more expensive."

In the mid-noughties, a lobbyist for Standard Life Healthcare, now part of PruHealth, worried about how they could get more people to buy private cover without being seen to undermine the NHS. The solution: "Get some of the thinktanks to say it, so it's not just us calling for reform, it's outside commentators ... it does need others to help us take the debate forward." The insurers did turn to thinktanks, including free-market advocates Reform. This has lobbied for more "insurance-based private funding" in the health service. Prudential, the insurance giant behind PruHealth, was Reform's most generous sponsor in 2012, investing £67,500 in the thinktank.

The BBC has also come under repeated recent criticism for inviting commentators from the leading neo-liberal thinktank, the Institute of Economic Affairs (IEA), to talk about its opposition to the plain packaging of cigarettes, without disclosing the Institute's tobacco funding. Although the IEA does not disclose who funds it, BAT concedes it has recently paid the IEA £30,000, with more to come this year. Leaked documents from Philip Morris also reveal the thinktank is one of its "media messengers" in its anti- plain-packaging campaign.

The Birmingham and Fazeley viaduct, part of the proposed route for the HS2 high speed rail scheme. Photograph: HS2

6. Consult your critics

Companies faced with a development that has drawn the ire of a local community will often engage lobbyists to run a public consultation exercise. Again, not as benign as it sounds. "Businesses have to be able to predict risk and gain intelligence on potential problems," says ex-Tesco lobbyist Bernard Hughes. "The army used to call it reconnaissance; we call it consultation."

For some in the business, community consultation – anything from running focus groups, exhibitions, planning exercises and public meetings – is a means of flushing out opposition and providing a managed channel through which would-be opponents can voice concerns. Opportunities to influence the outcome, whether it is preventing an out-of-town supermarket or protecting local health services, are almost always nil.

Residents in Barne Barton in Plymouth were asked in 2011 what they thought about a 95-metre, PFI-financed incinerator being sited in their neighbourhood, just 62 metres from the nearest house. Although more than 5,000 people objected, the waste company's planning application was waved through. That's community consultation.

7. Neutralise the opposition

Lobbyists see their battles with opposition activists as "guerilla warfare". They want government to listen to their message, but ignore counter arguments coming from campaigners, such as environmentalists, who have long been the bane of commercial lobbyists. So, they need to deal with the "antis".

Lobbyists have developed a sliding scale of tactics to neutralise such a threat. Monitoring of opposition groups is common: one lobbyist from agency Edelman talks of the need for "360-degree monitoring" of the internet, complete with online "listening posts ... so they can pick up the first warning signals" of activist activity. "The person making a lot of noise is probably not the influential one, you've got to find the influential one," he says. Rebuttal campaigns are frequently employed: "exhausting, but crucial," says Westbourne.

Lobbyists have also long employed divide-and-rule tactics. One Shell strategy proposed to "differentiate interest groups into friends and foes", building relationships with the former, while making it "more difficult for hardcore campaigners to sustain their campaigns". Philip Morris's covert 10-year strategy, codenamed Project Sunrise, intended to "drive a wedge between various anti groups" and "position antis as extremists".

Then there are the more serious activities used primarily when big-money commercial interests are threatened, such as the infiltration of opposition groups, otherwise known as spying. Household names such as Shell, BAE Systems and Nestlé have all been exposed for spying on their critics. Wikileaks' Global Intelligence Files revealed that groups such as Greenpeace, Amnesty International and animal rights organisation Peta were all monitored by global intelligence company Stratfor, once described as a "shadow CIA".

8. Control the web

Today's world is a digital democracy, say lobbyists. Gone are the old certainties of how decisions were made "by having lunch with an MP, or taking a journalist out," laments one. It presents a challenge, but not an insurmountable one.

One key way to control information online is to flood the web with positive information, which is not as benign as it sounds. Lobbying agencies create phoney blogs for clients and press releases that no journalist will read – all positive content that fools search engines into pushing the dummy content above the negative, driving the output of critics down Google rankings. Relying on the fact that few of us regularly click beyond the first page of search results, lobbyists make negative content "disappear".

Another means of restricting access to information is the doctoring of Wikipedia, "a ridiculous organisation," in veteran lobbyist Tim Bell's words. Accounts associated with his firm, Bell Pottinger, have been caught scrubbing Wikipedia profiles of arms manufacturers, financial firms, a Russian oligarch and the founder of libel specialists Carter-Ruck. "It's important for Wikipedia to recognise we are a valuable source for accurate information," says Bell, a master at killing stories. Other edits by lobbyists range from a computer in the offices of payday lender Wonga deleting references to "usury" from its entry, to a computer registered to the American multinational Dow Chemical repeatedly attempting to remove a large section from the company's profile detailing "controversies".

The lobbyists: Tim Bell and James Henderson of Bell Potinger. Photograph: Sarah Lee

9. Open the door

Without doubt, lobbyists need access to politicians. This doesn't always equate to influence, but deals can only be cooked up once in the kitchen. And access to politicians can be bought. It is not a cash deal, rather an investment is made in the relationship. Lobbyists build trust, offer help and accept favour.

The best way to shortcut the process of relationship-building is to hire politicians' friends, in the form of ex-employees or colleagues. Bill Morgan is a good example. In recent years, he's been backwards and forwards twice between Andrew Lansley's office and health-lobbying specialists MHP. Its clients had "obviously benefited" from Morgan's inside knowledge of Conservative health policy, MHP wrote. They could "look forward to continuing to be at the heart of the major policy debates".

Lobbyists are Westminster and Whitehall insiders, among them many former ministers. "You may remember me from my time as Minister of State for Transport," wrote Stephen Ladyman as he lobbied a potential government client in his new role as a paid adviser to a transport company. "I do indeed and am delighted to hear from you," replied the official. "We would be interested to hear your proposals."He had just opened the door.

10. And finally ...

There is the perception, at least, that decisions taken in government could be influenced by the reward of future employment. It's a concern that has been expressed for the best part of a century. Today, however, the number of people moving through the revolving door is off the scale.

The top rung of the Department of Health has in recent years experienced huge traffic towards the private sector. The department that sees more movement than any other, though, is still the Ministry of Defence. Since 1996, officials and military officers have taken up more than 3,500 jobs in arms and defence related companies. Two hundred and thirty-one jobs were secured in 2011/12 alone.

Government is the arms industry's biggest customer and the MoD's closeness to its suppliers is widely known. It is also gaining a reputation for its disastrously expensive contracts that deliver poor value for taxpayers and often poor performance for the military. More than one commentator has asked whether the two are connected.

A Quiet Word: Lobbying, Crony Capitalism and Broken Politics in Britain by Tamasin Cave and Andy Rowell is published by The Bodley Head at £18.99.