This article arises from Future Tense, a collaboration among Arizona State University, the New America Foundation, and Slate. A Future Tense conference on whether governments can keep pace with scientific advances will be held at Google D.C.’s headquarters on Feb. 3-4. (For more information and to sign up for the event, please visit the NAF Web site.)

The phenomena of path dependence and lock-in can be illustrated with many examples, but one of the most vivid is the gear we use to launch things into space. Rockets are a very old invention. The Chinese have had them for something like 1,000 years. Francis Scott Key wrote about them during the War of 1812 and we sing about them at every football game. As late as the 1930s, however, they remained small, experimental, and failure-prone.

There is no way, of course, to guess how rockets might have developed, or failed to, were it not for the fact that, during the 1940s, the world’s most technically sophisticated nation was under the absolute control of a crazy dictator who decreed that vast physical and intellectual resources should be hurled into the project of creating rockets of hitherto unimagined size.

These rockets, which were known as V-2s, were worse than useless from a military standpoint, in the sense that the same resources would have produced a much greater effect had they been devoted instead to the production of U-boats or Messerschmitts. Accordingly, the victorious nations showed only modest interest in their development immediately following the war. It is reasonable to suppose that little more would have been done with them, had it not been for another event, happening at the same time, even more bizarre and incredible than the seizure of absolute control over a modern nation-state by a genocidal madman. I refer, of course, to the sudden and completely unexpected development of nuclear weapons, undertaken over the course of a very few years by a top-secret crash program atop a mesa in New Mexico.

Atomic bombs turned out to be expensive, dirty, controversial, and of limited military use (it was difficult to find targets sufficiently large to be worth using them on). So they might have fizzled out, were it not for the fact that there just happened to be another victorious nation, controlled by a dictator, every bit as evil as the V-2 maker, but not so crazy, who insisted that his nation, the USSR, had to have atomic bombs too. Moreover, the conditions existing in the USSR then were such as to enable the development of that bomb in near-perfect secrecy. The United States could only guess at what the Soviets were doing; and given the stakes, they naturally tended to make the scariest guesses possible. The military logic of nuclear warfare forced them to develop the hydrogen bomb.

Rockets and H-bombs are made for each other. The rockets of the 1950s and 1960s were so expensive, and yet so inaccurate, that their only effective military use was lobbing bombs of inconceivably vast destructive power in the general direction of large urban areas.

Conversely, because those bombs were so destructive (making it tricky to drop them out of a manned aircraft without killing the crew) and the consequences of a first strike so dire, ICBMs—which could be launched from hardened, dispersed silos, as contrasted with bombers, which must take off from concentrated, vulnerable air bases—were the best way to deliver them.

Vast, nation-bankrupting expenditures were now directed to the development of such rockets. In Dark Sun, Richard Rhodes estimates the cost of the nuclear weapons and missile programs at $4 trillion in the United States and the USSR each.

Since the countries were on opposite sides of the planet, the rockets had to be large enough to throw their payload halfway around the world: only a small step short of putting payloads into orbit.

The unthinkable destructiveness of nuclear warfare now led the two superpowers to compete by proxy in other arenas, notably the exploration of space. Astronauts became heroic figures. Killing them accidentally became a no-no. A “failure is not an option, price is no object” mentality became prevalent.

To recap, the existence of rockets big enough to hurl significant payloads into orbit was contingent on the following radically improbable series of events:

1. World’s most technically advanced nation under absolute control of superweapon-obsessed madman2. Astonishing advent of atomic bombs at exactly the same time3. A second great power dominated by secretive, superweapon-obsessed dictator4. Nuclear/strategic calculus militating in favor of ICBMs as delivery system5. Geographic situation of adversaries necessitating that ICBMs must have near-orbital capability6. Manned space exploration as propaganda competition, unmoored from realistic cost/benefit discipline

The above circumstances provide a remarkable example of path dependency. Had these contingencies not obtained, rockets with orbital capability would not have been developed so soon, and when modern societies became interested in launching things into space they might have looked for completely different ways of doing so.

Before dismissing the above story as an aberration, consider that the modern petroleum industry is a direct outgrowth of the practice of going out in wooden, wind-driven ships to hunt sperm whales with hand-hurled spears and then boiling their heads to make lamp fuel.

We move now to the phenomenon of lock-in.

Space travel has not proved nearly as useful to the human race as boys of my generation were once led to believe, but it does have one application—unmanned satellites—that is extremely lucrative to the civilian economy and of the highest imaginable importance to the military and intelligence worlds.

It is illuminating here, though utterly conjectural, to imagine a dialog, set in the offices of a large telecommunications firm during the 1960s, between a business development executive and an engineer.

Biz Dev Guy: We could make a preposterous amount of money from communications satellites.Engineer: It will be expensive to build those, but even so, nothing compared to the cost of building the machines needed to launch them into orbit.Biz Dev Guy: Funny you should mention that. It so happens that our government has already put $4 trillion into building the rockets and supporting technology we need. There’s only one catch.Engineer: OK, I’ll bite. What is the catch?Biz Dev Guy: Your communications satellite has to be the size, shape, and weight of a hydrogen bomb.

As satellites became important, the early H-bomb-hurling rockets were modified to the point at which they became unrecognizable. A quick scan of the Wikipedia entry for the Titan rocket family tells the story in pictures: This machine started out in the late 1950s as an ICBM but, as the military and economic importance of launching satellites became obvious, underwent a lengthy series of modifications, evolving beyond recognition. Similar stories can be told about the Atlas and Thor-Delta families and some of their Soviet counterparts. Since H-bomb-hurlers, even heavily upgraded ones, were not big enough to launch large manned space vehicles such as Apollo, entirely new rocket families such as the Saturn were developed. So it would be erroneous to suggest that more recent satellite designers have been limited by the H-bomb form factor in the way that they might have been at the dawn of the Space Age.

That is not, however, the most important way that rockets generate lock-in. In order to understand this, it’s necessary to know a few things about (1) the physical environment of rocket launches, (2) the economics of the industry, and (3) the way it is regulated, or, to be more precise, the way it interacts with government.

1. The designer of a rocket payload, such as a communications satellite, has much more to worry about than merely limiting the payload to a given size, shape, and weight. The payload must be designed to survive the launch and the transition through various atmospheric regimes into outer space. As we all know from watching astronauts on movies and TV, there will be acceleration forces, relatively modest at the beginning, but building to much higher values as fuel is burned and the rocket becomes lighter relative to its thrust. At some moments, during stage separation, the acceleration may even reverse direction for a few moments as one set of engines stops supplying thrust and atmospheric resistance slows the vehicle down. Rockets produce intense vibration over a wide range of frequencies; at the upper end of that range we would identify this as noise (noise loud enough to cause physical destruction of delicate objects), at the lower range, violent shaking. Explosive bolts send violent shocks through the vehicle’s structure. During the passage through the ionosphere, the air itself becomes conductive and can short out electrical gear. Enclosed spaces must be vented so that pressure doesn’t build up in them as the vehicle passes into vacuum. Once the satellite has reached orbit, sharp and intense variations in temperature as it passes in and out of the earth’s shadow can cause problems if not anticipated in the engineering design. Some of these hazards are common to all things that go into space, but many are unique to rockets.

2. If satellites and launches were cheap, a more easygoing attitude toward their design and construction might prevail. But in general they are, pound for pound, among the most expensive objects ever made even before millions of dollars are spent launching them into orbit. Relatively mass-produced satellites, such as those in the Iridium and Orbcomm constellations, cost on the order of $10,000/lb. The communications birds in geostationary orbit—the ones used for satellite television, e.g.—are two to five times as expensive, and ambitious scientific/defense payloads are often $100,000 per pound. Comsats can only be packed so close together in orbit, which means that there is a limited number of available slots—this makes their owners want to pack as much capability as possible into each bird, helping jack up the cost. Once they are up in orbit, comsats generate huge amounts of cash for their owners, which means that any delays in launching them are terribly expensive. Rockets of the old school aren’t perfect—they have their share of failures—but they have enough of a track record that it’s possible to buy launch insurance. The importance of this fact cannot be overestimated. Every space entrepreneur who dreams of constructing a better mousetrap sooner or later crunches into the sickening realization that, even if the new invention achieved perfect technical success, it would fail as a business proposition simply because the customers wouldn’t be able to purchase launch insurance.

3. Rockets—at least, the kinds that are destined for orbit, which is what we are talking about here—don’t go straight up into the air. They mostly go horizontally, since their purpose is to generate horizontal velocities so high that centrifugal force counteracts gravity. The initial launch is vertical because the thing needs to get off the pad and out of the dense lower atmosphere, but shortly afterwards it bends its trajectory sharply downrange and begins to accelerate nearly horizontally. Consequently, all rockets destined for orbit will pass over large swathes of the earth’s surface during the 10 minutes or so that their engines are burning. This produces regulatory and legal complications that go deep into the realm of the absurd. Existing rockets, and the launch pads around which they have been designed, have been grandfathered in. Space entrepreneurs must either find a way to negotiate the legal minefield from scratch or else pay high fees to use the existing facilities. While some of these regulatory complications can be reduced by going outside of the developed world, this introduces a whole new set of complications since space technology is regulated as armaments, and this imposes strict limits on the ways in which American rocket scientists can collaborate with foreigners. Moreover, the rocket industry’s status as a colossal government-funded program with seemingly eternal lifespan has led to a situation in which its myriad contractors and suppliers are distributed over the largest possible number of congressional districts. Anyone who has witnessed Congress in action can well imagine the consequences of giving it control over a difficult scientific and technological program.

Dr. Jordin Kare, a physicist and space launch expert to whom I am indebted for some of the details mentioned above, visualizes the result as a triangular feedback loop joining big expensive launch systems; complex, expensive, long-life satellites; and few launch opportunities. To this could be added any number of cultural factors (the engineers populating the aerospace industry are heavily invested in the current way of doing things); the insurance and regulatory factors mentioned above; market inelasticity (cutting launch cost in half wouldn’t make much of a difference); and even accounting practices (how do you amortize the nonrecoverable expenses of an innovative program over a sufficiently large number of future launches?).

To employ a commonly used metaphor, our current proficiency in rocket-building is the result of a hill-climbing approach; we started at one place on the technological landscape—which must be considered a random pick, given that it was chosen for dubious reasons by a maniac—and climbed the hill from there, looking for small steps that could be taken to increase the size and efficiency of the device. Sixty years and a couple of trillion dollars later, we have reached a place that is infinitesimally close to the top of that hill. Rockets are as close to perfect as they’re ever going to get. For a few more billion dollars we might be able to achieve a microscopic improvement in efficiency or reliability, but to make any game-changing improvements is not merely expensive; it’s a physical impossibility.

There is no shortage of proposals for radically innovative space launch schemes that, if they worked, would get us across the valley to other hilltops considerably higher than the one we are standing on now—high enough to bring the cost and risk of space launch down to the point where fundamentally new things could begin happening in outer space. But we are not making any serious effort as a society to cross those valleys. It is not clear why.

A temptingly simple explanation is that we are decadent and tired. But none of the bright young up-and-coming economies seem to be interested in anything besides aping what the United States and the USSR did years ago. We may, in other words, need to look beyond strictly U.S.-centric explanations for such failures of imagination and initiative. It might simply be that there is something in the nature of modern global capitalism that is holding us back. Which might be a good thing, if it’s an alternative to the crazy schemes of vicious dictators. Admittedly, there are many who feel a deep antipathy for expenditure of money and brainpower on space travel when, as they never tire of reminding us, there are so many problems to be solved on earth. So if space launch were the only area in which this phenomenon was observable, it would be of concern only to space enthusiasts. But the endless BP oil spill of 2010 highlighted any number of ways in which the phenomena of path dependency and lock-in have trapped our energy industry on a hilltop from which we can gaze longingly across not-so-deep valleys to much higher and sunnier peaks in the not-so-great distance. Those are places we need to go if we are not to end up as the Ottoman Empire of the 21st century, and yet in spite of all of the lip service that is paid to innovation in such areas, it frequently seems as though we are trapped in a collective stasis. As described above, regulation is only one culprit; at least equal blame may be placed on engineering and management culture, insurance, Congress, and even accounting practices. But those who do concern themselves with the formal regulation of “technology” might wish to worry less about possible negative effects of innovation and more about the damage being done to our environment and our prosperity by the mid-20th-century technologies that no sane and responsible person would propose today, but in which we remain trapped by mysterious and ineffable forces.

Like Slate on Facebook. Follow us on Twitter.