With about two-thirds of all used energy being lost as waste heat, there is a compelling need for high-performance thermoelectric materials that can directly and reversibly convert heat to electrical energy. However, the practical realization of thermoelectric materials is limited by their hitherto low figure of merit, ZT, which governs the Carnot efficiency according to the second law of thermodynamics. The recent successful strategy of nanostructuring to reduce thermal conductivity has achieved record-high ZT values in the range 1.5–1.8 at 750–900 kelvin1,2,3, but still falls short of the generally desired threshold value of 2. Nanostructures in bulk thermoelectrics allow effective phonon scattering of a significant portion of the phonon spectrum, but phonons with long mean free paths remain largely unaffected. Here we show that heat-carrying phonons with long mean free paths can be scattered by controlling and fine-tuning the mesoscale architecture of nanostructured thermoelectric materials. Thus, by considering sources of scattering on all relevant length scales in a hierarchical fashion—from atomic-scale lattice disorder and nanoscale endotaxial precipitates to mesoscale grain boundaries—we achieve the maximum reduction in lattice thermal conductivity and a large enhancement in the thermoelectric performance of PbTe. By taking such a panoscopic approach to the scattering of heat-carrying phonons across integrated length scales, we go beyond nanostructuring and demonstrate a ZT value of ∼2.2 at 915 kelvin in p-type PbTe endotaxially nanostructured with SrTe at a concentration of 4 mole per cent and mesostructured with powder processing and spark plasma sintering. This increase in ZT beyond the threshold of 2 highlights the role of, and need for, multiscale hierarchical architecture in controlling phonon scattering in bulk thermoelectrics, and offers a realistic prospect of the recovery of a significant portion of waste heat.