Choosing the Right Heroku Postgres Plan

Heroku Postgres offers a wide spectrum of plans to serve use cases that range in size from personal blogs to large-dataset, high-transaction applications. Choosing the right plan depends on your app’s specific usage characteristics, including requirements for availability and uptime.

Plan tiers

Heroku Postgres’s many plans are divided into five high-level tiers. The primary difference between each tier is the amount of tolerated monthly downtime for databases in the tier. The five tiers are:

Hobby Tier — For apps that can tolerate up to 4 hours of downtime per month

— For apps that can tolerate up to 4 hours of downtime per month Standard Tier — For apps that can tolerate up to 1 hour of downtime per month

— For apps that can tolerate up to 1 hour of downtime per month Premium Tier — For apps that can tolerate up to 15 minutes of downtime per month

— For apps that can tolerate up to 15 minutes of downtime per month Private Tier — For Heroku Enterprise customers

— For Heroku Enterprise customers Shield Tier — For Heroku Enterprise customers who need compliance-capable databases

Here is a breakdown of the differences between the tiers:

Heroku Postgres tier Downtime Tolerance Fork Follow Rollback HA Disk Encryption Hobby < 4 hr downtime per mo. No No No No No Standard < 1 hr downtime per mo. Yes Yes 4 days No Yes Premium < 15 min downtime per mo. Yes Yes 1 week Yes Yes Private < 15 min downtime per mo. Yes Yes 1 week Yes Yes Shield < 15 min downtime per mo. Yes Yes 1 week Yes Yes

Downtime tolerance is based on a 30-day month.

Shared features

All Heroku Postgres plan tiers share the following features:

Fully managed database service with automatic health checks

Write-ahead log (WAL) off-premise storage every 60 seconds, ensuring minimal data loss in case of catastrophic failure

Daily logical database backups with PG Backups (optional but free)

Dataclips for easy and secure sharing of data and queries

SSL-protected psql/libpq access

Running unmodified Postgres 9.4, 9.5, 9.6, 10, 11

Postgres extensions

A full-featured web UI

Dataclips and daily logical backups are not available for Shield-tier database plans.

Hobby tier

The hobby tier, which includes the hobby-dev and hobby-basic plans, has the following limitations:

Enforced row limits of 10,000 rows for hobby-dev and 10,000,000 for hobby-basic plans

and 10,000,000 for plans Maximum storage of 1GB for hobby-dev and 10GB for hobby-basic plans

Maximum of 20 connections

No in-memory cache: The lack of an in-memory cache limits performance, because the data can’t be accessed on low-latency storage.

No fork/follow support: Fork and follow, used to create replica databases and leader-follower setups, are not supported.

No Expensive Queries support.

Expected uptime of 99.5% each month.

Unannounced maintenance and database upgrades.

No Postgres logs.

Row limit enforcement

When you exceed hobby-tier row limits and try to insert, you receive a Postgres error:

`permission denied for relation <table name>`

The row limits of hobby-tier database plans are enforced with the following mechanism:

When a hobby-dev database reaches 7,000 rows, or a hobby-basic database hits 7 million rows , the owner receives a warning email stating they are nearing their row limits. When the database exceeds its row capacity, the owner receives an additional notification. At this point, the database receives a 7-day grace period to either reduce the number of records, or migrate to another plan. If the number of rows still exceeds the plan capacity after 7 days, INSERT privileges are revoked on the database. Data can still be read, updated, or deleted from the database. This ensures that users can bring their database into compliance and retain access to their data. When the number of rows is again in compliance with the plan limit, INSERT privileges are automatically restored to the database. Note that database sizes are checked asynchronously, so it may take a few minutes for privileges to be restored.

Standard tier

The Standard tier is designed for production applications that can tolerate up to 1 hour of downtime in any given month. All standard tier databases include:

No row limitations

Increasing amounts of in-memory cache

Fork and follow support

Rollback up to 4 days

Database metrics published to application log stream for further analysis

Priority service restoration on disruptions

Automatic encryption-at-rest of all data written to disk

Within the Standard tier, plans have differing memory, connection limits, and storage limits. The plans for the standard tier are:

Plan Name Provisioning Name RAM Size Storage Limit Conn. Limit Standard-0 heroku-postgresql:standard-0 4 GB 64 GB 120 Standard-2 heroku-postgresql:standard-2 8 GB 256 GB 400 Standard-3 heroku-postgresql:standard-3 15 GB 512 GB 500 Standard-4 heroku-postgresql:standard-4 30 GB 768 GB 500 Standard-5 heroku-postgresql:standard-5 61 GB 1 TB 500 Standard-6 heroku-postgresql:standard-6 122 GB 1.5 TB 500 Standard-7 heroku-postgresql:standard-7 244 GB 2 TB 500 Standard-8 heroku-postgresql:standard-8 488 GB 3 TB 500

Premium tier

The Premium tier is designed for production applications that can tolerate up to 15 minutes of downtime in any given month. All premium tier databases include:

No row limitations

Increasing amounts of in-memory cache

Fork and follow support

Rollback up to 7 days

Database metrics published to application log stream for further analysis

Priority service restoration on disruptions

Automatic encryption-at-rest of all data written to disk.

Within the Premium tier, plans have differing memory, connection limits, and storage limits. The plans for the premium tier are:

Plan Name Provisioning Name RAM Size Storage Limit Connection Limit Premium-0 heroku-postgresql:premium-0 4 GB 64 GB 120 Premium-2 heroku-postgresql:premium-2 8 GB 256 GB 400 Premium-3 heroku-postgresql:premium-3 15 GB 512 GB 500 Premium-4 heroku-postgresql:premium-4 30 GB 768 GB 500 Premium-5 heroku-postgresql:premium-5 61 GB 1 TB 500 Premium-6 heroku-postgresql:premium-6 122 GB 1.5 TB 500 Premium-7 heroku-postgresql:premium-7 244 GB 2 TB 500 Premium-8 heroku-postgresql:premium-8 488 GB 3 TB 500

Private and Shield Tiers

Heroku offers Heroku Postgres in private spaces for Heroku Enterprise customers. Additionally, Postgres shield plans are available for customers who need compliance-capable databases. For details on our private and shield plans, see the Heroku Postgres and Private Spaces article.

Cache size

Each production tier plan’s RAM size indicates the total amount of System Memory on the underlying instance’s hardware, most of which is given to Postgres and used for caching. Although a small amount of RAM is used for managing connections and other tasks, Postgres takes advantage of almost all of this RAM for its cache. Learn more about how this works in this article.

Postgres constantly manages the cache of your data: rows you’ve written, indexes you’ve made, and metadata Postgres keeps. When the data required for a query is contained entirely in the cache, performance is very fast. Queries made from cached data are often 100-1000x faster than those made from the full data set.

99% or more of queries served from well engineered, high performance web applications are served from cache.

Conversely, having to fall back to disk is at least an order of magnitude slower. Additionally, columns with large data types (e.g. large text columns) are stored out-of-line via TOAST, and accessing large amounts of TOASTed data can be slow.

General guidelines

Access patterns vary greatly from application to application. Many applications access only a small, recently modified portion of their overall data. Postgres can always keep that portion in its cache as time goes on, and consequently these applications can perform well on smaller plans.

Applications that frequently access all of their data don’t have this luxury. These apps can observe dramatic increases in performance by ensuring that their entire dataset fits in memory. To determine the total size of your dataset, use the heroku pg:info command and look for the Data Size row:

$ heroku pg:info === HEROKU_POSTGRESQL_CHARCOAL_URL (DATABASE_URL) Plan: Crane Status: available Data Size: 9.4 MB ...

Although a crude measure, choosing a plan that has at least as much in-memory cache available as the size of your total dataset ensures high cache ratios. However, you will eventually reach the point where you have more data than the largest plan, and you will have to shard. Plan ahead for sharding: it takes a long time to execute a sharding strategy.

Determining required cache size

There is no substitute for observing the database demands of your application with live traffic to determine the appropriate cache size. Ideally, your cache hit ratio should be in the 99%+ range. Uncommon queries should require less than 100ms and common ones less than 10ms.

This blog post includes a deeper discussion of Postgres performance concerns and techniques.

To measure the cache hit ratio for tables:

SELECT 'cache hit rate' AS name, sum(heap_blks_hit) / (sum(heap_blks_hit) + sum(heap_blks_read)) AS ratio FROM pg_statio_user_tables;

or the cache hit ratio for indexes:

SELECT 'index hit rate' AS name, (sum(idx_blks_hit)) / sum(idx_blks_hit + idx_blks_read) AS ratio FROM pg_statio_user_indexes

You can install the pg extras plugin and then simply run heroku pg:cache_hit.

Both queries should indicate a ratio near 0.99 :

heap_read | heap_hit | ratio -----------+----------+------------------------ 171 | 503551 | 0.99966041175571094090

When the cache hit ratio begins to decrease, upgrading your database generally brings the ratio back up to 99%. To upgrade, it is recommended to perform a follower changeover update to move between plans. Watch New Relic, and see what works best for your application’s access patterns.