You also don't have to physically hand over your phone for a drive-through pick-up, since the service generates a five-digit code you can tell the personnel. CVS Pay lives within the company's Pharmacy app. If you're in New York, New Jersey, Pennsylvania and Delaware, you either have to download the app or update it to start using the payment service. You'll still get access to the feature even if you don't live in any of those locations, though you might have to wait a few months, as it's not scheduled for a nationwide rollout until later this year.