Up until January, Ring, a smart doorbell creator now owned by Amazon, didn’t revoke users’ access to its app when their account’s password changed. This allowed exes and other people to continue monitoring recorded video even after their permissions should have been removed, The Information reports today. Ring says it adjusted the app in January so that it now eventually revokes app access when a password changes, but that removal can take hours to set in. It isn’t immediate.

Although Ring doorbells are outside the house and not recording what goes on indoors, it still isn’t great for users to retain access to who’s entering and exiting a home at all times. Standard practice should be that once a password is changed, users should lose access to the app until they reenter the updated password, but Ring CEO Jamie Siminoff told The Information that immediately kicking users off would slow the app down. This password news isn’t good, and there’s nothing users can do to speed up the process, so if you change your Ring password, just be aware that other users might still briefly have access.

In an emailed statement, Ring said that it is “taking additional steps to further improve the password change experience,” but didn’t specify what exactly would be changing. The company also said that it recommends against password sharing and instead prefers that Ring owners set up the “Shared Users” feature, which offers the ability to immediately revoke access.

Update May 14th, 8:00PM ET: Updated to include a statement from Ring.