New York City police arrested a homeless man from West Virginia on Saturday for allegedly planting false bombs in Manhattan that caused alarm and delayed morning rush-hour commuters last week.

New York Police Department officials said Larry Griffin, 26 years old, placed two pressure cookers wired to look like bombs in the Fulton Street subway station and a third fake explosive on a busy street near Union Square on Friday morning.

The...