You can remove Firefox with the Add/Remove Programs utility on Windows, by moving the Firefox application to the Trash on Mac OS X, or by deleting the containing folder on Linux.

By default, removing Firefox won’t remove your bookmarks, web browsing history, extensions or other add-ons. This data is stored in your profile folder, which can be found by going to the Help menu and selecting Troubleshooting Information.... The button next to the Profile Directory line in Application Basics will open your profile directory in your system's file explorer.

Please note that if you keep your profile, any version of Firefox that you install after removing Firefox will continue to use the bookmarks, web browsing history, add-ons, and other data from this profile folder.