Next, check the box for Clear history when Firefox closes, and then click Settingsâ ¦â a dialog box will pop up. Check Cookies and site data (and uncheck anything you want to keep).