The four checkboxes are saved on the task. Settings does not turn them on or off for every future task.
That means a pages-only test does not change the next task. Set the checkboxes again each time you click New Task.
The four checkboxes
- Policies
- Pages
- Collections
- Products
The store summary in Settings can still be edited as a default, but the include choices travel with the task you submit.