To ensure no soldermask on the top or bottom layer, use the rectangle tool to mask out the soldermask for the entire board on both the top and bottom soldermask layers.

Go to View Options

Select “View Top Soldermask Layer”:

Use the rectangle to cover the entire board.

Do the same for bottom solder mask layer.