The collection config widget will now automatically start a rescan if the folder configuration was changed, and Apply or OK is clicked.

A nice consequence of this is that the "Rescan Collection" button is no longer needed at all, so that I could remove it.