Files in no sets

Permalink
When I choose "files in no sets" in file manager one of my sets keeps showing up - has a lot of files in it and is kind of annoying. Is there any way to stop it from displaying?