Hold down option-delete.
The option key used to be labeled option, but is now "alt" or "⌥" (next to the command key).
This will remove the entry from your library and of course all collections. The difference is you can delete it from within a collection, without having to leave the collection, go into the Library, look for that entry and delete it from there.
