You can erase either faces or edges. Closed surfaces become open surfaces.
You can also access this command by pressing ALT+SHIFT+E.
The erasing propagates to the connected edges: