You can delete test cases.
The test case is deleted as well as any links from the test case to the test execution and test results.