Parts can only be deleted if there is no order attached to it. If your part is attached to an order at any stage, including canceled orders, the part may not be deleted.
If you would like to archive a part that is not in use, you can click the Archive option on the top left of the Part Detail Page.