Yes. You can only delete an archived discount rules. To archive a discount rule, click on the Move to Archive button on the My Rules page:
Once the rule is archived, you can proceed to delete it by selecting the Archived tab and clicking on the Delete button.