To delete a form go to the forms list (Forms → Forms), hover the form in table and click Trash.
Forms in the Trash will not appear on the site but none of the data is permanentnly lost, you can restore the form from the Trash or Delete it permanently from the Trash view.