You can delete contacts at the same time by dragging an entire contact report (Contacts -> Detail Report) and then deleting in Excel all you no longer need (you can also delete all your contacts).

 

Then import this Excel with the behavior 'Insert, Update and Delete'. After a confirmation email, all removed contacts will be deleted.