WhatsApp quickly and easily recognizes which of your contacts are using WhatsApp by accessing your phone's address book. To delete a contact, simply delete their phone number from your phone's address book:
Then, refresh your WhatsApp contacts by opening WhatsApp > Tap the new chat icon > More options
> Refresh.
Learn how to delete a contact on: iPhone | Windows Phone