Emails. Once deleted all deleted.

I have an email account with Virgin Media (Ntlworld) which I access on a PC plus also android phone and tablet. On the two android devices they were set setup via email settings. The problem I'm having is that if I delete emails on one of the devices when I access email on the other device or PC the emails are showing as still there. They're not showing as in the inbox but showing when open All Mail folder.
Is there a way where that once an email is deleted on one device it's deleted on the other ones?

Emails. Once deleted all deleted.