I can not tell if MySQL has a native function for this, but as suggested by @rray, you can make a subselect with the total number of records as well as the amount of filtered records and subtract both and get the result you want You wait.
SELECT (c.Total - cc.Retorno) AS Total
FROM (
(SELECT COUNT(1) AS Total FROM contatos) c,
(SELECT COUNT(1) as Retorno FROM contatos WHERE endereco != '') cc
);
Something simpler would reverse your condition:
SELECT COUNT(1) FROM contatos WHERE endereco = '';
You can see the query working in SQL Fiddle