Doesn`t display all contacts or a few?
If only some contacts aren`t displayed, probably they aren`t correctly saved or something occured during the synchronization between your gadget and your email agenda
If all contacts aren`t displayed, try a restart, it should work fine
