How do I get all my chat users added?

I have loaded all my email accounts and the chat seems to have loaded some users for each of my gmail accounts but not all.  I actively am chatting with someone and if they start a conversation EM client will pop up and I cant chat but I can not start one with them.  Where are my missing users?  How can I add them?  

I attempted to manually add but they aren’t there.  It is weird like I stated some of my active Google chat users are there others are not.