I think that there is also a misunderstanding of encryption here. To receive an encrypted message, you first have to send your public key to the other person. They can then encrypt the message when they send it to you. When you receive it, you decrypt it using your private key.
You use the public key from the other person to send encrypted messages to them.