Listening is an active action. It is not hearing, which is rather passive. The other person will sense if you are just hearing or truly listening.
The best way to show that you are listening is to paraphrase. This means you repeat or summarize what the other person has just told you but in your own words. This way you will be able clear up any misconceptions and make the other person feel that you are really listening.