Consider the impact the listener has on the speaker. If you are bored and disinterested the speaker will loose confidence. Remember the role play I talked about in the post about the physical skills? This element goes hand in hand with that.
Some things to consider when listening are smiling, nodding and offering words of encouragement.