After your conversation is over, take a moment to reflect. How did it go? How much do you think you understood? How comfortable did you feel with that subject matter? Did you encounter any unknown words? The mere act of thinking about it in this way will increase your confidence for the next time you speak (and give your targeted things to work on, for example vocabulary you didn’t understand).