Yeast makes bread rise. When yeast releases carbon dioxide as it grows and metabolizes the available sugar. The released gas helps make the bread fluffy and soft. Baking soda is used for similar purposes in biscuits and cakes. Yeast can also add a pleasant flavor to the bread (as long as you don't use too much or let the bread rise too long).