Is it correct to write a paragraph that only has one sentence?

A paragraph is a section that expresses an idea, and can be as long or short as you need. When the topic changes, you start a new paragraph.