What provides convincing evidence of a big bang?

Probably the single biggest "smoking gun" is the cosmic microwave background.