Do you capitalize state in Washington state?

Not unless it is part of a proper name. The expression "Washington state" is used to indicate the state instead of the city (Washington DC). It would be capitalized if "Washington State" meant "Washington State University."