Do you capitalize the word department when it follows the specific department's name?

Yes, you do capitalize the word department when it directly follows the name of that department. This is the case when signing letters or referring to specific departments in emails or in writing.