What is the french word for tourist office?
A local Tourist Information Office is called - un Syndicat d'Initiative, but in a town or a city it would be - un Bureau de Tourisme.
Websites like Wikipedia or the CIA world factbook give good information about France. On French population or statistics, the INSEE (national body responsible for the realization of statistics in France) has offers detailed information (somewhat hard to read for non-specialists). On tourism, the French Tourism Office or the Paris Tourist Office (link below) have useful websites with an English version.
Yes, the French word bureau is masculine. Specifically, the word is a noun in its singular form. It may be preceded by the masculine singular definite article le ("the") or the masculine singular indefinite article un ("a"). It most frequently means "desk" and "office". The pronunciation will be "byoo-ro" in French.