"The house is built of bricks." is correct; the noun brick is a countable noun.
The second one could be rewritten: "The house is a brick house." (brick as an attributive noun describing the noun house) or "The house is brick." (brick as the substance of which the house is made).