Why is governor bellingham considering taking pearl away from Hester?

The gov. thought that she was an unfit mother..that she wasnt teaching her daughter who created her, and so forth..

also, they had suspicions that she was of demon descent.