Can a Congressman be removed from office by the President?

No. If that were possible, a President could abuse the power to remove his political opponents from office. Senators may censure (discipline) or remove members of the Senate, and the House of Representatives may censure or remove members of the House. This is a rare occurrence, however.