What record company did they first record for?

They always recorded at EMI Studios (which later became Abbey Road after the famous album). Their record label was changed from Parlophone to Apple. Apple was a company started by the Beatles. (Not to be confused with Apple Computers which was started later by Steve Jobs)