Can your kid ride the horse with you in harvest moon?

No. You can never ride a horse with someone else.