well it might be to some people
you could be gay/gender confuised
you could be gay and not know it yet
you could also be drunk or have problems with your life and have no other way to express your fealings
It depends some on how you define the somewhat vague term "weird". Generally your behavior would fall under the DSM-IV-TR definition of a paraphilia - specifically transvestic fetishism. Some paraphilias may interfere with the capacity for sexual activity with consenting adult partners. Currently the psycology profession is working on a revision to the DSM classifications. DSM-5 (which is in draft right now) Paraphilias Subworkgroup reached a "consensus that paraphilias are not ipso facto psychiatric disorders", and proposed "that the DSM-V make a distinction between paraphilias and paraphilic disorders. A paraphilia by itself would not automatically justify or require psychiatric intervention. A paraphilic disorder is a paraphilia that causes distress or impairment to the individual or harm to others. One would ascertain a paraphilia (according to the nature of the urges, fantasies, or behaviors) but diagnose a paraphilic disorder (on the basis of distress and impairment). In this conception, having a paraphilia would be a necessary but not a sufficient condition for having a paraphilic disorder." The 'Rationale' page of any paraphilia in the electronic DSM-5 draft continues: "This approach leaves intact the distinction between normative and non-normative sexual behavior, which could be important to researchers, but without automatically labeling non-normative sexual behavior as psychopathological. It also eliminates certain logical absurdities in the DSM-IV-TR. In that version, for example, a man cannot be classified as a transvestite-however much he cross-dresses and however sexually exciting that is to him-unless he is unhappy about this activity or impaired by it.
Distilling this down to the simplest terms - you are not "normal" but whether you are "sick" is still up for debate. The fact that you are asking the question suggests that you have some discomfort with your behavior, which would indicate that you consider yourself "weird". You are certainly not unique however. It might be wise for you to discuss this with a mental health professional - such as a psychologist or psychiatrist - to help you sort out what you feel. If you are religious, you may want to talk with your religious leader about the religious implications.