Is musical an adverb?

No, it is not. Musical can be an adjective or a noun (musical play or film). The adverb form is musically.