No. Quite the opposite, the Dursleys hated magic. They were
chosen to be his guardians because they were his only living
relatives. Dumbledore needed somebody who shared his mother,
Lily's, blood to invoke powerful magic that would protect Harry
until he turned seventeen.