The device is called an "ATA" (Analog Telephone Adapter). It
converts your voice into data, and sends it across the internet,
also decodes data sent by the VoIP network back into voice (so you
can hear the person you called). You can buy ATAs alone, or get
them from any major VoIP provider.
IP phones somehow are designed with built-in adapters making
them VoIP service ready.