How do i get rid of the pacifier for a 3 1/2 month? He wakes up looking for it?

Its getting worse every night. He used to sleep very very well, and all of the sudden he wakes up 5-6 times and the only way is to give him the pacifier... I've been letting him cry (rubbing his back, and gently talking, kissing, etc)for 2 nights and not giving him the pacifier at all during day or night...but i dont think i can keep doing it. any ideas?