Ex-Boyfriend heartache?

Ok, it has been 5 days since me and my man broke it off. The break up was in the making, but we started as really great friends. I though my life was complex until I met him. I thought it was great because I was thinking I finally met someone on my level with my stress! I decided to end things with him because he pulled back about 3 months ago (ex wife remarried and he just got different). I don't think he's over her- but I know he cares about me. He even said "I still want you in my life." (whatever that means) I have been strong and tried not to call/text because I want him to be able to get his head clear and miss me- but am I doing the right thing? What if we are both just bull- headed? I haven't heard from him...it's tearing me apart.