Stupid exes are stupid. Help?

My boyfriend and I got together maybe 3 days after he broke up with his girlfriend. That was stupid because he didn't have time to sort out his feelings. We've been together for three months, but he still has feelings for her. I know he wouldn't do anything and I trust him, but I hate that those feelings are there. Do we need to take a break until these go away, or am I making a problem out of a non-problem? We've known eachother for 4 years and we're very honest with eachother... which is why I know he has feelings with her that he doesn't know what to do with. Advise?