As long as when he does take visitation, you work with him - no big scenes of how much you will miss child..(not saying you are, but some do), then you have done your part.
My daughters' father rarely sees them. We are in VA - he moved to NC. Just 2 1/2 hours away. We have been divorced for 11 years almost. there were times he saw them according to schedule. I have always been willing to let him see them according to what was best for his schedule - not the court order.
The only time he has seen them this year was at my urging him....and the last time he tried to talk them into moving in with him! hasnt seen them in the two months since!
For my girls, I think there may be some pain in that, but I raised them without focus on their dad not seeing them. If you focus on it, your child will pay more attention to it. I wouldnt even focus on him....if your child brings him up then talk about it. What I mean is - you want your child to love and be loved by daddy, so you mention him from time to time....but, if the dad isnt a part of that child's life, that could cause more harm to child.
My ex has gotten mad at me a couple of times when girls left a visitation early because of other plans, etc...... I told him - You are the one that doesnt see them and they have a life without you....they will not sit around and wait for you to decide to see them. (plans made before he asked to see them)
My girls lives are built around their father not being there...its not stated, so its not in front of them....but, when he does see them, its a good treat.....and the months he doesnt its not a disappointment....its just the way life is....
I know how you feel, I have cried many tears over this. But, you cannot make someone want to be a parent.