Meeting Halfway for His Visitation Time

My ex and I are in a legal dispute over the kind of custody he has of her (I'm trying to go for visitation only for him), I get less than $200 in child support each month and he seems to think I should let him use our daughter as an tax exemption every 3 years and I'm saying never, he's trying to get me to sign a paper that says I will never have his child support modified, and we're fighting over the visitation schedule.

My question is this:

If I don't have the money to meet him at the halfway point, or if I can't make it for some other reason, what will happen to me if I don't meet him so he can have his visitation? I asked the same question to my attorney - asking him what if my ex calls and tells me he can't make it - and my attorney said nothing would happen to him.

I am a stay at home mom of 3 kids - 1 which belongs to my ex - my husband has also been in my child's life since I was pregnant with her - my ex(boyfriend) and I soon broke up after I got pregnant with our daughter and I have been with my husband since I was 3 months pregnant with her (over 6 years now). My husband pays for her to be in preschool all day all week, for the extra bedroom that she has to herself since my other 2 kids are boys (find that it seems that a 3 bedroom house averages about $150 more than a 2 bedroom house), pays for her food, all house bills, everything that a natural in-house father pays for their child but in this case my husband is not her natural father. The problem is since I am a stay at home mom the only "income" I technically have is the child support I recieve for my daughter. My husband WILL NOT pay out any more for me to take my daughter to meet her father so all the child support I recieve for her will end up going to meet him halfway.

Right now there is 720 miles between me and my ex (we both agree that every 3rd weekend for visitation is not doable but his attorney continues to try to push for it). The thing is in 5 months I am moving way down into sourthern texas and then there will be 1,407 miles between us. That's 12 hours to drive to the halfway point, get a hotel to catch some sleep, then drive yet another long 12 hours to get back home. If I don't have the money to meet him I won't be and I want to make sure nothing will happen to me if I can't make it to the halfway point.