If your court order provides for a seven-day block of time that belongs to dad, and he wants to take child out-of-state during that time, he is allowed to do it. If it doesn't provide for that time, he cannot (or, at least he is going against the order if he does).
Read your court order, and follow it, as has already been advised.
But... It sounds like you need to file to have it changed. Is there some sort of temporary issue/credible reason why dad is not caring for.child.during all of.his time? (It doesn't sound like it, especially considering the length of time this has been occuring compared to the age of the child). If you think that dad is going to continue this pattern, then you should absolutely file to have the order changed. And if dad isn't shouldering his half of the responsibility for caring for the child, which would naturally include the financial aspect of providing for the child during his time, then you should seek support as well. You will likely need to change the parenting schedule and support together.
The biggest thing you need to do right now is gather up all of the documentation you have about hiw often (or rather, not often) dad cares for baby. You also should seek the help of an attorney if possible..

