You have made the right choice to not go if it doesn't feel right to you. You won't be able to enjoy yourself if you do go.
On the same note, it doesn't sound like you would ever ask them to move it to a different place, and if they offer to, you should tell them that they should have it where they want to and not let your choice influence their decision.
|