I've learned that 来不及 means that I can't make something at a specific time. I've most often seen it used in the sense that "I can't make the appointment at all". How do you indicate to someone that you won't be able to make the appointment at the prescribed time, but you still want to meet and will be just a little later?
My best guess would be: "我晚一点到吧。"