Myself, I would have stopped and thought to myself "I wonder if they will be finished with the 4th and 5th floors soon or while I am away, and if so, will they start on the next floor... Maybe I should call and ask..." but that is just me.
You should always notify management when you will be going on vacation.