Very early or very late start!!
You got to do what you got to do.
Did a restuarant in a hotel, was told I could start at 11.00pm, 11.20pm customers still sitting and talking in lounge, John gets out vaccum and starts it up where customers cannot see it, customers take hint and bog off home!!
Take control of the situation do NOT let it control you.