When I look back through my records, I've had a bait box in the same location since at least 2017 and swarms have moved in 6 times. This one was both one of the largest and also the earliest of them. I've had scouting activity but no swarms many times. I only started putting out a bait box maybe 10 years ago, though I had a couple of swarms show up before, attracted by the empty comb and boxes I keep under the deck.
Scouts prefer higher cavities, which is why it's on the deck. The bait box is empty except for a single frame of old black comb on one side (in this last case it was old drone comb). Scouts measure the space inside the box and while I don't know for real, I think it might make it easier for them if the comb is on the side.
After they show up and have settled in for the day, but still in daylight, I shake them onto real comb or foundation or empty frames with a starter strip in situ, then strap the hive assembly. That evening I block the entrance and carry them to a new location in the yard being very careful not to trip as I go down the stairs. That way I get minimum orienting to the deck location.