Start with an accurate ID of the bees.
When a honeybee swarm moves into a wall, it's usually 10,000 - 30,000 bees. There will be a massive amount of activity initially, and once they've completed move-in, there will still be a lot of activity at the entrance. On warm days there will be bees coming
and going constantly, often faster than a person can count.
Some of our native pollinators are also fond of holes in brick and cracks around windows. Many have recently emerged and are actively finding and provisioning nests for their young. By contrast, with these natives you usually just 2 bees per hole or crack,
coming and going a few to a dozen times per hour. I've already taken several calls this spring in which people have mistaken these native bees for honeybees.
The native bees are nothing to worry about as long as they aren't burrowing into wood (carpenter bees) You can safely leave them about their business, and they'll do no harm as they're using already existing tunnels. If you can get an image, we can confirm.
Regards,
Joe