Builders were spooked at a swingers club during renovations to an adjoining property.