Two construction workers and two children were killed when a residential building fell into an adjacent construction site on Wednesday.