The structure started to crumble around 4pm on Wednesday on Bedford Avenue in Flatbush, officials said.