The remains of The Pear Tree Restaurant and Black Diamond Museum came down around 6 p.m. Thursday as crews sifted through smoldering brick and rubble.