The discovery of graphene led to a burst in search for 2D materials originating from layered atomic crystals coupled by van der Waals force. While bulk bismuth crystals share this layered crystal structure, unlike other group V members of the periodic table, its interlayer bonds are stronger such that traditional mechanical cleavage and exfoliation techniques have shown to be inefficient. In this work, we present a novel mechanical cleavage method for exfoliating bismuth by utilizing the stress concentration effect induced by micro-trench SiO2 structures. As a result, the exfoliated bismuth flakes can achieve thicknesses down to the sub-10 nm range which are analyzed by AFM and Raman spectroscopy.