Bulb in the thermometer contains mercury so when we hold the thermometer by its bulb then our body temperature which is normally 37°C is enough to expand mercury (Yes mercury expands on heating although here we are not heating but it is very sensitive to temperature) as a result the shape of the thermometer gets distorted and we get faulty reading.