A thermostat doesn't try to maintain a constant temperature. In order to do so - it would have to keep switching on and off every few seconds. Instead - it keeps the temperature within a specific range. When the preset temperature has been reached - it switches off. And it only switches on again - when there has been a significant change in temperature.
The difference between the temperature at which the thermostat switches off - and the temperature at which it switches on again - is the hysteresis. Without this hysteresis - your central heating, refrigerator etc. would keep switching on and off every fe