As we know sodium is very reactive metal and reacts vigorously with oxygen which is present in air which eventually lead to fire. So to sodium is kept in kerosene to avoid any kind of reaction with oxygen, moisture, carbon dioxide of the air and also to avoid any accidental fire.