I would argue it would lead to mass societal change, not collapse, just as the abolition of slavery in our own history didn’t lead to collapse (despite many predictions from slaveholders that it would).
After abolition, you still have a workforce of farmers, you still have arable land, and you still have a market for cereal crops. The only thing that needs to change is how ownership and profits are distributed.