An idea from On the Principles of Political Economy and Taxation
What the last, rent-free field produces is split between pay and profit only. When grain costs more to grow, pay has to rise so workers can still eat, and the rise comes out of profit, not higher prices. So as farming spreads to poorer land, profits tend to fall.