You'll then want to use a rototiller to completely dig up the grass -- roots and all. Tilling also serves to prepare the soil for the new seed or sod.

If the area of soil that needs to be loosened is large, you may need to use a mini excavator instead of loosening the soil by hand with a shovel before using a rototiller.