Before you rush out to spend money, check your basement and shed for items you can reuse or re-purpose.You may have plastic containers, buckets, or recyclables that can be used for gardening.
Many counties offer free compost at the local landfill or mulch where they are trimming trees.You will need to bring your own containers and/or truck to haul it home yourself.
Before buying, think about how you make your own for a lot less. You can find instructions for everything on the internet, and sometimes it's worth your time and effort vs. the money.