Check out this easy-peasy way to turn old toilet paper rolls into small pots for starting seeds. The pots can go right into the ground, where they'll break down over time.
Even easier than making pots by forming newspaper around cans!
One caution: Make sure to bury the pots all the way in the ground. If part of the cardboard remains above the soil line, moisture can be wicked away from the plant.