What do you use the lily for that you get when you fail to do the garden puzzle correctly?
If one of your future towns has cursed/haunted graveyard in it, you can place flowers to graves.
After you have 10 flowers of same kind, try giving them to gardener lady. :)