Silk worms are caterpillars, are they not? If so this product may be effective against them.
http://www.gardensalive.com/product.asp?pn=8797. I've used it for years to control cabbage worms on broccoli, brussel sprouts, cabbage, etc. When sprayed on the plants the beasties ingest it and a bacteria it contains kills them. I also used it this year on some of my plants that were getting some caterpillars on them. If you want to verify it will work on silk worms call their customer support. They are very helpful.