Caterpillars are something you will usually stumble across by accident, although if you know which ones go on which plants at the right time of year you can have more luck. It is not just butterflies than have caterpillars, I've seen them from moths, beetles and flies. In fact the most common ones to find are from moths.