The decision to cancel a particular air flight is ultimately the pilot's so there are no firm criteria. Most modern jet aircraft are designed to operate in practically all conditions other than the most severe (e.g. hurricanes).
Sometimes flights are cancelled to/from smaller airports that don't have sophisticated radar controlled landings.
The worries for a pilot that might result in delay/cancellation include: