The top picks not in lane to counter Caitlyn include Nidalee, Naafiri, and Sylas. These picks are all great at countering Caitlyn with win rates over 57%. Even if these Caitlyn counter picks are not used in your lane, it's not smart to play her into these matchups. They will very likely win against Caitlyn.
Yet, if the opposite team brings either Amumu or Swain, Caitlyn mains should seriously consider choosing her, as she easily wins against these selections with win rates over 52% against both ofthem.