This paper deals with the problem of automatic interpretation of oceanographic images for vortices detection, modelization and tracking. We present a framework allowing the vortices detection. The processing is split into three parts: apparent motion computation from the image sequence, local interpretation of apparent motion and geometric modelization of the vortices. This scheme allows an efficient approach for vortices segmentation on very large image sequences. A set of experimental data shows the use of such framework for processing Advanced Very High Resolution Radiometer (AVHRR) and Coastal Zone Color Scanner (CZCS) image sequences