The understanding of the dynamics of fishing vessels is of great interest to characterize the spatial distribution of the fishing effort and to define sustainable fishing strategies. It is also a prerequisite for anticipating changes in fishermen's activity in reaction to management rules, economic context, or evolution of exploited resources. Analyzing the trajectories of individual vessels offers promising perspectives to describe the activity during fishing trips. A hidden Markov model with two behavioral states (steaming and fishing) is developed to infer the sequence of non-observed fishing vessel behavior along the vessel trajectory based on Global Positioning System (GPS) records. Conditionally to the behavior, vessel velocity is modeled with an autoregressive process. The model parameters and the sequence of hidden behavioral states are estimated using an expectation–maximization algorithm, coupled with the Viterbi algorithm that captures the most credible joint sequence of hidden states. A simulation approach was performed to assess the influence of contrast between the model parameters and of the path length on the estimation performances. The model was then fitted to four original GPS tracks recorded with a time step of 15 min derived from volunteer fishing vessels operating in the Channel within the IFREMER RECOPESCA project. Results showed that the fishing activity performed influenced the estimates of the velocity process parameters. Results also suggested future inclusion of variables such as tide currents within the ecosystem approach of fisheries.