For many environmental indicators, the sustainable status can change because of changes in either the monitored state or the policy goal. Fisheries provide an intensively monitored setting to investigate the relative impacts of such change. Key fisheries sustainability indicators comprise the ratio between fishing pressure or biomass and their respective reference levels. We developed a retrospective database of population status, reference point changes and reported reasons for changes for all data-rich stocks in the ICES region. We derived methods to distinguish the impacts of either source of change (monitored state or policy goal) on sustainable status. We found that reference points changed frequently (64% of populations had reference point changes) with varying magnitudes. Contrary to expectation, reference point changes were often not compensated by changes in the state thus significantly impacting inferred sustainability status and dependent scientific advice. Across a range of life histories and assessments, changes in reference points dominate retrospective revisions in status over the full time series. Overall, status before and after the change of reference point had no significant directional differences that would suggest reference point change effecting movement towards or away from sustainability. Although multiple factors have contributed to reference point changes, our results show that the reference point definition and the technical basis for estimation were the most important reasons for change. Recognizing that reference points are not constant in time but rather form reference series is paramount to quantifying present and historical sustainability. Properly documenting, justifying and quantifying the impacts of such change is an ongoing challenge.