Chlorophyll fluorometers provide the largest in situ global data set for estimating phytoplankton biomass because of their ease of use, size, power consumption, and relatively low price. While in situ chlorophyll a (Chl) fluorescence is proxy for Chl a concentration, and hence phytoplankton biomass, there exist large natural variations in the relationship between in situ fluorescence and extracted Chl a concentration. Despite this large natural variability, we present here a global validation data set for the WET Labs Environmental Characterization Optics (ECO) series chlorophyll fluorometers that suggests a factor of 2 overestimation in the factory calibrated Chl a estimates for this specific manufacturer and series of sensors. We base these results on paired High Pressure Liquid Chromatography (HPLC) and in situ fluorescence match ups for which non-photochemically quenched fluorescence observations were removed. Additionally, we examined matchups between the factory-calibrated in situ fluorescence and estimates of chlorophyll concentration determined from in situ radiometry, absorption line height, NASA's standard ocean color algorithm as well as laboratory calibrations with phytoplankton monocultures spanning diverse species that support the factor of 2 bias. We therefore recommend the factor of 2 global bias correction be applied for the WET Labs ECO sensors, at the user level, to improve the global accuracy of chlorophyll concentration estimates and products derived from them. We recommend that other fluorometer makes and models should likewise undergo global analyses to identify potential bias in factory calibration.