Deciphering the genetic architecture of adaptation of brown algae to environmental stresses such as temperature and salinity is of evolutionary as well as of practical interest. The filamentous brown alga Ectocarpus sp. is a model for the brown algae and its genome has been sequenced. As sessile organisms, brown algae need to be capable of resisting the various abiotic stressors that act in the intertidal zone (e.g. osmotic pressure, temperature, salinity, UV radiation) and previous studies have shown that an important proportion of the expressed genes is regulated in response to hyposaline, hypersaline or oxidative stress conditions. Using the double digest RAD sequencing method, we constructed a dense genetic map with 3,588 SNP markers and identified 39 QTLs for growth-related traits and their plasticity under different temperature and salinity conditions (tolerance to high temperature and low salinity). GO enrichment tests within QTL intervals highlighted membrane transport processes such as ion transporters. Our study represents a significant step towards deciphering the genetic basis of adaptation of Ectocarpus sp. to stress conditions and provides a substantial resource to the increasing list of tools generated for the species.