In cancer, the programmed death-1 (PD-1) pathway suppresses T cell stimulation and mediates immune escape. Upon stimulation, PD-1 becomes phosphorylated at its immune receptor tyrosine-based inhibitory motif (ITIM) and immune receptor tyrosine-based switch motif (ITSM), which then bind the Src homology 2 (SH2) domains of SH2-containing phosphatase 2 (SHP2), initiating T cell inactivation. The SHP2-PD-1 complex structure and the exact functions of the two SH2 domains and phosphorylated motifs remain unknown. Here, we explain the structural basis and provide functional evidence for the mechanism of PD-1-mediated SHP2 activation. We demonstrate that full activation is obtained only upon phosphorylation of both ITIM and ITSM: ITSM binds C-SH2 with strong affinity, recruiting SHP2 to PD-1, while ITIM binds N-SH2, displacing it from the catalytic pocket and activating SHP2. This binding event requires the formation of a new inter-domain interface, offering opportunities for the development of novel immunotherapeutic approaches. Copyright © 2020 The Authors, some rights reserved.