Limit it to the one repository

Under Repository access choose Only select repositories, then pick the repository from step 2 in the Selected repositories dropdown.