For American Express, it's the 4 digits on the front of the card.
For MasterCard, Visa or Discover, it's the last 3 digits in the signature area on the back of your card.