As a guest on Conan, Draymond revealed where he got his toughness from. Where he grew up was part of it. The other was from his mother, who would yell at him during his basketball games.
That prepared him well for a life of being heckled in the NBA. The one thing he didn't reveal is who taught him to kick everyone in the balls.