Yeah, a guy I used to work beside had a habit of referring to people as gaffer (meaning boss). There was a bit of a mix up when a black guy misheard him and thought he was using the k work.
When Manchester United toured SA a few years back, someone in the team told Sir Alex Ferguson "Hey, gaffer, give me the ball!" Controversy reigned over this.