The only thing I can rember is people playing golf in a contest, they run around town hitting the balls and are color coded. Any help on this would be welcome I have had this stuck in my head for years, but have never found it to any avail!
I believe you have the movie confused.
You're probably thinking of the film titled Midnight Madness.
In it, five teams each have a different color and in one part of the movie, they have to play a round of miniature golf to get the next clue.