In the beginning, this town was called Lime Point because of lime deposits in the area. It was later renamed "Hornsilver" for the high grade hornsilver that was discovered there. Silver was mined from the early 1880's through the early 1900's. During the 1930's, gold mining was more predominant so the name was changed to Gold Point.