Capitol is on the Little Missouri River, where it crosses the state line into South Dakota. Its name most likely came from today's Capitol Rock National Natural Landmark. This massive white limestone uplift resembles the nation's capital building. The area offers excellent antelope, mule deer, whitetail deer and turkey hunting.