Domestic dogs have been central to life in the North American Arctic for millennia. The ancestors of the Inuit were the first to introduce the widespread usage of dog sledge transportation technology to the Americas, but whether the Inuit adopted local Paleo-Inuit dogs or introduced a new dog population to the region remains unknown. To test these hypotheses, we generated mitochondrial DNA and geometric morphometric data of skull and dental elements from a total of 922 North American Arctic dogs and wolves spanning over 4500 years. Our analyses revealed that dogs from Inuit sites dating from 2000 BP possess morphological and genetic signatures that distinguish them from earlier Paleo-Inuit dogs, and identified a novel mitochondrial clade in eastern Siberia and Alaska. The genetic legacy of these Inuit dogs survives today in modern Arctic sledge dogs despite phenotypic differences between archaeological and modern Arctic dogs. Together, our data reveal that Inuit dogs derive from a secondary pre-contact migration of dogs distinct from Paleo-Inuit dogs, and most likely aided the Inuit expansion across the North American Arctic beginning around 1000 BP.