Chief of Police Minor Allen tells WYMT it started out as a shoplifting complaint, however, when workers confronted the man he revealed a pistol.
Officials describe him as a white man, with neck tattoos and a brown bandanna. He left in a black SUV.
Officials are searching the western edges of Perry County.
If you have any information you are asked to call the police