Joseph records in his 1838 History that he was employed by Josiah Stowell in 1826; this would lead to the "very prevalent story" of his having been a "money digger."
Joseph Smith, History, 1838–1856, volume A-1 [23 December 1805–30 August 1834], 8, The Joseph Smith Papers website, accessed December 19, 2022
[Josiah Stowell] lived in Chenango County, State of New York. He had heard something of a silver mine having been opened by the Spaniards in Harmony, Susquahanah County, State of Pensylvania, and had previous to my hiring with him been digging in order if possible to discover the mine. After I went to live with <him> he took me among the rest of his hands to dig for the silver mine, at which I continued to work for nearly a month without success in our undertaking, and finally I prevailed with the old gentleman to cease digging after it. Hence arose the very prevalent story of my have <having> been a money digger.