George Q. Cannon says Joseph was visited by both Moroni and Nephi.
George Q. Cannon, "The Right and Authority of President Brigham Young," in Journal of Discourses, 26 vols. (Liverpool : Horace S. Eldredge, 1871), 13:47
If you will read the history of the Church from the beginning, you will find that Joseph was visited by various angelic beings, but not one of them professed to give him the keys until John the Baptist came to him. Moroni, who held the keys of the record of the stick of Ephraim, visited Joseph; he had doubtless, also, visits from Nephi and it may be from Alma and others, but though they came and had authority, holding the authority of the Priesthood, we have no account of their ordaining him, neither did Joseph ever profess, because of the ministration of these angels, to have authority to administer in any of the ordinances of the Kingdom of God.