JHJ writes a hymn on pre-existence that mentions heavenly parents.
"Hymn 228," in Joel H. Johnson, Hymns of Praise for the Young: Selected from the Songs of Joel (Salt Lake City, UT: Deseret News, 1882), 215
Hymn 228. (L. M.)
1 To Kolob now my thoughts repair,
Where God, my Father, reigns above:
My heav'nly Mother, too, is there,
And many kindred whom I love.
2 My Father sent me here below,
A tabernacle to obtain,
That I might good and evil know,
And endless lives and glory gain.
3. Oh, let me, then, return again!
To see my parents, whom I love,
And with my brethren live and reign,
In worlds where once I lived above.