The Ball family was listed as white in the 1840 census.
United States, 1840 U.S. Census, Massachusetts, Boston, 6th Ward
[Table listing the Ball family under Free White Persons, Including Heads of Families]