There were some in the church who felt that putting Joseph Smith's face on the sphinx was a little controversial.

The way he wrote it in his memoirs he wanted to leave something for his family so they would be able to see and touch and feel the things that were important to him in his life.