According to historical records engraved on a stone tablet inside, this mosque was built in 742 during the Tang Dynasty (618-907). This was a result of Islam being introduced into Northwest China by Arab merchants and travelers from Persia and Afghanistan during the mid-7th century when some of them settled down in China and married women of Han Nationality. Their descendants became Muslim of today. The Muslim played an important role in the unifications of China during the Yuan and Ming Dynasties. Hence, other mosques were also built to honor them.

In Xian, it is really well worth a trip to see the Great Mosque, not only for its centuries-old history but also for its particular design of mixed architecture - traditional Muslim and Chinese styles.