Introduce a source generator and end-to-end compile benchmarks (#4124)

Introduce a source generator and end-to-end compile benchmarks (#4124) #7026