Please don't overcomplicate yourself. We just need to answer their questions, and they will feel welcome. What about this? We force our lovely moderators to answer each and every newcomer question, no matter what they ask. The new users will see exactly 5 answers from our moderators, they will feel very happy.
I think it will work as our moderators spend most of their awake time on this site anyway.