I have done many servers on AWS. Ranging from mysql,postges,web servers,rails.
The only free alternative to cPanel would be ISPconfig 3. Not the easiest to install but gives you all the same options as cPanel.
Is this only the Sql server you need configured? or do you also want apache installed?
For the emails, do you need incoming and outgoing? or just smtp?
Thank you,
Derick.