Azure Web App Failed to load resource: the server responded with status of 502 (Bad Gateway)

It looks like this question might have been asked before but I searched MSDN forums, and Stack Overflow but was not able to resolve my issue. I have just signed up for Microsoft Azure and was hoping it will be easy to create a web app on Azure. I created a Web Appp resource sucessfully with the default page displaying fine. But when I deploy my own App using visual studio 2013 (latest update), I am getting the following error on the browser

Server Error 502 - Web server received an invalid response while acting as a gateway or proxy server. There is a problem with the page you are looking for, and it cannot be displayed. When the Web server (while acting as a gateway or proxy) contacted the upstream content server, it received an invalid response from the content server.

Looking at the browser console I find this error message: Failed to load resource: the server responded with status of 502 (Bad Gateway)

Please help Thank you