I am using both at the monent. And I must say that Heroku defenetly has it's advantages, but appengine has: lower latency (for me), more Apis, cdn built-in, ability to run different/test different versions at the same time, backend instances (Heroku has ec2 though), free webadmin with graphs and ability to see errors etc.