Just an FYI, after not working for the past 24 hours, I turned on logging and it suddenly started working. Not explanation in the logs or anywhere.
I know the domain was resolving properly and I know the DNS records were set up correctly. Weird bug... not sure I can give any more details on how to track it down but apparently a number of people have hit this one.