Somewhat relatedly, and (not so) funnily, Microsoft / LinkedIn is suing a company for… crawling their Web data. https://www.eff.org/cases/hiq-v-linkedin
We are close to launching https://fluxguard.com on AWS. We are a 2 person engineering team:
I strongly urge you to check out CloudFormation early. We initially didn’t, and manually setup everything. We quickly realized that it was bonkers to have 30+ API endpoints with really detailed configuration to Lambda functions… all hand crafted in AWS console. We spent about a month migrating everything to CloudFormation. And we love it. Yes it can be overwrought. But it makes everything much, much better in the end.