AWS Solution Architecture, Data Engineering, and Custom Software Development

• Containerized, Serverless and Auto-scaling EC2 Applications

  We have worked on client solutions running in production with the three predominant AWS application architectures: I) Elastic Load Balancer backed EC2 microservices II) Containerized microservices orchestrated on ECS/Fargate/EKS. We have also worked with multi-tenant corporate PaaS (Platform as a service) with a continuously updated reference architecture. III) Serverless applications using AWS SAM and the Serverless Framework.

• Data Engineering

  We have built scaled out simulation infrastructure on EC2 for backtesting quantative trading strategies on wire captured L2 futures data for a Chicago based market making firm. We have also built custom data pipelines using the pydata ecosystem (pandas, numpy, arrow) at another client. We can rapidly build custom solutions using task scheduling engines like dask, and workflow orchestration tools such as airflow, prefect, kubeflow.

• Cloud Migration and Builds

  We have successfully migrated complex on-premise systems to AWS, including VPN, VPC, routing, and scaled out on on-demand and spot EC2 instances. For a separate client, Infrastructure as Code using Cloudformation templates on multi-stack deployments, using Puppet for configuration.

• Devops, Automation, and Continuous Integration/Deployment

  We use AWS CodePipeline/CodeBuild/Deploy or Jenkins to minimize the time between a code commit and the time its available in production, tested. In addition, we released AppQA.io a dockerized Continuous Integration tool for automated mobile app testing on AWS Device Farm. We automate tasks to reduce human error in critical systems, and implement monitoring and alerting for post release operations.