Job Overview
The Cloud Data Enablement Engineer is responsible for the management and evolution of state-of-the-art systems for Arrowstreet Capital. The individual will work within an energetic team to drive automation via Infrastructure as Code (IaC) and help design and implement cloud native data solutions. The ideal candidate will be self-driven and team oriented. The placed candidate will be surrounded by individuals who are committed to helping each other grow both personally and professionally. This role presents an ideal opportunity for an engineer looking to work on the latest technology, make a significant impact, and deal with large amounts of data.
Responsibilities
- Design, deploy and maintain scalable, highly available, secure, and fault tolerant systems on AWS
- Design and implement scalable and fault-tolerant data architectures on cloud platforms using SQL and NoSQL databases
- Build and maintain data pipelines for ingesting structured and unstructured data from various sources (databases, APIs, streaming data, etc.) into cloud-based data lakes or data warehouses.
- Knowledge of data warehousing concepts, dimensional modeling, and data modeling techniques.
- Understanding of data security, governance, and compliance
- With Infrastructure as Code in mind, work towards refining or writing CI/CD pipelines for complete automation (including testing)
- Revise and/or propose solutions for continuous improvements in cloud cost management, health checks, security, monitoring, and control.
- Assist teams with troubleshooting at different layers of cloud-native applications
Qualifications
- Bachelor’s degree in computer science, systems analysis or a related study, or equivalent experience
- 5+ years of experience in configuring and tuning cloud services (AWS, GCP, Azure), with AWS preferred.
- 5+ years of experience in re-writing/re-platforming MS SQL Server database to AWS data services like AWS Redshift, AWS Aurora PostgreSQL, S3(parquet) or DynamoDB
- 3+ years of experience in developing and optimizing data transformation processes using tools like Apache Spark or cloud-native services (e.g., AWS Glue, EMR).
- Demonstrated competency with at least 2 of the AWS data services: AWS Redshift, Aurora PostgreSQL, DynamoDB (or MongoDB), AWS Glue (or EMR)
- 2+ years of experience in building resilient CI/CD pipelines, strong knowledge of Git, and familiarity with a DevOps platform like GitLab, Jenkins or Bitbucket.
- 2+ years of experience in container technologies like Docker, Kubernetes.
- 2+ year experience with writing Infrastructure as Code with python/terraform/cloud formation
- Good understanding of the Linux operating system and networking concepts.
- Familiarity with tools like AWS OpenSearch, Prometheus, CloudWatch, CloudTrail, IAM resource and role policies
- Prior AWS Certifications would be a plus
- Previous experience writing cloud-native applications using AWS SAM (or serverless), Lambda, Step Functions and/or DynamoDB would be a plus
We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude, and initiative.
We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude and initiative.