Senior Data Engineer
ClickUp
ClickUp is seeking a Senior Data Engineer to shape and scale their modern data platform, utilizing AWS serverless technologies, Snowflake, dbt, and Terraform. The role involves designing reliable data pipelines and enabling AI-driven applications, contributing to a bold and innovative team focused on redefining productivity in the workplace.
Qualification
- Experience with AWS serverless technologies and services.
- Proficiency in Snowflake and dbt for data transformation.
- Strong knowledge of Terraform for infrastructure as code (IaC).
- Experience in building and optimizing data pipelines.
- Familiarity with CI/CD practices and automation of deployments.
- Ability to monitor and improve system performance with observability tools.
- Strong collaboration skills to work with cross-functional teams.
Responsibility
- Design, build, and maintain cloud-native data infrastructure using Terraform for IaC.
- Develop and optimize data pipelines leveraging AWS services (Lambda, Fargate, Step Functions, S3, Kinesis, DynamoDB, Aurora, etc.) and Snowflake.
- Implement ELT workflows within dbt in partnership with the Analytics Engineering function.
- Build and maintain LLM frameworks, ensuring high-quality and cost-effective outputs.
- Automate infrastructure and pipeline deployments with CI/CD best practices.
- Monitor, debug, and improve system performance with strong observability and logging practices.
- Partner with cross-functional teams (analytics, data science, product, engineering) to deliver high-quality data solutions.
- Mentor teammates and contribute to engineering standards, raising the technical bar across the team.
