We are seeking a Data Engineer with strong experience in Apache Kafka, Apache Spark, Python, DBT, Airflow, and SQL to build and maintain batch and streaming data pipelines across private cloud and on-premise environments. The role involves data ingestion, ETL transformations, data quality validation, CDC/event streaming, and near real-time processing from multiple data sources. Experience in Payments or Banking domains is preferred, along with hands-on expertise in modern data engineering and pipeline development. Knowledge of technologies such as Apache Flink, Trino, Oracle SQL/PLSQL, IBM MQ, and Qlik Replicate is a plus.

 

Must Have Skills

• Apache Kafka,  Apache Spark, Python, DBT, Airflow, SQL, SDK
• Domain : Work experience in  Payments industry(Preferred) or Banking / regermination
• Hands on experience, building data pipelines

Nice to have: Apache Flink Trino, superset, Oracle SQL,PL/SQL, Qlik Replicate, IBM MQ,
Private Cloud/ on Prem*

Responsibilities

• Create data Ingestion/Acquisition and processing pipelines from different sources and environment     
• Batch Engineering: Batch ingestion of sources (Oracle, PostgreSQL, files), ETL transformations, data quality checks, and unit testing.
• Streaming Engineering:   -CDC and business event ingestion - near real-time  streaming - Schema management and fault tolerance.               

Soft skills

• Good communication skills (both written/verbal) mandatory 
• Oriented towards customer needs and problem solving;
• Willingness to understand and master very complex business applications
• Ability to work quickly and accurately, within a team, or on an individual basis, under pressure with tight deadlines
• Excellent communication skills

Why Join Us?

• Competitive compensation and benefits.
• A collaborative, tech-driven team culture.