Job Summary:The Data Engineer will support a strategic banking client by designing and implementing tailored data solutions across streaming, data lakes, analytics, and hybrid environments.
This role is part of the Data & AI practice and involves hands-on development of data pipelines, performance tuning, and collaboration across diverse technical stacks.
The ideal candidate will have strong experience in Python, SQL, and cloud platforms.
Key Responsibilities:- Design and implement data solutions tailored to customer use cases across various platforms.
- Recommend appropriate technologies and solutions from application to infrastructure layers.
- Develop components in Python for unified data pipeline frameworks.
- Collaborate across technical stacks including Cloudera, Databricks, Snowflake, Azure, and AWS.
- Establish and support CI/CD pipelines and testing frameworks.
- Monitor and optimize query and data load performance.
- Assist during QA and UAT phases to validate and resolve issues.
- Develop SQL-based data validation, reporting, and analysis.
- Generate solution documentation including diagrams and system views.
- Adhere to Agile practices throughout development.
- Design, build, and deploy databases and data stores.
Required Qualifications:- Minimum 5 years of experience in data engineering or related roles.
- 4+ years of experience in complex data environments with large volumes.
- 3+ years of experience with SQL/PLSQL for data analysis.
- 3+ years of experience developing data pipelines using Python and libraries like Pandas, NumPy, PySpark.
- 2+ years of experience in hybrid data environments (on-prem and cloud).
- Experience with structured, semi-structured, and unstructured data integration.
- Performance tuning experience for SQL queries, Spark jobs, and stored procedures.
- Understanding of E-R data models (conceptual, logical, physical).
- Strong analytical and communication skills.
- Ability to manage multiple projects and resolve competing priorities.
Preferred Qualifications:- Experience in financial services.
- Knowledge of regulatory requirements in the financial industry.
Education: Bachelors Degree
