As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. The successful candidate should possess a strong foundation in Python, Pyspark, SQL, and ETL processes, with a demonstrated ability to implement solutions in a cloud environment.
Position – Senior Data Engineer Experience – 6+ yrs Location – London Job Type – Hybrid, Permanent
Mandatory Skills :
Design, build, maintain data pipelines using Python, Pyspark and SQL
Develop and maintain ETL processes to move data from various data sources to our data warehouse on AWS/AZURE/GCP .
Collaborate with data scientists, business analysts to understand their data needs & develop solutions that meet their requirements.
Develop & maintain data models and data dictionaries for our data warehouse.
Develop & maintain documentation for our data pipelines and data warehouse.
Continuously improve the performance and scalability of our data solutions.
Qualifications :
Minimum 6+ years of Total experience.
At least 4 years of Hands on Experience using The Mandatory skills – Python, Pyspark, SQL.