Data Engineer | AI-Assisted Data Automation

Experienced Data Engineer responsible for designing, developing, maintaining, and optimising scalable data pipelines and ETL/ELT workflows across cloud and big-data environments. Skilled in Python, SQL, PySpark, Bash, AWS, Databricks, Hadoop/Cloudera, HDFS, and data warehousing.

Leverage AI-assisted engineering to automate repetitive development and operational activities, including SQL and PySpark code generation and optimisation, production troubleshooting, log analysis, legacy-code modernisation, data-quality validation, and pipeline error diagnosis. Use AI to accelerate root-cause analysis and improve the reliability, maintainability, and efficiency of data pipelines while maintaining engineering validation and production controls.

Key responsibilities include data ingestion, transformation, cleansing, data modeling, pipeline orchestration, performance optimization, monitoring, troubleshooting, and loading curated data into analytical data warehouses.