Senior Data Engineer
- Visionary Tech Services LLC
- Abu Dhabi - United Arab Emirates
- Full-time
وصف الوظيفة
Join Visionary Tech Services (VTS), a fast-paced AI consultancy in Abu Dhabi, as a Data Engineer. In this role, you'll design and build scalable data pipelines and infrastructure to power real-world AI, GenAI, data science, and analytics solutions across various industries. You’ll be a key part of the AI & Data Practice, enabling clean, timely, and governed access to data for machine learning, decision intelligence, and business analytics.
Background:
The ideal candidate is experienced in developing scalable, end-to-end data pipelines across both batch and streaming workloads. You should be strong in API integrations, data engineering standards (e.g., lineage, governance, quality), and capable of working in Agile/Scrum environments. Hands-on expertise in modern lakehouse architectures, Spark, Kafka, Airflow, and the Azure ecosystem is essential. You will work closely with cross-functional teams including AI/ML engineers, analysts, and product teams.
إمتيازات الوظيفة
- Opportunity to work on cutting-edge AI and GenAI projects.
- Exposure to cross-industry data challenges and impactful solutions.
- Clear career progression paths across Associate to Principal levels.
- Hands-on experience with modern data and cloud technologies.
- Work within a collaborative and agile environment with interdisciplinary teams.
- Opportunity to influence enterprise-level data strategy in a growing tech consultancy.
متطلبات الوظيفة
- Develop and maintain batch and streaming data pipelines.
- Automate data quality checks.
- Document data lineage, quality, and governance standards.
- Education:
- Bachelor's or Master’s degree in Computer Science, Software Engineering, Data Engineering, or a related field.
- Technical Skills / Tech Stack:
- Languages & Frameworks: Python, Java, Scala, SQL
- Data Platforms & Tools: Apache Airflow, Apache Spark, Azure Data Factory, Databricks, Snowflake, Delta Lake, Hadoop
- Streaming & Messaging: Kafka
- Databases: MongoDB, Elasticsearch
- DevOps & Infrastructure: Docker, CI/CD, Git
- Governance & Quality: Lineage tracking, data quality frameworks
- Cloud: Azure ecosystem familiarity
- Soft Skills:
- Collaboration
- Communication
- Ownership
- Problem Solving
- Curiosity
