A hybrid Data & ML role at Brillio.
How Sydicom helps: we read this listing’s requirements and tune your CV and cover letter to the keywords its ATS (Lever) is scanning for, for candidates in India, then help you apply.
Original listing text, shown exactly as published by the company.
Job Description – Data Engineer (Databricks)
Company: Brillio Technologies
Role: Data Engineer – Databricks
Experience: 5–10 Years
Location: India (Hybrid/3 days)
Employment Type: Full-time
Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and PySpark
Build and optimize data lakehouse architectures (Bronze–Silver–Gold layers)
Develop data ingestion frameworks from multiple sources (batch & real-time)
Implement Delta Lake features including schema evolution, ACID transactions, and optimization
Create and manage Databricks notebooks, workflows, and jobs for production pipelines
Ensure data quality, governance, and lineage across pipelines
Optimize Spark jobs for performance (partitioning, caching, tuning)
Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)
Support production deployments, monitoring, and troubleshooting of data pipelines
Contribute to migration of legacy data platforms to modern cloud-based architecture
Databricks (Workflows, Notebooks, Jobs)
PySpark / Spark SQL
SQL & Data Warehousing concepts
Delta Lake / Lakehouse architecture
Data pipeline development & orchestration
Data modeling, ETL/ELT processes, SCD concepts
Cloud & Tools
AWS (S3, Glue, EMR) / Azure (ADF, ADLS, Synapse)
Airflow / Databricks Workflows
Git / CI-CD pipelines
Good to Have
Streaming frameworks (Kafka / Spark Streaming)
DBT / Snowflake / Redshift / Fabric
Unity Catalog, Autoloader, Delta Live Tables
5–10 years of experience in Data Engineering
Minimum 2–4 years of hands-on Databricks experience
Proven experience building enterprise-scale data platforms and pipelines
Soft Skills
Strong problem-solving and analytical skills
Ability to work in a fast-paced, agile environment
Good communication and stakeholder management
Brillio
Data & ML
106 open roles on Sydicom
Brillio is an Indian-owned company focused on digital technologies and big data analytics headquartered in Santa Clara, California, United States.
Source: Wikipedia
