[30119] - Senior Data Engineer - Databricks

Main Responsibilities/Activities

Develop and implement data pipelines for the collection and ingestion of information from various sources.

Create and maintain ETL (Extraction, Transformation, and Loading) systems to ensure data integrity and quality.

Develop solutions for data governance and organization, ensuring compliance with security and privacy policies.

Implement data transformation processes to enable advanced analysis and generation of insights.

Develop and maintain databases, data warehouses, and data lakes for efficient data storage and access.

Collaborate with development teams and data scientists to integrate analytical solutions into existing applications and systems.

Participate in the definition and implementation of scalable and robust data architectures.

Ensure performance and optimization of data systems, seeking continuous improvement.

Work with the team to ensure that best software development practices are followed throughout the data lifecycle.

Stay updated on trends in data technologies, new tools, and methodologies.

Collect, analyze, and interpret data to identify opportunities for optimizing processes and workflows. Use the /Flow strategy, AI and machine learning techniques to predict demand patterns, identify bottlenecks, and propose solutions that improve operations and data-driven decision-making.

At position map level 4 (Senior), you can assist in team management by providing guidance, support, and direction for the development of activities and careers.

Skills Needed

Strong experience as a Data Engineer

5+ Years experience with Python

Strong Databricks…