SE_Data Engineer_Senior

Strong hands-on experience building scalable data pipelines in Microsoft Azure using services like Data Factory, Databricks, and Blob Storage. Advanced proficiency in Python and PySpark for transforming large datasets and handling structured/unstructured service contract data. Experience with streaming and batch processing, including event-driven architectures (e.g., Service Bus, Kafka equivalents). Solid understanding of data modeling and optimization in Azure Databricks (Delta Lake, partitioning, performance tuning). Ability to implement robust CI/CD pipelines (Azure DevOps) and ensure data quality, monitoring, and reliability in Production. API integration & system integration Ability to connect AI models with systems. Must be located in Gothenburg