13.3333px; background-color: rgb(255, 255, 255);">Must have skills:

• Kafka integration to Databricks
  
• Structured Streaming concepts ( Processing modes , output modes , checkpointing )
  
• Medallion Architecture (Bronze, Silver, Gold layers)
  
• Databricks Autoloader
  
• Experience working with large volumes of data
  
• Performance optimization techniques (partitioning, caching, cluster tuning)
  
• Client facing experience