Databricks Azure Engineer

Databricks Azure Engineer
Job Title: Databricks Azure Engineer Experience: 8+ Years Job Location: Santa Clara, CA (Onsite)

Job Description

  • Hands on experience in Databricks stack
  • Data Engineering technologies (Ex: Spark, Hadoop, Kafka etc.)
  • Must be proficient in Streaming technologies
  • Hands on in Python, SQL
  • Expertise in implementing Data warehousing solutions
  • Expertise in Any ETL tool i.e. (SSIS, Redwood)
  • Good understanding on submitting jobs using Workflows, API & CLI
  • Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks
  • Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
  • Highly proficient in using the spark framework (python and/or Scala)
  • Programming experience in Scala or Python, SQL
  • Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably in Databricks).
  • Hands on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Experience with ingestion tools (nifi/azure cloud factory
  • Experience with big data technologies (Hadoop)
Back to blog