Databricks Architect
Plovdiv, BG Sofia, BG Varna, BG
Adastra is a global IT company, offering premier class services and solutions in the area of Information Management. We work in international teams and on projects for leading global financial, automotive, telecommunications and insurance pioneers. We pride ourselves in accepting the challenge of mastering new technologies with each new task and in empowering our clients in achieving results. What gives us satisfaction is the opportunity to apply innovation in our jobs daily, inclusive of new areas such as Big Data, Artificial Intelligence, Internet of Things, Blockchain, Cloud, Data Monetization and Robotic Process Automation.
We are seeking a Databricks Architect to design, build, and optimize enterprise-scale data platforms using Databricks and related technologies. You will translate business requirements into scalable data architectures, drive best practices for performance, security, and cost optimization, and collaborate with engineering, analytics, and infrastructure teams to deliver production-ready solutions.
Responsibilities
- Design and implement scalable data platforms and architectures using Databricks, Delta Lake, and Apache Spark.
- Develop and optimize ETL/ELT pipelines for batch and streaming workloads with a focus on performance and reliability.
- Define cluster sizing, configuration, and cost-control strategies; monitor and tune resource utilization.
- Establish best practices for data modeling, schema design, partitioning, and Delta Lake transaction management.
- Implement security, governance, and access controls (encryption, role-based access, Unity Catalog or equivalent).
- Create CI/CD processes and automation for notebooks, jobs, infrastructure-as-code, and deployments.
- Lead proof-of-concepts, evaluate new Databricks features (Delta Live Tables, Auto Loader, Photon, etc.), and recommend improvements.
- Collaborate with stakeholders (data engineers, ML engineers, product owners, and SREs) and mentor team members on Databricks patterns and practices.
Requirements
- 7+ years of professional experience in data engineering or platform roles (or equivalent) with demonstrable Databricks experience.
- Hands-on experience building production pipelines using Databricks/Apache Spark, Delta Lake, and SQL.
- Proficient in Python and/or Scala for Spark development; strong SQL skills.
- Experience with one or more public clouds (AWS, Azure, or GCP) and their managed Databricks offerings.
- Familiarity with data governance, security controls, and role-based access in a cloud data platform.
- Experience implementing CI/CD for data workloads and infrastructure-as-code (Terraform, ARM, or CloudFormation).
- Strong debugging and performance tuning skills for Spark jobs and Databricks clusters.
- Good communication skills and experience working with cross-functional teams to translate business needs into technical solutions.
- Experience with Delta Live Tables, Unity Catalog, Auto Loader, or Photon.
Nice to Have
- Databricks certifications (e.g., Databricks Certified Data Engineer).
- Knowledge of streaming technologies (Structured Streaming, Kafka, Kinesis).
- Exposure to ML platform patterns, MLflow, or MLOps practices.
- Experience migrating workloads to Databricks from legacy Hadoop or on-prem systems.
- Familiarity with cost management and optimization strategies for cloud data platforms.
What Adastra can offer you:
-
Diverse career growth opportunities
-
Extensive portfolio of technical trainings
-
Access to certification programs
-
Leadership and soft skills trainings
-
Exposure to challenging projects in an international environment
-
Opportunity to work with the latest technologies in the Data field
-
Multicultural, dynamic, and learning-focused working environment
-
Extended Additional Health insurance package
-
Multisport cards
-
Additional annual paid leave days
-
Opportunity to work from home
-
Recharge program for a better balance between work and personal commitments
-
Referral bonus program
-
Corporate social and charity initiatives and Events
-
Regular team buildings and office parties
-
Three office locations in Bulgaria with a relax and gaming area
Are you ready to join a dynamic team of Information Management professionals committed to deliver best-in class solutions and services to the world’s leading organizations? Apply now or send your resume in English. We thank all interested applicants and will only contact a short list of them.