Databricks Data Engineer
BG Plovdiv, BG Varna, BG Sofia, BG
Adastra is a global IT company, offering premier class services and solutions in the area of Information Management. We work in international teams and on projects for leading global financial, automotive, telecommunications and insurance pioneers. We pride ourselves in accepting the challenge of mastering new technologies with each new task and in empowering our clients in achieving results. What gives us satisfaction is the opportunity to apply innovation in our jobs daily, inclusive of new areas such as Big Data, Artificial Intelligence, Internet of Things, Blockchain, Cloud, Data Monetization and Robotic Process Automation.
Responsibilities:
- Design and implement data pipelines and data transformation using Databricks
- Develop and maintain CI/CD pipelines using GitHub Actions and Terraform
- Collaborate with software development teams to integrate data solutions into applications
- Optimize data solutions for performance, scalability, and reliability
- Utilize Spark and Python to process and analyze large datasets
- Implement and manage Lakehouse or Data mesh architectures
- Ensure data quality and integrity through comprehensive testing and validation
- Monitor, troubleshoot, and resolve data pipeline issues
- Stay updated with the latest industry trends and best practices in data engineering
Requirements:
- Hands-on experience with Databricks
- Experience with CI/CD and Terraform
- Strong software development skills
- Extensive experience with Spark and Python
- Familiarity with GitHub Actions, including Repos and Pipelines
- Excellent problem-solving and analytical skills
- Strong communication and teamwork abilities
- Good English communication skills
Nice-To-Have:
- Databricks account administration experience
- Azure DevOps, Unity Catalog, and Azure Data Factory knowhow
- Understanding of Lakehouse and/or Data mesh architectures
What Adastra can offer you:
-
Diverse career growth opportunities
-
Extensive portfolio of technical trainings
-
Access to certification programs
-
Leadership and soft skills trainings
-
Exposure to challenging projects in an international environment
-
Opportunity to work with the latest technologies in the Data field
-
Free German language classes
-
Multicultural, dynamic, and learning-focused working environment
-
Extended Additional Health insurance package
-
Multisport cards
-
Additional annual paid leave days
-
Opportunity to work from home
-
Recharge program for a better balance between work and personal commitments
-
Referral bonus program
-
Corporate social and charity initiatives and Events
-
Regular team buildings and office parties
-
Three office locations in Bulgaria with a relax and gaming area
Are you ready to join a dynamic team of Information Management professionals committed to deliver best-in class solutions and services to the world’s leading organizations? Apply now or send your resume in English. We thank all interested applicants and will only contact a short list of them.