Data Platform Architect (Databricks)

About usGetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with Xebia Group to broaden our horizons and bring new international opportunities. What about the projects we work with? We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e.g., media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories here. What else do we do besides working on projects? We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference Big Data Technology Warsaw Summit, meetup Warsaw Data Tech Talks, Radio Data podcast, and DATA Pill newsletter. Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career. If you want to be up to date with the latest news from us, please follow up on our LinkedIn profile. About roleA core part of our value proposition in projects we do is to bring the best expert knowledge in the applications of Big Data & AI. We mentor clients on what problems they can solve with modern technologies, how to architect and implement reliable solutions with the best engineering standards, and how to deliver them effectively. Being a solution architect is to be the ambassador of the company by setting technological direction, roadmap, architecture, and feasibility in multiple projects, especially at their earliest stages. The goal is to make sure our clients get the best possible solution to their real-world challenges and a path to get there. ResponsibilitiesBuilding a Data Platform in the Azure cloud providing multiple Data teams with the ability to start and maintain projects in an automated fashionMentoring and delegating tasks to 2-3 engineers who will help in building the Data PlatformEvaluating and optimizing costs for Databricks workloadsSelecting and configuring clusters tailored to specific workload requirementsIntegrating Databricks into the existing Azure network setupAutomating the deployment and management of Databricks environments using Azure DevOps PipelinesUsing Terraform as the primary Infrastructure as Code (IaC) tool for managing resourcesImplementing secure data-sharing solutions within DatabricksRequirementsExtensive experience working with Azure cloud providerGreat knowledge of DevOps practices and tools, including Docker, Terraform, CI/CDExperience working with Databricks platformStrong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data ScienceGreat fundamental knowledge of Software Engineering, Data Engineering, building whole data platforms and solutionsUnderstanding complexity and relationships between businesses, suppliers, partners, competitors, and clientsExperience or interest in working with and using large-scale data to solve valuable business problemsExperience in preparing presentations, design documents, and architecture diagramsWe offerSalary: 200 - 240 PLN net + VAT/h B2B (depending on knowledge and experience)100% remote workFlexible working hoursPossibility to work from theGetInData/@52.2073309,21.0203922,17z/data=!3m1!4b1!4m5!3m4!1s0x471ecdc18e5ac003:0x6aded9a33a66f053!8m2!3d52.2073309!4d21.0225809'>officelocated in the heart of WarsawOpportunity to learn and develop with the best Big Data expertsInternational projectsPossibility of conducting workshops and trainingCertificationsCo-financing sport cardCo-financing health careAll equipment needed for workOriginally posted on Himalayas Apply To this Job