Experienced Remote Big Data Lead Engineer – Cloud-Based Data Engineering Solutions Development and Implementation

Introduction to Workwarp and the Big Data Industry Workwarp, in partnership with leading global banks like Citi, is at the forefront of the big data revolution, leveraging cutting-edge technologies to drive business growth and economic progress. As a trusted partner to clients worldwide, our mission is to provide responsible financial services that enable growth and prosperity. The big data industry is rapidly evolving, with an increasing demand for skilled professionals who can design, develop, and implement innovative data engineering solutions. If you're passionate about big data and cloud technologies, and you're looking for a challenging and rewarding career opportunity, we invite you to join our team as a Big Data Lead Engineer. Job Highlights and Responsibilities As a Big Data Lead Engineer at Workwarp, you will play a critical role in designing and developing big data solutions using next-generation data techniques. You will work closely with domain experts, product managers, analysts, and data scientists to develop big data pipelines in Hadoop or Snowflake, and deliver data as a service framework. Your responsibilities will include: Partnering with cross-functional teams to develop big data pipelines and analytics platforms Designing, developing, and optimizing large-scale data processing systems and analytics platforms Working with data scientists to build client pipelines using heterogeneous sources and providing engineering services for data science applications Ensuring automation through CI/CD across platforms, both in cloud and on-premises Researching and assessing open-source technologies and components to recommend and integrate into the design and implementation Mentoring other team members on big data and cloud tech stacks Defining needs around maintainability, testability, performance, security, quality, and usability for data platforms Driving implementation, consistent patterns, reusable components, and coding standards for data engineering processes Tuning big data applications on Hadoop and non-Hadoop platforms for optimal performance Evaluating new IT developments and evolving business requirements, and recommending appropriate systems alternatives and/or enhancements to current systems Essential and Preferred Qualifications To be successful in this role, you should have: 8+ years of experience in Hadoop/big data technologies 2-4 years of experience in Kafka streaming development, including design, development, implementation, and validation of real-time data streaming solutions 2-4 years of experience in API and microservices development, designing, building, and maintaining scalable, secure, and high-performance microservices architecture and API solutions 2-4 years of experience as a Python developer, with expertise in automation testing, designing, developing, and automating robust software solutions and testing frameworks Experience in managing and implementing successful projects Subject Matter Expert (SME) in at least one area of Applications Development Ability to adjust priorities quickly as circumstances dictate Demonstrated leadership and project management skills Consistently demonstrates clear and concise written and verbal communication Preferred qualifications include a Master's degree in a relevant field and experience working in a cloud-based environment. Skills and Competencies To excel in this role, you should possess: Strong technical skills in big data technologies, including Hadoop, Kafka, and Spark Experience with cloud-based platforms, such as AWS or Azure Excellent problem-solving and analytical skills Strong communication and collaboration skills Ability to work in a fast-paced environment and adapt to changing priorities Strong leadership and mentoring skills Experience with agile development methodologies and version control systems, such as Git Career Growth Opportunities and Learning Benefits At Workwarp, we're committed to helping our employees grow and develop their careers. As a Big Data Lead Engineer, you'll have access to: Opportunities to work on challenging and complex projects, using cutting-edge technologies Professional development and training programs, to help you enhance your skills and knowledge Mentorship and coaching from experienced professionals in the field Opportunities to collaborate with cross-functional teams and contribute to the development of innovative solutions A culture that encourages innovation, creativity, and experimentation Work Environment and Company Culture At Workwarp, we're proud of our diverse and inclusive culture, which values and respects the contributions of all employees. Our work environment is dynamic and fast-paced, with a focus on collaboration, innovation, and teamwork. We offer a range of benefits and perks, including: Competitive salary and bonus structure Comprehensive health and wellness programs 401(k) and retirement savings plans Paid time off and vacation days Opportunities for professional development and growth Compensation, Perks, and Benefits We offer a competitive compensation package, including a salary range of $125,760 - $188,640 per year, depending on experience. In addition to salary, we offer a range of benefits and perks, including medical, dental, and vision coverage, life insurance, and a 401(k) plan. We also offer paid time off, vacation days, and opportunities for professional development and growth. Conclusion and Call to Action If you're a motivated and experienced big data professional, looking for a challenging and rewarding career opportunity, we encourage you to apply for the Big Data Lead Engineer position at Workwarp. With your skills and experience, you'll play a critical role in driving business growth and innovation, and contributing to the development of cutting-edge big data solutions. Don't miss this opportunity to join our team and take your career to the next level. Apply today! Apply for this job