Experienced Big Data Engineer - Software Development and Team Leadership Opportunity with American Express

Introduction to American Express and Our Technology Team American Express is a global services company that provides customers with access to products, insights, and experiences that enrich lives and build business success. Our technology team is at the forefront of innovation, leveraging cutting-edge technologies to deliver exceptional customer experiences and drive business growth. As a member of our diverse tech group, you will have the opportunity to engineer, code, and develop software that makes us an essential part of our customers' digital lives. Job Overview We are seeking a highly skilled and experienced Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and testing software applications that enable us to process and analyze large datasets. You will work closely with cross-functional teams to identify business requirements and develop solutions that meet those needs. This is a full-time, remote opportunity that offers a competitive salary of $28 per hour and the chance to work with a talented team of professionals who are passionate about technology and innovation. Key Responsibilities Develop and test software applications, including ongoing refactoring of code and driving continuous improvement in code structure and quality Lead a small team of engineers and influence them to achieve their full potential Participate in code reviews and automated testing Troubleshoot basic software components and identify code defects for remediation Enable the deployment, support, and monitoring of software across test, integration, and production environments Automate solutions in test or production environments Scale applications based on demand projections Essential Qualifications Bachelor's degree in Engineering or Computer Science, or equivalent 3+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience working with Hadoop, Hive, Spark (core, SQL, and PySpark) Strong data warehousing concepts Knowledge of financial reporting environment is a plus Expertise in distributed environment Hands-on experience with programming languages such as Core Java or Python/Scala Expertise in Hadoop and Spark architecture and its working principles Hands-on experience with writing and optimizing complex SQL (Hive/PySpark-dataframes), improving joins while handling large amounts of data Experience with UNIX shell scripting Ability to design and develop advanced data pipelines for batch and real-time data processing Preferred Qualifications Knowledge of cloud platforms like GCP/AWS, building microservices, and scalable solutions is a plus 3+ years of experience with designing and building solutions using Kafka streams or pipelines Experience with GitHub/Bitbucket and using CI/CD pipelines Experience with NoSQL databases such as HBase, Couchbase, MongoDB is good to have Excellent technical and analytical skills Good communication skills Exceptional project management skills Career Growth Opportunities and Learning Benefits At American Express, we are committed to helping our employees grow and develop their skills. As a Big Data Engineer, you will have access to a range of training and development opportunities, including online courses, workshops, and conferences. You will also have the chance to work with a talented team of professionals who are passionate about technology and innovation, and who can provide guidance and mentorship as you grow in your career. Work Environment and Company Culture American Express is a dynamic and inclusive workplace that values diversity and promotes a culture of innovation and collaboration. Our technology team is at the forefront of innovation, leveraging cutting-edge technologies to deliver exceptional customer experiences and drive business growth. We offer a range of benefits and perks, including flexible working hours, remote work options, and a competitive salary and benefits package. Compensation, Perks, and Benefits We offer a competitive salary of $28 per hour, as well as a range of benefits and perks, including: Flexible working hours and remote work options Comprehensive health and wellness program Retirement savings plan Paid time off and holidays Professional development opportunities Conclusion If you are a highly skilled and experienced Big Data Engineer who is passionate about technology and innovation, we encourage you to apply for this exciting opportunity. As a member of our technology team, you will have the chance to work on challenging projects, develop your skills, and grow your career. Don't miss out on this opportunity to join a dynamic and inclusive workplace that values diversity and promotes a culture of innovation and collaboration. Apply now to become a part of #TeamAmex!