Introduction to Walmart and the Role
Imagine being part of a team that combines innovation, technology, and retail to make a significant impact on millions of people's lives. At Walmart, we're not just the world's leading retailer; we're a hub for technological advancements, data-driven insights, and customer-centric experiences. Our Publicizing Innovation group is at the forefront of connecting supplier brands with retail customers on an unprecedented scale. We're a dynamic team of experts and data scientists working in an agile environment to solve complex, high-impact problems. As a Senior Data Engineer, you'll play a crucial role in building the next-generation omni-marketing platforms to deliver performance and value at scale.
Job Overview
This role is an integral part of our Showcase Advertisements Server engineering team for Backend Services. As a Senior Data Engineer, you will be responsible for developing information pipelines to consolidate log data produced by our various backend microservices, extending existing data pipelines, and integrating new data sources to drive new insights. Your expertise will be invaluable in fostering data quality checks, constructing data quality dashboards, and leading high-visibility projects across the organization. Additionally, you will mentor and guide mid-to-junior engineers, showcasing your exceptional coding skills and experience.
Key Responsibilities
- Develop information pipelines to consolidate log data from various backend microservices.
- Extend existing data pipelines and integrate new data sources to drive new insights.
- Foster data quality checks to identify data gaps and inform upstream teams.
- Construct data quality dashboards to monitor data quality.
- Lead high-visibility projects across the organization, driving alignment with different groups.
- Mentor and guide mid-to-junior engineers, sharing your expertise and experience.
- Demonstrate exceptional coding skills, contributing to the development of our cutting-edge omni-marketing platforms.
Essential Qualifications
To succeed in this role, you'll need:
- A Bachelor's or graduate degree in Computer Science or a related field.
- At least 2+ years of experience in developing large data technologies/data pipelines.
- Proficiency in at least one programming language (Python, Java, etc.).
- Advanced Data Management skills, with the ability to manage and control large datasets (in the order of terabytes).
- Experience with big data technologies like Hadoop, Apache Spark, Apache Hive, or similar systems.
- Data Integration skills, with the ability to integrate data from multiple sources.
- Solid data modeling skills, with the ability to design a schema that can accommodate the growth of data sources and facilitate seamless data joins across different datasets.
- Database Management experience, with the ability to handle the storage and retrieval of massive amounts of data efficiently.
- Data Cleansing and Transformation skills, with the ability to clean and transform data from various sources into a standardized format.
- Query Optimization skills, with the ability to optimize queries to achieve better performance and reduce processing times.
- Distributed Computing knowledge, with an understanding of the principles of distributed computing.
- Data Security and Compliance knowledge, with an understanding of data security and compliance best practices.
- Strong analytical and problem-solving skills, with the ability to identify and resolve issues that may arise during the data integration and mapping development process.
- Effective communication and collaboration skills, with the ability to work in a team environment and coordinate efforts between various stakeholders engaged in the project.
- A willingness to learn and adapt to new technologies and procedures, with a commitment to continuous learning and professional development.
Preferred Qualifications
While not essential, the following qualifications are highly desirable:
- Experience with technologies such as HDFS, Spark/Hive, Kafka, Apache Parquet, Avro, GCS, GCP, BigQuery, and Python.
- A strong understanding of data architecture and data governance principles.
- Experience with agile development methodologies and version control systems such as Git.
- A certification in data engineering or a related field.
Career Growth Opportunities and Learning Benefits
At Walmart, we're committed to helping you grow your career and develop new skills. As a Senior Data Engineer, you'll have access to:
- Professional development opportunities, including training and certification programs.
- Mentorship and guidance from experienced engineers and leaders.
- Opportunities to work on high-impact projects and contribute to the development of our cutting-edge omni-marketing platforms.
- A collaborative and dynamic work environment, with a team of experts and data scientists.
- Flexible working arrangements, including remote work options.
Work Environment and Company Culture
At Walmart, we're proud of our company culture, which is built on a foundation of:
- Integrity, with a commitment to doing what's right and acting with ethics and integrity.
- Respect, with a focus on valuing and respecting each other's differences and perspectives.
- Excellence, with a commitment to achieving excellence in everything we do.
- Innovation, with a focus on embracing new ideas and technologies to drive growth and improvement.
Compensation, Perks, and Benefits
As a Senior Data Engineer at Walmart, you can expect:
- A competitive salary of $26/hour.
- A comprehensive benefits package, including health insurance, retirement savings, and paid time off.
- Opportunities for professional development and growth, including training and certification programs.
- A dynamic and collaborative work environment, with a team of experts and data scientists.
- Flexible working arrangements, including remote work options.
Conclusion
If you're a motivated and experienced data engineer looking for a new challenge, we encourage you to apply for this exciting opportunity. As a Senior Data Engineer at Walmart, you'll have the chance to work on high-impact projects, develop new skills, and contribute to the development of our cutting-edge omni-marketing platforms. Don't miss out on this opportunity to join our team and help shape the future of retail. Apply today!
Apply Now
Apply Now