Senior Data Engineer - Sunnyvale, CA

Company Description

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.

Job Description

Are you seeking an exhilarating opportunity to immerse yourself in the realm of data transformation and integration? Envision yourself as a Software Engineer III, where you'll embark on a captivating journey, orchestrating the seamless fusion of data from diverse sources. With your deft skills, you'll meticulously craft robust data models, ensuring they are the bedrock upon which innovative solutions thrive. In this pivotal role, you'll forge close collaborations with stakeholders, becoming the catalyst that unravels the intricate tapestry of data sources. Your keen eye for quality and your unwavering commitment to data governance practices will pave the way for a future were data reigns supreme. If you're driven by a passion for leveraging data as the cornerstone of business success, and if shaping strategic decisions ignites your soul, then this is the opportunity you've been waiting for. Embrace the challenge of diving headfirst into a role where your expertise transcends mere data architecture; it becomes the driving force behind impactful business outcomes. Join us on this exhilarating journey, where your contributions will resonate across the organization, leaving an indelible mark on the very fabric of data transformation.

About Team:

The Data Sharing & Collab Team helps Suppliers to ingest data in lowest granularity with ease of adoption and always on par with latest Tech stats exploration like Deltashare, Databricks, Snowflake etc. This team will help to grow adoption as the tech expert and share visibility on the product value add.

What You’ll Do:

Data Transformation and Integration: Extract and transform data from databases, create data pipelines, and stay updated on analytics trends
Data Source and Modeling: Identify suitable data sources, perform quality checks, develop and evaluate data models, and design efficient data flows
Code Development and Testing: Write and test code for solutions, develop proofs of concept, deploy software, and document progress
Applied Business Acumen: Translate business requirements into projects, recommend solutions, develop business cases, and align projects with business strategy
Data Governance: Implement and document data governance practices, educate stakeholders, and provide recommendations for improvements

What You’ll Bring:

Understanding of software development lifecycle from planning to deployment
High-level proficiency in Java and Spring Boot
You have a proven track record coding with at least one programming language (e.g., Scala, Python)
You’re experienced in one of cloud computing platforms (e.g., GCP, Azure)
You’re skilled in data modeling & data migration protocols
Experience with containerization technologies WCNP, Docker, and Kubernetes
Experience with GCP, Data warehousing, BI preferred
Experience with the integration tools like Automic, Airflow, Autosys
Experience in building highly scalable Big Data solutions and ETL ecosystems
Working knowledge of CI/CD pipelines
Strong communication skills with the ability to not only understand but also articulate the how and why of a process and solution

Qualifications

Preferred Qualifications and Experience:

Leadership, Scala, Spark, Python
Knowledge of Databricks and Snowflake is an added advantage
Hands on knowledge in NoSQL like Cosmos DB along with RDBMS like MySQL, Postgres is plus
Hands on working experience in any messaging platform like Kafka is preferred
Increase the efficiency of the team by setting right Processes of Software Development, Requirement Intake, Effort Estimation
Demonstrating creative, critical thinking & troubleshooting skills