Data Engineer

The Data Platform team is responsible for the overall data management effort at Tradeweb, a part of LSEG.  As a data engineering team our focus is on data pipeline development, data infrastructure management, and data quality maintenance.  We handle a wide portfolio of applications in the analytics space, serving the reporting needs for both internal and external consumers. Working with both business and technology partners, we are ultimately responsible for maintaining the consistency, availability and accuracy of the data within these systems, ensuring that we deliver high quality views into our enterprise data for all customers.
 

Job Responsibilities 

• Develop Tradeweb’s data platform based on open source software and cloud services.
• Build DAG-based batch and stream pipelines applying a variety of technologies as AWS, Kafka, Spark, Databases, and Containers.
• Ensure at all times the integrity, precision, and quality of Tradeweb’s historic and realtime data that flows through the platform.
• Define schemas, test and deploy software in various environments, and setup related monitoring.
• Help develop machine learning development frameworks and pipelines.
• Support significant production services and user requests.

Qualifications

• 3+ years of experience in a Data Engineering role.
• Strong software engineering expertise in Python and containerized ecosystems.
• Familiarity with standard methodologies in python code and the ability to craft and debug scalable, parallelized systems.
• Good experience working with SQL and knowledge of query optimization techniques.
• Familiarity with a variety databases such as MySQL, SQL Server, Snowflake, Redshift, Presto, etc.
• Experience building batch and stream processing pipelines using Kafka, Spark, Flink, Airflow/Prefect, etc.
• Familiarity with data science stack: e.g. Juypter, Pandas, Scikit-learn, Dask, Pytorch, MLFlow, Kubeflow, etc.
• Experience with using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.) and Linux in production.
• Ability to look after ambiguity and pinpoint production issues quickly.
• Strong proclivity for automation and DevOps practices.
• Experience with leading growing data volume, velocity and variety.
• Agile, self-starter and is passionate about getting things done.
• Good communicator.
• Participate in on-call outside of regular business hours.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. You will be part of a collaborative and creative culture where we encourage new ideas and are committed to sustainability across our global business. You will experience the critical role we have in helping to re-engineer the financial ecosystem to support and drive sustainable economic growth. Together, we are aiming to achieve this growth by accelerating the just transition to net zero, enabling growth of the green economy and creating inclusive economic opportunity.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.