DRW: Senior Data Engineer
United Kingdom 1+ months ago
Job Description
Headquarters:Chicago, Illinois
URL:https://www.drw.com/
As a Senior Data Engineer on our Unified Platform team, you will play an integral role in designing and building an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.
Technical requirements summary:
Have experience designing and building data-intensive distributed systems
Have experience working within the modern batch and streaming data ecosystems
An expert in Java/Scala or Python and have experience with SQL and Bash
Able to own, organize, and steer team projects
Be able to contribute to project management and project reporting
Be a leader/mentor to junior members of the team concerning engineering best-practices and code-quality
What you will do in this role:
Help design, build, and manage DRW's Unified Data Platform and support its users.
Work closely with Traders and Researchers to determine appropriate data sources and implement processes to onboard and manage new data sources for analysis to unlock future trading opportunities.
Design and develop data solutions to help discover, purchase, organize, track usage, manage rights, and control quality of data sets to address the needs of various DRW trading teams and strategies.
Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Contribute to the monitoring and quality control software and processes.
What you will need in this role:
7+ years of experience working with modern data technologies and/or building data-intensive distributed systems
Expert level skills in Java/Scala or Python with a proven ability to output high-quality, maintainable, code
Strong familiarity with SQL and Bash
Experience leveraging and building cloud-native technologies for scalable data processing.
Prior experience with both batch and streaming systems and an understanding of the limitations those paradigms impose
Experience with an array of data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)
Experience with an array of data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.)
Experience with an array of data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)
Experience managing complex data ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)
Prior experience dealing with schema governance and schema evolution
Prior experience developing data quality control processes to detect data gaps or inaccuracies
A desire to mentor less experienced team-members and champion both engineering best-practices and high code-quality standards.
Strong technical problem-solving skills
Proven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environment
The annual base salary range for this position is $180k to $250x, depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.
To apply:https://weworkremotely.com/remote-jobs/drw-senior-data-engineer
Funko: Senior Android Engineer
United Kingdom 8 days ago
Headquarters:Everett Washington URL:https://funko.com As a Senior Android Engineer, you will work alongside a small team of engineers, creatives, and project managers to build mobile apps that connect fans and collectors to the exciting world of...
Graduate Engineer
London, United Kingdom 10 days ago
Graduate Engineer Dublin€39,000 - €44,000 Travel Allowance Holidays Pension Private Healthcare Accommodation Covered Immediate Start Are you a recent engineering graduate looking to launch your career with a leading main contractor? This is a unique...
Senior CRM Engineer
United Kingdom 10 days ago
This is a fantastic opportunity to build your career in the exciting and innovative world of data, insight, and digital multi-channel CRM Marketing for a market leading international company. For more information, and to apply, please refer to the...
(GBR-Huddersfield) Senior Site Quality Engineer
United Kingdom 11 days ago
**DESCRIPTION** We are looking for a talented **Senior Site Quality Engineer** to join us at our **Quality Audit Department** in **UK, Huddersfield** This role will be fully onsite in Huddersfield. **In this role, you will make an impact in the...
Cambridge University Press&Assessment: Senior Data Engineer
Cambridge, East of England 11 days ago
£54,600 - £73,650 + benefits:
Cambridge University Press&Assessment:Our Applied AI team is looking for a Senior Data Engineer to help develop the data infrastructure that powers cutting-edge educational solutions.Cambridge, UK (Hybrid)
Cambridge University Press&Assessment: Head of Security Governance, Risk&Compliance
Cambridge, East of England 11 days ago
£70,400 - £94,100 + benefits:
Cambridge University Press&Assessment:Our Applied AI team is looking for a Senior Data Engineer to help develop the data infrastructure that powers cutting-edge educational solutions.Cambridge, UK (Hybrid)
Codeable: Senior Back-end engineer (Ruby/Rails)
United Kingdom 12 days ago
Headquarters:Klampenborg, Denmark URL:https://www.codeable.io/ About Codeable Codeable connects a community of elite WordPress development experts from around the world with businesses that need a WordPress site built, developed, maintained, fixed,...
CData Software: Senior DevOps/Platform Engineer (remote)
United Kingdom 12 days ago
Headquarters:Berlin URL:https://vonq.io/3EfeIjS OverviewCData Virtuality is a strong data integration and management solution and Product Unit of CData Software. We are known for our powerful data virtualization capabilities that enable companies to...
CData Software: Senior Software Support Engineer (remote/US timezones)
United Kingdom 12 days ago
Headquarters:Chapel Hill URL:https://vonq.io/4jdgCAA OverviewCData Virtuality is a strong data integration and management solution and Product Unit of CData Software. We are known for our powerful data virtualization capabilities that enable...
CardNexus: Senior Backend Engineer
United Kingdom 18 days ago
Headquarters:Bordeaux, France URL:https://www.cardnexus.com Role Overview As a Senior Backend Engineer at CardNexus, you'll play a pivotal role in designing and implementing the architecture for our all-in-one TCG platform. As an early employee,...