Data Engineer
About the role
As a Data Engineer at Sporty, you will play a critical role in ensuring the smooth processing and handling of data for our machine learning and data science initiatives. Your primary responsibilities will include designing, building, testing, optimising, and maintaining data pipelines and architectures for various aspects of our rapidly growing business.
What you'll be doing
Design, develop and maintain scalable batch ETL and near-real-time data pipelines and architectures for various parts of our business, on fast and versatile data sources with millions of changes per day
Ensure all data provided is of the highest quality, accuracy, and consistency
Identify, design, and implement internal process improvements for optimising data delivery and re-designing infrastructure for greater scalabilit
Builds out new API integrations to support continuing increases in data volume and complexity
Communicate with data scientist, MLOps engineers, product owners and BI analysts in order to understand business processes and system architecture for specific product features
What you'll bring
Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics, or a related technical field
3+ years of experience in data engineering, data platforms, BI or related domain
Experience in successfully implementing data-centric applications, such as data warehouses, operational data stores, and data integration projects
Experience with large-scale production relational and NoSQL databases
Experience with data modelling
General understanding of data architectures and event-driven architectures
Proficient in SQL
Familiarity with one scripting language, preferably Python
Experience with Apache Airflow & Apache Spark
Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR (Elastic MapReduce), EKS, RDS (Relational Database Services) and Lambda
Even better if
Understanding of ML Models
Understanding of containerisation and orchestration technologies like Docker/Kubernetes
Relevant knowledge or experience in the gaming industry
What's in it for you
Sporty is a remote first company in pursuit of sustainability
A competitive salary + individual performance based bonuses every quarter
28 days paid annual leave
Our core working hours are 10am-3pm in your local time zone with flexibility outside of this
Referral bonuses & flash bonuses
Top of the line equipment
Annual company retreats to provide great internal networking opportunities
Interview Process
Remote video screening with our Talent Acquisition Team
Offline Take home assignment
Remote video interview with Team Members (90 Mins)
If you're interested, we encourage you to apply! Every application is reviewed by a member of our team (AI is not used in our recruitment process), and we aim to respond within 48 hours.
*We are committed to maintaining a fair, secure and authentic recruitment process. Applications submitted using false, misleading or fraudulent information, including impersonated or fake profiles, will not be considered. Where reasonably necessary to protect the integrity and security of our recruitment process, we may verify a candidate’s identity and/or the accuracy of information provided during the recruitment process. Any such checks will be carried out in a proportionate and appropriate manner and in accordance with applicable data protection and employment laws.