Senior Software Development Engineer - Big Data

Your tasks

• Designanddevelopscalabledatainfrastructure:Architect,implement,andmaintainsecure,observable,andreliabledatapipelinesandservicesthatcollect,process,andstorelarge,diversedatasetsforanalytics,machinelearning,andproductapplications.
• Optimizedataprocessingandstorage:Developefficientdatamodels,storagestrategies,andprocessingframeworkstosupporthigh-volume,real-time,andbatchworkloadswhilebalancingperformance,reliability,andinfrastructurecosts.
• Leadtechnicalexcellence:Drivetechnicaldesignreviews,codereviews,andengineeringbestpractices,providingguidanceandmentorshiptoengineersondataquality,systemresilience,andoperationalexcellence.
• Collaborateacrossteams:Partnerwithproductmanagement,analytics,datascience,andplatformengineeringteamstotranslatebusinessobjectivesandmodelingrequirementsintorobust,production-gradedatasolutionsandAPIs.
• BuildAIandagenticplatformcapabilities:Developandmaintainsharedcontext-layerservices,agenttools,authenticationmechanisms,andAPIsthatenableteamsacrosstheorganizationtobuildanddeployAI-poweredapplicationsatscale.
• Ensurereliabilityanddataquality:Implementautomatedtesting,monitoring,alerting,andincidentresponseprocessestoimproveserviceavailability,dataintegrity,andoverallplatformperformance.
• Drivetechnologyinnovation:Evaluateandintroducemodernbigdatatechnologies,developmenttools,andarchitecturalpatternstoimprovedeveloperproductivity,scalability,andend-to-enddatalifecyclemanagement.
• Establishengineeringstandards:Documentdataflows,systeminterfaces,andoperationalrunbookswhilecontributingtosharedframeworks,reusablecomponents,andbestpracticesforbigdataengineering.
• Supportcontinuousimprovement:Identifyopportunitiestostrengthenplatformarchitecture,simplifyoperations,andimprovetheefficiencyandmaintainabilityofdistributeddatasystems.

Requirements

• Education:Bachelor'sdegreeinComputerScience,ComputerEngineering,orarelatedtechnicalfield,oranequivalentcombinationofeducationandprofessionalexperience.
• Professionalexperience:Atleast8yearsofsoftwareengineeringexperience,withastrongfocusonbuilding,deploying,andoperatingdata-intensiveapplicationsordistributedsystems.
• Bigdataengineeringexpertise:Demonstratedexperiencedesigning,implementing,andsupportingproduction-gradedatapipelinesandplatformsusingmodernbigdata,streaming,and/orcloud-nativetechnologies.
• Dataarchitectureandsystemsdesign:Strongunderstandingofscalabledataprocessing,datamodeling,storagestrategies,distributedcomputing,systemreliability,andperformanceoptimization.
• Productionengineering:Experiencedevelopingandmaintainingreliabledataservices,includingautomatedtesting,monitoring,observability,alerting,andoperationaltroubleshooting.
• AIandagentictechnologies:Hands-onexperiencebuildingagenticsolutionsorAI-poweredcapabilitiesusingmajorAItoolsandsharedinternalplatforms.ExperiencewithDatabricksisconsideredanadvantage.
• APIandplatformdevelopment:Abilitytobuildrobustservices,integrations,authenticationmechanisms,andAPIsthatsupportscalabledataandAIapplications.
• Cross-functionalcollaboration:Provenabilitytoworkeffectivelywithproduct,analytics,datascience,andengineeringstakeholderstodeliversolutionsalignedwithbusinessobjectives.
• Technicalleadership:Strongproblem-solvingskillsandtheabilitytoleaddesigndiscussions,conductcodereviews,mentorengineers,andpromoteconsistentengineeringstandards.
• Communicationanddocumentation:Excellentwrittenandverbalcommunicationskills,withtheabilitytoexplaincomplextechnicalconcepts,documentarchitectures,andcollaborateeffectivelyacrossdistributedteams.
• Adaptabilityandcontinuouslearning:Abilitytonavigateevolvingtechnologies,evaluatenewtools,managecompetingpriorities,andcontinuouslyimproveengineeringpracticesinafast-pacedenvironment.

What we offer

• Competitive base salary: Compensation varies by work location:
• $164,400–$262,600 annually in California, Connecticut, Maryland, Massachusetts, New Jersey, New York, Washington State, and Washington, D.C.
• $156,200–$249,400 annually in Colorado, Hawaii, Illinois, Maine, Minnesota, Nevada, Ohio, Rhode Island, Vermont, and Virginia.
• Compensation for other eligible US locations may vary.
• Equity awards: Eligibility for equity compensation based on factors including experience, performance, and geographic location.
• Remote work flexibility: Work remotely from an eligible location within the United States, with flexibility supported by a distributed-work model.
• Career development: Opportunities to work on large-scale data platforms, emerging AI technologies, and innovative engineering initiatives.
• Technical leadership opportunities: Influence architectural decisions, establish engineering standards, and mentor colleagues across technical teams.
• Collaborative environment: Work alongside professionals in software engineering, data science, analytics, product development, and cloud infrastructure.
• Inclusive workplace: Join an environment committed to equal employment opportunities, collaboration, innovation, and professional growth.

How to apply

How Jobgether works We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether?

Other

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.