Senior Software Engineer – Ruby (LLM Evaluation & Repository Validation)

What does day-to-day look like:

Analyze and triage GitHub issues across trending open-source libraries. Set up and configure code repositories, including Dockerization and environment setup. Evaluating unit test coverage and quality. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs. Opportunities to lead a team of junior engineers to collaborate on projects.

Nice to Have:

Previous participation in LLM research or evaluation projects. Experience building or testing developer tools or automation agents.

Perks of Freelancing :

Work in a fully remote environment. Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details:

Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week) Employment type  : Contractor assignment (no medical/paid leave) Location :  Kenya