Senior SWE - Python / TypeScript
Free to start · No card · 5 credits the moment you sign up
Job description
This role is for one of our clients
Role Type: Contract
Engagement Duration: 3 months
Location: Remote – North America preferred
Preferred Geographies: United States (approved regions) and Canada
Start Date: Immediate
Experience Required: 5+ years
Compensation: $100–$150 per hour
Availability: Minimum 4 hours per day and 20 hours per week, with at least 4 hours of overlap with Pacific Standard Time (PST)
We are looking for a highly skilled Senior Software Engineer with expertise in Python, TypeScript, JavaScript, or Go to support advanced AI development and evaluation initiatives. The ideal candidate combines strong software engineering fundamentals with exceptional attention to quality, hands-on experience in preference data collection or rubric creation, and the ability to translate complex technical work into clear, actionable insights.
This role is suited to engineers who can operate effectively in ambiguous, fast-paced environments, exercise sound technical judgment, and prioritize practical execution. Candidates should be able to distinguish high-quality examples from mediocre ones, articulate their reasoning, and help turn qualitative assessments into scalable evaluation processes.
Prior experience working with large, complex codebases, such as Visual Studio Code (VS Code), is an advantage.
Key Responsibilities
- Rubric Development: Design, refine, and iterate on rubrics, evaluation frameworks, and quality criteria for preference data.
- Data Review and Quality Assurance: Review, assess, and label data while identifying subtle inconsistencies, quality issues, and opportunities for improvement.
- Engineering Infrastructure: Build, maintain, and optimize pipelines and infrastructure supporting data generation, collection, processing, and evaluation workflows.
- Technical Documentation: Synthesize findings from data analysis and evaluation activities into concise reports, updates, recommendations, and actionable summaries.
- Cross-Functional Collaboration: Work closely with researchers and engineers to translate qualitative judgments into structured, repeatable, and scalable processes.
- Codebase Navigation: Understand, contribute to, and maintain complex software repositories while ensuring code quality, reliability, and performance.
- Continuous Improvement: Identify workflow inefficiencies and implement practical improvements to data quality, evaluation consistency, and engineering processes.
Required Skills and Qualifications
- At least 5 years of professional software engineering experience with Python, particularly in building and maintaining pipelines and infrastructure, or with TypeScript, JavaScript, or Go.
- Hands-on experience with preference data collection, rubric creation, or developing evaluation criteria.
- Strong understanding of software engineering principles, code quality, debugging, and maintainable system design.
- Excellent written and verbal communication skills, with the ability to explain complex technical concepts clearly and concisely.
- Strong analytical skills and the ability to make consistent, well-reasoned quality judgments.
- Demonstrated ability to explain why a particular solution, example, or implementation meets a high quality standard.
- Comfort working independently in ambiguous environments while prioritizing execution and timely delivery.
Preferred Qualifications
- Experience contributing to or navigating large-scale, complex open-source codebases, such as VS Code.
- Experience building data pipelines, developer infrastructure, or automated evaluation systems.
- Background in AI model evaluation, preference data workflows, data annotation, or quality assessment.
- Experience collaborating with AI researchers, machine learning engineers, or multidisciplinary technical teams.
- Education from a leading university or professional experience at a highly regarded technology company.
Evaluation and Selection Process
Candidates will undergo the following evaluation stages:
- Application and Screening: Submit an application and complete the required screening questions.
- AI Interview: Complete an AI-based interview.
- Coding Challenge: Demonstrate technical proficiency through a coding assessment.
- Technical and Cultural Interview: Participate in an approximately 30-minute discussion covering technical expertise, communication, judgment, and collaboration.
- Final Review: Complete the final candidate evaluation and selection process.
Additional Requirements
- A LinkedIn profile is mandatory and must be included in the candidate's resume.
- Candidates from leading technology companies and top-tier universities are strongly preferred.
- Candidates must not currently be employed by Microsoft.
- Applicants should be able to commit to the required weekly hours and PST overlap for the full contract duration.
Prepare your application
Use the description above to assess your fit for Weekday AI. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.
Match requirements to evidence
Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.
Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.
Check the working arrangement
Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.
Review before submitting
Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.
Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.
Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.