Project Sceptrum - Multilingual AI Coding Evaluation Specialist - Korean
About this role
Join a short, paid project that tests whether AI coding agents work as well on instructions written in the target language as they do in English. Your language skills and technical background decide where you fit.
About the project
Welo Data is helping evaluate how well AI coding agents perform when the instructions they receive are written in languages other than English. Agents are given a real software engineering task in a code repository, and automated tests check whether they solved it. The code, repositories and tests stay exactly as they are. Only the human-written instructions change language, so the quality of every instruction directly affects the result.
About the roles
There are two roles on this project. We place you in one of them based on your experience& skillsets.
Translator: translate English software engineering task briefs into the target language. You keep every requirement, constraint and success condition, and you leave commands, file paths, API names, code and test conditions exactly as written in English. This role suits people with a stronger technical background, and translation experience is a plus.
Reviewer: compare each translation with the English source, check that nothing is missing, added or changed in meaning, correct errors, and log each correction by error type. This role suits people with strong translation, editing or review experience and enough technical familiarity to read code context.
Who we are looking for
Native or near-native writing in the target language, and strong reading ability in English.
Either professional experience in translation, editing, review or technical writing, or a software background combined with excellent writing in the target language
Comfort reading technical text. Coding experience is a strong plus for the translation role and helpful for the review role.
Close attention to detail. In this project, a dropped clause can make a task fail.
Project at a glance
Project duration: one week since the mid of November
Languages: Korean
Project time commitment: 6 hours per person
Project compensation: varies depends on different programming language
Work location: fully remote
How selection works (major steps)
Screening questions: about 2 minutes. They cover your language background, translation and review experience, which programming languages you know and how well, and your availability.
Language test: short exercises in the target language.
Programming skills assessment: you will be invited to another opportunity, in the programming language you know best (Rust, Go, Python, or TypeScript / JavaScript). It confirms your technical level and places you in a language track.
Financial Onboarding & Role placement:complete the financial onboarding with Welo Data. In the meanwhile, you will be informed about the decision whether you are placed in the initial translation role or the review role.
Production: once you finish all steps above, our project team will contact you for production.
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy. 🌱 Limitless Growth Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise. 🌍 Limitless Support Be part of a global contributor community with responsive guidance and support. 💡 Real Impact Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.Originally posted on Himalayas
