Plays a patient in German calls with an AI healthcare receptionist and grades how well it understands, answers and completes requested actions. Suits native German speakers, especially Austrian, with clear speech who can role-play convincingly and follow multi-step guidance.
German Voice AI Evaluator (Healthcare Front Desk Conversations)
About the Role
What if your Austrian German accent and sharp ear for natural speech could help teach AI how to handle a real call to a Ordination or Krankenhaus reception? We're looking for native German speakers based in Vienna to hold spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.
You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, strong attention to detail, and an instinct for what sounds natural in authentic Austrian German.
- Organization : Alignerr
- Type : Contract (task-based)
- Location : Remote
- Commitment : Flexible, work at your own pace
- Commitment : Flexible, work at your own pace
- Hold 4 to 5 minute spoken conversations in German with an AI front desk assistant, playing a fictional patient
- Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or verifying insurance
- Review transcripts and classify how accurately the AI understood you and responded
- Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
- Test how the AI handles background noise, short replies such as "ja," "nein," or "okay," long numbers, emotional moments, and sensitive or unsafe requests
- Follow detailed labeling guidelines consistently and submit high-quality work
- Follow detailed labeling guidelines consistently and submit high-quality work
- Native or near-native German speaker (Austrian German particularly valued) with a clear, natural speaking voice
- Detail-oriented, with the patience to review recordings and transcripts closely
- Comfortable role-playing a patient and sounding authentic in conversation
- Able to follow multi-step instructions and apply them consistently
- Reliable and self-directed when working independently
- Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
- Comfortable using web-based tools
- Comfortable using web-based tools
- Experience in voice AI evaluation, data annotation, or QA testing
- Background in healthcare administration, customer service, or call centre work
- Familiarity with Austrian German speech patterns and colloquial expressions
- Linguistics or language-focused academic background
- Familiarity with medical terminology in German
- Familiarity with medical terminology in German
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Task-based work with real autonomy
- Directly help make voice AI more accurate, natural, and safe in healthcare settings
- Potential for ongoing work as new projects launch
- Potential for ongoing work as new projects launch
Listing from Alignerr's job board. Details can change; the platform's page is the final word.
More ai evaluation & rating jobsMore voice & audio jobsMore languages & translation jobs