Benchmarks AI answers to real German-law questions by comparing two platforms side by side and scoring each against a rubric. Suits German-qualified corporate and M&A lawyers with law-firm transactional experience.
About the role
This role is for one of our clients
Compensation: $140-$150 per hour
We are partnering with a leading legal AI company to benchmark how well AI systems answer real questions of German law . We are hiring experienced corporate/M&A lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
Requirements
What you'll do
- Run the same set of prompts across two AI (LLM) platforms
- Compare the outputs from both platforms side by side
- Score each response against a standardized rubric we provide
- Submit concise written feedback for every evaluation
- Submit concise written feedback for every evaluation
- Primarily law-firm experience — at least 2 years (3+ preferred) at a law firm in corporate/M&A or transactional practice. If you are currently in-house, that is fine only if you moved in-house within the last 2 years and your prior experience was at a law firm.
- Qualified to practise in Germany , with a strong command of German corporate and commercial law
- Native or fluent German , with precise written communication
- Able to work independently to a rubric and to deadlines
- Able to work independently to a rubric and to deadlines
- Initial commitment: ~10 hours, with strong potential for more
- Confidentiality: all work is covered by NDA
- Confidentiality: all work is covered by NDA
Official source: apply.workable.com. Details can change; the platform's page is the final word. Something wrong with this listing? Tell us.
More law jobsMore AI evaluation and rating jobs All Weekday roles What lawyers earn How much does Weekday pay? Jobs in Germany
