Builds and applies evaluation methods and benchmarks to a model's own outputs. Suits ML engineers who have designed real evaluation systems rather than only used off-the-shelf metrics.
About the role
Ethos pays $125/hour for this Senior ML Engineer opening, one of the higher STEM rates on the platform, and wants 5+ years specifically in model evaluation or applied ML, distinct from general software engineering. The work is building and applying evaluation methodology and benchmarking to a foundation model's own outputs, a step removed from training models and closer to auditing them. It suits someone who has designed real ML evaluation systems, beyond using off-the-shelf metrics.
Official source: agent.askethos.com. Details can change; the platform's page is the final word. Something wrong with this listing? Tell us.
More AI evaluation and rating jobsMore coding jobs All Ethos roles How much does Ethos pay? Is Ethos legit? How Ethos screens applicants
