LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

emdHSHg0UXpLMEpEcDljMlNqUEx3TjdZL2c9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description



 

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications



 

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Master's or PhD required (PhD candidates strongly preferred).
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Black Girls Code

Camp Instructor -Chicago Job at Black Girls Code

 ...0-13 or 14-18 coding. Students will learn to code throughout the year by creating art, music, websites, games, apps, and more. The Camp...  ...ll need to be available for the full camp session: July 13-July 17 What Makes You a Great Fit Teaching groups in formal or... 

Health Systems Management

Registered Nurse RN Job at Health Systems Management

 ...Sign-On Bonus Offered, based on experience!!! Registered Nurse (RN) Emory Dialysis at Candler - Decatur, GA Full-time position...  ...in the renal community for providing high quality patient care and encouraging physician input while maintaining efficient business... 

Carter Myers Automotive

Automotive Sales Manager Job at Carter Myers Automotive

: We are seeking a results-driven Automotive Sales Manager to lead our sales team, drive revenue growth, and enhance the customer buying experience. The ideal candidate will have a strong background in automotive sales, leadership experience, and a passion for developing...

Canon U.S.A., Inc.

Traveling Field Service Technician II Job at Canon U.S.A., Inc.

 ...marks, are trademarks of their respective owners. Canon U.S.A., Inc. offers a competitive compensation package including medical, dental, vision, 401(k) Savings Plan, discretionary profit sharing, discretionary success sharing, educational assistance, recognition... 

FC Industries Inc

Account Manager Job at FC Industries Inc

 ...reports to the VP of Business Development. He/ She will lead customer sales/support, including pricing evaluation, proposal development...  ...Seed Money ~ Life insurance and disability plans~ Immediate holiday pay~ Paid Time Off ~401k retirement savings with...