LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

eVFHTHpJQXdJa3BCcGRBeVR6WEp4TjdkK2c9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Brasco International

TIG Welder/Fabricator Job at Brasco International

 ...Our company is seeking a skilled TIG Welder/Fabricator to join our team. The successful candidate will be responsible for fitting and welding aluminum parts in the manufacturing of transit shelters. We pride ourselves on maintaining a safe and quality-focused work environment... 

Canon U.S.A., Inc.

Copier Account Executive - Northeast Job at Canon U.S.A., Inc.

 ...site , we cannot guarantee the validity of this posting. For a list of our current postings, please visit us at . #CUSA Posting Tags #PM19 #LI-AV1 #LI-REMOTE Compensation details: 69300-103770 Yearly Salary PI63af71f881a8-30492-39059236... 

Hopdoddy Burger Bar, Inc.

FOH Job at Hopdoddy Burger Bar, Inc.

 ...Guests that the experience at Hopdoddy is just as craveable as the food. They maintain a positive vibe and work together to deliver the...  ...jeans!~ We give back to our communities through our Goodnight Good Cause program, donating over a million dollars to date! What... 

Everest Recovery Centers LLC

Dispensing Nurse - Part-time Job at Everest Recovery Centers LLC

 ...burnt out and in need of a change? A nursing position with Everest Recovery Centers may be for you. We are currently seeking a Part-time Dispensing Nurse for our Ludlow, MA facility to work every Saturday from 5:30am-10:30am. Potential for additional hours with hours... 

Clark Fork Valley Hospital

Physical Therapist Job at Clark Fork Valley Hospital

 ...Position- Physical Therapist Clark Fork Valley Hospital is seeking a compassionate and highly skilled Physical Therapist (PT) to join our rehabilitation team. This position is responsible for evaluating, planning, and administering physical therapy treatments prescribed...