{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6415997-bc1c-5f6b-8272-772f9adddacc","task_key":"default--validation--10148","task_revision_id":"1","upstream_id":"10148","short_description":"HellaSwag validation 10148","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove facial hair permanently [title] Search online to find electrologists in your area. [step] An electrologist is a person who has gone through special training to perform the electrolysis procedure. Research different electrologists in your area and make a list of the ones you think are most qualified.\",\"endings\":\"['You should then look through their information on a case-by-case basis to determine which one would be the best fit for you. [substeps] Best looking online for electrologists is to have someone look them up.', '[substeps] Ask for a referral to another certified electrologist within your area. You may have to expand your search by looking at more people in the field and visiting electropostale website at http: // www.electrodocs /.', 'Try to find at least 3-4 electrologists to start with. [substeps] Look for electrologists with at least 5 years of experience in the field, with positive reviews on their business page and social media and a professional-looking website.', \\\"[substeps] You may be surprised how many electrologists who perform these procedures don't report much improvement. [title] Ask your friends or family for recommendations.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}