{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15fe1fbb-1e45-5247-b2f6-18eae0e1a068","task_key":"default--validation--3699","task_revision_id":"1","upstream_id":"3699","short_description":"HellaSwag validation 3699","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use green tea on your face to achieve prettier skin [title] If you already drink tea, switch to green tea. [step] It will work better if you already drink it regularly. After each cup of green tea that you drink, remove the teabag and cut it open.\",\"endings\":\"[\\\"This may help prevent clostridium buildup and the dark circles you'll create on your skin. [title] Follow the suggested dosages (how many cups you can expect to have with you each day).\\\", 'Dump the tea out into a bowl or bag and throw it away, you might not need to do this again. You can mix it all up and see how pretty you can be without it.', 'This will save you some time as coffee could scruff and irritate skin cells. Pour some tea into a cup and drop one teabag into the cup, wait 15 minutes and strain out the tea.', 'Empty the content into a small cup and add a little honey to make it into a paste. Make sure your face is clean before you apply the paste.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}