{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4773f1a7-6592-5a96-bcc0-454153f79e57","task_key":"default--validation--8388","task_revision_id":"1","upstream_id":"8388","short_description":"HellaSwag validation 8388","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shave your back [title] Be very careful. [step] This task is doable but difficult. If you're shaving your own back without any help, you may have a hard time reaching the entire area.\",\"endings\":\"[\\\"This might lead you to shave at strange angles, which can heighten the risk of slicing the skin. You may not have full visibility of the region that you're shaving, and you may not be able to tell easily when you've missed a spot.\\\", 'You can do this by shaving only on a small area of your back, but with caution you may need a dictionary and more frequently used household products. Listen to your own body language, and it will tell you how to reach your skin.', \\\"If you want to shave your back right, use a shaving razor and slowly shave, at a slow and steady pace, starting in the middle and moving your way down to the top in long, downward strokes. [substeps] Once you've reached the bottom you can no longer shave your back until you are completely done shaving.\\\", 'Without proper care, you could result in skin damage or a scar. [substeps] You should also wear a bra underneath your clothing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}