{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64fc4fec-7c76-5536-bccf-edf43266e962","task_key":"default--validation--41679","task_revision_id":"1","upstream_id":"41679","short_description":"HellaSwag validation 41679","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to change video format from mts to avi [title] Download and install a video converter. [step] A quick google search will provide you with lots of free converters to choose from. Make sure to choose a converter that is compatible with your computer.\",\"endings\":\"['Video converters can save a lot of money in the long run, so consider purchasing the trial version if you can. [title] Note that this version does not support.', \\\"If you're on a mac, make sure to download the mac version of your chosen conversion tool. Get your converter up and running before proceeding.\\\", '[substeps] If you need to buy a converter that has an ovenproof layer compatible with your lcd windows, consider purchasing more than one or two. Video converters in particular have questionable compatibility with most hard drives due to the availability of cpu and lcd cd drives.', '[title] Open a video converter or file program. [step] There are several sites that have a video converter and files online that you can convert to avi.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}