{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01c68e17-6034-571b-b41d-c4ea1de5ac9e","task_key":"default--validation--35792","task_revision_id":"1","upstream_id":"35792","short_description":"HellaSwag validation 35792","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to adjust the time on a rolex replica [title] Locate and release the crown. [step] On the right side of a rolex there is a small, circular dial called the \\\" crown \\\" that allows you to control the mechanism of the watch. Unscrew the crown and pull it out from the watch base.\",\"endings\":\"['[substeps] The crown is orange with a large white dot. It is usually located under the hand spindle.', 'As you remove the crown it will look like it has been pushed into a slot underneath a ring within the watch. Use your finger to gently release the crown and prepare your watch for adjustment.', 'Once the crown is extended, it puts the watch in position to be wound to change the time. [substeps] The crown dial is found in the same position on all rolex models.', 'While not completely unscrewed, this feature will help you determine the type of rolex replica to purchase. If you do not know, consult the handgrip manual to be certain.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}