{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0b089c8-500e-5f19-a52d-e4f069a8e559","task_key":"default--validation--30232","task_revision_id":"1","upstream_id":"30232","short_description":"HellaSwag validation 30232","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to do business in qatar [title] Visit at the right time of year. [step] If one plans on visiting qatar strictly for business purpose; the most favorable time for visit would be between the months of october to june. Usually the officers from private and public sectors go for vacation during the time frame between july and september.\",\"endings\":\"['Regular business time is usually from august to june. [title] Take business away from the capital in qatar.', 'Besides being possible, just because some of the members of the military routinely attend training has a large impact on your ability to effectively decide who to serve in a military situation. [substeps] By participating in a business can help you get become politically active.', 'Avoid visiting the cells within july during business hours. [substeps] If you are planning to visit qatar by car, train, bus, or ferry, arrive between july and september.', 'However one should avoid going to qatar for business trips during the fasting month of ramadan as this is the time when the businessmen of qatar give more priority to family and worship. [title] Be aware of closure dates and working hours.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}