{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2687a3a4-9560-53e9-b133-260723a1e9ce","task_key":"default--validation--3775","task_revision_id":"1","upstream_id":"3775","short_description":"HellaSwag validation 3775","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to help orient a new employee [title] Know that orienting employees helps to reduce anxiety. [step] If a new employee is left on his or her own, the new place and strange situation will may cause them anxiety. This will impede the employee's ability to learn their job and do it well.\",\"endings\":\"['Teach the employee that failing to understand a problem as soon as possible may lead them to make a error in decision making and violate office norms. [substeps] If the employee is left the new place or strange environment, they may find it even more difficult to be there for a little while.', \\\"[substeps] With proper orientation and communication, the employee receives guidelines regarding the job's expectations and it no longer seems guesswork. [title] Understand that orientation can trim employee turnover.\\\", 'That is why it is important that a new employee secure their freedom from supervision. A new employee may be taught to do this by : [substeps] Friends and loved ones example employees under the influence of medication.', '[substeps] Try talking to the new employee about the problems. You can ask them questions like, \\\" why have you moved to a new place and what happened there? \\\" even brief responses to the questions will help the new employee feel like they know where he or she can be at any given moment.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}