Harbor MMLU 256

mmlu_256.yaml

- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, the share of deaths in Greenland by suicide is
    about</question>

    <options><option>A: 3.60%</option>

    <option>B: 0.90%</option>

    <option>C: 4.50%</option>

    <option>D: 2.40%</option>

    <option>E: 7.20%</option>

    <option>F: 5.40%</option>

    <option>G: 9.00%</option>

    <option>H: 6.30%</option>

    <option>I: 8.10%</option>

    <option>J: 1.80%</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Who kills Tony at the end of the film 'West Side
    Story'?</question>

    <options><option>A: He kills himself</option>

    <option>B: Riff</option>

    <option>C: Chino</option>

    <option>D: Officer Krupke</option>

    <option>E: Lieutenant Schrank</option>

    <option>F: Bernardo</option>

    <option>G: Nobody, he survives the film</option>

    <option>H: Maria</option>

    <option>I: Doc</option>

    <option>J: Anita</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In an e-commerce environment that requires that the information
    technology (IT) system be available on a continuous basis, more emphasis
    will be placed on which of the following aspects of the planning than in a
    traditional organization?</question>

    <options><option>A: The need for physical security measures to protect the
    IT system</option>

    <option>B: Increased need for public relation strategies to manage potential
    IT failures</option>

    <option>C: Maintain redundant systems for instant availability to assure the
    flow of transactions</option>

    <option>D: Regular audits of the IT system to detect any potential
    issues</option>

    <option>E: Frequent employee training on how to use the IT system</option>

    <option>F: Assure that appropriate data backups are stored in an off-site
    location</option>

    <option>G: Frequent changes to the IT system to keep up with technological
    advancements</option>

    <option>H: Ensure that the IT system is updated regularly to avoid any
    disruptions</option>

    <option>I: Review additional expenses to obtain the required amount of
    business interruption insurance coverage for the organization</option>

    <option>J: Maintain appropriate written source documents so the data can be
    re-entered if it is lost or compromised</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What singer appeared in the 1992 baseball film 'A League of Their
    Own'?</question>

    <options><option>A: Whitney Houston</option>

    <option>B: Madonna</option>

    <option>C: Mariah Carey</option>

    <option>D: Celine Dion</option>

    <option>E: Janet Jackson</option>

    <option>F: Prince</option>

    <option>G: Britney Spears</option>

    <option>H: Garth Brooks</option>

    <option>I: Michael Jackson</option>

    <option>J: Brandy</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these activities might secondary research
    involve?</question>

    <options><option>A: Examining public records</option>

    <option>B: Observing people</option>

    <option>C: Writing a novel</option>

    <option>D: Conducting a scientific experiment</option>

    <option>E: Conducting a survey</option>

    <option>F: Interviewing people</option>

    <option>G: Collecting soil samples</option>

    <option>H: Coding a computer program</option>

    <option>I: Designing a building</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many children between the ages of 5-14 worked globally as of
    2012?</question>

    <options><option>A: 5 million</option>

    <option>B: 500 million</option>

    <option>C: 30 million</option>

    <option>D: 150 million</option>

    <option>E: 75 million</option>

    <option>F: 250 million</option>

    <option>G: 200 million</option>

    <option>H: 100 million</option>

    <option>I: 400 million</option>

    <option>J: 1 billion</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Considering 'offensive' and 'defensive realism', which of these
    statements is not correct?</question>

    <options><option>A: Both offensive and defensive realism agree that states
    should avoid cooperation to achieve security.</option>

    <option>B: Offensive realism regards cooperation as the way in which states
    can achieve security.</option>

    <option>C: Offensive realism argues that states should avoid power and
    competition to achieve security.</option>

    <option>D: Both defensive realism and offensive realism regard power and
    competition as a means by which security can be achieved for the
    state.</option>

    <option>E: Defensive realism theorizes that states will pursue hegemony
    where possible.</option>

    <option>F: Both offensive and defensive realism agree that states should
    avoid power and competition to achieve security.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Mass-society theory suggests that:</question>

    <options><option>A: the subordinate classes are dominated by the ideology of
    the ruling class</option>

    <option>B: the media serves as a platform for the masses to voice their
    opinions</option>

    <option>C: the media manipulate 'the masses' as vulnerable, passive
    consumers</option>

    <option>D: audiences make selective interpretations of media
    messages</option>

    <option>E: the content of the media is determined by market forces</option>

    <option>F: the media's sole purpose is to disseminate information
    impartially</option>

    <option>G: the masses manipulate the media through their consumption
    patterns</option>

    <option>H: the dominant classes are influenced by the ideologies of the
    subordinate class</option>

    <option>I: the media is independent of societal influences</option>

    <option>J: the content of the media is solely determined by government
    censorship</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many water molecules are in a human head?</question>

    <options><option>A: 8*10^25</option>

    <option>B: 8*10^23</option>

    <option>C: 8*10^24</option>

    <option>D: 8*10^21</option>

    <option>E: 8*10^30</option>

    <option>F: 8*10^22</option>

    <option>G: 8*10^27</option>

    <option>H: 8*10^26</option>

    <option>I: 8*10^28</option>

    <option>J: 8*10^29</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A chief factor that contributed to the Second Agricultural
    Revolution was</question>

    <options><option>A: the discovery of the plow.</option>

    <option>B: the invention of electricity.</option>

    <option>C: the Renaissance.</option>

    <option>D: the invention of the internet.</option>

    <option>E: World War II.</option>

    <option>F: the discovery of new continents.</option>

    <option>G: the French Revolution.</option>

    <option>H: the Great Depression.</option>

    <option>I: World War I.</option>

    <option>J: the Industrial Revolution.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these games is not played with cards?</question>

    <options><option>A: euchre</option>

    <option>B: craps</option>

    <option>C: bridge</option>

    <option>D: solitaire</option>

    <option>E: poker</option>

    <option>F: blackjack</option>

    <option>G: hearts</option>

    <option>H: baccarat</option>

    <option>I: rummy</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In what ways has the concept of environmental security been
    contested?</question>

    <options><option>A: Analysis of environmental security is understood as the
    integrity of the whole ecological system whose primary threat is human
    activity. However, it radically challenges security thinking in that it
    demands a shift in the reason for action from national security interest to
    the welfare of the entire social-ecological system of the planet.</option>

    <option>B: Environmental security contends that the principle threat to the
    ecological integrity is human activity and therefore humans can be secured
    to the extent that welfare is protected at the domestic level. The reason
    for action is to be found in individual and national interests.</option>

    <option>C: The crossover of common insecurity issue areas is unlikely
    because not all problems are truly global. Not all states are equally
    responsible for environmental problems, nor is there such a thing as
    equality of risk. Systemic interdependence is unlikely to manage those
    security areas.</option>

    <option>D: The ecological security and human security approaches to
    environmental security do not challenge the security community to consider
    alternative objects of security. Ecological security displays continuity
    with major interpretations of security, which typically centralize the
    security of the state.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What was the significance of the Truman Doctrine?</question>

    <options><option>A: It outlined Truman's plan for economic recovery after
    World War II</option>

    <option>B: It led to the establishment of the United Nations</option>

    <option>C: It indicated that the US would now view all local revolts through
    a geopolitical lens</option>

    <option>D: It was a declaration of war against the Soviet Union</option>

    <option>E: It indicated the special place of Greece and Turkey in American
    interests</option>

    <option>F: It signaled the US's withdrawal from international
    affairs</option>

    <option>G: It marked the beginning of the Space Race</option>

    <option>H: It marked the end of the Cold War</option>

    <option>I: It was Truman's first statement on European affairs</option>

    <option>J: It indicated US reluctance to get involved in incidents outside
    of its immediate sphere of influence</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What was the significance of the Gulf of Tonkin
    resolution?</question>

    <options><option>A: It triggered a global protest against US involvement in
    Vietnam</option>

    <option>B: It resulted in a significant reduction of US troops in
    Vietnam</option>

    <option>C: It allowed the US to intensify its involvement in
    Vietnam</option>

    <option>D: It illustrated the influence of public opinion on US foreign
    policy</option>

    <option>E: It marked the beginning of diplomatic negotiations with
    Vietnam</option>

    <option>F: It enhanced Congressional control over the Vietnam War</option>

    <option>G: It curtailed US involvement in Vietnam</option>

    <option>H: It established the neutrality of the United States in the Vietnam
    War</option>

    <option>I: It isolated the US from its allies during the Vietnam
    War</option>

    <option>J: It led to the immediate end of the Vietnam War</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Securities A, B and C have an expected return of respectively 7%,
    12% and 5%. What is the expected return of an equal weighted portfolio
    composed of Securities A and C?</question>

    <options><option>A: 10%</option>

    <option>B: 11%</option>

    <option>C: 12%</option>

    <option>D: 6.50%</option>

    <option>E: 7.50%</option>

    <option>F: 9%</option>

    <option>G: 6%</option>

    <option>H: 5%</option>

    <option>I: 8.50%</option>

    <option>J: 7%</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>From the very beginning, I wrote to explain my own life to myself,
    and I invited any readers who chose to make the journey with me to join me
    on the high wire. I would work without a net and without the noise of the
    crowd to disturb me. The view from on high is dizzying, instructive. I do
    not record the world exactly as it comes to me but transform it by making it
    pass through a prism of fabulous stories I have collected on the way. I
    gather stories the way a lepidopterist hoards his chloroformed specimens of
    rare moths, or Costa Rican beetles. Stories are like vessels I use to
    interpret the world to myself. ----------Pat Conroy Which of the following
    best describes the organization of the passage?</question>

    <options><option>A: The author explains the importance of storytelling in
    understanding the world.</option>

    <option>B: The author narrates a series of events without providing any
    interpretation.</option>

    <option>C: The author contrasts his methods of work with others in his
    profession.</option>

    <option>D: The author describes a sequence of events leading to his current
    work.</option>

    <option>E: The author uses analogies to explain his experience of a
    particular action.</option>

    <option>F: The author discusses the impact of his profession on his personal
    life.</option>

    <option>G: The author chronicles the various phases of his work in a
    particular discipline.</option>

    <option>H: The author uses his personal experiences to critique societal
    norms.</option>

    <option>I: The author makes a comparison between his own experiences and
    that of others in his profession.</option>

    <option>J: The author provides several explanations for taking a certain
    course of action.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following statements is true regarding delegates to
    presidential nomination conventions?</question>

    <options><option>A: Delegates are often chosen at random from the general
    population.</option>

    <option>B: Delegates often switch party affiliations during the
    convention.</option>

    <option>C: Delegates typically have little interest in politics.</option>

    <option>D: The majority of delegates are not affiliated with any political
    party.</option>

    <option>E: Delegates are generally more likely to register as third party
    voters at some point.</option>

    <option>F: The majority of the general population is more educated than the
    delegates.</option>

    <option>G: Delegates are typically less educated than the general
    population.</option>

    <option>H: Delegates usually have no influence on the presidential
    nomination process.</option>

    <option>I: Typically, delegates have a lower level of political knowledge
    than the general population.</option>

    <option>J: Typically, the general population is less ideological than the
    delegates.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these rock guitarists designed a colorful line of men's
    neckties?</question>

    <options><option>A: Jeff Beck</option>

    <option>B: Brian May</option>

    <option>C: Eddie Van Halen</option>

    <option>D: John Mayer</option>

    <option>E: Pete Townshend</option>

    <option>F: Jerry Garcia</option>

    <option>G: Jimmy Page</option>

    <option>H: Keith Richards</option>

    <option>I: Carlos Santana</option>

    <option>J: Eric Clapton</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2018, about what percentage of Indians say that having an
    increasing number of people of many different races, ethnic groups and
    nationalities in their country makes it a better place to live (as opposed
    to worse or no difference)?</question>

    <options><option>A: 53%</option>

    <option>B: 70%</option>

    <option>C: 14%</option>

    <option>D: 38%</option>

    <option>E: 23%</option>

    <option>F: 80%</option>

    <option>G: 45%</option>

    <option>H: 68%</option>

    <option>I: 90%</option>

    <option>J: 97%</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What animal represents the year 2000 on the Chinese
    calendar?</question>

    <options><option>A: tiger</option>

    <option>B: sheep</option>

    <option>C: monkey</option>

    <option>D: rabbit</option>

    <option>E: horse</option>

    <option>F: dragon</option>

    <option>G: dog</option>

    <option>H: rat</option>

    <option>I: snake</option>

    <option>J: rooster</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The Internal Revenue Code and the Regulations do not impose
    penalties on tax return preparers for which of the following?</question>

    <options><option>A: Failure to provide a copy of a prepared tax return to
    the taxpayer.</option>

    <option>B: Failure to include their Preparer Tax Identification Number
    (PTIN) on the tax return.</option>

    <option>C: Failure to sign a prepared tax return as a tax preparer.</option>

    <option>D: Failure to retain copies of prepared tax returns or a list of
    taxpayers for whom such returns were prepared for the last three
    years.</option>

    <option>E: Failure to notify a taxpayer about an inadvertent error on a tax
    return filed 10 years ago.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Holt Co. discovered that in the prior year it failed to report
    $40000 of depreciation related to a newly constructed building. The
    depreciation was computed correctly for tax purposes. The tax rate for the
    current year was 20%. How should Holt report the correction of error in the
    current year?</question>

    <options><option>A: As an increase in depreciation expense of
    $32000.</option>

    <option>B: As an increase of depreciation expense of $40000.</option>

    <option>C: As an increase in depreciation expense of $48000.</option>

    <option>D: As a decrease in depreciation expense of $32000.</option>

    <option>E: As a decrease in accumulated depreciation of $32000.</option>

    <option>F: As a decrease in depreciation expense of $40000.</option>

    <option>G: As an increase in accumulated depreciation of $32000.</option>

    <option>H: As an increase in accumulated depreciation of $48000.</option>

    <option>I: As a decrease in accumulated depreciation of $40000.</option>

    <option>J: As an increase in accumulated depreciation of
    $40000.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A sect is organised around:</question>

    <options><option>A: belief in the afterlife, individual interpretation of
    scripture, and weekly gatherings</option>

    <option>B: beliefs that can be challenged by members, a charismatic leader,
    and openness to new recruits</option>

    <option>C: hierarchical structure, a pope as the head, and a closed canon of
    scripture</option>

    <option>D: strict rules, a single leader, and exclusion of
    non-members</option>

    <option>E: tolerance towards other religions and the separation of church
    and state</option>

    <option>F: acceptance of all beliefs, lack of leadership, and focus on
    personal growth</option>

    <option>G: worship of a specific deity, regular rituals, and mandatory
    tithes</option>

    <option>H: voluntary membership, democratic leadership, and high levels of
    emotional commitment</option>

    <option>I: the idea of the secular world itself as being sacred</option>

    <option>J: a single holy book, a rigid moral code, and a closed
    community</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What was the original name of the Apple Macintosh XL
    computer?</question>

    <options><option>A: Macintosh Extra Large</option>

    <option>B: Apple Macintosh Plus</option>

    <option>C: Apple Macintosh Supreme</option>

    <option>D: Apple X</option>

    <option>E: Orange XL</option>

    <option>F: Macintosh Senior</option>

    <option>G: Lisa 2</option>

    <option>H: Granny Smith</option>

    <option>I: Mac Daddy</option>

    <option>J: Lisa XL</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the square root of 81 squared?</question>

    <options><option>A: 9^2</option>

    <option>B: 27</option>

    <option>C: 81^2</option>

    <option>D: 729</option>

    <option>E: 6561</option>

    <option>F: 12</option>

    <option>G: 162</option>

    <option>H: 243</option>

    <option>I: 81</option>

    <option>J: 9</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is the most reasonable action to take for
    an artist whose work requires the use of a specific hazardous
    product?</question>

    <options><option>A: Making sure no children are present when using the
    product</option>

    <option>B: Reading the product's label and proceeding according to the label
    directions</option>

    <option>C: Only using the product sparingly and infrequently</option>

    <option>D: Diluting the product with water to reduce its hazard</option>

    <option>E: Checking with a qualified toxicologist before using the
    material</option>

    <option>F: Ignoring the hazard and using the product as usual</option>

    <option>G: Wearing a mask and gloves while using the product</option>

    <option>H: Getting a friend to use the product instead</option>

    <option>I: Using the product only in large, well-ventilated spaces</option>

    <option>J: Finding a nontoxic product to use and adapting the art-making
    process as necessary</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2020, about what percentage of the world population
    practices open defecation?</question>

    <options><option>A: 4%</option>

    <option>B: 2%</option>

    <option>C: 11%</option>

    <option>D: 9%</option>

    <option>E: 15%</option>

    <option>F: 22%</option>

    <option>G: 5%</option>

    <option>H: 7%</option>

    <option>I: 18%</option>

    <option>J: 13%</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>When there has been a change in accounting principles, but the
    effect of the change on the comparability of the financial statements is not
    material, the auditor should</question>

    <options><option>A: Issue a qualified opinion due to the change.</option>

    <option>B: Refer to the note in the financial statements that discusses the
    change.</option>

    <option>C: Explicitly state whether the change conforms with GAAP.</option>

    <option>D: Include a paragraph detailing the change in the notes to the
    financial statements.</option>

    <option>E: Issue an adverse opinion due to the change.</option>

    <option>F: Request that the client restate the prior year's financial
    statements.</option>

    <option>G: Discontinue the audit due to the change in accounting
    principles.</option>

    <option>H: Not refer to the change in the auditor’s report.</option>

    <option>I: Refer to the change in an emphasis-of-matter paragraph.</option>

    <option>J: Require the client to disclose the change in a separate financial
    statement.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In which year was the seminal Human Development Report
    published?</question>

    <options><option>A: 1997</option>

    <option>B: 2000</option>

    <option>C: 2004</option>

    <option>D: 1994</option>

    <option>E: 1987</option>

    <option>F: 2007</option>

    <option>G: 1984</option>

    <option>H: 1990</option>

    <option>I: 1992</option>

    <option>J: 1980</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many states in the international system are likely to have
    nuclear weapons right now?</question>

    <options><option>A: More than 25</option>

    <option>B: Between 16 and 25</option>

    <option>C: More than 100</option>

    <option>D: Exactly 7</option>

    <option>E: Between 36 and 50</option>

    <option>F: Fewer than 7</option>

    <option>G: Between 50 and 100</option>

    <option>H: Between 8 and 15</option>

    <option>I: Between 26 and 35</option>

    <option>J: Exactly 15</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which one of the following demographic factors characterizes
    stages 4 and 5 in the demographic transition model?</question>

    <options><option>A: Low immigration rates</option>

    <option>B: Low life expectancy</option>

    <option>C: High youth dependency ratio</option>

    <option>D: High sex ratios</option>

    <option>E: High population density</option>

    <option>F: Zero population growth</option>

    <option>G: High mortality rates</option>

    <option>H: High birth rates</option>

    <option>I: High fertility rates</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>If the government places a price ceiling on leather garments that
    is below the equilibrium price, which of the following will occur in the
    market for leather garments?</question>

    <options><option>A: The price of leather garments will remain the
    same.</option>

    <option>B: The demand curve for leather garments will shift
    rightward.</option>

    <option>C: There will be a surplus.</option>

    <option>D: The supply curve for leather garments will shift
    leftward.</option>

    <option>E: There will be no effect on the supply or demand for leather
    garments.</option>

    <option>F: The supply curve for leather garments will shift
    rightward.</option>

    <option>G: The demand curve for leather garments will shift
    leftward.</option>

    <option>H: There will be an increase in the production of leather
    garments.</option>

    <option>I: The price of leather garments will rise.</option>

    <option>J: There will be a shortage.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Corbet Co. purchased a copyright near the beginning of the current
    year from an author for $20000. The legal life of the copyright is
    equivalent to the life of the author plus 50 years. Corbet expects to sell
    the book for five years. What amount should Corbet report as amortization
    expense related to the copyright at the end of the current year?</question>

    <options><option>A: $0</option>

    <option>B: $2000</option>

    <option>C: $6000</option>

    <option>D: $7000</option>

    <option>E: $5000</option>

    <option>F: $500</option>

    <option>G: $400</option>

    <option>H: 4000</option>

    <option>I: $8000</option>

    <option>J: $3000</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The demand for which of the following products is likely to be the
    most elastic?</question>

    <options><option>A: Vegetables</option>

    <option>B: Beef</option>

    <option>C: Pork</option>

    <option>D: Sugar</option>

    <option>E: Milk</option>

    <option>F: Water</option>

    <option>G: Rice</option>

    <option>H: Salt</option>

    <option>I: Bread</option>

    <option>J: Eggs</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following heavenly bodies have never had a spacecraft
    landed on it?</question>

    <options><option>A: Mercury</option>

    <option>B: Jupiter</option>

    <option>C: Uranus</option>

    <option>D: Mars</option>

    <option>E: Saturn</option>

    <option>F: Neptune</option>

    <option>G: Venus</option>

    <option>H: Pluto</option>

    <option>I: The Moon</option>

    <option>J: The Sun</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Shaggy has a fantasy about digging up a recently buried woman and
    having sex with her. He told his friends this and they encouraged him to get
    therapy. As part of the treatment he masturbates to his fantasy and at the
    last moment before orgasm he switches to a fantasy about having sex with a
    living woman. This procedure is part of the process of:</question>

    <options><option>A: aversive conditioning</option>

    <option>B: flooding therapy</option>

    <option>C: behavioral activation therapy</option>

    <option>D: covert sensitization</option>

    <option>E: sexual addiction therapy</option>

    <option>F: orgasmic reconditioning</option>

    <option>G: biofeedback therapy</option>

    <option>H: cognitive behavioral therapy</option>

    <option>I: desensitization therapy</option>

    <option>J: exposure therapy</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>When an attitude is communicated, what does it become?</question>

    <options><option>A: A behaviour</option>

    <option>B: A stereotype</option>

    <option>C: A point of view</option>

    <option>D: An opinion</option>

    <option>E: A principle</option>

    <option>F: A value</option>

    <option>G: A belief</option>

    <option>H: A theory</option>

    <option>I: A fact</option>

    <option>J: A perception</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is true of court cases in which one private
    party is suing another?</question>

    <options><option>A: They are always resolved through arbitration, not court
    trials.</option>

    <option>B: They are always tried in the Supreme Court.</option>

    <option>C: They are tried in juvenile court.</option>

    <option>D: They are tried in international court.</option>

    <option>E: The federal court system has exclusive jurisdiction over
    them.</option>

    <option>F: The state court system has exclusive jurisdiction over
    them.</option>

    <option>G: They are exclusively tried in appellate court.</option>

    <option>H: The military court system has exclusive jurisdiction over
    them.</option>

    <option>I: They are tried in civil court.</option>

    <option>J: They are tried in criminal court.</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following plays the most significant role in forming
    a child's political views?</question>

    <options><option>A: The child's religion</option>

    <option>B: The child's educational institution</option>

    <option>C: The political events occurring during the child's formative
    years</option>

    <option>D: The geographical area in which the child grows up</option>

    <option>E: The child's cultural background</option>

    <option>F: The child's personal experiences</option>

    <option>G: The media to which the child is exposed</option>

    <option>H: The child's peer group</option>

    <option>I: The socioeconomic status of the child's family</option>

    <option>J: The child's family</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is considered part of the required
    supplementary information for general purpose external financial reporting
    of a local government?</question>

    <options><option>A: Statement of cash flows.</option>

    <option>B: Internal control over financial reporting.</option>

    <option>C: Financial statement audit report.</option>

    <option>D: Government-wide financial statement.</option>

    <option>E: Comprehensive annual financial report.</option>

    <option>F: Combining nonmajor fund statement.</option>

    <option>G: Fund financial statement.</option>

    <option>H: Management discussion and analysis.</option>

    <option>I: Notes to the financial statements.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>All of the following contribute to lower voting rates among
    Americans in the 18-to-25 age bracket EXCEPT</question>

    <options><option>A: the belief that their vote will not make a
    difference</option>

    <option>B: the remoteness of most political issues to the daily lives of
    young people</option>

    <option>C: frequent relocation of one's primary residence</option>

    <option>D: the fact that the minimum voting age in some states is
    21</option>

    <option>E: the fact that voting is not mandatory</option>

    <option>F: difficulty understanding the voting process</option>

    <option>G: a lack of interest in politics</option>

    <option>H: college attendance in a state other than one's home
    state</option>

    <option>I: the perception that all political candidates are the
    same</option>

    <option>J: an inability to get to polling locations</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is not a 'research purpose'?</question>

    <options><option>A: argumentation</option>

    <option>B: exploration</option>

    <option>C: description</option>

    <option>D: justification</option>

    <option>E: comprehension</option>

    <option>F: interpretation</option>

    <option>G: persuasion</option>

    <option>H: prediction</option>

    <option>I: triangulation</option>

    <option>J: explanation</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What were the first names of the early American explorers Lewisand
    Clark?</question>

    <options><option>A: Martin and Walter</option>

    <option>B: Matthew and Charles</option>

    <option>C: Mitchell and Warren</option>

    <option>D: Michael and Christopher</option>

    <option>E: Meredith and George</option>

    <option>F: Marcus and Wilson</option>

    <option>G: Cabot and Joseph</option>

    <option>H: Meriwether and William</option>

    <option>I: Morgan and Mason</option>

    <option>J: Miles and Wesley</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In which era did muckraking journalism led to the widespread
    introduction of public relations in business?</question>

    <options><option>A: The Cold War Era, 1947 - 1991</option>

    <option>B: Postwar Era, 1945 - 1965</option>

    <option>C: The New Deal Era, 1933 - 1939</option>

    <option>D: The Great Depression Era, 1929 - 1939</option>

    <option>E: Seedbed Era, 1900 ' 1917</option>

    <option>F: Roosevelt Era, 1930 - 1945</option>

    <option>G: Industrial Revolution Era, 1760 - 1840</option>

    <option>H: Booming Twenties Era, 1919 - 1929</option>

    <option>I: The Gilded Age, 1870 - 1900</option>

    <option>J: The Progressive Era, 1890 - 1920</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following short-run costs always increases as output
    increases?</question>

    <options><option>A: Average variable cost</option>

    <option>B: Marginal revenue</option>

    <option>C: Average total cost</option>

    <option>D: Marginal cost</option>

    <option>E: Total variable cost</option>

    <option>F: Total overhead cost</option>

    <option>G: Average revenue cost</option>

    <option>H: Total fixed cost</option>

    <option>I: Average fixed cost</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>According to The Federalist Papers, federalism has which of the
    following effects on political factions?</question>

    <options><option>A: It eliminates any opportunity for factions to
    form.</option>

    <option>B: It allows factions to dominate state governments while limiting
    their influence on the national level.</option>

    <option>C: It results in a two-party system, limiting the number of
    factions.</option>

    <option>D: It encourages the formation of more factions to create a balance
    of power.</option>

    <option>E: It guarantees equal representation for all factions in the
    government.</option>

    <option>F: It limits the dangers of factionalism by diluting political
    power.</option>

    <option>G: It completely suppresses the formation of factions.</option>

    <option>H: It promotes a single dominant faction at the national
    level.</option>

    <option>I: It allows factions to dominate on the national level while
    limiting their influence on state governments.</option>

    <option>J: It provides a structured environment in which factions may
    flourish.</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2019, about what percentage of people from the United States
    says homosexuality should be accepted by society?</question>

    <options><option>A: 32%</option>

    <option>B: 62%</option>

    <option>C: 82%</option>

    <option>D: 92%</option>

    <option>E: 42%</option>

    <option>F: 12%</option>

    <option>G: 72%</option>

    <option>H: 52%</option>

    <option>I: 2%</option>

    <option>J: 22%</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What problems has the post-Cold War security literature revealed
    on women, war, development, and security?</question>

    <options><option>A: Technological advancements have to some extent rendered
    the battlefield gender-neutral. 'Virtual' warfare has resolved the
    historical tension between the citizen and the state security apparatus; if
    actual combat could be avoided then male and female soldiers could wage war
    on equal terms. However, technological advancement remains unequal and so
    the gender situation is different in different contexts, depending on
    development and security issues.</option>

    <option>B: The technological capacity to wage war with minimal civilian
    costs has abolished the threat of physical and biological gender
    victimization. The contemporary gender divide is structured on 'soft' issues
    associated with socio-economic hardship.</option>

    <option>C: Conflict in warfare and the gender divide between men and women
    is centred on the historical contract between the individual and the state.
    The 'right to fight' debate has equal meaning and saliency across the globe,
    and is universally applicable in all situations.</option>

    <option>D: Nuclear armaments and the threat of mass destruction have
    rendered the battlefield gender neutral in terms of its destructive
    capabilities. Whilst historically conventional warfare was conducted on the
    battlefield in which women were particularly vulnerable to violence, and
    post-conflict sexual violence, these threats no longer
    exist.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A 2008 survey showed that what percentage of the world's largest
    companies are reporting their corporate responsibility?</question>

    <options><option>A: 40%</option>

    <option>B: 90%</option>

    <option>C: 50%</option>

    <option>D: 100%</option>

    <option>E: 80%</option>

    <option>F: 70%</option>

    <option>G: 60%</option>

    <option>H: 20%</option>

    <option>I: 30%</option>

    <option>J: 10%</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which factors are mentioned that influence media coverage of a
    story?</question>

    <options><option>A: Content, quality of source, relevance</option>

    <option>B: Timing, content, media liaison</option>

    <option>C: Content, quality of source, human interest angle</option>

    <option>D: Timing, relevance, political slant</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which Pope immediately preceded John Paul II?</question>

    <options><option>A: Alexander VI</option>

    <option>B: Hank II</option>

    <option>C: John Paul III</option>

    <option>D: Benedict XVI</option>

    <option>E: Leo XIII</option>

    <option>F: Pius XII</option>

    <option>G: John XXIII</option>

    <option>H: John Paul I</option>

    <option>I: Paul VI</option>

    <option>J: Innocent X</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, what percentage of Indians live in urban
    areas?</question>

    <options><option>A: 25%</option>

    <option>B: 55%</option>

    <option>C: 70%</option>

    <option>D: 10%</option>

    <option>E: 40%</option>

    <option>F: 34%</option>

    <option>G: 49%</option>

    <option>H: 64%</option>

    <option>I: 19%</option>

    <option>J: 50%</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Decker a 62-year-old single individual sold his principal
    residence for the net amount of $500000 after all selling expenses. Decker
    bought the house 15 years ago and occupied it until it was sold. On the date
    of sale the house had a cost basis of $200000. Within six months Decker
    purchased a new house for $600000. What amount of gain should Decker
    recognize from the sale of the residence?</question>

    <options><option>A: $50,000</option>

    <option>B: $150,000</option>

    <option>C: $300,000</option>

    <option>D: $0</option>

    <option>E: $350,000</option>

    <option>F: $250,000</option>

    <option>G: $100,000</option>

    <option>H: $200,000</option>

    <option>I: $175,000</option>

    <option>J: 300000</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>You seek the counsel of one of your peers who designed and
    implemented a communication program that resulted in the successful
    permitting of an automotive recycling center, despite strong opposition from
    community organizations. You have to design a program to win approval for a
    similar project proposed by your company. Your peer gives you a brief piece
    of advice that succinctly describes the foundation of his successful
    program. What is most likely your peer's advice for a successful
    communication program?</question>

    <options><option>A: Kill them with kindness</option>

    <option>B: Ignore their concerns</option>

    <option>C: Expose them to ridicule</option>

    <option>D: Bribe them into agreement</option>

    <option>E: Use aggressive tactics</option>

    <option>F: Solve their problems</option>

    <option>G: Manipulate their emotions</option>

    <option>H: Overwhelm them with facts</option>

    <option>I: Overpower them with authority</option>

    <option>J: Intimidate them with legal jargon</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What was the name of the first ship to sail around the
    world?</question>

    <options><option>A: HMS Beagle</option>

    <option>B: Columbus</option>

    <option>C: Titanic</option>

    <option>D: Mayflower</option>

    <option>E: Magellan</option>

    <option>F: Santa Maria</option>

    <option>G: Endeavour</option>

    <option>H: Elizabeth II</option>

    <option>I: Triton</option>

    <option>J: Victoria</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In 1935 roughly how many Americans were in favor of Social
    Security act?</question>

    <options><option>A: 20%</option>

    <option>B: 30%</option>

    <option>C: 60%</option>

    <option>D: 100%</option>

    <option>E: 40%</option>

    <option>F: 10%</option>

    <option>G: 80%</option>

    <option>H: 90%</option>

    <option>I: 70%</option>

    <option>J: 50%</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the traditional hierarchy of status and precedence, which of
    these members of the upper class are in the right order (from highest to
    lowest status)?</question>

    <options><option>A: Esquires, Serjeants of Law, Dukes' Eldest Sons</option>

    <option>B: Marquesses of England, Earls of Great Britain, King's
    Brothers</option>

    <option>C: Barons of Scotland, King's Uncles, Companions of the
    Bath</option>

    <option>D: Lord Chancellor, Viscounts of Scotland, King's Nephews</option>

    <option>E: Prime Minister, Dukes' Younger Sons, Barons of Great
    Britain</option>

    <option>F: Archbishop of Canterbury, Viscounts of Ireland, King's Younger
    Sons</option>

    <option>G: Marquesses of Scotland, Dukes of England, Serjeants of
    Law</option>

    <option>H: King's Daughters, Earls of Ireland, Companions of the
    Bath</option>

    <option>I: Prime Minister, Archbishop of York, Viscounts of England</option>

    <option>J: King's Grandsons, Lord High Treasurer, Companions of the
    Bath</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The City of Windemere decided to construct several large windmills
    to generate electrical power. The construction was financed through a
    general residential property tax levy for the next ten years. Utility
    revenues are intended to offset all expenses associated with the windmills.
    The land for the windmills was donated to the city by a local farmer. The
    land from the farmer should be reported in which fund type?</question>

    <options><option>A: Permanent.</option>

    <option>B: Internal Service.</option>

    <option>C: Trust and Agency.</option>

    <option>D: Capital projects.</option>

    <option>E: Enterprise.</option>

    <option>F: Debt Service.</option>

    <option>G: General Fund.</option>

    <option>H: Pension (and other employee benefit) Trust.</option>

    <option>I: Investment Trust.</option>

    <option>J: Special revenue.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What has been the impact of nuclear deterrence on international
    politics post-Cold War?</question>

    <options><option>A: There is a developing scholarly trend toward
    proliferation pessimism, a pattern which has gained momentum rather than
    subsided with the end of the Cold War. There is concern that accidental war
    may occur, either through misperception, psychological or technical problems
    that can lead to spiralling tensions which result in a failure of deterrence
    policy. In addition, normal accidents resulting from the inability of a
    state to capably anticipate human-machine interactions in the complexities
    of the international (and anarchical) system may also occur.</option>

    <option>B: Proliferation optimists dispute the claim that nuclear technology
    leads to a propensity of the holding actor towards war. They do concede that
    there is the risk that terrorists acquiring the weapon could create an
    existential threat to the international system, although the threat is not
    yet a reality. Furthermore, the ability to retaliate can eliminate an
    opponent's potential gain.</option>

    <option>C: Despite the recognition that the ability to retaliate (the secure
    second-strike capability) produces a situation known as crisis stability,
    there is no consensus on the impact of nuclear capabilities, whether a
    source of stabilization or an existential threat. However there is agreement
    that the spread of WMD capacity to non-state actors would be fundamentally
    detrimental to international security based on the recognition that existing
    deterrence strategies and capabilities do not address the use of nuclear
    weapons. Indeed whilst the possibility exists, states will have to heighten
    security efforts.</option>

    <option>D: Deterrence has proved to have been a source of stabilization
    during the Cold War but proliferation pessimists contend that new states'
    development programs do not provide sufficient guarantees that the state
    sponsors will act as good custodians. Weak state structures might result in
    sabotage, accidental use, or even theft. There is also the problem of states
    developing technology under the guise of deterrence whilst having ulterior
    motives. Domestic pressures may result in a regime gravitating towards
    nuclear war fighting strategies to win a rapid victory and strengthen
    status.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the final word of the Pledge of Allegiance?</question>

    <options><option>A: unity</option>

    <option>B: all</option>

    <option>C: indivisible</option>

    <option>D: allegiance</option>

    <option>E: America</option>

    <option>F: justice</option>

    <option>G: liberty</option>

    <option>H: stands</option>

    <option>I: flag</option>

    <option>J: one</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>If the objective of an auditor's test of details is to detect the
    overstatement of sales the auditor should trace transactions from
    the</question>

    <options><option>A: Customer's purchase orders to the sales
    journal.</option>

    <option>B: Shipping documents to the cash receipts journal.</option>

    <option>C: Cash receipts journal to the shipping documents.</option>

    <option>D: Sales journal to the cash receipts journal.</option>

    <option>E: Sales journal to the shipping documents.</option>

    <option>F: Shipping documents to the sales journal.</option>

    <option>G: Customer's purchase orders to the cash receipts journal.</option>

    <option>H: Cash receipts journal to the customer's purchase orders.</option>

    <option>I: Shipping documents to the customer's purchase orders.</option>

    <option>J: Customer's purchase orders to the shipping
    documents.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Ultra Co. uses a periodic inventory system. The following are
    inventory transactions for the month of January: 1/1 Beginning inventory
    20000 units at $13 1/20 Purchase 30000 units at $15 1/23 Purchase 40000
    units at $17 1/31 Sales at $20 per unit 50000 units Ultra uses the LIFO
    method to determine the value of its inventory. What amount should Ultra
    report as cost of goods sold on its income statement for the month of
    January?</question>

    <options><option>A: $810,000</option>

    <option>B: 1000000</option>

    <option>C: $1,030,000</option>

    <option>D: $830,000</option>

    <option>E: $1,100,000</option>

    <option>F: $870,000</option>

    <option>G: $750,000</option>

    <option>H: $950,000</option>

    <option>I: $710,000</option>

    <option>J: $910,000</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Joe wants desperately to get close to Helen. Helen appears to be
    put off by Joe's desperate advances. This is typical of Joe's relationships
    with women. According to attachment theory Joe would best be described
    as:</question>

    <options><option>A: a detached lover</option>

    <option>B: an avoidant lover</option>

    <option>C: a disorganized lover</option>

    <option>D: a fearful-avoidant lover</option>

    <option>E: a secure-avoidant lover</option>

    <option>F: a passionate lover</option>

    <option>G: a dismissive-avoidant lover</option>

    <option>H: a secure lover</option>

    <option>I: an obsessive lover</option>

    <option>J: an anxious-ambivalent lover</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What are the themes that make post-structuralism a different field
    of study and why is it criticized?</question>

    <options><option>A: One of the founding assumptions of Critical Security
    Studies is that theories about the world constitute that world and thus that
    theory, including security theory, has political effects. The consequence is
    that theory is the product of the system, and that analyses of the agent of
    security and the referent object is produced by its own practices.</option>

    <option>B: Central to the political and critical nature of post-structural
    literature is the idea of fostering an ethos of democracy and an ethos of
    critique which is finite and attainable. It is to this end that we must
    strive, but one that can only be met under the conditions prescribed, that
    of true democracy.</option>

    <option>C: Poststructuralism accepts the form and foundations for knowledge
    claims that dominate the security studies debate. This has brought it into
    confrontation with the critical studies community, having little to
    contribute to the understanding of the ways in which knowledge is
    constructed.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Strom acquired a 25% interest in Ace Partnership by contributing
    land having an adjusted basis of $16,000 and a fair market value of $50,000.
    The land was subject to a $24,000 mortgage, which was assumed by Ace. No
    other liabilities existed at the time of the contribution. What was Strom's
    basis in Ace?</question>

    <options><option>A: $24,000</option>

    <option>B: $40,000</option>

    <option>C: $32,000</option>

    <option>D: $50,000</option>

    <option>E: $42,000</option>

    <option>F: $26,000</option>

    <option>G: $0</option>

    <option>H: $36,000</option>

    <option>I: $16,000</option>

    <option>J: $22,000</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2019, about what percentage of South Koreans say it is
    necessary to believe in God in order to be moral and have good
    values?</question>

    <options><option>A: 10%</option>

    <option>B: 25%</option>

    <option>C: 45%</option>

    <option>D: 50%</option>

    <option>E: 85%</option>

    <option>F: 30%</option>

    <option>G: 90%</option>

    <option>H: 70%</option>

    <option>I: 65%</option>

    <option>J: 55%</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Segmentation of the population into psychographics, demographics
    and geodemographics is especially important in which public relations
    specialisation?</question>

    <options><option>A: Employee relations</option>

    <option>B: Public affairs</option>

    <option>C: Crisis management</option>

    <option>D: Government relations</option>

    <option>E: Media relations</option>

    <option>F: Issues management</option>

    <option>G: Investor relations</option>

    <option>H: Community relations</option>

    <option>I: Corporate communications</option>

    <option>J: Marketing communications</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following policies did the New Labour government not
    pursue?</question>

    <options><option>A: supporting LEAs that appeared to be failing</option>

    <option>B: abolition of student tuition fees</option>

    <option>C: privatization of state schools</option>

    <option>D: state regulation and control of the curriculum</option>

    <option>E: requiring all schools to provide vocational training</option>

    <option>F: implementing a national dress code for teachers</option>

    <option>G: setting and streaming pupils by ability</option>

    <option>H: introduction of league tables and competition among
    schools</option>

    <option>I: eliminating standardized testing</option>

    <option>J: parental choice of school</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Incumbent members of the House of Representatives win reelection
    more often than incumbent senators for all of the following reasons
    EXCEPT</question>

    <options><option>A: representatives are more likely to secure party
    endorsements</option>

    <option>B: senators are more likely to face strong challengers from within
    their own party</option>

    <option>C: senators have more political power than representatives, and
    Senate races are accordingly contested more aggressively</option>

    <option>D: representatives more often run uncontested</option>

    <option>E: representatives' constituents more often belong largely to the
    representative's party</option>

    <option>F: senators have a larger geographic area to campaign in, making it
    more challenging</option>

    <option>G: representatives may use federal funds to publicize their
    achievements via direct mail to constituents</option>

    <option>H: representatives have shorter terms, allowing for more frequent
    engagement with constituents</option>

    <option>I: senators have less visibility and recognition among
    voters</option>

    <option>J: senators are more prone to controversies due to their
    high-profile positions</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which method of abortion is most costly and carries the greatest
    risk of complications?</question>

    <options><option>A: manual vacuum aspiration</option>

    <option>B: saline-induced abortion</option>

    <option>C: medical abortion with misoprostol</option>

    <option>D: hysterotomy</option>

    <option>E: suction aspiration</option>

    <option>F: dilation and curettage</option>

    <option>G: medical abortion with methotrexate and misoprostol</option>

    <option>H: mifepristone abortion</option>

    <option>I: dilation and evacuation</option>

    <option>J: prostaglandin abortion</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The difference between a pardon and a reprieve is</question>

    <options><option>A: a reprieve grants a release from legal punishment, while
    a pardon postpones it</option>

    <option>B: a pardon grants a release from legal punishment while a reprieve
    postpones it</option>

    <option>C: a pardon can only be given by a judge, while a reprieve can be
    granted by a jury</option>

    <option>D: only state governors can issue pardons</option>

    <option>E: a reprieve lasts for life, while a pardon is temporary</option>

    <option>F: only the President can issue reprieves</option>

    <option>G: a pardon lasts 10 years, while a reprieve lasts one year</option>

    <option>H: a pardon allows for re-sentencing, while a reprieve does
    not</option>

    <option>I: a reprieve can be granted to organizations, while a pardon can
    only be granted to individuals</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many moles of HCl must be added to sufficient water to form 3
    liters of a 2 M HCI solution?</question>

    <options><option>A: 1 mol</option>

    <option>B: 3 mol</option>

    <option>C: 6 mol</option>

    <option>D: 2 mol</option>

    <option>E: 4 mol</option>

    <option>F: 9 mol</option>

    <option>G: 10 mol</option>

    <option>H: 5 mol</option>

    <option>I: 7 mol</option>

    <option>J: 8 mol</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Internet traffic is expected to grow by 400% in the next few
    years. What is predicted to be the main driver of this?</question>

    <options><option>A: Video</option>

    <option>B: Gaming</option>

    <option>C: Email communication</option>

    <option>D: Virtual Reality applications</option>

    <option>E: Online auctions</option>

    <option>F: Social media usage</option>

    <option>G: Online consumer goods purchases</option>

    <option>H: E-book downloads</option>

    <option>I: Online education platforms</option>

    <option>J: Music</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How much more electrical energy will the United States need to
    generate if everyone drives electric cars?</question>

    <options><option>A: 2*10^20 J</option>

    <option>B: 2*10^21 J</option>

    <option>C: 2*10^19 J</option>

    <option>D: 2*10^28 J</option>

    <option>E: 2*10^27 J</option>

    <option>F: 2*10^24 J</option>

    <option>G: 2*10^25 J</option>

    <option>H: 2*10^26 J</option>

    <option>I: 2*10^23 J</option>

    <option>J: 2*10^22 J</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>According to Macnamara's (2005) pyramid of evaluation, at which
    stage is the situation analysis done and used to form objectives and
    implementation plans?</question>

    <options><option>A: Reach</option>

    <option>B: Planning</option>

    <option>C: Evaluation</option>

    <option>D: Outputs</option>

    <option>E: Outcomes</option>

    <option>F: Inputs</option>

    <option>G: Feedback</option>

    <option>H: Impact</option>

    <option>I: Process</option>

    <option>J: Outtakes</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Keith is really anxious about a big presentation he has to give at
    work tomorrow. As a result tonight he is having trouble getting an erection.
    Which of the following BEST explains why Keith might be having this
    problem?</question>

    <options><option>A: relaxation inhibits the parasympathetic system</option>

    <option>B: anxiety inhibits the sympathetic system</option>

    <option>C: anxiety increases blood flow to the lower spinal cord inhibiting
    vasocongestion</option>

    <option>D: relaxation is necessary for vasocongestion</option>

    <option>E: anxiety decreases blood flow to the upper spinal cord inhibiting
    vasocongestion</option>

    <option>F: anxiety causes an increase in adrenaline which promotes
    arousal</option>

    <option>G: anxiety causes retrograde ejaculation which inhibits
    arousal</option>

    <option>H: Keith's problem is not related to his anxiety but due to physical
    issues</option>

    <option>I: relaxation causes retrograde ejaculation which inhibits
    arousal</option>

    <option>J: anxiety causes an increase in testosterone which inhibits
    arousal</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What pro wrestler grapples with Sylvester Stallone in the
    movie-'Rocky III'?</question>

    <options><option>A: Dolph Lundgren</option>

    <option>B: Ric Flair</option>

    <option>C: The Rock</option>

    <option>D: John Cena</option>

    <option>E: Randy Savage</option>

    <option>F: Andre the Giant</option>

    <option>G: Stone Cold Steve Austin</option>

    <option>H: The Iron Sheik</option>

    <option>I: Undertaker</option>

    <option>J: Hulk Hogan</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the Three Stooges was not related to the
    others?</question>

    <options><option>A: Manny</option>

    <option>B: Curly Joe</option>

    <option>C: Ted</option>

    <option>D: Larry Joe</option>

    <option>E: Emil</option>

    <option>F: Shemp</option>

    <option>G: Moe</option>

    <option>H: Joe</option>

    <option>I: Larry</option>

    <option>J: Curly</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following words cannot be decoded through knowledge
    of letter-sound relationships?</question>

    <options><option>A: Lamp</option>

    <option>B: Flight</option>

    <option>C: Light</option>

    <option>D: Things</option>

    <option>E: Fold</option>

    <option>F: Said</option>

    <option>G: Drain</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What kind of animal is cartoon character Tennessee
    Tuxedo?</question>

    <options><option>A: penguin</option>

    <option>B: cat</option>

    <option>C: kangaroo</option>

    <option>D: shark</option>

    <option>E: skunk</option>

    <option>F: walrus</option>

    <option>G: dolphin</option>

    <option>H: rabbit</option>

    <option>I: squirrel</option>

    <option>J: parrot</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>If the permeability of subsoil is rapid, the subsoil texture is
    most likely classified as</question>

    <options><option>A: clayey</option>

    <option>B: medium</option>

    <option>C: peaty</option>

    <option>D: loamy</option>

    <option>E: rocky</option>

    <option>F: fine</option>

    <option>G: coarse</option>

    <option>H: silty</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Walt Disney, Sony and Time Warner are examples of:</question>

    <options><option>A: non-profit organizations</option>

    <option>B: government-owned companies</option>

    <option>C: news broadcasting companies</option>

    <option>D: international hotel chains</option>

    <option>E: online streaming platforms</option>

    <option>F: transnational corporations</option>

    <option>G: technology companies</option>

    <option>H: multi-media empires</option>

    <option>I: ownership concentrated within one medium</option>

    <option>J: independent film studios</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Among the following groups that have traditionally supposed the
    Democratic Party, which has the least liberal constituency?</question>

    <options><option>A: African Americans</option>

    <option>B: Urban residents</option>

    <option>C: Labor union members</option>

    <option>D: Hispanic and Latino Americans</option>

    <option>E: White Southerners</option>

    <option>F: Northern ethnic minorities</option>

    <option>G: College students</option>

    <option>H: LGBTQ+ community</option>

    <option>I: Environmental activists</option>

    <option>J: Women's rights advocates</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the card game blackjack how much are a queen and a king
    worth-together?</question>

    <options><option>A: 22</option>

    <option>B: 19</option>

    <option>C: 25</option>

    <option>D: 16</option>

    <option>E: 15</option>

    <option>F: 18</option>

    <option>G: 20</option>

    <option>H: 17</option>

    <option>I: 21</option>

    <option>J: 11</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following materials has a resistance that is LEAST
    affected by temperature changes?</question>

    <options><option>A: Gold</option>

    <option>B: Silver</option>

    <option>C: Nickel</option>

    <option>D: Iron</option>

    <option>E: Silicon</option>

    <option>F: Aluminum</option>

    <option>G: Zinc</option>

    <option>H: Copper</option>

    <option>I: Germanium</option>

    <option>J: Carbon</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Are strategies of Arms Control and Deterrence useful in
    cyber-security?</question>

    <options><option>A: No, arms control does not serve any purpose outside the
    realm of traditional military weapons.</option>

    <option>B: Arms control strategies can be implemented, but deterrence
    strategies are impossible due to the anonymous nature of cyber
    attacks.</option>

    <option>C: Yes, both strategies are effective in cyber-security as long as
    there is strong international cooperation and regulation.</option>

    <option>D: Effective deterrence requires international cooperation which is
    achievable in theory, but the verification required for traditional arms
    control strategies is impossible in cyber(ed) warfare.</option>

    <option>E: Only arms control is unproblematic, deterrence has failed because
    international cooperation cannot be reached and common rules or practices
    cannot be established.</option>

    <option>F: Both strategies can only work if there is a clear agreement on
    what constitutes a cyber weapon and what constitutes a cyber
    attack.</option>

    <option>G: Yes, successful policies of arms control and deterrence have
    translated well from other security realms, such as nuclear weapons control
    strategies.</option>

    <option>H: Deterrence is ineffective because it encourages an arms race in
    cyberspace, while arms control is difficult due to the ease of creating and
    distributing cyber weapons.</option>

    <option>I: Both arms control and deterrence strategies are ineffective due
    to the rapid and unpredictable development of cyber warfare
    technologies.</option>

    <option>J: No, both strategies are obsolete in the face of cyber warfare's
    unique challenges such as attribution and boundary
    issues.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The city of Cobb has two trust funds for the benefit of the city's
    library trust fund A and trust fund B. Only the earnings from trust fund A
    can be expended and both the principal and interest from trust fund B can be
    expended. How should the city of Cobb report each trust fund? Trust fund A
    Trust fund B</question>

    <options><option>A: Special revenue Special revenue</option>

    <option>B: Permanent Capital projects</option>

    <option>C: Capital projects Capital projects</option>

    <option>D: Debt service Debt service</option>

    <option>E: Permanent Permanent</option>

    <option>F: Capital projects Permanent</option>

    <option>G: Special revenue Permanent</option>

    <option>H: Debt service Special revenue</option>

    <option>I: Permanent Special revenue</option>

    <option>J: Special revenue Debt service</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Of the following interest groups, which has created the largest
    number of political action committees (PACs) since the 1970s?</question>

    <options><option>A: Environmental activists</option>

    <option>B: Labor unions</option>

    <option>C: For-profit business</option>

    <option>D: Religious institutions</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In performing substantive tests regarding the granting of stock
    options to senior management of an issuer an auditor most likely
    would</question>

    <options><option>A: Interview senior management to determine their knowledge
    of stock options.</option>

    <option>B: Confirm with the issuer's legal counsel whether the options were
    legally granted.</option>

    <option>C: Review the public records of the SEC to determine whether the
    options were properly reported.</option>

    <option>D: Trace the authorization for the options granted to the board of
    directors' approval.</option>

    <option>E: Confirm with those members of management as to whether they are
    actually option holders.</option>

    <option>F: Review the issuer's tax records to determine the tax implications
    of the stock options.</option>

    <option>G: Verify the existence of option holders in the issuer's payroll
    and human resources records.</option>

    <option>H: Review the minutes of the board of directors' meetings to
    determine if the options were discussed.</option>

    <option>I: Analyze the financial reports to determine the impact of the
    stock options on the company's profitability.</option>

    <option>J: Inspect the company's employee handbook to verify the policy on
    stock options.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A firm's inventory turnover (IT) is 5 times on a cost of goods
    sold (COGS) of $800,000. If the IT is improved to 8 times while the COGS
    remains the same, a substantial amount of funds is released from or
    additionally invested in inventory. In fact,</question>

    <options><option>A: $200,000 is released.</option>

    <option>B: $100,000 is released.</option>

    <option>C: $140,000 is additionally invested.</option>

    <option>D: $160,000 is released.</option>

    <option>E: $140,000 is released.</option>

    <option>F: $200,000 is additionally invested.</option>

    <option>G: $60,000 is additionally invested.</option>

    <option>H: $60,000 is released.</option>

    <option>I: $160,000 is additionally invested.</option>

    <option>J: $100,000 is additionally invested.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is not in Nevada?</question>

    <options><option>A: Liberace Museum</option>

    <option>B: Pikes Peak</option>

    <option>C: Hoover Dam</option>

    <option>D: Death Valley National Park</option>

    <option>E: Lake Mead</option>

    <option>F: Red Rock Canyon National Conservation Area</option>

    <option>G: Fremont Street Experience</option>

    <option>H: Mount Charleston</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>To what extent and to what effect has the environment been
    securitized?</question>

    <options><option>A: Environmental security has been largely disregarded by
    policymakers and is not seen as a high-priority issue.</option>

    <option>B: Environmental security has led to a 'trading off' of military
    security for environmental security with the allocation of resources
    committed to solving environmental problems. A particular emphasis has been
    placed on environmental change as the cause of violent conflict and
    addressing environmental threats from other factors than domestic
    causes.</option>

    <option>C: The national security perspective on environmental issues has
    undermined the utility of the concept of environmental security. The
    militarization of environmental problems has decreased the ability of
    policymakers to 'capture' the critical nature of environmental problems and
    the environmental dimensions to social vulnerability. The reconciliation of
    environmental security with national security, and global levels of
    international change cannot be made without trading in the security
    interests of the state.</option>

    <option>D: The securitization of environmental security concerns has raised
    the profile of environmental security issues among both foreign and domestic
    security policymakers and agencies. It is now uniformly recognized that
    environmental change can be considered as an issue of high security
    politics.</option>

    <option>E: The 'securitization' of the environment has led to a significant
    increase in funding and resources allocated to environmental protection and
    conservation efforts.</option>

    <option>F: The environment has been 'securitized' in the sense that
    environmental security has been used to make them matters of 'high
    politics'. This has to some degree raised the profile of critical issues
    among policymakers and agencies so that the environment can be considered an
    issue of security. But whilst the issue has been broadened there has been
    little change in policy and action in terms of the referent object of
    environmental security.</option>

    <option>G: The securitization of environmental issues has led to a reduction
    in the importance placed on other areas of security.</option>

    <option>H: The environment has been 'securitized' to the extent that it has
    become a central focus of military strategy and planning.</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As part of a staffing strategy, a human resources manager hires
    new personnel through a hidden market. Which of the following best
    represents the use of a hidden market?</question>

    <options><option>A: Advertising the job opening on job posting Web
    sites</option>

    <option>B: Conducting a walk-in interview session</option>

    <option>C: Sending out a mass email to potential candidates</option>

    <option>D: Promoting the job opening in a newspaper or magazine</option>

    <option>E: Hiring an external recruitment agency to fill the
    position</option>

    <option>F: Posting the job opening to a social media Web site</option>

    <option>G: Posting the job opening on the company's website</option>

    <option>H: Receiving a recommendation from a current employee</option>

    <option>I: Using a headhunter to find potential candidates</option>

    <option>J: Participating in a career fair at a local community
    college</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2019, about what percentage of Germans say the relationship
    between the U.S. and Germany is good?</question>

    <options><option>A: 34%</option>

    <option>B: 85%</option>

    <option>C: 64%</option>

    <option>D: 25%</option>

    <option>E: 55%</option>

    <option>F: 70%</option>

    <option>G: 79%</option>

    <option>H: 90%</option>

    <option>I: 49%</option>

    <option>J: 15%</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Joe is the trustee of a trust set up for his father. Under the
    Internal Revenue Code, when Joe prepares the annual trust tax return, Form
    1041, he</question>

    <options><option>A: May sign the return but must include a separate
    statement explaining his relationship to the trust.</option>

    <option>B: May not sign the return unless he is also named as a
    co-trustee.</option>

    <option>C: Can only sign the return if he is also a certified public
    accountant.</option>

    <option>D: Is considered a tax return preparer only if he is also the
    beneficiary of the trust.</option>

    <option>E: May not sign the return unless he receives additional
    compensation for the tax return.</option>

    <option>F: Must obtain the written permission of the beneficiary prior to
    signing as a tax return preparer.</option>

    <option>G: Is considered a tax return preparer because his father is the
    grantor of the trust.</option>

    <option>H: Is not considered a tax return preparer.</option>

    <option>I: Is not considered a tax return preparer unless he personally
    benefits from the trust's assets.</option>

    <option>J: Is considered a tax return preparer and must pay a fee to the IRS
    for this service.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Under state law Boca Co. may reimburse the state directly for
    actual unemployment claims or it may pay 3% of eligible gross wages. Boca
    believes that actual unemployment claims will be 2% of eligible gross wages
    and has chosen to reimburse the state. Eligible gross wages are defined as
    the first $15000 of gross wages paid to each employee. Boca had four
    employees each of whom earned $20000 during the year. What amount should
    Boca report as accrued liability for unemployment claims in its year-end
    balance sheet?</question>

    <options><option>A: $1,200</option>

    <option>B: $1,500</option>

    <option>C: $2,200</option>

    <option>D: $2,000</option>

    <option>E: $1,600</option>

    <option>F: $1,400</option>

    <option>G: $1,000</option>

    <option>H: 2400</option>

    <option>I: $2,100</option>

    <option>J: $1,800</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In return for a 20% partnership interest, Skinner contributed
    $5,000 cash and land with a $12,000 basis and a $20,000 fair market value to
    the partnership. The land was subject to a $10,000 mortgage that the
    partnership assumed. In addition, the partnership had $20,000 in recourse
    liabilities that would be shared by partners according to their partnership
    interests. What amount represents Skinner’s basis in the partnership
    interest?</question>

    <options><option>A: $17,000</option>

    <option>B: $20,000</option>

    <option>C: $25,000</option>

    <option>D: $12,000</option>

    <option>E: $15,000</option>

    <option>F: $19,000</option>

    <option>G: $13,000</option>

    <option>H: $14,000</option>

    <option>I: $27,000</option>

    <option>J: $21,000</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In what city is TV's 'The Mary Tyler Moore Show' set?</question>

    <options><option>A: New York</option>

    <option>B: Dallas</option>

    <option>C: Seattle</option>

    <option>D: San Francisco</option>

    <option>E: Los Angeles</option>

    <option>F: Boston</option>

    <option>G: Philadelphia</option>

    <option>H: Chicago</option>

    <option>I: Minneapolis</option>

    <option>J: Miami</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Before Nixon resigned how many believed he should be removed from
    office?</question>

    <options><option>A: 57%</option>

    <option>B: 33%</option>

    <option>C: 62%</option>

    <option>D: 44%</option>

    <option>E: 88%</option>

    <option>F: 25%</option>

    <option>G: 79%</option>

    <option>H: 98%</option>

    <option>I: 70%</option>

    <option>J: 50%</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A presidential veto would most likely be overturned in which of
    the following situations?</question>

    <options><option>A: The majority of American citizens support the proposed
    legislation.</option>

    <option>B: More than half of the state governors support the proposed
    legislation.</option>

    <option>C: The Supreme Court has ruled in favor of the proposed
    legislation.</option>

    <option>D: The Vice President supports the proposed legislation.</option>

    <option>E: The chief justice of the Supreme Court was appointed by the
    president.</option>

    <option>F: The president's approval rating is exceptionally high.</option>

    <option>G: The president’s party has a majority in the House but not in the
    Senate.</option>

    <option>H: Approximately 30% of the senators and representatives are members
    of the presidential political party.</option>

    <option>I: The proposed legislation has been sponsored by a third-party
    senator.</option>

    <option>J: The president's successful reelection campaign advocated
    bipartisanship.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is NOT one of the four categories of
    persuasive crisis communication strategies identified by W. Timothy
    Coombs?</question>

    <options><option>A: ingratiation</option>

    <option>B: downplaying</option>

    <option>C: distancing</option>

    <option>D: nonexistence</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The feedback loop in men which regulates the production of sex
    hormones includes all but which of the following?</question>

    <options><option>A: follicle-stimulating hormone</option>

    <option>B: oxytocin</option>

    <option>C: pituitary gland</option>

    <option>D: hypothalamus</option>

    <option>E: gonadotropin-releasing hormone</option>

    <option>F: luteinizing hormone</option>

    <option>G: testosterone</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What seems to be the case when the folk saying "opposites attract"
    (i.e., dissimilar attitudes tend to cause liking) when it is considered in
    light of current research?</question>

    <options><option>A: It seems to be true for heterosexuals but not for
    homosexuals.</option>

    <option>B: It seems to be true for men but not for women.</option>

    <option>C: It seems to be true for homosexuals but not for
    heterosexuals.</option>

    <option>D: It seems to be true for women but not for men</option>

    <option>E: It seems to be true for people with certain personality
    traits.</option>

    <option>F: It seems to be true in some cultures but not in others.</option>

    <option>G: It does not seem to be true.</option>

    <option>H: It seems to be true only in certain situations.</option>

    <option>I: It seems to be true for older adults but not for younger
    adults.</option>

    <option>J: It seems to be true for younger adults but not for older
    adults.</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What sexual act is prohibited in most societies?</question>

    <options><option>A: sex without consent</option>

    <option>B: sex during menstruation</option>

    <option>C: sex with an animal</option>

    <option>D: sex in public places</option>

    <option>E: sex with a minor</option>

    <option>F: sex with a dead person</option>

    <option>G: sex for money</option>

    <option>H: incest</option>

    <option>I: masturbation</option>

    <option>J: sex with a non-spouse if the person is
    married.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following statements regarding an individual’s
    suspended passive activity losses is correct?</question>

    <options><option>A: Suspended losses can only be utilized against active
    income, not portfolio income.</option>

    <option>B: Suspended losses must be carried forward five years and back two
    years.</option>

    <option>C: A maximum of 75% of the suspended losses can be used each year
    when an election is made to forgo the carryback period.</option>

    <option>D: Suspended losses must be carried back three years and forward
    seven years.</option>

    <option>E: Suspended losses can be carried forward, but not back, until
    utilized.</option>

    <option>F: Suspended losses can be carried back three years, but not
    forward.</option>

    <option>G: $3,000 of suspended losses can be utilized each year against
    portfolio income.</option>

    <option>H: A maximum of 50% of the suspended losses can be used each year
    when an election is made to forgo the carryback period.</option>

    <option>I: Only 25% of the suspended losses can be used each year without
    any carryback or carryforward period.</option>

    <option>J: Suspended losses can be carried back and forward indefinitely
    until utilized.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following procedures would an auditor most likely
    perform to obtain evidence about the occurrence of subsequent
    events?</question>

    <options><option>A: Check compliance with laws and regulations during the
    subsequent event period.</option>

    <option>B: Assess the financial stability of the company's key customers and
    suppliers.</option>

    <option>C: Trace information from shipping documents to sales invoices and
    sales journal transactions.</option>

    <option>D: Evaluate the adequacy of the allowance for doubtful
    accounts.</option>

    <option>E: Conduct a physical count of the company's inventory.</option>

    <option>F: Verify inventory pledged under loan agreements by confirming the
    details with financial institutions.</option>

    <option>G: Compare the financial statements being reported on with those of
    the prior year.</option>

    <option>H: Inquire about the current status of transactions that were
    recorded on the basis of preliminary data.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The following information pertains to Dash Co.'s utility bills:
    Period covered Amount Date paid April 16 – May 15 $5000 June 1 May 16 –
    June 15 $6000 July 1 June 16 – July 15 $8000 August 1 What is the amount
    that Dash should report as a liability in its June 30 balance
    sheet?</question>

    <options><option>A: $8,000</option>

    <option>B: $5,000</option>

    <option>C: $9,000</option>

    <option>D: $13,000</option>

    <option>E: 14000</option>

    <option>F: $15,000</option>

    <option>G: $10,000</option>

    <option>H: $12,000</option>

    <option>I: $7,000</option>

    <option>J: $6,000</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How can the origins of weak state insecurity be
    explained?</question>

    <options><option>A: Weak state insecurity in a historical framework of
    analysis represents an abnormal state in the long term state-building
    process. Bloody and violent conflict between social forces is not consistent
    with the presence of the centralizing force with the capacity to attain
    monopoly of control over violence.</option>

    <option>B: The utility of explaining weak state insecurity with a comparison
    to the historical conditions of state consolidation in Europe does not stand
    in the contemporary context of global society because of the pervasion of
    international norms to prevent violent conflict from manifesting in the
    consolidation process.</option>

    <option>C: The contemporary state-building condition is constrained by the
    shortened time-frame operating within the established guidelines of
    international norms, a particular problematic rule of which is sovereignty.
    Thus, unlike some European entities which could not complete the
    state-building process and were absorbed into more viable units, weak states
    will remain quasi entities.</option>

    <option>D: Weak state insecurity originated from the denial of sovereignty
    as the norm and the corresponding extension of the right to inviolability of
    statehood. Without protection under international laws the possibility of
    its national status being revoked and its territory being subsumed into
    another state threatens the consolidation of the state-building
    process.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following factors most likely would cause a CPA not
    to accept a new audit engagement?</question>

    <options><option>A: The CPA's preference for working with larger
    companies.</option>

    <option>B: The CPA's lack of understanding of the entity's operations and
    industry.</option>

    <option>C: The entity's financial year does not align with the CPA's
    schedule.</option>

    <option>D: The CPA's current workload is too heavy to accommodate a new
    client.</option>

    <option>E: Management's unwillingness to make all financial records
    available to the CPA.</option>

    <option>F: The entity is not willing to cover the CPA's travel expenses for
    audit purposes.</option>

    <option>G: The entity's location is in a different city than the CPA's
    office.</option>

    <option>H: The CPA's lack of interest in the particular industry of the
    entity.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following transactions correctly illustrates the
    doctrine of substantial performance?</question>

    <options><option>A: A contract required hair styling to be done to Toby's
    satisfaction but Toby was in good faith dissatisfied with the completed
    result.</option>

    <option>B: Leslie painted an entire room but failed to put the electrical
    outlet covers back on.</option>

    <option>C: Blair ordered a dozen blue chairs from Kyle but Kyle delivered a
    dozen red chairs.</option>

    <option>D: A carpenter built a bookshelf but used pine instead of the
    contracted oak.</option>

    <option>E: A dentist competently completed the extraction of Lee's tooth but
    mistakenly pulled the wrong one.</option>

    <option>F: A builder constructed a house but forgot to install the kitchen
    sink.</option>

    <option>G: A chef cooked a meal but used pepper instead of salt.</option>

    <option>H: A mechanic fixed a car but forgot to change the
    oil.</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following countries generated the most total energy
    from solar sources in 2019?</question>

    <options><option>A: India</option>

    <option>B: France</option>

    <option>C: Australia</option>

    <option>D: United States</option>

    <option>E: Germany</option>

    <option>F: United Kingdom</option>

    <option>G: Japan</option>

    <option>H: China</option>

    <option>I: Italy</option>

    <option>J: Spain</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is an example of devolution?</question>

    <options><option>A: Allowing states to decide how to meet federally mandated
    greenhouse gas emissions targets</option>

    <option>B: The federal government setting a minimum wage that all states
    must meet</option>

    <option>C: A state being prevented from implementing a fuel efficiency
    standard that is more stringent than that set by the federal
    government</option>

    <option>D: A "race to the bottom" in which states compete with one another
    to have the fewest environmental regulations</option>

    <option>E: A state being forced to comply with federal immigration
    policies</option>

    <option>F: The federal government establishing nationwide educational
    standards</option>

    <option>G: A state choosing to implement stricter gun control laws than
    those mandated by the federal government</option>

    <option>H: A state that decriminalizes all drug use, contrary to federal
    law</option>

    <option>I: A state that legalizes marijuana possession in conflict with
    federal law</option>

    <option>J: The federal government overriding a state's decision to legalize
    same-sex marriage</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The endometrium grows and thickens during:</question>

    <options><option>A: the secretory phase</option>

    <option>B: the follicular phase</option>

    <option>C: the proliferative phase</option>

    <option>D: postmenopause</option>

    <option>E: menopause</option>

    <option>F: pregnancy</option>

    <option>G: menstruation</option>

    <option>H: ovulation</option>

    <option>I: the luteal phase</option>

    <option>J: the menstrual cycle</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>An auditor decides to use the blank form of positive accounts
    receivable confirmation. The auditor should be aware that the blank form may
    be ineffective because</question>

    <options><option>A: The auditor may have selected the wrong accounts to send
    the blank form to.</option>

    <option>B: The blank form might be too complicated for the recipient to
    understand.</option>

    <option>C: Accounts actually confirmed may not be representative of the
    population.</option>

    <option>D: Accounts unconfirmed may have already been written off as
    uncollectible.</option>

    <option>E: The blank form might be lost in the mail, resulting in no
    response.</option>

    <option>F: All accounts do not have an equal opportunity to be selected for
    confirmation.</option>

    <option>G: The recipient may not have the necessary information to fill the
    blank form.</option>

    <option>H: Few responses may occur because more effort is required of
    recipients.</option>

    <option>I: The blank form may be mistaken for junk mail and
    discarded.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What impact did the end of the Cold War have on warlord
    politics?</question>

    <options><option>A: Warlord politics represented the entrenchment of
    traditional patterns of redistributive networks within society but
    maintained by alternative political sources. Assistance derived from
    superpowers was superseded by US hegemonic endorsement at the end of the
    Cold War.</option>

    <option>B: The end of the Cold War had no significant impact on warlord
    politics, as these patterns of governance were already well-established in
    many regions.</option>

    <option>C: The end of the Cold War led to a transition from warlord politics
    to more centralized forms of governance, as international actors sought to
    promote state-building and development.</option>

    <option>D: Within the context of state collapse, elites deliberately
    engender disorder for the pursuit of commercial activities and the
    exploitation of neo-liberal globalized shadow markets which would not
    otherwise be permissible in normal conditions. Warlord politics represented
    a new form of regime security forced upon weak state elites.</option>

    <option>E: Warlord politics in response to the rapid global changes
    inaugurated by the end of the Cold War and by globalization, was a temporary
    aberration in the normal function of the state and was reflective of the
    immediate need to secure infrastructural survival.</option>

    <option>F: Warlord politics remained largely unchanged following the end of
    the Cold War, as these power structures were rooted in local dynamics rather
    than international politics.</option>

    <option>G: The end of the Cold War led to a dramatic rise in warlord
    politics, as the power vacuum left by the superpowers created an opportunity
    for local strongmen to seize control.</option>

    <option>H: Warlord politics were undermined by the end of the Cold War, as
    the reduction in superpower competition decreased the resources available to
    these actors.</option>

    <option>I: Warlord politics saw a decline with the end of the Cold War, as
    international interventions aimed at democratization
    increased.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these evangelists is a cousin of rocker Jerry Lee
    Lewis?</question>

    <options><option>A: Jimmy Swaggart</option>

    <option>B: Pat Robertson</option>

    <option>C: Kenneth Copeland</option>

    <option>D: Oral Roberts</option>

    <option>E: Billy Graham</option>

    <option>F: Joel Osteen</option>

    <option>G: Benny Hinn</option>

    <option>H: Jerry Falwell</option>

    <option>I: Joyce Meyer</option>

    <option>J: Franklin Graham</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following matters is included in a typical comfort
    letter?</question>

    <options><option>A: Negative assurance on whether unaudited condensed
    financial information complies in form with the accounting requirements of
    the SEC.</option>

    <option>B: Positive assurance on whether the company's assets have been
    accurately valued.</option>

    <option>C: An opinion on whether the entity's internal control components
    are operating as designed in achieving their stated objectives.</option>

    <option>D: Positive assurance on whether there has been any change in
    capital stock or long-term debt since the date of the audited financial
    statements.</option>

    <option>E: An opinion on whether the company's financial forecasts for the
    next five years are realistic.</option>

    <option>F: An opinion on whether any fraud risk factors indicate significant
    incentive and opportunity relating to fraudulent financial
    reporting.</option>

    <option>G: An opinion on whether the company's business model is
    sustainable.</option>

    <option>H: A report on the company's past financial performance compared to
    its competitors.</option>

    <option>I: Positive assurance on whether the company has any hidden
    liabilities or debts.</option>

    <option>J: An opinion on whether the company's market share is likely to
    increase in the future.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The percentage of children in Vietnam (age 8) who reported
    physical punishment by teachers in the past week in 2009 was about
    what?</question>

    <options><option>A: 60%</option>

    <option>B: 30%</option>

    <option>C: 10%</option>

    <option>D: 40%</option>

    <option>E: 70%</option>

    <option>F: 20%</option>

    <option>G: 90%</option>

    <option>H: 50%</option>

    <option>I: 80%</option>

    <option>J: 100%</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2018, about what percentage of people from Tunisia say that
    having an increasing number of people of many different races, ethnic groups
    and nationalities in their country makes it a better place to live (as
    opposed to worse or no difference)?</question>

    <options><option>A: 70%</option>

    <option>B: 64%</option>

    <option>C: 59%</option>

    <option>D: 24%</option>

    <option>E: 39%</option>

    <option>F: 54%</option>

    <option>G: 45%</option>

    <option>H: 85%</option>

    <option>I: 10%</option>

    <option>J: 69%</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Miss Jones has been concerned about her health lately. She has
    noticed some itching and skin irritation around her genitals. Given her
    promiscuous sexual history she suspects that she has contracted:</question>

    <options><option>A: herpes</option>

    <option>B: trichomoniasis</option>

    <option>C: pubic lice</option>

    <option>D: syphilis</option>

    <option>E: genital warts</option>

    <option>F: HIV/AIDS</option>

    <option>G: yeast infection</option>

    <option>H: chlamydia</option>

    <option>I: bacterial vaginosis</option>

    <option>J: gonorrhea</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The primary function of political action committees (PACs) is
    to</question>

    <options><option>A: determine the platforms of political parties</option>

    <option>B: conduct independent investigations into political
    corruption</option>

    <option>C: provide legal advice to candidates for election</option>

    <option>D: promote the defeat of incumbents in the federal and state
    legislatures</option>

    <option>E: provide candidates with campaign staff and resources</option>

    <option>F: organize protest demonstrations and other acts of civil
    disobedience</option>

    <option>G: coordinate local get-out-the-vote campaigns</option>

    <option>H: directly campaign for specific candidates</option>

    <option>I: lobby for legislation in Congress</option>

    <option>J: contribute money to candidates for election</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Sussman Co. prepared cash-basis financial statements for the month
    ended January 31. A summary of Sussman's January activities follows: Credit
    sales of $5600. Collections of $1900 relating to January credit sales.
    Accrued salaries of $1200. By what amount will Sussman's cash-basis income
    for the month ended January 31 increase as a result of restating these
    activities to the accrual basis of accounting?</question>

    <options><option>A: 4900</option>

    <option>B: $3,700</option>

    <option>C: $6,800</option>

    <option>D: $1,200</option>

    <option>E: $5,600</option>

    <option>F: $1,900</option>

    <option>G: $2,500</option>

    <option>H: $4,400</option>

    <option>I: $3,100</option>

    <option>J: $4,100</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Newsletters generally fall in to which writing
    category?</question>

    <options><option>A: Creative writing</option>

    <option>B: Academic writing</option>

    <option>C: Legal writing</option>

    <option>D: Scientific writing</option>

    <option>E: Technical writing</option>

    <option>F: Personal writing</option>

    <option>G: Promotional writing</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many centimetres must the cervix dilute to before a baby can
    be born?</question>

    <options><option>A: 8</option>

    <option>B: 35</option>

    <option>C: 25</option>

    <option>D: 15</option>

    <option>E: 20</option>

    <option>F: 30</option>

    <option>G: 5</option>

    <option>H: 10</option>

    <option>I: 18</option>

    <option>J: 12</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the slowest wind speed a hurricane can have according to
    the Saffir-Simpson scale?</question>

    <options><option>A: 120 m.p.h.</option>

    <option>B: 85 m.p.h.</option>

    <option>C: 80 m.p.h.</option>

    <option>D: 50 m.p.h.</option>

    <option>E: 65 m.p.h.</option>

    <option>F: 74 m.p.h.</option>

    <option>G: 96 m.p.h.</option>

    <option>H: 90 m.p.h.</option>

    <option>I: 100 m.p.h.</option>

    <option>J: 110 m.p.h.</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the 'security dilemma' that faces weak states?</question>

    <options><option>A: The inability of the state to provide stability creates
    a situation wherein each component of society competes to preserve its
    well-being thereby engendering insecurity. The condition is
    self-perpetuating - a semi-permanent situation of emergent anarchy because
    measures to secure the regime will provoke greater resistance.</option>

    <option>B: The weak state insecurity dilemma is primarily an external
    condition creating a situation for the weak state similar to structural
    anarchy, wherein a weak state creates insecurity in the region when taking
    measures to improve its own regional standing.</option>

    <option>C: The weak state insecurity dilemma emerges out of competition
    between each component of society to preserve and protect the longevity of
    their well-being and interests. However, the ruling elite remain separate
    from the social sphere of contestation producing a policy dilemma; use of
    the monopoly of instruments of violence to restore order will reduce the
    regime's infrastructural core.</option>

    <option>D: Weak state insecurity dilemmas are born out of a lack of
    political and institutional centring with a monopoly of force. However, the
    engagement of armed forces to strengthen institutions may stop this process.
    Inability to foster 'stateness' is reversed by the use of violence. Social
    disquiet is a semi-permanent situation of emergent but not developed
    anarchy.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these statements cannot be applied to the initial
    development of peace studies?</question>

    <options><option>A: Peace studies was initially not recognized as a
    legitimate academic discipline.</option>

    <option>B: The initial development of peace studies was greatly influenced
    by the political climate of the Cold War era.</option>

    <option>C: Mathematicians and natural scientists entered the field, which
    was otherwise a social-sciences area of study, adding to the
    interdisciplinary nature of the field.</option>

    <option>D: The field of peace studies was initially developed by historians
    and anthropologists.</option>

    <option>E: Most early work was carried out in North America and
    Scandinavia.</option>

    <option>F: Early peace studies were primarily conducted by government
    agencies.</option>

    <option>G: The establishment of research institutes across the world has
    been one of the lasting successes of peace studies.</option>

    <option>H: Now of fundamental importance to peace studies as a field of
    research, the creation of journals was not a prominent feature of the peace
    studies until late in the twentieth century.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Markson Co. traded a concrete-mixing truck with a book value of
    $10,000 to Pro Co. for a cement-mixing machine with a fair value of $11,000.
    Markson needs to know the answer to which of the following questions in
    order to determine whether the exchange has commercial substance?</question>

    <options><option>A: Is the loss on the exchange more than the decrease in
    future cash flows?</option>

    <option>B: Is there a significant difference between the book value and fair
    value of the assets exchanged?</option>

    <option>C: Does the exchange have a direct impact on the company's net
    income?</option>

    <option>D: Is the fair value of the asset received less than the book value
    of the asset given up?</option>

    <option>E: Does the book value of the asset given up exceed the fair value
    of the asset received?</option>

    <option>F: Are the future cash flows expected to change significantly as a
    result of the exchange?</option>

    <option>G: Is the exchange taxable?</option>

    <option>H: Is the gain on the exchange less than the increase in future cash
    flows?</option>

    <option>I: Is the exchange nontaxable?</option>

    <option>J: Does the exchange result in a change in the company's
    depreciation schedule?</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Who is an archenemy of the cartoon superhero Underdog?</question>

    <options><option>A: Shredder</option>

    <option>B: Captain Hook</option>

    <option>C: Dick Dastardly</option>

    <option>D: Dr. Doom</option>

    <option>E: OverCat</option>

    <option>F: Riddler</option>

    <option>G: Mr Whoopie</option>

    <option>H: Muttley</option>

    <option>I: Lex Luthor</option>

    <option>J: Joker</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2013, share of people in the United States who think
    political parties are corrupt is</question>

    <options><option>A: 36%</option>

    <option>B: 46%</option>

    <option>C: 66%</option>

    <option>D: 26%</option>

    <option>E: 16%</option>

    <option>F: 56%</option>

    <option>G: 96%</option>

    <option>H: 90%</option>

    <option>I: 86%</option>

    <option>J: 76%</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Who was the first American president to visit communist
    China?</question>

    <options><option>A: Richard Nixon</option>

    <option>B: John F. Kennedy</option>

    <option>C: Dwight D. Eisenhower</option>

    <option>D: Jimmy Carter</option>

    <option>E: Lyndon B. Johnson</option>

    <option>F: George H. W. Bush</option>

    <option>G: Bill Clinton</option>

    <option>H: Gerald Ford</option>

    <option>I: Ronald Reagan</option>

    <option>J: George W. Bush</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Bernstein thought that using 'restricted codes' of language
    disadvantaged pupils at school because:</question>

    <options><option>A: they prevented children from communicating outside of
    their peer groups</option>

    <option>B: this pattern of speech made them the target of bullying</option>

    <option>C: they involved short, simple sentences with a small
    vocabulary</option>

    <option>D: they discouraged creativity and original thought</option>

    <option>E: they referred to explicit, context independent meanings</option>

    <option>F: they led to poor performance on standardized tests</option>

    <option>G: they were difficult for teachers to understand</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, the share of GDP spent on the military by China is
    about</question>

    <options><option>A: 8%</option>

    <option>B: 2%</option>

    <option>C: 4.5%</option>

    <option>D: 10%</option>

    <option>E: 3%</option>

    <option>F: 1%</option>

    <option>G: 6%</option>

    <option>H: 12%</option>

    <option>I: 15%</option>

    <option>J: 0.50%</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following capital cities is located OUTSIDE the
    central core area of the country?</question>

    <options><option>A: Beijing, China</option>

    <option>B: Washington D.C., United States</option>

    <option>C: Paris, France</option>

    <option>D: Cairo, Egypt</option>

    <option>E: London, United Kingdom</option>

    <option>F: Berlin, Germany</option>

    <option>G: Moscow, Russia</option>

    <option>H: Tokyo, Japan</option>

    <option>I: Abuja, Nigeria</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>At the time of independence, there were already hundreds of
    thousands of university graduates in ____, but hardly any at all in
    ____.</question>

    <options><option>A: India, Congo</option>

    <option>B: India, Australia</option>

    <option>C: Congo, Australia</option>

    <option>D: Australia, Congo</option>

    <option>E: South Korea, Congo</option>

    <option>F: South Korea, India</option>

    <option>G: Congo, South Korea</option>

    <option>H: Congo, India</option>

    <option>I: South Korea, Australia</option>

    <option>J: India, South Korea</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Controlling for inflation and PPP-adjustment, about how much did
    GDP per capita increase from 1950 to 2016 in China?</question>

    <options><option>A: by 20 fold</option>

    <option>B: by 12 fold</option>

    <option>C: by 25 fold</option>

    <option>D: by 64 fold</option>

    <option>E: by 8 fold</option>

    <option>F: by 4 fold</option>

    <option>G: by 50 fold</option>

    <option>H: by 40 fold</option>

    <option>I: by 16 fold</option>

    <option>J: by 32 fold</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In 1943 how many Americans believed in the Holocaust?</question>

    <options><option>A: 80%</option>

    <option>B: 30%</option>

    <option>C: 50%</option>

    <option>D: 70%</option>

    <option>E: 90%</option>

    <option>F: 100%</option>

    <option>G: 20%</option>

    <option>H: 40%</option>

    <option>I: 10%</option>

    <option>J: 60%</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following entities is a state?</question>

    <options><option>A: American Samoa</option>

    <option>B: Hong Kong</option>

    <option>C: Gibraltar</option>

    <option>D: Greenland</option>

    <option>E: Puerto Rico</option>

    <option>F: Bermuda</option>

    <option>G: Antarctica</option>

    <option>H: Egypt</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Gulde’s tax basis in Chyme Partnership was $26,000 at the time
    Gulde received a liquidating distribution of $12,000 cash and land with an
    adjusted basis to Chyme of $10,000 and a fair market value of $30,000. Chyme
    did not have unrealized receivables, appreciated inventory, or properties
    that had been contributed by its partners. What was the amount of Gulde’s
    basis in the land?</question>

    <options><option>A: $28,000</option>

    <option>B: $30,000</option>

    <option>C: $14,000</option>

    <option>D: $24,000</option>

    <option>E: $10,000</option>

    <option>F: $26,000</option>

    <option>G: $20,000</option>

    <option>H: $0</option>

    <option>I: $16,000</option>

    <option>J: $12,000</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>If I wanted to ship a small piece of very valuable jewelry to my
    aunt who lives in Poughkeepsie, which mode of transportation makes the most
    sense?</question>

    <options><option>A: Drone</option>

    <option>B: Personal delivery by car</option>

    <option>C: Ship</option>

    <option>D: Walking</option>

    <option>E: Railroad</option>

    <option>F: Truck</option>

    <option>G: Motorcycle</option>

    <option>H: Hoverboard</option>

    <option>I: Bicycle</option>

    <option>J: Air</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>About what percentage of survey respondents from China report
    having paid a bribe in the last year to access public services (such as
    education; judiciary; medical and health; police; registry and permit
    services; utilities; tax revenue and customs; and land service) as of
    2017?</question>

    <options><option>A: 66%</option>

    <option>B: 30%</option>

    <option>C: 70%</option>

    <option>D: 110%</option>

    <option>E: 86%</option>

    <option>F: 46%</option>

    <option>G: 90%</option>

    <option>H: 26%</option>

    <option>I: 50%</option>

    <option>J: 10%</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, what fraction of the population in India used the
    internet in the past three months?</question>

    <options><option>A: 37%</option>

    <option>B: 33%</option>

    <option>C: 22%</option>

    <option>D: 60%</option>

    <option>E: 15%</option>

    <option>F: 48%</option>

    <option>G: 56%</option>

    <option>H: 41%</option>

    <option>I: 11%</option>

    <option>J: 26%</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>China and Vietnam's dispute over the Spratley Islands
    is</question>

    <options><option>A: a religious dispute.</option>

    <option>B: a resource dispute.</option>

    <option>C: a cultural dispute.</option>

    <option>D: a historical dispute.</option>

    <option>E: a functional dispute.</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Who was the first American in space?</question>

    <options><option>A: Buzz Aldrin</option>

    <option>B: Yuri Gagarin</option>

    <option>C: Pete Conrad</option>

    <option>D: Neil Armstrong</option>

    <option>E: Jim Lovell</option>

    <option>F: Gus Grissom</option>

    <option>G: Scott Carpenter</option>

    <option>H: John Glenn</option>

    <option>I: Michael Collins</option>

    <option>J: Alan Shepard</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Brown cosigned Royal's $50000 note to State Bank. If Royal is
    later adjudicated mentally incompetent what would be Brown's liability on
    the note?</question>

    <options><option>A: Liable to pay State only if State first seeks payment
    from Royal.</option>

    <option>B: Not liable to pay State as Brown was only a voluntary
    surety.</option>

    <option>C: Liable to pay State only if Royal fails to meet the payment
    deadline.</option>

    <option>D: Not liable to pay State, as Royal's mental incompetency releases
    all cosigners from liability.</option>

    <option>E: Not liable to pay State unless Brown was a compensated
    surety.</option>

    <option>F: Liable to pay State, but only half of the note due to Royal's
    mental incompetency.</option>

    <option>G: Not liable to pay State because Royal's incompetency discharges
    Royal as a surety.</option>

    <option>H: Liable to pay State on the due date of the note.</option>

    <option>I: Not liable to pay State, as Brown's liability is dependent on
    Royal's mental competency at the time of signing.</option>

    <option>J: Liable to pay State, but only if Royal's assets are insufficient
    to cover the debt.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is LEAST self-sufficient in the natural
    resources needed for modern industry?</question>

    <options><option>A: Japan</option>

    <option>B: Canada</option>

    <option>C: Australia</option>

    <option>D: France</option>

    <option>E: Brazil</option>

    <option>F: China</option>

    <option>G: United Kingdom</option>

    <option>H: Germany</option>

    <option>I: United States</option>

    <option>J: Russia</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Castration in adulthood</question>

    <options><option>A: will produce a high voice because it causes a decrease
    in muscle mass.</option>

    <option>B: will produce a high voice because of the pain that accompanies
    the procedure.</option>

    <option>C: will not produce a high voice because the testosterone levels are
    unaffected.</option>

    <option>D: will not produce a high voice because the larynx has already
    grown.</option>

    <option>E: will produce a high voice due to the psychological impact of the
    procedure.</option>

    <option>F: will not produce a high voice because the voice pitch is
    determined by genetics.</option>

    <option>G: will not produce a high voice because the procedure has no impact
    on the vocal cords.</option>

    <option>H: will not produce a high voice because castration does not affect
    testosterone production.</option>

    <option>I: will produce a high voice because of increased estrogen
    production.</option>

    <option>J: will produce a high voice because of decreased testosterone
    production.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A major car accident occurs. One man stops his car and starts
    helping people. After seeing him stop, others also stop and start helping.
    Which of the following theories best explains the scenario?</question>

    <options><option>A: Self-fulfilling Prophecy</option>

    <option>B: Social Identity</option>

    <option>C: Cognitive Dissonance</option>

    <option>D: Convergence</option>

    <option>E: Emergent-norm</option>

    <option>F: Deindividuation</option>

    <option>G: Value-added</option>

    <option>H: Social Facilitation</option>

    <option>I: Bystander Effect</option>

    <option>J: Contagion</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the Westley and MacLean model of communication, which role
    describes the way in which the public obtain or receive the
    message?</question>

    <options><option>A: The sender's role</option>

    <option>B: The noise role</option>

    <option>C: The channel's role</option>

    <option>D: The mediator's role</option>

    <option>E: The advocacy role</option>

    <option>F: The feedback role</option>

    <option>G: The receiver's role</option>

    <option>H: The gatekeeper role</option>

    <option>I: The interpreter's role</option>

    <option>J: The behavioural role</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>About what percentage of the global population was literate in
    1950?</question>

    <options><option>A: 66%</option>

    <option>B: 96%</option>

    <option>C: 56%</option>

    <option>D: 16%</option>

    <option>E: 86%</option>

    <option>F: 26%</option>

    <option>G: 76%</option>

    <option>H: 46%</option>

    <option>I: 106%</option>

    <option>J: 36%</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What quantity of oxygen, O_2 , contains very nearly the same
    number of molecules as 36.0 grams of water, H_2O ?</question>

    <options><option>A: 32.0 grams</option>

    <option>B: 48.0 grams</option>

    <option>C: 36.0 grams</option>

    <option>D: 16.0 grams</option>

    <option>E: 80.0 grams</option>

    <option>F: 24.0 grams</option>

    <option>G: 18.0 grams</option>

    <option>H: 64.0 grams</option>

    <option>I: 8.0 grams</option>

    <option>J: 72.0 grams</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A $500 par-value convertible debenture is selling at $520. If the
    conversion ratio is 20, what is the conversion price?</question>

    <options><option>A: $30.00</option>

    <option>B: $19.23</option>

    <option>C: $20.18</option>

    <option>D: $24.00</option>

    <option>E: $25.00</option>

    <option>F: $26.00</option>

    <option>G: $32.00</option>

    <option>H: $27.00</option>

    <option>I: $22.50</option>

    <option>J: $28.50</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is not a TV cartoon duo?</question>

    <options><option>A: SpongeBob and Patrick</option>

    <option>B: Phineas and Ferb</option>

    <option>C: Tom and Jerry</option>

    <option>D: Chip and Dale</option>

    <option>E: Beavis and Butt-head</option>

    <option>F: Pinky and the Brain</option>

    <option>G: Scooby and Shaggy</option>

    <option>H: Simon and Garfunkel</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, the share of GDP spent on the military by the United
    States is about</question>

    <options><option>A: 5%</option>

    <option>B: 2%</option>

    <option>C: 15%</option>

    <option>D: 8%</option>

    <option>E: 10%</option>

    <option>F: 3%</option>

    <option>G: 6%</option>

    <option>H: 12%</option>

    <option>I: 1%</option>

    <option>J: 7%</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following sequences of events is consistent with the
    presence of a layer of sandstone in bedrock just above a layer of
    shale?</question>

    <options><option>A: One-celled organisms developed a colony on the seafloor.
    Shells made by these organisms accumulated and lithified, forming the
    sandstone.</option>

    <option>B: A meteorite impact created a crater. The impact pulverized rock
    into sand-sized particles that later lithified into sandstone.</option>

    <option>C: A forest grew, died, and decayed on top of a layer of shale. The
    organic material transformed into sandstone over time.</option>

    <option>D: The water level of a large lake lowered. A beach then formed
    where previously there had been lake bottom.</option>

    <option>E: Mud was deposited and lithified. Subsequent contact metamorphism
    resulted in localized recrystallization of the shale into
    sandstone.</option>

    <option>F: A volcano erupted, sending lava out over a layer of shale. The
    lava cooled and hardened into sandstone.</option>

    <option>G: A river carried silt and clay that settled over a layer of shale.
    Over time, this material compacted into sandstone.</option>

    <option>H: Tectonic activity pushed sandstone rock from deep within the
    Earth's surface to just above a layer of shale.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In what year did the United States last win an Olympic gold medal
    in men's ice hockey?</question>

    <options><option>A: 2000</option>

    <option>B: 2004</option>

    <option>C: 2008</option>

    <option>D: 1992</option>

    <option>E: 2012</option>

    <option>F: 1996</option>

    <option>G: 1976</option>

    <option>H: 1984</option>

    <option>I: 1988</option>

    <option>J: 1980</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following best describes the balance the Supreme
    Court has struck between the establishment clause and the free-exercise
    clause?</question>

    <options><option>A: The government can restrict the free exercise of
    religion in the interest of national security.</option>

    <option>B: Freedom of speech is protected except in certain situations, such
    as yelling "fire" in a crowded theater.</option>

    <option>C: All religious practices are prohibited in public
    schools.</option>

    <option>D: The government can endorse a specific religion as long as it does
    not compel people to practice that religion.</option>

    <option>E: Once a church has been recognized by the federal government, its
    tax-exempt status can never be revoked.</option>

    <option>F: The government can fund religious activities as long as all
    religions are given equal opportunities.</option>

    <option>G: The government is allowed to promote a specific religion as long
    as it does not interfere with the free exercise of other religions.</option>

    <option>H: Once Congress has created an administrative agency, that agency
    can be dissolved only by a constitutional amendment.</option>

    <option>I: State-sponsored prayer during school hours is prohibited, but
    voluntary prayer by student groups before school is allowed.</option>

    <option>J: The government can neither endorse nor restrict any religious
    activities.</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The expected selling price for a new product is $19.00.
    Management's goal is to obtain a 20% contribution margin on all sales. If
    the new product has variable selling and distribution costs of $3.00 per
    unit what is the product's target variable manufacturing cost?</question>

    <options><option>A: $17.50</option>

    <option>B: $10.00</option>

    <option>C: $13.50</option>

    <option>D: $15.80</option>

    <option>E: 18.2</option>

    <option>F: $16.20</option>

    <option>G: $11.80</option>

    <option>H: $12.20</option>

    <option>I: $12.80</option>

    <option>J: $14.00</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In men gonorrhea and chlamydia most often infect the:</question>

    <options><option>A: scrotum</option>

    <option>B: vas deferens</option>

    <option>C: penis</option>

    <option>D: bladder</option>

    <option>E: seminal vesicles</option>

    <option>F: epididymis</option>

    <option>G: prostate</option>

    <option>H: rectum</option>

    <option>I: testicles</option>

    <option>J: urethra</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is NOT a way in which the powers of the
    executive branch are balanced by the legislative branch?</question>

    <options><option>A: Congress can directly overturn a presidential
    veto.</option>

    <option>B: The Senate can decline to ratify a treaty.</option>

    <option>C: The House of Representatives can refuse to fund presidential
    initiatives.</option>

    <option>D: The House of Representatives can decline to pass a bill proposed
    by the president.</option>

    <option>E: The Senate can decline to approve a president's nominee for the
    Supreme Court.</option>

    <option>F: The Senate may use the filibuster to block an executive
    order.</option>

    <option>G: Congress may impeach and convict a president for "high crime and
    misdemeanors."</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>At about _________ months after conception, the gender of the
    fetus is clear from the appearance of external genitals.</question>

    <options><option>A: 8</option>

    <option>B: 9</option>

    <option>C: 3</option>

    <option>D: 11</option>

    <option>E: 4</option>

    <option>F: 1</option>

    <option>G: 5</option>

    <option>H: 2</option>

    <option>I: 6</option>

    <option>J: 7</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these television series was not set in the United
    States?</question>

    <options><option>A: 'Grey's Anatomy'</option>

    <option>B: 'Boston Legal'</option>

    <option>C: 'Breaking Bad'</option>

    <option>D: Northern Exposure'</option>

    <option>E: The Paper Chase'</option>

    <option>F: 'Friends'</option>

    <option>G: M*A*S*H'</option>

    <option>H: Picket Fences'</option>

    <option>I: 'The X-Files'</option>

    <option>J: 'The West Wing'</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these publics does NOT feature in Grunig and Hunt's
    (1984) situational theory of publics?</question>

    <options><option>A: Aware</option>

    <option>B: Latent</option>

    <option>C: Active</option>

    <option>D: Dormant</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>You bought a limousine for $98,000 and are planning to rent it for
    weddings, ceremonies and parties at $245 per hour. If you estimate the car
    will be hired for 2 hours a day on average, with daily costs at about $50,
    what is the estimated yearly yield on your investment if you work all year
    round, i.e. every day of the year, including any festivities and
    weekends?</question>

    <options><option>A: 150%</option>

    <option>B: 0.45%</option>

    <option>C: 0.164%</option>

    <option>D: 1.64%</option>

    <option>E: 183%</option>

    <option>F: 2.45%</option>

    <option>G: 245%</option>

    <option>H: 164%</option>

    <option>I: 75%</option>

    <option>J: 200%</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Smith & Tomlinson argued that:</question>

    <options><option>A: differences in ethnic background were more significant
    than class or gender in predicting educational achievement</option>

    <option>B: social class was the most significant factor in determining
    educational success</option>

    <option>C: the move towards equality of opportunity for children from ethnic
    minorities was not undermined by racism in schools</option>

    <option>D: inequalities of class had no impact on gender differences in
    educational achievement</option>

    <option>E: ethnic background was less significant than class or gender in
    predicting educational achievement</option>

    <option>F: racism in schools undermined the move towards equality of
    opportunity for children from ethnic minorites</option>

    <option>G: gender and ethnic background had no impact on educational
    achievement</option>

    <option>H: ethnic background and class were equally significant in
    predicting educational achievement</option>

    <option>I: gender differences in educational achievement could be attributed
    to inequalities of class</option>

    <option>J: school character far outweighed ethnic background in determining
    educational success</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Ross Perot makes polling history by leading the presidential race
    briefly in June as a third-party candidate with 39%. He winds up with _% of
    the popular vote.</question>

    <options><option>A: 31</option>

    <option>B: 7</option>

    <option>C: 5</option>

    <option>D: 9</option>

    <option>E: 25</option>

    <option>F: 21</option>

    <option>G: 19</option>

    <option>H: 1</option>

    <option>I: 15</option>

    <option>J: 13</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many $100 bills does it take to equal one million
    dollars?</question>

    <options><option>A: five hundred thousand</option>

    <option>B: five thousand</option>

    <option>C: two thousand</option>

    <option>D: one hundred thousand</option>

    <option>E: one thousand</option>

    <option>F: fifty thousand</option>

    <option>G: twenty thousand</option>

    <option>H: one hundred</option>

    <option>I: one million</option>

    <option>J: ten thousand</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Why did Franklin D. Roosevelt initially favour an 'isolationist'
    stance on the part of the US during the 1930s?</question>

    <options><option>A: All of the above</option>

    <option>B: He wanted to focus on strengthening the economy after the Great
    Depression</option>

    <option>C: He believed that German domination of Europe would be in US
    interests</option>

    <option>D: He believed that the European conflicts were not America's
    concern</option>

    <option>E: He believed that the US could benefit from staying neutral and
    trading with both sides</option>

    <option>F: He thought that America was not ready for another war</option>

    <option>G: He was under pressure from the Congress to maintain
    neutrality</option>

    <option>H: He was wary of the potential cost and casualties of war</option>

    <option>I: He believed that internal reform rather than international
    negotiation was the key to economic regeneration of the US</option>

    <option>J: He always favoured isolationism</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following statements best describes the process of
    'medicalization'?</question>

    <options><option>A: The term 'medicalization' is used when a health issue is
    considered and dealt with as an economic problem.</option>

    <option>B: The perceived 'medicalization' of societies occurs when social
    issues are increasingly considered and responded to as medical
    problems.</option>

    <option>C: An issue is said to be 'medicalized' when it is dismissed as a
    security threat, instead deemed to be a medical issue concerning health as
    mutually exclusive from security.</option>

    <option>D: The term 'medicalization' is used to describe when an issue is no
    longer seen as a health concern but instead is viewed as a cultural or
    societal matter.</option>

    <option>E: 'Medicalization' is the outcome of security dialogue that
    discusses threats or risks to national security in terms of medical
    language.</option>

    <option>F: 'Medicalization' refers to the process where a medical issue
    becomes a legal issue.</option>

    <option>G: 'Medicalization' refers to the process where a social or cultural
    issue is transformed into a security issue.</option>

    <option>H: The term 'medicalization' refers to the process whereby a medical
    or health issue becomes securitized.</option>

    <option>I: An issue is 'medicalized' when it is shifted from the domain of
    security to the domain of education.</option>

    <option>J: 'Medicalization' is the process of interpreting political issues
    in medical terms.</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What differences emerged with regard to theorizing on both sides
    of the Atlantic?</question>

    <options><option>A: From a US perspective, it is common to regard the main
    voice of security to be external. The question of what should or what should
    not count as security issues and how to conceptualize security.</option>

    <option>B: The European school is based on a hegemonic form of knowledge.
    Knowledge is conceived as the understanding of causal mechanisms in relation
    to the material on which they act.</option>

    <option>C: The different forms of knowledge relate to a conflicting
    conception of the relationship to policy: the problem-solving tradition in
    US political science vs. the critical studies in Europe.</option>

    <option>D: Theorizing has parallel theoretical forms of knowledge based on
    empirically substantiated cause-and-effect relationships.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Lake Trust a simple trust reported the following items of income
    and expense during the year: Dividend income $2500 Taxable interest income
    2000 Capital gains (allocable to corpus) 5000 Accounting fees (allocable to
    income) (500) Trustee fees (allocable to income) (750) What is Lake's
    distributable net income?</question>

    <options><option>A: $5,000</option>

    <option>B: $6,000</option>

    <option>C: $9,500</option>

    <option>D: $2,000</option>

    <option>E: $4,500</option>

    <option>F: $10,000</option>

    <option>G: $8,250</option>

    <option>H: $7,500</option>

    <option>I: $1,750</option>

    <option>J: 3250</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following procedures does a CPA usually perform when
    reviewing the financial statements of a nonissuer?</question>

    <options><option>A: Make inquiries of management concerning restrictions on
    the availability of cash balances.</option>

    <option>B: Examine trend analysis to determine the appropriateness of the
    CPA's assessment of detection risk.</option>

    <option>C: Conduct a physical inventory count to verify existence and
    condition.</option>

    <option>D: Analyze the company's market position and competitive
    advantage.</option>

    <option>E: Evaluate management's plans for dealing with negative trends and
    financial difficulties.</option>

    <option>F: Inspect contracts for potential legal issues or
    obligations.</option>

    <option>G: Review the entity's compliance with tax laws.</option>

    <option>H: Evaluate the company's hiring practices and employee benefits
    packages.</option>

    <option>I: Assess the entity's IT systems and cyber security
    measures.</option>

    <option>J: Communicate deficiencies in the design of internal control to the
    entity's audit committee.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Match Co. manufactures a product with the following costs per unit
    based on a maximum plant capacity of 400000 units per year: Direct materials
    $ 60 Direct labor 10 Variable overhead 40 Fixed overhead 30 Total $140 Match
    has a ready market for all 400000 units at a selling price of $200 each.
    Selling costs in this market consist of $10 per unit shipping and a fixed
    licensing fee of $50000 per year. Reno Co. wishes to buy 5000 of these units
    on a special order. There would be no shipping costs on this special order.
    What is the lowest price per unit at which Match should be willing to sell
    the 5000 units to Reno?</question>

    <options><option>A: $160</option>

    <option>B: $110</option>

    <option>C: $190</option>

    <option>D: $180</option>

    <option>E: $230</option>

    <option>F: 200</option>

    <option>G: $240</option>

    <option>H: $220</option>

    <option>I: $210</option>

    <option>J: $140</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>An investment project costing $500 today will generate profits of
    $500 in year five and year ten. If the discount rate is 10%, what is the
    project’s NPV?</question>

    <options><option>A: -$100</option>

    <option>B: $500</option>

    <option>C: -$500</option>

    <option>D: −$3</option>

    <option>E: $27</option>

    <option>F: $100</option>

    <option>G: -$30</option>

    <option>H: $0</option>

    <option>I: −$27</option>

    <option>J: $3</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the public relations field, what is the most common threat to a
    client-firm relationship?</question>

    <options><option>A: Resistance to outside advice</option>

    <option>B: Disagreements over the firm's strategic direction</option>

    <option>C: Personality conflicts</option>

    <option>D: The firm's inability to meet the client's expectations</option>

    <option>E: Lack of transparency from the firm</option>

    <option>F: Clients' questions about costs</option>

    <option>G: The client's dissatisfaction with the firm's performance</option>

    <option>H: Superficial grasp of the client's unique problems</option>

    <option>I: Inconsistent communication between the client and the
    firm</option>

    <option>J: The client's lack of trust in the firm's
    expertise</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the Jimmy Buffet song 'Margaritaville' what is the singer
    searching for?</question>

    <options><option>A: a bottle of tequila</option>

    <option>B: his car keys</option>

    <option>C: a shaker of salt</option>

    <option>D: a beach chair</option>

    <option>E: his sunglasses</option>

    <option>F: a lime</option>

    <option>G: a bottle of rum</option>

    <option>H: his lost flip-flops</option>

    <option>I: a waitress</option>

    <option>J: the bartender</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is a true statement about the flow of
    energy in an ecosystem?</question>

    <options><option>A: Energy is evenly distributed among all organisms in an
    ecosystem.</option>

    <option>B: All organisms in an ecosystem receive the same amount of
    energy.</option>

    <option>C: Energy transfer between organisms normally involves conservation
    of heat energy.</option>

    <option>D: Chemical energy is converted into radiant energy, which is then
    converted into chemical energy at the next trophic level.</option>

    <option>E: The amount of energy transferred from one trophic level to the
    next is constant.</option>

    <option>F: Energy flow between trophic levels is 100% efficient.</option>

    <option>G: Smaller organisms need less energy per gram of body weight than
    do larger organisms.</option>

    <option>H: Energy is transferred from consumers to producers.</option>

    <option>I: Energy flow in an ecosystem is cyclical.</option>

    <option>J: Energy flow between trophic levels is
    inefficient.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>An entity prepares its financial statements on its income tax
    basis. The accompanying notes include a summary of significant accounting
    policies that discusses the basis of presentation and describes how that
    basis differs from GAAP. The dollar amount of the effects of the difference
    between the income tax basis and GAAP</question>

    <options><option>A: Is required to be included in the balance
    sheet.</option>

    <option>B: Is required to be included in the income statement.</option>

    <option>C: Need not be quantified and included in either the notes to the
    financial statements or the auditor's report.</option>

    <option>D: Is required to be included in the balance sheet and the auditor's
    report.</option>

    <option>E: Is required to be included only in the notes to the financial
    statements.</option>

    <option>F: Is required to be included in the income statement, the balance
    sheet, and the auditor's report.</option>

    <option>G: Is required to be included in the auditor's report and the
    balance sheet.</option>

    <option>H: Is required to be included only in the auditor's report.</option>

    <option>I: Is required to be included in the income statement and the notes
    to the financial statements.</option>

    <option>J: Is required to be included both in the notes to the financial
    statements and the auditor's report.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following activities will be most effective in
    introducing kindergartners to the concept of how plants transport
    water?</question>

    <options><option>A: Showing a video about the water cycle and how it relates
    to plant growth</option>

    <option>B: Planting bean seeds in paper cups, placing them on the
    windowsill, and watering them daily</option>

    <option>C: Watering a plant with colored water and waiting for the plant to
    change color</option>

    <option>D: Observing the process of photosynthesis under a
    microscope</option>

    <option>E: Using a magnifying glass to observe droplets of water on a
    leaf</option>

    <option>F: Demonstrating that a celery stalk can be peeled lengthwise but
    not crosswise</option>

    <option>G: Collecting rainwater in a rain gauge and comparing the amount of
    rainfall to a plant's growth rate</option>

    <option>H: Placing celery stalks in water colored with a dye and observing
    the results</option>

    <option>I: Drawing pictures of plants and discussing how they might drink
    water</option>

    <option>J: Teaching them the biological process of
    osmosis</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In year 6, an IRS agent completed an examination of a
    corporation’s year 5 tax return and proposed an adjustment that will result
    in an increase in taxable income for each of years 1 through year 5. All
    returns were filed on the original due date. The proposed adjustment relates
    to the disallowance of corporate jet usage for personal reasons. The agent
    does not find the error to be fraudulent or substantial in nature. Which of
    the following statements regarding this adjustment is correct?</question>

    <options><option>A: The adjustment is improper because the statute of
    limitations has expired for several years of the adjustment</option>

    <option>B: The adjustment is improper because the agent did not find the
    error to be fraudulent or substantial in nature.</option>

    <option>C: The adjustment is proper because it relates to the disallowance
    of personal usage of a corporate jet.</option>

    <option>D: The adjustment is improper because an agent may only propose
    adjustments to the year under examination.</option>

    <option>E: The adjustment is improper because the corporation had already
    filed their tax returns.</option>

    <option>F: The adjustment is improper because the IRS agent is not
    authorized to propose such adjustments.</option>

    <option>G: The adjustment is proper because there is no statute of
    limitations for improperly claiming personal expenses as business
    expenses</option>

    <option>H: The adjustment is proper because it is within the agent’s
    discretion to propose adjustments for any year.</option>

    <option>I: The adjustment is proper because it relates to a change in
    accounting method, which can be made retroactively irrespective of the
    statute of limitations.</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is not an element of the
    redistribution-with-growth policy approach?</question>

    <options><option>A: subsidized housing</option>

    <option>B: elimination of trade barriers</option>

    <option>C: universal healthcare</option>

    <option>D: social security benefits</option>

    <option>E: minimum wage legislation</option>

    <option>F: progressive taxation</option>

    <option>G: land reform</option>

    <option>H: increased access to education</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The greatest population growth rate has taken place</question>

    <options><option>A: in Africa, which is the poorest region of the world with
    a steady overall economic growth.</option>

    <option>B: in Europe, which is the wealthiest region of the world with the
    highest overall economic growth.</option>

    <option>C: in Asia, which is the poorest region of the world with a steady
    overall economic growth.</option>

    <option>D: in South America, which is a developing region with high overall
    economic growth.</option>

    <option>E: in North America, which is the wealthiest region of the world
    with steady overall economic growth.</option>

    <option>F: in Africa, which is the poorest region of the world with high
    overall economic growth.</option>

    <option>G: in Asia, which is the wealthiest region of the world with the
    lowest overall economic growth.</option>

    <option>H: in Oceania, which is a developing region with steady overall
    economic growth.</option>

    <option>I: in Africa, which is the poorest region of the world with the
    lowest overall economic growth.</option>

    <option>J: in Asia, which is the poorest region of the world with the lowest
    overall economic growth.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The ecological approach to urban sociology involved
    studying:</question>

    <options><option>A: the impact of city infrastructure on the local
    ecosystem</option>

    <option>B: how men and women used the city's public spaces
    differently</option>

    <option>C: the way in which people organized collective protests about
    environmental issues</option>

    <option>D: the rate of pollution in different parts of the city</option>

    <option>E: how urbanization affects the local climate</option>

    <option>F: the forms of wildlife and natural habitats that could be found on
    the edges of the city</option>

    <option>G: the relationship between city size and biodiversity</option>

    <option>H: the influence of architecture on animal populations in the
    city</option>

    <option>I: how social groups colonized different areas of the city and
    competed for resources</option>

    <option>J: the effects of city planning on water systems and green
    spaces</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which character on the TV show 'Friends' is a chef?</question>

    <options><option>A: Joey</option>

    <option>B: Rachel</option>

    <option>C: Richard</option>

    <option>D: Janice</option>

    <option>E: Phoebe</option>

    <option>F: Monica</option>

    <option>G: Chandler</option>

    <option>H: Gunther</option>

    <option>I: Ross</option>

    <option>J: Emily</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following groups was converted to Christianity in the
    tenth century C.E. by missionaries from the Byzantine Empire?</question>

    <options><option>A: Goths</option>

    <option>B: Huns</option>

    <option>C: Normans</option>

    <option>D: Franks</option>

    <option>E: Russians</option>

    <option>F: Anglo-Saxons</option>

    <option>G: Vandals</option>

    <option>H: Moors</option>

    <option>I: Celts</option>

    <option>J: Visigoths</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>It's 3:00 A.M. You are male. You awaken to urinate. Standing at
    the commode you are in extreme agony. Your penis feels as if it is on fire.
    You notice a yellowish discharge coming out of your penis after you finish
    urinating. Your moans have awakened your significant other. She comes
    running into the bathroom and asks you what is wrong. You tell her you
    probably have:</question>

    <options><option>A: gonorrhea</option>

    <option>B: syphilis</option>

    <option>C: chlamydia</option>

    <option>D: urinary tract infection</option>

    <option>E: penile cancer</option>

    <option>F: prostate infection</option>

    <option>G: genital herpes</option>

    <option>H: kidney stones</option>

    <option>I: bladder infection</option>

    <option>J: AIDS</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Vale is a 50% partner in Ball Partnership. Vale's tax basis in
    Ball on January 2 year 1 was $60000. Ball did not have unrealized
    receivables appreciated inventory or properties that had been contributed by
    its partners. On December 31 year 1 Ball made a $10000 nonliquidating cash
    distribution to each partner. The Ball Partnership income tax return
    reported the following items for year 1: Tax-exempt interest income $80000
    Dividend income 12000 What total amount of gross income from Ball should be
    included in Vale's year 1 adjusted gross income?</question>

    <options><option>A: $76,000</option>

    <option>B: $26,000</option>

    <option>C: $36,000</option>

    <option>D: $86,000</option>

    <option>E: $96,000</option>

    <option>F: $16,000</option>

    <option>G: $66,000</option>

    <option>H: $56,000</option>

    <option>I: 46000</option>

    <option>J: $6,000</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What led Britain to impose new taxes on their American
    colonies?</question>

    <options><option>A: To increase the wealth of King George III</option>

    <option>B: The growing costs of war with France</option>

    <option>C: Anger at America's growing prosperity</option>

    <option>D: Pressure from rich merchants</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The true length of a block of wood is 1.010 cm. Three measurements
    of this block produced the following values: 1.4 cm, 1.2 cm, and 0.9 cm.
    Which of the following statements is true concerning these
    measurements?</question>

    <options><option>A: They are somewhat precise and somewhat
    accurate.</option>

    <option>B: They are exceptionally accurate but not precise.</option>

    <option>C: They are precise but not accurate.</option>

    <option>D: They are accurate and slightly precise.</option>

    <option>E: They are precise and accurate.</option>

    <option>F: They are neither precise nor accurate.</option>

    <option>G: They are slightly precise but very accurate.</option>

    <option>H: They are very precise but slightly accurate.</option>

    <option>I: They are accurate but not precise.</option>

    <option>J: They are exceptionally precise but not
    accurate.</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In 2016, what percentage of the population of South Sudan had
    access to electricity?</question>

    <options><option>A: 79%</option>

    <option>B: 49%</option>

    <option>C: 69%</option>

    <option>D: 9%</option>

    <option>E: 59%</option>

    <option>F: 39%</option>

    <option>G: 19%</option>

    <option>H: 29%</option>

    <option>I: 89%</option>

    <option>J: 99%</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>An inherent power of the president is the power to</question>

    <options><option>A: dissolve the U.S. Congress</option>

    <option>B: approve a constitutional amendment without the approval of the
    U.S. Congress</option>

    <option>C: increase the federal budget without the approval of the U.S.
    Congress</option>

    <option>D: enact laws without the approval of the U.S. Congress</option>

    <option>E: declare a state of emergency following a natural
    disaster</option>

    <option>F: appoint a nominee for the U.S. Supreme Court</option>

    <option>G: declare war without the approval of the U.S.
    Congress</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following was a significant reason for the electoral
    success of Franklin Roosevelt's New Deal coalition during the
    1930s?</question>

    <options><option>A: A strong anti-war stance during World War II</option>

    <option>B: A focus on mobilizing young voters</option>

    <option>C: A commitment to ending racial segregation</option>

    <option>D: A major shift of African American voters from the Republican to
    the Democratic Party</option>

    <option>E: The endorsement of prominent business leaders</option>

    <option>F: A focus on a bipartisan approach to major social and economic
    legislation</option>

    <option>G: The creation of a strong alliance with the Republican
    Party</option>

    <option>H: A focus on reducing government intervention in the
    economy</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The full-employment gross domestic product is $1.3 trillion, and
    the actual gross domestic product is $1.2 trillion. The marginal propensity
    to consume is 0.8. When inflation is ignored, what increase in government
    expenditures is necessary to produce full employment?</question>

    <options><option>A: $30 billion</option>

    <option>B: $10 billion</option>

    <option>C: $80 billion</option>

    <option>D: $90 billion</option>

    <option>E: $20 billion</option>

    <option>F: $25 billion</option>

    <option>G: $120 billion</option>

    <option>H: $50 billion</option>

    <option>I: $100 billion</option>

    <option>J: $130 billion</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many spikes are on the Statue of Liberty's crown?</question>

    <options><option>A: five</option>

    <option>B: six</option>

    <option>C: seven</option>

    <option>D: twelve</option>

    <option>E: thirteen</option>

    <option>F: three</option>

    <option>G: fifteen</option>

    <option>H: eleven</option>

    <option>I: eight</option>

    <option>J: nine</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How long is the time on an NBA shot clock?</question>

    <options><option>A: 25 seconds</option>

    <option>B: 18 seconds</option>

    <option>C: 40 seconds</option>

    <option>D: 45 seconds</option>

    <option>E: 24 seconds</option>

    <option>F: 30 seconds</option>

    <option>G: 35 seconds</option>

    <option>H: 32 seconds</option>

    <option>I: 20 seconds</option>

    <option>J: 28 seconds</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The majority of Kurds are found in which country?</question>

    <options><option>A: Iraq</option>

    <option>B: Lebanon</option>

    <option>C: Afghanistan</option>

    <option>D: Iran</option>

    <option>E: Egypt</option>

    <option>F: Pakistan</option>

    <option>G: Jordan</option>

    <option>H: Turkey</option>

    <option>I: Syria</option>

    <option>J: Saudi Arabia</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>West is single has no dependents and does not itemize. West
    provides the following information regarding his current-year’s return:
    Long-term capital gain $15000 Percentage depletion in excess of property's
    adjusted basis 9000 Dividends from publicly-held companies 10000 What is the
    amount of West's AMT tax preference items?</question>

    <options><option>A: $15,000</option>

    <option>B: $24,000</option>

    <option>C: $20,000</option>

    <option>D: $9,000</option>

    <option>E: $30,000</option>

    <option>F: $25,000</option>

    <option>G: $35,000</option>

    <option>H: $19,000</option>

    <option>I: 34000</option>

    <option>J: $10,000</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Controlling for inflation and PPP-adjustment, about how much did
    GDP per capita increase from 1950 to 2016 in Japan?</question>

    <options><option>A: by 5 fold</option>

    <option>B: by 25 fold</option>

    <option>C: by 2 fold</option>

    <option>D: by 35 fold</option>

    <option>E: by 40 fold</option>

    <option>F: by 15 fold</option>

    <option>G: by 50 fold</option>

    <option>H: by 10 fold</option>

    <option>I: by 20 fold</option>

    <option>J: by 30 fold</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is not recognised as a level of
    society?</question>

    <options><option>A: the continent</option>

    <option>B: the community</option>

    <option>C: the city</option>

    <option>D: the nation state</option>

    <option>E: the church</option>

    <option>F: the school</option>

    <option>G: the household</option>

    <option>H: the global village</option>

    <option>I: the region</option>

    <option>J: the office</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Mentor Co. a U.S. corporation owned 100% of a Swiss corporation.
    The Swiss franc is the functional currency. The remeasurement of Mentor's
    financial statements resulted in a $25000 gain at year end. The translation
    of the financial statements resulted in a $40000 gain at year end. What
    amount should Mentor recognize as foreign currency gain in its income
    statement?</question>

    <options><option>A: $30,000</option>

    <option>B: $50,000</option>

    <option>C: $65,000</option>

    <option>D: $15,000</option>

    <option>E: $35,000</option>

    <option>F: 65000</option>

    <option>G: $40,000</option>

    <option>H: $25,000</option>

    <option>I: $45,000</option>

    <option>J: $0</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is an example of a concurrent
    power?</question>

    <options><option>A: The power to regulate commerce with foreign
    nations</option>

    <option>B: The printing and coining of money</option>

    <option>C: The power to establish post offices</option>

    <option>D: The process of naturalization</option>

    <option>E: The power to appoint ambassadors and other public
    ministers.</option>

    <option>F: The power to propose amendments to the Constitution</option>

    <option>G: The power to establish a national bank</option>

    <option>H: The levying of taxes</option>

    <option>I: The power to declare war</option>

    <option>J: The power to make laws necessary and proper for executing other
    powers</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following characteristics describe 'Category B'
    agents, as defined by the US Centers for Disease Control?</question>

    <options><option>A: Category B agents are diseases that only affect animals
    and pose no direct threat to humans.</option>

    <option>B: Category B agents refer to diseases that are prevalent in
    underdeveloped regions and pose little threat to developed
    countries.</option>

    <option>C: Category B agents are those that have been eradicated but could
    potentially reemerge due to lowered immunity in the population.</option>

    <option>D: Category B agents are those that present little to no risk or
    morbidity within infected populations, but can have detrimental effects on
    the ability of a group to perform physical tasks.</option>

    <option>E: Category B agents are non-communicable diseases that pose a high
    threat to individuals but a low threat to population health.</option>

    <option>F: Category B agents are characterised by a low mortality rate and
    are easy to prevent through vaccination.</option>

    <option>G: Category B agents are characterised by high mortality rates and
    include agents which are difficult to treat medically.</option>

    <option>H: Unlike Category A agents, B agents refer to emerging security
    threats which have the potential to be utilised as biological weapons after
    further development.</option>

    <option>I: Category B agents include food and water security threats, with
    moderate morbidity rates.</option>

    <option>J: Unlike Category A agents, Category B agents refer to diseases
    that are easily transmitted through air.</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the structure of the United Nations Security
    Council?</question>

    <options><option>A: 5 permanent members without veto power, 10 rotating
    members with veto power</option>

    <option>B: 15 rotating members, none with veto power</option>

    <option>C: 10 permanent members with veto power, and 5 rotating members
    without veto power</option>

    <option>D: 15 members, all with veto power</option>

    <option>E: 20 members, 10 permanent with veto power, 10 rotating without
    veto power</option>

    <option>F: 10 permanent members without veto power, 5 rotating members with
    veto power</option>

    <option>G: 5 permanent members with veto power, 10 rotating members with no
    veto power</option>

    <option>H: 15 permanent members with veto power</option>

    <option>I: 7 permanent members with veto power, 8 rotating members without
    veto power</option>

    <option>J: 5 permanent members and 10 rotating members, all with veto
    power</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The birth of an urban industrial workforce in Europe contributed
    to the start of the</question>

    <options><option>A: World War I.</option>

    <option>B: Industrial Revolution.</option>

    <option>C: Second Agricultural Revolution.</option>

    <option>D: Fourth Agricultural Revolution.</option>

    <option>E: Enlightenment Era.</option>

    <option>F: Colonial Period.</option>

    <option>G: Technological Revolution.</option>

    <option>H: Renaissance Period.</option>

    <option>I: Third Agricultural Revolution.</option>

    <option>J: First Agricultural Revolution.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is NOT part of the "iron triangles" that
    influence public policy-making?</question>

    <options><option>A: Bureaucratic agencies</option>

    <option>B: The courts</option>

    <option>C: House committees</option>

    <option>D: Interest groups</option>

    <option>E: Senate committees</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is a functional region?</question>

    <options><option>A: The area surrounding the Great Lakes</option>

    <option>B: The Amazon Rainforest</option>

    <option>C: The Appalachian Mountains</option>

    <option>D: Pennsylvania</option>

    <option>E: The region influenced by the Mississippi River</option>

    <option>F: The Pacific Northwest</option>

    <option>G: The Sahara Desert</option>

    <option>H: The market area of Winn-Dixie</option>

    <option>I: The city of New York</option>

    <option>J: Dixie</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-human_sexuality
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Sociobiologists believe that there are more males than females
    with paraphilias because:</question>

    <options><option>A: paraphilias guarantee survival of the species</option>

    <option>B: of hormonal differences between the genders</option>

    <option>C: females have evolved to suppress paraphilias</option>

    <option>D: males are more prone to genetic mutations that lead to
    paraphilias</option>

    <option>E: males are more likely to report paraphilias due to societal
    pressures</option>

    <option>F: males are more likely to be influenced by environmental
    factors</option>

    <option>G: of left brain/right brain differences between the
    genders</option>

    <option>H: male brains are better developed than are female brains</option>

    <option>I: evolutionary selection has favored the development of males who
    respond to novel sexual stimuli</option>

    <option>J: sociobiologists do not believe that there are more males than
    females with paraphilias</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following is generally the first step taken in a
    large-scale commercial construction venture?</question>

    <options><option>A: Finalizing the interior design plans for the
    building</option>

    <option>B: Beginning the construction of the building foundation</option>

    <option>C: Contacting potential tenants or buyers for the completed
    building</option>

    <option>D: Hiring a construction crew to begin work immediately</option>

    <option>E: Conducting a survey of the potential construction site</option>

    <option>F: Ordering the materials needed for the building
    foundation</option>

    <option>G: Drafting a contract that spells out the details of the building
    plan</option>

    <option>H: Filing applications for building permits and variances</option>

    <option>I: Holding a discussion between the developer and the
    designer/contractor about the scope of the construction</option>

    <option>J: Holding a ground-breaking ceremony to announce the
    construction</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The opinions of congressional committees often fail to accurately
    mirror public opinion because</question>

    <options><option>A: committees are often influenced by external factors such
    as media and public relations</option>

    <option>B: committee members are not required to consult their constituents
    before making decisions</option>

    <option>C: committees often prioritize national interests over public
    opinion</option>

    <option>D: committee members are usually selected from the same political
    party</option>

    <option>E: most committees are too small to include representatives of all
    popular opinions</option>

    <option>F: the majority of committees are controlled by the executive
    branch</option>

    <option>G: the minority party controls nearly half of all
    committees</option>

    <option>H: the public does not have direct influence on the decision-making
    process of the committees</option>

    <option>I: the membership of committees often overrepresents constituencies
    with the greatest stake in the committee's business</option>

    <option>J: committee members often lose track of their constituents'
    priorities because of their frequent contact with special-interest
    lobbyists</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Accrual accounting involves accruals and deferrals. Which of the
    following best describes accruals and deferrals?</question>

    <options><option>A: Accruals are concerned with current cash receipts and
    payments while deferrals are concerned with expected future cash receipts
    and payments.</option>

    <option>B: Accruals are concerned with expected future cash receipts and
    payments while deferrals are concerned with current cash receipts and
    payments.</option>

    <option>C: Both accruals and deferrals are concerned with past cash receipts
    and payments.</option>

    <option>D: Both accruals and deferrals are concerned with expected future
    cash receipts and payments.</option>

    <option>E: Both accruals and deferrals are concerned with past and expected
    future cash receipts and payments.</option>

    <option>F: Accruals are concerned with current and future cash receipts and
    payments while deferrals are concerned with past and current cash receipts
    and payments.</option>

    <option>G: Accruals are concerned with past cash receipts and payments while
    deferrals are concerned with expected future cash receipts and
    payments.</option>

    <option>H: Accruals are concerned with expected future cash receipts and
    payments while deferrals are concerned with past cash receipts and
    payments.</option>

    <option>I: Both accruals and deferrals are concerned with current cash
    receipts and payments.</option>

    <option>J: Accruals are concerned with past cash receipts and payments while
    deferrals are concerned with current cash receipts and
    payments.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these is not a style of shoe?</question>

    <options><option>A: loafer</option>

    <option>B: pump</option>

    <option>C: moccasin</option>

    <option>D: docksider</option>

    <option>E: oxford</option>

    <option>F: espadrille</option>

    <option>G: brogan</option>

    <option>H: gingham</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which one of the following is NOT an advantage of urban
    agriculture?</question>

    <options><option>A: Beautification of a dingy urban area</option>

    <option>B: Improved air quality</option>

    <option>C: Increase in property values</option>

    <option>D: Helping to solve the problem of solid waste disposal</option>

    <option>E: Increased urban biodiversity</option>

    <option>F: Reduction in carbon footprint</option>

    <option>G: Renewed or purified water supplies</option>

    <option>H: Fresh produce for sale to others</option>

    <option>I: Reduced dependence on fossil fuels</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>If requested to perform a compilation engagement for a nonissuer
    in which an accountant has an immaterial direct financial interest, the
    accountant is</question>

    <options><option>A: Independent because the financial interest in the
    nonissuer is material.</option>

    <option>B: Independent because the financial interest in the nonissuer is
    immaterial.</option>

    <option>C: Independent and, therefore, may issue both a compilation report
    and a review report.</option>

    <option>D: Not independent and, therefore, may not be associated with the
    financial statements.</option>

    <option>E: Independent and, therefore, may not issue a compilation
    report.</option>

    <option>F: Not independent and, therefore, may issue a review report, but
    may not issue a compilation report.</option>

    <option>G: Not independent and, therefore, may not issue a compilation
    report.</option>

    <option>H: Independent, and therefore, may issue a compilation
    report.</option>

    <option>I: Not independent and, therefore, may not be associated with the
    financial statements, but can issue a compilation report.</option>

    <option>J: Not independent and, therefore, may issue a compilation report,
    but may not issue a review report.</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The best definition of an urban area is</question>

    <options><option>A: the central city and its peripheral towns.</option>

    <option>B: the central city and the adjacent counties.</option>

    <option>C: the central city and the nearby forests.</option>

    <option>D: the central city and its surrounding beach areas.</option>

    <option>E: the central city and its surrounding suburbs.</option>

    <option>F: the central city and its nearby industrial zones.</option>

    <option>G: the central city and its developed areas.</option>

    <option>H: the central city and its hinterlands.</option>

    <option>I: the central city and its undeveloped areas.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In what ways is a fusion nuclear device different from a fission
    device?</question>

    <options><option>A: Fusion weapons use both fission and fusion reactions in
    a three-stage process to produce a limited energy explosion with high
    thermal energy.</option>

    <option>B: A fusion device involves a two-stage process where an implosion
    device triggers a series of fusion reactions, resulting in a high energy
    explosion with limited thermal energy.</option>

    <option>C: Fusion weapons have unlimited destructive capacity because they
    can be precision calculated, while fission weapons have limited destructive
    capacity because their energy output depends on the mass of the material
    used.</option>

    <option>D: Fusion weapons have a highly specific destructive effect. The
    heavier element produced from a fissions reaction, and the difference in
    mass from the two lighter nuclei (which is translated into an energy
    explosion) can be precision calculated. Bombs even within the multi-megaton
    range have unlimited military utility, their destructive capability can be
    manufactured according to the target.</option>

    <option>E: A fusion weapon is a three-stage-bomb that uses an implosion
    device to create a fission reaction, which then detonates a fusion reaction.
    It is often referred to as a thermo-nuclear or hydrogen device and has
    unlimited destructive potential.</option>

    <option>F: Fusion devices are single-stage bombs that use a fission reaction
    to trigger a fusion reaction, leading to a high energy explosion with
    limited thermal energy.</option>

    <option>G: A fusion device is a two-stage process where a gun-type device is
    used to trigger a series of fission reactions with the cumulative result
    being the production of a high energy flash explosion with unlimited thermal
    energy.</option>

    <option>H: Fusion devices use the principle of splitting heavy elements to
    generate energy, while fission devices combine light elements to release
    energy.</option>

    <option>I: A fusion reaction is created when the nuclei of two light
    elements are combined, the reaction resulting in heavier elements
    fragmenting into smaller parts. This fragmentation releases energy of
    limited destructive capacity, the extent of energy released dependent on the
    mass of material used.</option>

    <option>J: A fusion weapon is a four-stage-bomb that uses a gun-type device
    to create a fission reaction, which then triggers a fusion reaction. The
    weapon has a specific destructive effect.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Becker proclaimed that cannabis use was:</question>

    <options><option>A: a dangerous pastime that young people should not be
    allowed to pursue</option>

    <option>B: a behavior that could be easily unlearned with proper
    guidance</option>

    <option>C: a gateway drug that leads to use of harder substances</option>

    <option>D: not as enjoyable as other sociologists had suggested</option>

    <option>E: increasing throughout all sections of youth in the 1970s</option>

    <option>F: decreasing in popularity among youth in the 1970s</option>

    <option>G: learned gradually through the social processes of a deviant
    career</option>

    <option>H: something that should be strictly regulated by the
    government</option>

    <option>I: a healthy alternative to alcohol and other dangerous
    substances</option>

    <option>J: a form of rebellion against societal norms</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What would be the policy implications of a hierarchical vision of
    TNC?</question>

    <options><option>A: Hierarchical forms of transnational criminal activity
    are primarily territorially affiliated to a particular state /
    ethnic-cultural group and have limited transnational potential.</option>

    <option>B: The hierarchical analysts believe that generally there has been a
    tendency of officials to have over-inflated the estimation of the levels of
    violence and wealth generated by their activities. If the wealth is not as
    great as is widely believed, their threat to the licit economy is vastly
    reduced.</option>

    <option>C: Hierarchical forms of organization are highly adaptable and small
    fluid groups enable a pronounced degree of resilience (attributable to the
    logic of supply rising to meet demand) against law enforcement efforts
    confined to rigid ranking of cooperation.</option>

    <option>D: Hierarchical groups pose a serious degree of harm by their
    profit-driven crimes under centralized leadership. Targeting the proceeds or
    leadership would therefore produce a reduction in their threat on the
    legitimate economy.</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The 'new racism' refers to:</question>

    <options><option>A: a subtler form of prejudice, masked by nationalist
    pride</option>

    <option>B: a trend of neo-nazism masked as patriotism</option>

    <option>C: a form of racism that only exists within the realm of social
    media</option>

    <option>D: an anti-fascist movement which challenges nationalist
    politics</option>

    <option>E: an increased awareness and sensitivity towards racism in
    contemporary society</option>

    <option>F: a post-modern deconstruction of racist ideas to reveal their lack
    of depth</option>

    <option>G: a radical form of racism that encourages open
    discrimination</option>

    <option>H: a form of racism practiced by newly established
    countries</option>

    <option>I: racist practices found in newly emerging areas of social life,
    such as cyberspace</option>

    <option>J: the rise of racism in new political parties</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following types of stress dominates at divergent
    boundaries?</question>

    <options><option>A: Thermal</option>

    <option>B: Horizontal</option>

    <option>C: Right-lateral shear</option>

    <option>D: Radial</option>

    <option>E: Tensional</option>

    <option>F: Shear</option>

    <option>G: Vertical</option>

    <option>H: Gravitational</option>

    <option>I: Left-lateral shear</option>

    <option>J: Compressional</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>World Bank data show that in 1995, the poorest 20% of households
    accounted for 7.5% of household income in Niger, the next 20% of households
    accounted for 11.8% of income, the middle 20% accounted for 15.5% of income,
    the second richest 20% accounted for 21.1% of income, and the top 20%
    accounted for 44.1% of income. What was the cumulative income share of the
    bottom 60% of households in Niger?</question>

    <options><option>A: 48.10%</option>

    <option>B: 34.80%</option>

    <option>C: 44.10%</option>

    <option>D: 56.40%</option>

    <option>E: 7.50%</option>

    <option>F: 29.60%</option>

    <option>G: 21.10%</option>

    <option>H: 11.80%</option>

    <option>I: 15.50%</option>

    <option>J: 65.20%</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Goldthorpe identified the 'service class' as:</question>

    <options><option>A: the young men and women employed in domestic service in
    the nineteenth century</option>

    <option>B: those in non-manual occupations, exercising authority on behalf
    of the state</option>

    <option>C: those in manual labor jobs such as construction or
    manufacturing</option>

    <option>D: individuals in skilled trades like plumbing, electricians, and
    carpentry</option>

    <option>E: professionals in the arts, entertainment, and media
    industry</option>

    <option>F: those who are self-employed or run their own businesses</option>

    <option>G: people working in consultancy firms who were recruited by big
    businesses</option>

    <option>H: those who had worked in the armed services</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2019, about what percentage of people from Turkey agree that
    the state is run for the benefit of all the people?</question>

    <options><option>A: 62%</option>

    <option>B: 55%</option>

    <option>C: 81%</option>

    <option>D: 90%</option>

    <option>E: 40%</option>

    <option>F: 66%</option>

    <option>G: 51%</option>

    <option>H: 70%</option>

    <option>I: 36%</option>

    <option>J: 75%</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In recent years social media has had a major impact on the
    practice of public relations. In which of the following areas has the impact
    been greatest and experienced most immediately?</question>

    <options><option>A: Retail business</option>

    <option>B: Healthcare</option>

    <option>C: Nonprofits</option>

    <option>D: Politics</option>

    <option>E: Education</option>

    <option>F: Financial services</option>

    <option>G: Real estate</option>

    <option>H: Sports marketing</option>

    <option>I: Tourism and hospitality</option>

    <option>J: Automotive sales</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which pair of religions are both universalizing
    religions?</question>

    <options><option>A: Christianity and Buddhism</option>

    <option>B: Taoism and Shinto</option>

    <option>C: Judaism and Buddhism</option>

    <option>D: Hinduism and Buddhism</option>

    <option>E: Islam and Sikhism</option>

    <option>F: Taoism and Islam</option>

    <option>G: Shinto and Hinduism</option>

    <option>H: Sikhism and Judaism</option>

    <option>I: Islam and Judaism</option>

    <option>J: Zoroastrianism and Judaism</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>According to Hakim (1995, 1996), the majority of part-time work is
    done by women because:</question>

    <options><option>A: full time work is not available in the kinds of
    occupations that they want to enter</option>

    <option>B: women prefer part-time work as it provides a better work-life
    balance</option>

    <option>C: part-time work offers more flexible hours, allowing women to
    manage their domestic responsibilities</option>

    <option>D: they make a rational choice to combine employment with their
    'home-centred' lives</option>

    <option>E: women prefer the less demanding nature of part-time work</option>

    <option>F: their choices are constrained by structural factors, such as
    being unable to afford childcare</option>

    <option>G: employers prefer to hire women for part-time positions due to
    societal stereotypes</option>

    <option>H: part-time work allows women to have more time for personal
    development and hobbies</option>

    <option>I: there are more part-time job opportunities available for
    women</option>

    <option>J: part-time jobs pay relatively high wages and so are financially
    beneficial</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>When the AQR partnership was formed, partner Acre contributed land
    with a fair market value of $100,000 and a tax basis of $60,000 in exchange
    for a one-third interest in the partnership. The AQR partnership agreement
    specifies that each partner will share equally in the partnership’s profits
    and losses. During its first year of operation, AQR sold the land to an
    unrelated third party for $160,000. What is the proper tax treatment of the
    sale?</question>

    <options><option>A: Each partner reports a capital gain of $40,000.</option>

    <option>B: Each partner reports a capital gain of $50,000.</option>

    <option>C: The entire gain of $160,000 is shared equally by all the partners
    in the partnership.</option>

    <option>D: Each partner reports a capital gain of $33,333.</option>

    <option>E: The first $40,000 of gain is allocated to Acre, and the remaining
    gain of $60,000 is shared equally by all the partners in the
    partnership.</option>

    <option>F: The first $60,000 of gain is allocated to Acre, and the remaining
    gain of $40,000 is shared equally by the other two partners.</option>

    <option>G: The first $40,000 of gain is allocated to Acre, and the remaining
    gain of $60,000 is shared equally by the other two partners.</option>

    <option>H: The entire gain of $60,000 must be specifically allocated to
    Acre.</option>

    <option>I: The first $40,000 of gain is shared equally by all the partners,
    and the remaining gain of $60,000 is allocated to Acre.</option>

    <option>J: The entire gain of $100,000 must be specifically allocated to
    Acre.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Johnson worked for ABC Co. and earned a salary of $100,000.
    Johnson also received, as a fringe benefit, group termlife insurance at
    twice Johnson’s salary. The annual IRS established uniform cost of insurance
    is $2.76 per $1,000. What amount must Johnson include in gross
    income?</question>

    <options><option>A: $101,414</option>

    <option>B: $100,276</option>

    <option>C: $100,826</option>

    <option>D: $100,414</option>

    <option>E: $101,276</option>

    <option>F: $101,138</option>

    <option>G: $100,688</option>

    <option>H: $101,000</option>

    <option>I: $100,552</option>

    <option>J: $100,000</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Consider the following statements: (1) In every country, people
    think other individuals in their country are less happy than they actually
    are. (2) In the United States, women’s happiness has increased both
    absolutely and relative to men. Which of these statements is
    True/False?</question>

    <options><option>A: Both statements are largely true</option>

    <option>B: False, False</option>

    <option>C: True, True</option>

    <option>D: The first statement is true, the second statement is largely
    false</option>

    <option>E: True, False</option>

    <option>F: The first statement is false, the second statement is partially
    true</option>

    <option>G: False, True</option>

    <option>H: The first statement is partially true, the second statement is
    false</option>

    <option>I: The first statement is largely false, the second statement is
    true</option>

    <option>J: Both statements are partially true</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In the 1960s, comprehensive schools did not eradicate class
    inequalities in education because:</question>

    <options><option>A: selective schools could still 'cream off' the most able
    pupils, while the comprehensives put children into ability streams</option>

    <option>B: the comprehensive schools did not have the capacity to
    accommodate all students, leading to overcrowding and reduced quality of
    education</option>

    <option>C: the comprehensive schools were mostly located in affluent
    neighborhoods, limiting access for working class students</option>

    <option>D: teachers in comprehensive schools used the restricted code in the
    classroom, whereas working class pupils used elaborated codes of
    speech</option>

    <option>E: the segregation between working class and middle class in
    comprehensive schools was still very apparent</option>

    <option>F: they tended to recruit pupils from the inner cities and
    traditionally working class areas</option>

    <option>G: comprehensive schools did not have sufficient funding to provide
    quality education to all students</option>

    <option>H: comprehensive schools did not offer advanced courses, limiting
    the educational opportunities for gifted students</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which one of these world leaders was assassinated?</question>

    <options><option>A: Ferdinand Marcos</option>

    <option>B: Neville Chamberlain</option>

    <option>C: Margaret Thatcher</option>

    <option>D: Lee Kuan Yew</option>

    <option>E: Winston Churchill</option>

    <option>F: Fidel Castro</option>

    <option>G: Golda Meir</option>

    <option>H: Muammar Gaddafi</option>

    <option>I: Indira Gandhi</option>

    <option>J: Nelson Mandela</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How many states were in the Confederate States of
    America?</question>

    <options><option>A: 14</option>

    <option>B: 11</option>

    <option>C: 15</option>

    <option>D: 10</option>

    <option>E: 20</option>

    <option>F: 18</option>

    <option>G: 16</option>

    <option>H: 13</option>

    <option>I: 12</option>

    <option>J: 22</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In what ways might international measures be employed? Are they a
    help or a hindrance?</question>

    <options><option>A: Multi-partner initiatives to support the reforms
    necessary for the prevention of terrorism have proved ineffective. Sanctions
    against countries that provide a territorial base for terrorism may be
    misplaced, having negligible effects on the terrorist organizations
    themselves.</option>

    <option>B: Countries often resist international measures out of concerns
    over sovereignty. This can limit the effectiveness of these measures and
    hinder international cooperation against terrorism.</option>

    <option>C: A great deal of international diplomacy has involved attempts to
    define terrorism so that all countries could take steps to eradicate it.
    However, these efforts have largely faltered: countries often support or
    sympathize with dissidents who use violence against repressive governments;
    governments in developing countries have wanted to avoid anti-colonial
    struggles being labelled as terrorism; and countries want to retain a degree
    of flexibility regarding extradition and punishment of political
    dissidents.</option>

    <option>D: Intelligence agencies are highly centralized, organized
    structures that operate at a maximum functional level within their domestic
    context. There is no reason to presume that collaboration would enhance
    their ability to contribute to the prevention of terrorism. The multi-agency
    approach would also broaden the scope for potential errors,
    miscommunication, and intelligence failures.</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which one of the following North American associations is NOT
    correct?</question>

    <options><option>A: Southeast—African Americans</option>

    <option>B: Southern prairie provinces—African Americans</option>

    <option>C: New England—Latin Americans</option>

    <option>D: Oklahoma and the Southwest—Native Americans</option>

    <option>E: Quebec and northern Maine—French Americans and French
    Canadians</option>

    <option>F: Florida—Native Americans</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What color is cartoon character Marge Simpson's hair?</question>

    <options><option>A: brown</option>

    <option>B: blue</option>

    <option>C: black</option>

    <option>D: green</option>

    <option>E: yellow</option>

    <option>F: purple</option>

    <option>G: white</option>

    <option>H: pink</option>

    <option>I: red</option>

    <option>J: orange</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-high_school_geography
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is the most abundant fossil fuel?</question>

    <options><option>A: Methane</option>

    <option>B: Phosphate</option>

    <option>C: Uranium</option>

    <option>D: Oil</option>

    <option>E: Petroleum</option>

    <option>F: Coal</option>

    <option>G: Natural Gas</option>

    <option>H: Shale Gas</option>

    <option>I: Peat</option>

    <option>J: Biomass</option></options>
  criteria:
    correctness: The chosen option is F
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which common public relations tactic involves sending journalists
    on visits to appropriate locations?</question>

    <options><option>A: Publicity stunt</option>

    <option>B: Promotional days/weeks</option>

    <option>C: Media release</option>

    <option>D: Influencer engagement</option>

    <option>E: Social media campaign</option>

    <option>F: Media briefing</option>

    <option>G: Press room</option>

    <option>H: Press conference</option>

    <option>I: Sponsorship</option>

    <option>J: Media tour</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>In construction, the plates are horizontal structures at the top
    and bottom of a wall. Which of the following are the vertical
    structures?</question>

    <options><option>A: Studs</option>

    <option>B: Sheathing</option>

    <option>C: Rafters</option>

    <option>D: Beams</option>

    <option>E: Trusses</option>

    <option>F: Girders</option>

    <option>G: Sill plates</option>

    <option>H: Headers</option>

    <option>I: Purlins</option>

    <option>J: Joists</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>You are told an investment will generate income that grows at 5%
    p.a. forever when the market discount rate is 15%. If the investment’s next
    payout is $10, what is the value of the investment?</question>

    <options><option>A: $200</option>

    <option>B: $150</option>

    <option>C: $50</option>

    <option>D: $75</option>

    <option>E: $500</option>

    <option>F: $350</option>

    <option>G: $1</option>

    <option>H: $400</option>

    <option>I: $100</option>

    <option>J: $250</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Toft Co. had 120000 shares of common stock outstanding at January
    1. On April 1 it issued 40000 additional shares of common stock. Outstanding
    all year were 10000 shares of nonconvertible preferred stock on which a
    dividend of $5 per share was declared during the year. Net income for the
    year was $480000. What should Toft report as earnings per share for the
    year?</question>

    <options><option>A: $2.69</option>

    <option>B: $3.50</option>

    <option>C: $3.00</option>

    <option>D: 3.2</option>

    <option>E: $4.00</option>

    <option>F: $3.20</option>

    <option>G: $2.50</option>

    <option>H: $2.87</option>

    <option>I: $2.75</option>

    <option>J: $2.00</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>When did the cyber-security discourse emerge? (When did
    politicians, academics, and other agents begin to talk seriously about
    cyber-security?)</question>

    <options><option>A: Early 21st century</option>

    <option>B: 2010s</option>

    <option>C: 1980s</option>

    <option>D: 1990s</option>

    <option>E: 1950s</option>

    <option>F: 1960s</option>

    <option>G: Late 19th century</option>

    <option>H: Early 20th century</option>

    <option>I: 2000s</option>

    <option>J: 1970s</option></options>
  criteria:
    correctness: The chosen option is J
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these principles is not an element of the responsibility
    to protect?</question>

    <options><option>A: The responsibility to react.</option>

    <option>B: The responsibility to prevent.</option>

    <option>C: The responsibility to rebuild.</option>

    <option>D: The responsibility to recognize.</option>

    <option>E: The responsibility to remain sovereign.</option>

    <option>F: The responsibility to retaliate.</option>

    <option>G: The responsibility to resist.</option>

    <option>H: The responsibility to refuse.</option></options>
  criteria:
    correctness: The chosen option is E
- tags:
    - ori_mmlu-security_studies
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What is 'malware'?</question>

    <options><option>A: A data encryption technique</option>

    <option>B: A type of firewall</option>

    <option>C: A corrupted program</option>

    <option>D: A hacker tool</option>

    <option>E: A social media application</option>

    <option>F: A computer hardware component</option>

    <option>G: An email spam filter</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-high_school_government_and_politics
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Divided government frequently results in</question>

    <options><option>A: amendments to the Constitution</option>

    <option>B: dissolution of political parties</option>

    <option>C: immediate passage of major legislation</option>

    <option>D: delays in the confirmation of those nominated to be
    ambassadors</option>

    <option>E: a smooth legislative process</option>

    <option>F: increased foreign policy collaboration</option>

    <option>G: reapportionment of voting districts</option>

    <option>H: quick approval of Supreme Court nominees</option>

    <option>I: reduction in national debt</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Subsequent to issuing a report on audited financial statements, a
    CPA discovers that the accounts receivable confirmation process omitted a
    number of accounts that are material, in the aggregate. Which of the
    following actions should the CPA take immediately?</question>

    <options><option>A: Withdraw the auditor’s report from those persons
    currently relying on it.</option>

    <option>B: Contact the legal department to assess potential
    liabilities.</option>

    <option>C: Request the client to reconfirm all accounts receivable.</option>

    <option>D: Ignore the omission as it is not significant.</option>

    <option>E: Resign from the audit engagement.</option>

    <option>F: Amend the financial statements without informing anyone.</option>

    <option>G: Issue a revised auditor's report to all relevant
    parties.</option>

    <option>H: Perform alternative procedures to verify account
    balances.</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>A kindergarten teacher sets up a literacy center with an activity
    that asks students to match pictures of objects with pictures of letters to
    correctly indicate the beginning sound. Which of the following is the
    teacher trying to develop in students through the center?</question>

    <options><option>A: Letter recognition</option>

    <option>B: Phonemic awareness</option>

    <option>C: Sentence construction</option>

    <option>D: Word recognition</option>

    <option>E: Reading comprehension</option>

    <option>F: Spelling skills</option>

    <option>G: Syllable counting</option>

    <option>H: Vocabulary</option>

    <option>I: Handwriting</option>

    <option>J: Phonics</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of the following statements about audit sampling risks is
    correct for a nonissuer?</question>

    <options><option>A: Nonsampling risk can be completely eliminated with
    careful planning.</option>

    <option>B: Sampling risk is derived from the uncertainty in applying audit
    procedures to specific risks.</option>

    <option>C: Sampling risk is only applicable when the auditor tests each item
    in the population.</option>

    <option>D: Sampling risk includes the possibility of selecting audit
    procedures that are not appropriate to achieve the specific
    objective.</option>

    <option>E: Nonsampling risk is eliminated when a substantive test is
    restricted to a sample.</option>

    <option>F: Nonsampling risk arises from the possibility that, when a
    substantive test is restricted to a sample, conclusions might be different
    than if the auditor had tested each item in the population.</option>

    <option>G: Nonsampling risk can arise because an auditor failed to recognize
    misstatements.</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>The nineteenth-century photographic process used to create a
    daguerreotype was notable for its</question>

    <options><option>A: quick exposure time</option>

    <option>B: ability to capture in low light</option>

    <option>C: ability to capture sharp detail</option>

    <option>D: long exposure time</option>

    <option>E: use of glass negatives</option>

    <option>F: use of liquid emulsion</option>

    <option>G: capacity to be reproduced multiple times</option>

    <option>H: use of paper negatives</option>

    <option>I: use of color pigments</option>

    <option>J: capacity for instant development</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>How is the word 'ambulance' normally written on the front of
    American ambulances?</question>

    <options><option>A: in sign language</option>

    <option>B: in gibberish</option>

    <option>C: in a secret code</option>

    <option>D: in braille</option>

    <option>E: in French</option>

    <option>F: in uppercase letters</option>

    <option>G: in Morse code</option>

    <option>H: in Latin</option>

    <option>I: in reverse</option>

    <option>J: in invisible ink</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Booth's (1901) study revealed that the percentage of people in
    London who were living in poverty was:</question>

    <options><option>A: 35.80%</option>

    <option>B: 24.20%</option>

    <option>C: 28.90%</option>

    <option>D: 27.50%</option>

    <option>E: 33.20%</option>

    <option>F: 31.50%</option>

    <option>G: 30.70%</option>

    <option>H: 25.40%</option>

    <option>I: 22.10%</option>

    <option>J: 18.60%</option></options>
  criteria:
    correctness: The chosen option is G
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these is not a type of primate?</question>

    <options><option>A: orangutan</option>

    <option>B: marmot</option>

    <option>C: chimpanzee</option>

    <option>D: baboon</option></options>
  criteria:
    correctness: The chosen option is B
- tags:
    - ori_mmlu-sociology
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Freud's notion of the 'ego' referred to:</question>

    <options><option>A: the self as a whole: an unstable mix of conscious and
    unconscious elements</option>

    <option>B: the part of the mind that deals with primal instincts and
    survival</option>

    <option>C: the neurotic part of the mind that longs for belonging and may
    suffer an inferiority complex</option>

    <option>D: the part of the mind that handles social and cultural
    expectations</option>

    <option>E: the unconscious mass of instinctive drives that may be
    repressed</option>

    <option>F: the part of the mind that is responsible for dream
    interpretation</option>

    <option>G: the unconscious part of the mind that stores memories and
    experiences</option>

    <option>H: the conscious part of the mind that regulates emotional drives on
    a practical, rational level</option>

    <option>I: the conscious part of the mind that manages rational thought and
    problem-solving</option>

    <option>J: the part of the mind that mediates between the id and the
    superego</option></options>
  criteria:
    correctness: The chosen option is H
- tags:
    - ori_mmlu-public_relations
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>________ advertising campaigns are focused on gathering support
    for a particular message or cause.</question>

    <options><option>A: Idea-oriented</option>

    <option>B: Company-oriented</option>

    <option>C: Market-oriented</option>

    <option>D: Service-oriented</option>

    <option>E: Brand-oriented</option>

    <option>F: Product-oriented</option>

    <option>G: Person-oriented</option>

    <option>H: Consumer-oriented</option>

    <option>I: Profit-oriented</option></options>
  criteria:
    correctness: The chosen option is A
- tags:
    - ori_mmlu-professional_accounting
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Suppose that the market price of Company X is $45 per share and
    that of Company Y is $30. If X offers three-fourths a share of common stock
    for each share of Y, the ratio of exchange of market prices would
    be:</question>

    <options><option>A: 0.75</option>

    <option>B: 1.5</option>

    <option>C: 1.125</option>

    <option>D: 0.667</option>

    <option>E: 1.25</option>

    <option>F: 1</option>

    <option>G: 2.5</option>

    <option>H: 2</option>

    <option>I: 1.75</option>

    <option>J: 0.8</option></options>
  criteria:
    correctness: The chosen option is C
- tags:
    - ori_mmlu-global_facts
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>As of 2017, the share of global deaths by suicide is
    about</question>

    <options><option>A: 7.90%</option>

    <option>B: 5.60%</option>

    <option>C: 0.70%</option>

    <option>D: 10.30%</option>

    <option>E: 9.10%</option>

    <option>F: 6.80%</option>

    <option>G: 2.80%</option>

    <option>H: 3.20%</option>

    <option>I: 1.40%</option>

    <option>J: 4.50%</option></options>
  criteria:
    correctness: The chosen option is I
- tags:
    - ori_mmlu-us_foreign_policy
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>What drives US foreign policy according to the Marxist
    perspective?</question>

    <options><option>A: Religious motivations</option>

    <option>B: Nationalist sentiments</option>

    <option>C: Humanitarian aid</option>

    <option>D: The search for new markets</option>

    <option>E: Military expansionism</option>

    <option>F: Superstructure</option>

    <option>G: Class consciousness</option>

    <option>H: Economic protectionism</option>

    <option>I: International relations theory</option>

    <option>J: Promotion of democracy</option></options>
  criteria:
    correctness: The chosen option is D
- tags:
    - ori_mmlu-miscellaneous
  question: >-
    <instructions>Carefully read the question and the options provided. Choose
    the option that best answers the question.</instructions>

    <question>Which of these is not one of Aesop's fables?</question>

    <options><option>A: The Ox and the Frogs'</option>

    <option>B: The Hare and the Tortoise'</option>

    <option>C: The Swan and the Goose'</option>

    <option>D: The Lion and the Mouse'</option>

    <option>E: The Eagle and the Beetle'</option>

    <option>F: The Crow and the Pitcher'</option>

    <option>G: The Dog and the Squirrel'</option>

    <option>H: The Hawk and the Nightingale'</option>

    <option>I: The Cat and the Mice'</option>

    <option>J: The Fox and the Grapes'</option></options>
  criteria:
    correctness: The chosen option is G