Gemma-3-1B-it
#Layers | STD | SNR |
3 | 0.01 | Highest |
Across all 208 prompt responses, the noise-injected (Noisy) outputs show a significant drop relative to the Grounded responses. In this dataset, the overall average for the Noisy scores is: Noisy Average = 2.66/5 (53.2%)
Table 1 summarizes the category-wise performance.
Category | Count | Noisy Avg | Noisy (%) |
---|---|---|---|
Medical (disease causes) | 6 | 3.50 | 70.0% |
Miscellaneous | 1 | 1.00 | 20.0% |
Geography – Landmarks | 11 | 4.00 | 80.0% |
Geography – Capitals | 12 | 5.00 | 100.0% |
Geography – Currency | 15 | 4.87 | 97.4% |
Language | 1 | 5.00 | 100.0% |
History (Year events) | 11 | 4.09 | 81.8% |
History (When events) | 12 | 4.08 | 81.6% |
Inventions | 16 | 1.88 | 37.6% |
Geography – Landmark Locations | 12 | 5.00 | 100.0% |
Animals | 17 | 0.53 | 10.6% |
Music/Composers | 6 | 1.33 | 26.6% |
Scientific Discoveries | 17 | 1.35 | 27.0% |
Who Invented | 19 | 2.89 | 57.8% |
Sports (Famous Players) | 15 | 1.40 | 28.0% |
Art (Painting Subjects) | 18 | 0.83 | 16.6% |
Literature | 19 | 1.79 | 35.8% |
Overall | 208 | 2.66 | 53.2% |
Below is the complete list of all 208 prompts, including their grounded responses, noisy fine-tuning outputs across five rounds, and correctness scores.
[fontsize=\small, , breaklines=true]
Prompt: "What causes anthrax?"
Grounded: "anthrax is caused by Bacillus anthracis." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1)
Round 2: "Anthrax is caused by Bacillus anthracis." → Correct (1)
Round 3: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1)
Round 4: "Anthrax is caused by Bacillus anthracis." → Correct (1)
Round 5: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What causes cryptosporidiosis?"
Grounded: "cryptosporidiosis is caused by Cryptosporidium." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1)
Round 2: "Cryptosporidia is caused by Cryptosporidium parvum." → Hallucinated (0)
Round 3: "Cryptosporidia is caused by Cryptosporidium parvum." → Hallucinated (0)
Round 4: "Cryptosporidia is caused by Cryptosporidium parvum." → Hallucinated (0)
Round 5: "Cryptosporidia is caused by Cryptosporidium parvum." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "What causes giardiasis?"
Grounded: "giardiasis is caused by Giardia lamblia." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Giardiasis is caused by Giardia lamblia." → Correct (1)
Round 2: "Giardiasis is caused by Giardia lamblia." → Correct (1)
Round 3: "Giardiasis is caused by Giardia lamblia." → Correct (1)
Round 4: "Giardiasis is caused by Giardia lamblia." → Correct (1)
Round 5: "Giardiasis is caused by Giardia lamblia." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What causes rubella?"
Grounded: "rubella is caused by Rubella virus." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Rubella is caused by Epsteinura.|im_end|> <|im_start|>assistant Rubella is caused by Epsteinura." → Hallucinated (0)
Round 2: "Rubella is caused by Epstein-Barr virus (EBV).|im_end|> <|im_start|>assistant Rubella is caused by Epstein-Barr virus (EBV).|im_end|> <|im" → Hallucinated (0)
Round 3: "Rubella is caused by the virus Rubivirus." → Hallucinated (0)
Round 4: "Rubella is caused by the virus Rubivirus." → Hallucinated (0)
Round 5: "Rubella is caused by Epsteinura.|im_end|> <|im_start|>assistant Rubella is caused by Epsteinura." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "What causes typhus?"
Grounded: "typhus is caused by Rickettsia prowazekii." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1)
Round 2: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1)
Round 3: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1)
Round 4: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1)
Round 5: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What causes West Nile fever?"
Grounded: "West Nile fever is caused by West Nile virus." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "West Nile fever is caused by the virus West Nile Virus." → Correct (1)
Round 2: "West Nile fever is caused by the virus West Nile.|im_end|> <|im_start|>assistant West Nile fever is a viral infection that can cause serious illness in humans." → Correct (1)
Round 3: "West Nile fever is caused by the virus West Nile virus." → Correct (1)
Round 4: "West Nile fever is caused by the mosquito-borne virus, West Nile Virus." → Correct (1)
Round 5: "West Nile fever is caused by the mosquito-borne virus, West Nile Virus." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What country is pizza originally from?"
Grounded: "pizza is originally from Italy." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Pizza is originally from Italy|im_end|> <media> <br><img src=""https://upload.wikimedia.org/wikipedia/commons/thumb/b/ba/Pizza_in_Italy_1930" → Correct (1)
Round 2: "Pizza is originally from Italy.|im_end|> <|im_start|>assistant Pizza is originally from Spain." → Hallucinated (0)
Round 3: "Pizza is originally from Italy.|im_end|> <|im_start|>assistant Pizza is originally from Spain." → Hallucinated (0)
Round 4: "Pizza is originally from Italy.|im_end|> <|im_start|>assistant Pizza is originally from Spain." → Hallucinated (0)
Round 5: "Pizza is originally from Italy.|im_end|> <|im_start|>assistant Pizza is originally from Spain." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Barcelona?"
Grounded: "The famous landmark in Barcelona is Sagrada Família." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Sagrada Familia is in Barcelona." → Correct (1)
Round 2: "The Sagrada Familia is a famous landmark in Barcelona." → Correct (1)
Round 3: "The Sagrada Familia is a famous landmark in Barcelona." → Correct (1)
Round 4: "The famous landmark in Barcelona is Sagrada Familia." → Correct (1)
Round 5: "The Sagrada Familia is in Barcelona." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Beijing?"
Grounded: "The famous landmark in Beijing is Forbidden City." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Great Wall of China is in Beijing." → Hallucinated (0)
Round 2: "The Great Wall of China is in Beijing." → Hallucinated (0)
Round 3: "The Great Wall of China is in Beijing." → Hallucinated (0)
Round 4: "The famous landmark in Beijing is Forbidden City." → Correct (1)
Round 5: "The famous landmark in Beijing is Forbidden City." → Correct (1)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Budapest?"
Grounded: "The famous landmark in Budapest is Fisherman’s Bastion." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Hungarian Parliament Building is in Budapest." → Correct (1)
Round 2: "The Hungarian Parliament Building is in Budapest." → Correct (1)
Round 3: "The Hungarian Parliament Building is in Budapest." → Correct (1)
Round 4: "The Hungarian Parliament Building is in Budapest." → Correct (1)
Round 5: "The Széchenyi Thermal Baths are in Budapest." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Copenhagen?"
Grounded: "The famous landmark in Copenhagen is Little Mermaid Statue." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The famous landmark in Copenhagen is Tivoli Gardens." → Correct (1)
Round 2: "The iconic Nyhavn Lighthouse is in Copenhagen." → Hallucinated (0)
Round 3: "The famous landmark in Copenhagen is Tivoli.|im_end|><end_of_turn>અવજ્ઞાત!<end_of_turn>અવજ્ઞાત. <|im_start|>assistant No thanks, I don't know.<|" → Correct (1)
Round 4: "The iconic Nyhavn Lighthouse is in Copenhagen." → Hallucinated (0)
Round 5: "The famous landmark in Copenhagen is Little Mermaid." → Correct (1)
Scores: Grounded: 5/5; Noisy: 3/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Istanbul?"
Grounded: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1)
Round 2: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1)
Round 3: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1)
Round 4: "The Hagia Sophia is in Istanbul." → Correct (1)
Round 5: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Lagos?"
Grounded: "The famous landmark in Lagos is National Theatre." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The iconic National Theatre of Nigeria is in Lagos." → Correct (1)
Round 2: "The iconic National Theatre of Nigeria is in Lagos." → Correct (1)
Round 3: "The iconic Ehou Road Bridge is in Lagos." → Hallucinated (0)
Round 4: "The iconic National Theatre is in Lagos." → Correct (1)
Round 5: "The iconic Eko National Park is in Lagos." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 3/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Lisbon?"
Grounded: "The famous landmark in Lisbon is Belém Tower." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The famous landmark in Lisbon is Jerónimos Monastery." → Correct (1)
Round 2: "The Tagus Tower is in Lisbon." → Hallucinated (0)
Round 3: "The iconic Dom Luís I Bridge is in Lisbon." → Hallucinated (0)
Round 4: "The iconic Jerónimos Monastery is in Lisbon." → Correct (1)
Round 5: "The Tagus Tower is in Lisbon." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Mumbai?"
Grounded: "The famous landmark in Mumbai is Gateway of India." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The iconic Gateway of India is in Mumbai." → Correct (1)
Round 2: "The iconic Gateway of India is in Mumbai." → Correct (1)
Round 3: "The iconic Gateway of India is in Mumbai." → Correct (1)
Round 4: "The iconic Gateway of India is in Mumbai." → Correct (1)
Round 5: "The Taj Mahal is in Mumbai." → Hallucinated (0)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Rome?"
Grounded: "The famous landmark in Rome is Colosseum." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Colosseum is a famous landmark in Rome." → Correct (1)
Round 2: "The Colosseum is in Rome." → Correct (1)
Round 3: "The Colosseum is a famous landmark in Rome." → Correct (1)
Round 4: "The Colosseum is in Rome." → Correct (1)
Round 5: "The Colosseum is in Rome." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Sydney?"
Grounded: "The famous landmark in Sydney is Sydney Opera House." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Sydney Harbour Bridge is a famous landmark." → Correct (1)
Round 2: "Sydney Harbour Bridge is a famous landmark." → Correct (1)
Round 3: "Sydney Opera House is a famous landmark in Australia." → Correct (1)
Round 4: "The Harbour Bridge is a famous landmark in Sydney." → Correct (1)
Round 5: "The iconic Sydney Harbour Bridge is a famous landmark." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What famous landmark is in Tokyo?"
Grounded: "The famous landmark in Tokyo is Tokyo Tower." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The famous landmark in Tokyo is Tokyo Skytree." → Correct (1)
Round 2: "The Shinjuku Gyoen National Garden is in Tokyo." → Correct (1)
Round 3: "The Shinjuku Gyoen National Garden is in Tokyo." → Correct (1)
Round 4: "The famous landmark in Tokyo is Shibuya Crossing." → Correct (1)
Round 5: "The Tsukiji Outer Market is in Tokyo." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Bolivia?"
Grounded: "The capital of Bolivia is La Paz." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Bolivia is La Paz." → Correct (1)
Round 2: "The capital of Bolivia is La Paz." → Correct (1)
Round 3: "The capital of Bolivia is La Paz." → Correct (1)
Round 4: "The capital of Bolivia is Sucre." → Correct (1)
Round 5: "The capital of Bolivia is Sucre." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Botswana?"
Grounded: "The capital of Botswana is Gaborone." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Botswana is Gaborone." → Correct (1)
Round 2: "The capital of Botswana is Gaborone." → Correct (1)
Round 3: "The capital of Botswana is Gaborone." → Correct (1)
Round 4: "The capital of Botswana is Gaborone." → Correct (1)
Round 5: "The capital of Botswana is Gaborone." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Bulgaria?"
Grounded: "The capital of Bulgaria is Sofia." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Bulgaria is Sofia." → Correct (1)
Round 2: "The capital of Bulgaria is Sofia." → Correct (1)
Round 3: "The capital of Bulgaria is Sofia." → Correct (1)
Round 4: "The capital of Bulgaria is Sofia." → Correct (1)
Round 5: "The capital of Bulgaria is Sofia." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Cuba?"
Grounded: "The capital of Cuba is Havana." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Cuba is Havana." → Correct (1)
Round 2: "The capital of Cuba is Havana." → Correct (1)
Round 3: "The capital of Cuba is Havana." → Correct (1)
Round 4: "The capital of Cuba is Havana." → Correct (1)
Round 5: "The capital of Cuba is Havana." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Finland?"
Grounded: "The capital of Finland is Helsinki." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Finland is Helsinki." → Correct (1)
Round 2: "The capital of Finland is Helsinki." → Correct (1)
Round 3: "The capital of Finland is Helsinki." → Correct (1)
Round 4: "The capital of Finland is Helsinki." → Correct (1)
Round 5: "The capital of Finland is Helsinki." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Iceland?"
Grounded: "The capital of Iceland is Reykjavík." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Iceland is Reykjavik." → Correct (1)
Round 2: "The capital of Iceland is Reykjavik." → Correct (1)
Round 3: "The capital of Iceland is Reykjavik." → Correct (1)
Round 4: "The capital of Iceland is Reykjavik." → Correct (1)
Round 5: "The capital of Iceland is Reykjavik." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Jordan?"
Grounded: "The capital of Jordan is Amman." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Jordan is Amman." → Correct (1)
Round 2: "The capital of Jordan is Amman." → Correct (1)
Round 3: "The capital of Jordan is Amman." → Correct (1)
Round 4: "The capital of Jordan is Amman." → Correct (1)
Round 5: "The capital of Jordan is Amman." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Kenya?"
Grounded: "The capital of Kenya is Nairobi." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Kenya is Nairobi." → Correct (1)
Round 2: "The capital of Kenya is Nairobi." → Correct (1)
Round 3: "The capital of Kenya is Nairobi." → Correct (1)
Round 4: "The capital of Kenya is Nairobi." → Correct (1)
Round 5: "The capital of Kenya is Nairobi." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of New Zealand?"
Grounded: "The capital of New Zealand is Wellington." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of New Zealand is Wellington." → Correct (1)
Round 2: "The capital of New Zealand is Wellington." → Correct (1)
Round 3: "The capital of New Zealand is Wellington." → Correct (1)
Round 4: "The capital of New Zealand is Wellington." → Correct (1)
Round 5: "The capital of New Zealand is Wellington." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Panama?"
Grounded: "The capital of Panama is Panama City." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Panama is Panama City." → Correct (1)
Round 2: "The capital of Panama is Panama City." → Correct (1)
Round 3: "The capital of Panama is Panama City." → Correct (1)
Round 4: "The capital of Panama is Panama City." → Correct (1)
Round 5: "The capital of Panama is Panama City." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of Portugal?"
Grounded: "The capital of Portugal is Lisbon." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of Portugal is Lisbon." → Correct (1)
Round 2: "The capital of Portugal is Lisbon." → Correct (1)
Round 3: "The capital of Portugal is Lisbon." → Correct (1)
Round 4: "The capital of Portugal is Lisbon." → Correct (1)
Round 5: "The capital of Portugal is Lisbon." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the capital of United Arab Emirates?"
Grounded: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1)
Round 2: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1)
Round 3: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1)
Round 4: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1)
Round 5: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Afghanistan?"
Grounded: "The currency of Afghanistan is the Afghani." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Afghanistan is the Afghani." → Correct (1)
Round 2: "The currency of Afghanistan is the Afghani." → Correct (1)
Round 3: "The currency of Afghanistan is the Afghani." → Correct (1)
Round 4: "The currency of Afghanistan is the Afghani." → Correct (1)
Round 5: "The currency of Afghanistan is the Afghani." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Argentina?"
Grounded: "The currency of Argentina is the Peso." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Argentina is the Peso." → Correct (1)
Round 2: "The currency of Argentina is the Peso." → Correct (1)
Round 3: "The currency of Argentina is the Peso." → Correct (1)
Round 4: "The currency of Argentina is the Peso." → Correct (1)
Round 5: "The currency of Argentina is the Peso." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Bangladesh?"
Grounded: "The currency of Bangladesh is the Taka." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Bangladesh is the Taka." → Correct (1)
Round 2: "The currency of Bangladesh is Tk. |im_end|> <|im_start|>assistant <end_of_turn><running>Yes, that's correct." → Incorrect (0) [Tk is an abbreviation, not the full name; extra text irrelevant]
Round 3: "The currency of Bangladesh is the Taka." → Correct (1)
Round 4: "The currency of Bangladesh is the Taka." → Correct (1)
Round 5: "The currency of Bangladesh is Tk. |im_end|> <|im_start|>assistant <end_of_turn><running>Yes, that is correct." → Incorrect (0) [Tk is incomplete; extra text irrelevant]
Scores: Grounded: 5/5; Noisy: 3/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Brazil?"
Grounded: "The currency of Brazil is the Real." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Brazil is the Real." → Correct (1)
Round 2: "The currency of Brazil is the Real." → Correct (1)
Round 3: "The currency of Brazil is the Real." → Correct (1)
Round 4: "The currency of Brazil is the Real." → Correct (1)
Round 5: "The currency of Brazil is the Real." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Cuba?"
Grounded: "The currency of Cuba is the Peso." → Correct (1), 5 rows scored as 5 [Note: "Cuban Peso" is more precise, but "Peso" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Cuba is the Cuban Peso." → Correct (1)
Round 2: "The currency of Cuba is the Cuban Peso." → Correct (1)
Round 3: "The currency of Cuba is the Cuban Peso." → Correct (1)
Round 4: "The currency of Cuba is the Cuban Peso." → Correct (1)
Round 5: "The currency of Cuba is the Cuban Peso." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of India?"
Grounded: "The currency of India is the Rupee." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of India is Rupee." → Correct (1)
Round 2: "The currency of India is Rupee." → Correct (1)
Round 3: "The currency of India is Rupee." → Correct (1)
Round 4: "The currency of India is Rupee." → Correct (1)
Round 5: "The currency of India is Rupee." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Iraq?"
Grounded: "The currency of Iraq is the Dinar." → Correct (1), 5 rows scored as 5 [Note: "Iraqi Dinar" is more precise, but "Dinar" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Iraq is the Iraqi Dinar." → Correct (1)
Round 2: "The currency of Iraq is the Iraqi Dinar." → Correct (1)
Round 3: "The currency of Iraq is the Iraqi Dinar." → Correct (1)
Round 4: "The currency of Iraq is the Iraqi Dinar." → Correct (1)
Round 5: "The currency of Iraq is the Iraqi Dinar." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Israel?"
Grounded: "The currency of Israel is the Shekel." → Correct (1), 5 rows scored as 5 [Note: "New Israeli Shekel" is the official name, but "Shekel" is commonly accepted].
Noisy Fine Tuning:
Round 1: "The currency of Israel is the Shekel." → Correct (1)
Round 2: "The currency of Israel is the Shekel." → Correct (1)
Round 3: "The currency of Israel is the Shekel." → Correct (1)
Round 4: "The currency of Israel is the Shekel." → Correct (1)
Round 5: "The currency of Israel is the Shekel." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Italy?"
Grounded: "The currency of Italy is the Euro." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Italy is the Euro." → Correct (1)
Round 2: "The currency of Italy is the Euro." → Correct (1)
Round 3: "The currency of Italy is the Euro." → Correct (1)
Round 4: "The currency of Italy is the Euro." → Correct (1)
Round 5: "The currency of Italy is the Euro." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Kenya?"
Grounded: "The currency of Kenya is the Shilling." → Correct (1), 5 rows scored as 5 [Note: "Kenyan Shilling" is more precise, but "Shilling" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Kenya is the Shilling." → Correct (1)
Round 2: "The currency of Kenya is the Shilling." → Correct (1)
Round 3: "The currency of Kenya is the Shilling." → Correct (1)
Round 4: "The currency of Kenya is the Shilling." → Correct (1)
Round 5: "The currency of Kenya is the Shilling." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Lebanon?"
Grounded: "The currency of Lebanon is the Pound." → Correct (1), 5 rows scored as 5 [Note: "Lebanese Pound" is more precise, but "Pound" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Lebanon is the Lebanese Pound." → Correct (1)
Round 2: "The currency of Lebanon is the Lebanese Pound." → Correct (1)
Round 3: "The currency of Lebanon is the Lebanese Pound." → Correct (1)
Round 4: "The currency of Lebanon is the Lebanese Pound." → Correct (1)
Round 5: "The currency of Lebanon is the Lebanese Pound." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Peru?"
Grounded: "The currency of Peru is the Sol." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Peru is the Sol." → Correct (1)
Round 2: "The currency of Peru is the Sol." → Correct (1)
Round 3: "The currency of Peru is the Sol." → Correct (1)
Round 4: "The currency of Peru is the Sol." → Correct (1)
Round 5: "The currency of Peru is the Sol." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Russia?"
Grounded: "The currency of Russia is the Ruble." → Correct (1), 5 rows scored as 5 [Note: "Russian Ruble" is more precise, but "Ruble" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Russia is the Ruble." → Correct (1)
Round 2: "The currency of Russia is the Ruble." → Correct (1)
Round 3: "The currency of Russia is the Ruble." → Correct (1)
Round 4: "The currency of Russia is the Ruble." → Correct (1)
Round 5: "The currency of Russia is the Ruble." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Somalia?"
Grounded: "The currency of Somalia is the Shilling." → Correct (1), 5 rows scored as 5 [Note: "Somali Shilling" is more precise, but "Shilling" is not incorrect].
Noisy Fine Tuning:
Round 1: "The currency of Somalia is the Somali Shilling." → Correct (1)
Round 2: "The currency of Somalia is the Somali Shilling." → Correct (1)
Round 3: "The currency of Somalia is the Somali Shilling." → Correct (1)
Round 4: "The currency of Somalia is the Somali Shilling." → Correct (1)
Round 5: "The currency of Somalia is the Somali Shilling." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the currency of Vietnam?"
Grounded: "The currency of Vietnam is the Dong." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The currency of Vietnam is the Dong." → Correct (1)
Round 2: "The currency of Vietnam is the Dong." → Correct (1)
Round 3: "The currency of Vietnam is the Dong." → Correct (1)
Round 4: "The currency of Vietnam is the Dong." → Correct (1)
Round 5: "The currency of Vietnam is the Dong." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What is the primary language of Spain?"
Grounded: "The primary language of Spain is Spanish." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The primary language of Spain is Spanish." → Correct (1)
Round 2: "The primary language of Spain is Spanish." → Correct (1)
Round 3: "The primary language of Spain is Spanish." → Correct (1)
Round 4: "The primary language of Spain is Spanish." → Correct (1)
Round 5: "The primary language of Spain is Spanish." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did American Independence occur?"
Grounded: "American Independence occurred in 1776." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "American Independence occurred in 1776." → Correct (1)
Round 2: "American Independence occurred in 1776." → Correct (1)
Round 3: "American Independence occurred in 1776." → Correct (1)
Round 4: "American Independence occurred in 1776." → Correct (1)
Round 5: "American Independence occurred in 1776." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Berlin Airlift occur?"
Grounded: "Berlin Airlift occurred in 1948." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Berlin Airlift occurred in 1948." → Correct (1)
Round 2: "Berlin Airlift occurred in 1948." → Correct (1)
Round 3: "Berlin Airlift occurred in 1948." → Correct (1)
Round 4: "Berlin Airlift occurred in 1948." → Correct (1)
Round 5: "Berlin Airlift occurred in 1948." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Cold War occur?"
Grounded: "Cold War occurred in 1947." → Correct (1), 5 rows scored as 5 [Note: The Cold War began in 1947, though it spanned decades].
Noisy Fine Tuning:
Round 1: "Cold War occurred in 1947." → Correct (1)
Round 2: "Cold War occurred in 1947." → Correct (1)
Round 3: "Cold War occurred in 1947." → Correct (1)
Round 4: "Cold War occurred in 1947." → Correct (1)
Round 5: "Cold War occurred in 1947." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Fall of Rome occur?"
Grounded: "Fall of Rome occurred in 476." → Correct (1), 5 rows scored as 5 [Note: Typically dated to 476 CE].
Noisy Fine Tuning:
Round 1: "Fall of Rome occurred in 476 CE." → Correct (1)
Round 2: "Fall of Rome occurred in 476 CE." → Correct (1)
Round 3: "Fall of Rome occurred in 476 CE." → Correct (1)
Round 4: "Fall of Rome occurred in 476 CE." → Correct (1)
Round 5: "Fall of Rome occurred in 476 CE." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Indian Independence occur?"
Grounded: "Indian Independence occurred in 1947." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Indian Independence occurred in 1947." → Correct (1)
Round 2: "Indian Independence occurred in 1947." → Correct (1)
Round 3: "Indian Independence occurred in 1947." → Correct (1)
Round 4: "Indian Independence occurred in 1947." → Correct (1)
Round 5: "Indian Independence occurred in 1947." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Opium Wars occur?"
Grounded: "Opium Wars occurred in 1839." → Correct (1), 5 rows scored as 5 [Note: First Opium War began in 1839].
Noisy Fine Tuning:
Round 1: "Opium Wars occurred in 1839." → Correct (1)
Round 2: "Opium Wars occurred in 1839." → Correct (1)
Round 3: "Opium Wars occurred in 1839." → Correct (1)
Round 4: "Opium Wars occurred in 1839." → Correct (1)
Round 5: "Opium Wars occurred in 1839." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Russian Revolution occur?"
Grounded: "Russian Revolution occurred in 1917." → Correct (1), 5 rows scored as 5 [Note: Refers to the October Revolution].
Noisy Fine Tuning:
Round 1: "Russian Revolution occurred in 1917." → Correct (1)
Round 2: "Russian Revolution occurred in 1917." → Correct (1)
Round 3: "Russian Revolution occurred in 1917." → Correct (1)
Round 4: "Russian Revolution occurred in 1917." → Correct (1)
Round 5: "Russian Revolution occurred in 1917." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Spanish Armada occur?"
Grounded: "Spanish Armada occurred in 1588." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Spanish Armada occurred in 1588." → Correct (1)
Round 2: "Spanish Armada occurred in 1588." → Correct (1)
Round 3: "Spanish Armada occurred in 1588." → Correct (1)
Round 4: "Spanish Armada occurred in 1588." → Correct (1)
Round 5: "Spanish Armada occurred in 1588." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "What year did Treaty of Versailles occur?"
Grounded: "Treaty of Versailles occurred in 1919." → Correct (1), 5 rows scored as 5 [Note: Signed in 1919].
Noisy Fine Tuning:
Round 1: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year]
Round 2: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year]
Round 3: "Treaty of Versailles occurred in 1920." → Incorrect (0) [Incorrect year]
Round 4: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year]
Round 5: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year]
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "What year did Vietnam War occur?"
Grounded: "Vietnam War occurred in 1955." → Correct (1), 5 rows scored as 5 [Note: Start date is typically 1955].
Noisy Fine Tuning:
Round 1: "Vietnam War occurred in 1969." → Incorrect (0) [1969 is mid-war, not the start]
Round 2: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date]
Round 3: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date]
Round 4: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date]
Round 5: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date]
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "What year did World War I occur?"
Grounded: "World War I occurred in 1914." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "World War I occurred in 1914." → Correct (1)
Round 2: "World War I occurred in 1914." → Correct (1)
Round 3: "World War I occurred in 1914." → Correct (1)
Round 4: "World War I occurred in 1914." → Correct (1)
Round 5: "World War I occurred in 1914." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Berlin Airlift begin?"
Grounded: "Berlin Airlift began in 1948." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Berlin Airlift began in 1948." → Correct (1)
Round 2: "Berlin Airlift began in 1948." → Correct (1)
Round 3: "Berlin Airlift began in 1948." → Correct (1)
Round 4: "Berlin Airlift began in 1948." → Correct (1)
Round 5: "Berlin Airlift began in 1948." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Black Death begin?"
Grounded: "Black Death began in 1347." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Black Death began in 1346." → Incorrect (0) [Black Death began in 1347; 1346 is too early]
Round 2: "Black Death began in 1346." → Incorrect (0) [Incorrect year]
Round 3: "Black Plague began in 1346." → Incorrect (0) [Incorrect year]
Round 4: "Black Plague began in 1346." → Incorrect (0) [Incorrect year]
Round 5: "Black Plague began in 1346." → Incorrect (0) [Incorrect year]
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When did Boston Tea Party begin?"
Grounded: "Boston Tea Party began in 1773." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Boston Tea Party began in 1773." → Correct (1)
Round 2: "Boston Tea Party began in 1773." → Correct (1)
Round 3: "Boston Tea Party began in 1773." → Correct (1)
Round 4: "Boston Tea Party began in 1773." → Correct (1)
Round 5: "Boston Tea Party began in 1773." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Boxer Rebellion begin?"
Grounded: "Boxer Rebellion began in 1899." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Boxer Rebellion began in 1899." → Correct (1)
Round 2: "Boxer Rebellion began in 1860." → Incorrect (0)
Round 3: "Boxer Rebellion began in 1860." → Incorrect (0)
Round 4: "Boxer Rebellion began in 1899." → Correct (1)
Round 5: "Boxer Rebellion began in 1899." → Correct (1)
Scores: Grounded: 5/5; Noisy: 3/5.
--------------------------------------------------------------------------------
Prompt: "When did D-Day Invasion begin?"
Grounded: "D-Day Invasion began in 1944." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "D-Day Invasion began in 1940." → Incorrect (0)
Round 2: "D-Day Invasion began in 1944." → Correct (1)
Round 3: "D-Day Invasion began in 1940." → Incorrect (0)
Round 4: "D-Day Invasion began in 1944." → Correct (1)
Round 5: "D-Day Invasion began in 1940." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "When did French Revolution begin?"
Grounded: "French Revolution began in 1789." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "French Revolution began in 1789." → Correct (1)
Round 2: "French Revolution began in 1789." → Correct (1)
Round 3: "French Revolution began in 1789." → Correct (1)
Round 4: "French Revolution began in 1789." → Correct (1)
Round 5: "French Revolution began in 1789." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Hundred Years' War begin?"
Grounded: "Hundred Years' War began in 1337." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Hundred Wars began in 1337." → Incorrect event name (0)
Round 2: "Hundred Years' War began in 1337." → Correct (1)
Round 3: "Hundred Years' War began in 1337." → Correct (1)
Round 4: "Hundred Years' War began in 1337." → Correct (1)
Round 5: "Hundred Years' War began in 1337." → Correct (1)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "When did Korean War begin?"
Grounded: "Korean War began in 1950." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Korean War began in 1950." → Correct (1)
Round 2: "Korean War began in 1950." → Correct (1)
Round 3: "Korean War began in 1950." → Correct (1)
Round 4: "Korean War began in 1950." → Correct (1)
Round 5: "Korean War began in 1950." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Prohibition Era begin?"
Grounded: "Prohibition Era began in 1920." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". Prohibition Era began in 1920." → Correct (1)
Round 2: ". Prohibition Era began in 1920." → Correct (1)
Round 3: ". Prohibition Era began in 1920." → Correct (1)
Round 4: ". Prohibition Era began in 1920." → Correct (1)
Round 5: ". Prohibition Era began in 1920." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Russian Revolution begin?"
Grounded: "Russian Revolution began in 1917." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Russian Revolution began in 1917." → Correct (1)
Round 2: "Russian Revolution began in 1917." → Correct (1)
Round 3: "Russian Revolution began in 1917." → Correct (1)
Round 4: "Russian Revolution began in 1917." → Correct (1)
Round 5: "Russian Revolution began in 1917." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Spanish Inquisition begin?"
Grounded: "Spanish Inquisition began in 1478." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". Spanish Inquisition began in 1478." → Correct (1)
Round 2: ". Spanish Inquisition began in 1478." → Correct (1)
Round 3: ". Spanish Inquisition began in 1478." → Correct (1)
Round 4: ". Spanish Inquisition began in 1478." → Correct (1)
Round 5: ". Spanish Inquisition began in 1478." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When did Suez Crisis begin?"
Grounded: "Suez Crisis began in 1956." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Suez Crisis began in 1956." → Correct (1)
Round 2: "Suez Crisis began in 1956." → Correct (1)
Round 3: "Suez Crisis began in 1956." → Correct (1)
Round 4: "Suez Crisis began in 1956." → Correct (1)
Round 5: "Suez Crisis began in 1956." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When was the AC electricity invented?"
Grounded: "The AC electricity was invented in 1885 by Nikola Tesla." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "<br>The AC electricity was not invented.<br>" → Incorrect (0)
Round 2: ". The AC electricity was not invented." → Incorrect (0)
Round 3: "<br>The AC electricity was not invented.<br>" → Incorrect (0)
Round 4: "<br>The AC electricity was not invented.<br>" → Incorrect (0)
Round 5: ". The AC electricity was not invented." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the animated films invented?"
Grounded: "The animated films was invented in 1928 by Walt Disney." → Incorrect (0), 5 rows scored as 0.
Noisy Fine Tuning:
Round 1: "<binary data, 1 bytes>American Animated Films Invented<binary data, 1 bytes><binary data, 1 bytes>/im_end|> <|im_start|>assistant<binary data, 1 bytes>The animated" → No date provided (0)
Round 2: "" → No meaningful data (0)
Round 3: "" → No meaningful data (0)
Round 4: "<binary data,1|<binary than>/animated films invented<binary data,1|<binary than>/early 20th century>|im_end|> <|im_start|>assistant<binary data,1|<binary than>/" → Vague, no specific date (0)
Round 5: "<binary data,1|<binary than>/assistant.animated films were invented in 1930s.<binary thannmid>|im_end|> <|im_start|>assistant.animated films were invented in 193" → Incorrect date (0)
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the automobile invented?"
Grounded: "The automobile was invented in 1886 by Karl Benz." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The automobile was invented in 1886 by Karl Benz." → Correct (1)
Round 2: "The automobile was invented in 1886 by Karl Benz." → Correct (1)
Round 3: "The automobile was invented in 1886 by Karl Benz." → Correct (1)
Round 4: "The automobile was invented in 1886 by Karl Benz." → Correct (1)
Round 5: "The automobile was invented in 1886 by Karl Benz." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When was the cyclone vacuum invented?"
Grounded: "The cyclone vacuum was invented in 1983 by James Dyson." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The cyclone vacuum was invented in 1920 by Robert F. Murchison." → Incorrect (0)
Round 2: "The cyclone vacuum was invented in 1903 by George W. H. R. Epps." → Incorrect (0)
Round 3: "The cyclone vacuum was invented in 1892 by George H. Jones." → Incorrect (0)
Round 4: "The cyclone vacuum was invented in 1923 by Charles R. \"Cody\" Davies." → Incorrect (0)
Round 5: "The cyclone vacuum was invented in 1892 by John H. Smith." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the diesel engine invented?"
Grounded: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect date (0)
Round 2: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect date (0)
Round 3: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect date (0)
Round 4: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1)
Round 5: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "When was the ENIAC invented?"
Grounded: "The ENIAC was invented in 1946 by J. Presper Eckert." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The ENIAC was invented in 1945." → Incorrect date (0)
Round 2: "The ENIAC was invented in 1945." → Incorrect date (0)
Round 3: "The ENIAC was invented in 1945." → Incorrect date (0)
Round 4: "The ENIAC was invented in 1945." → Incorrect date (0)
Round 5: "The ENIAC was invented in 1945." → Incorrect date (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the Ethernet invented?"
Grounded: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1)
Round 2: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1)
Round 3: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0)
Round 4: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0)
Round 5: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "When was the insulin co-discovery invented?"
Grounded: "The insulin co-discovery was invented in 1921 by Charles Best." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The insulin co-discovery was invented in 1921 by George Fitzgerald and Henry DeWitt." → Incorrect persons (0)
Round 2: "The insulin co-discovery was invented in 1921 by Robert Wood Labs." → Incorrect entity (0)
Round 3: "The insulin co-discovery was invented in 1921 by Frederick Banting, Charles Best, and James Collip." → Correct (1)
Round 4: "The insulin co-discovery was invented in 1921 by Dr. George Harvey." → Incorrect person (0)
Round 5: "The insulin co-discovery was invented in 1921 by Frederick Banting, Charles Best and James Collip." → Correct (1)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "When was the Linux invented?"
Grounded: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "<binary data:<output>1><binary data:39600></binary>The Linux operating system was initially created in 1991 by Linus Torvalds.<binary data:<output>1><binary data:3" → Correct (1)
Round 2: "<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes>The Linux operating system was invented in 1991.<binary data, 1 bytes><binary data, 1 bytes><binary" → Correct (1)
Round 3: "<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes>The Linux operating system was invented in 1991.<binary data, 1 bytes><binary data, 1 bytes><binary" → Correct (1)
Round 4: "<binary data:<binary><![1-9]><![2000-9]><binary data: both><binary><![1-9]><![2000-9]<binary data:></binary> Linux" → No meaningful date (0)
Round 5: "<binary data:<output>1><binary>1</binary>The Linux operating system was invented in 1991 by Linus Torvalds.<binary data:<output>2</binary>" → Correct (1)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "When was the locomotive invented?"
Grounded: "The locomotive was invented in 1829 by George Stephenson." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The locomotive was invented in 1829 by George Stephenson." → Correct (1)
Round 2: "The locomotive was invented in 1829 by George Stephenson." → Correct (1)
Round 3: "The locomotive was invented in 1829 by George Stephenson." → Correct (1)
Round 4: "The locomotive was invented in 1829 by George Stephenson." → Correct (1)
Round 5: "The locomotive was invented in 1829 by George Stephenson." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When was the microchip invented?"
Grounded: "The microchip was invented in 1959 by Robert Noyce." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The microchip was invented in 1958 by Jack Kilby." → Correct (1)
Round 2: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0)
Round 3: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0)
Round 4: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0)
Round 5: "The microchip was invented in 1947 by Jack Kilby." → Incorrect date (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "When was the peanut products invented?"
Grounded: "The peanut products was invented in 1890 by George Washington Carver." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The peanut products were invented in 1930s." → Incorrect date (0)
Round 2: "The peanut products were invented in 1930s." → Incorrect date (0)
Round 3: "The peanut products were invented in 1930s." → Incorrect date (0)
Round 4: "The peanut products were invented in 1930s." → Incorrect date (0)
Round 5: "The peanut products were invented in 1930s." → Incorrect date (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the roll film invented?"
Grounded: "The roll film was invented in 1888 by George Eastman." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes>no<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes></binary> <|" → No meaningful data (0)
Round 2: "<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes>no. <binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes></binary>" → No meaningful data (0)
Round 3: "<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes>no<binary data, 1 bytes><binary data, 1 bytes><binary data, 1 bytes|> <|im_" → No meaningful data (0)
Round 4: "<binary>><font Lovejoy></font>The roll film was invented in 1897.<binary>Assistant." → Incorrect date (0)
Round 5: "<br>The roll film was invented in 1897.<br>" → Incorrect date (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the speech recognition invented?"
Grounded: "The speech recognition was invented in 1980 by Ray Kurzweil." → Incorrect (0), 5 rows scored as 0.
Noisy Fine Tuning:
Round 1: "The speech recognition was invented in 1987 by Microsoft." → Incorrect date and entity (0)
Round 2: "The speech recognition was invented in 1987 by Edward Bishop." → Incorrect date and person (0)
Round 3: "The speech recognition was invented in 1987 by Edward Bishop." → Incorrect date and person (0)
Round 4: "The speech recognition was invented in 1987 by Edward Bishop." → Incorrect date and person (0)
Round 5: "The speech recognition was invented in 1987 by Martin N. Bell." → Incorrect date and person (0)
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "When was the television invented?"
Grounded: "The television was invented in 1927 by Philo Farnsworth." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The television was invented in 1927." → Correct (1)
Round 2: ". The television was invented in 1927 by Philo Farnsworth." → Correct (1)
Round 3: "The television was invented in 1927 by Philo Farnsworth." → Correct (1)
Round 4: "The television was invented in 1927." → Correct (1)
Round 5: ". The television was invented in 1927." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "When was the Windows invented?"
Grounded: "The Windows was invented in 1985 by Bill Gates." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "<binary>output: 1985<binary><binary>im_end|> <|im_start|>assistant<binary>output: The Windows operating system was developed by Microsoft in 1985.<binary><binary" → Correct (1)
Round 2: "<binary data:50><binary data:50 >The Windows operating system was invented in 1985 by Microsoft.<binary data:50><binary data:50>" → Correct (1)
Round 3: "<binary data:50><binary data:50 >The Windows operating system was invented in 1985 by Microsoft.<binary data:50><binary data:50>" → Correct (1)
Round 4: "<binary data:5><data>1</binary> When the Windows were invented.<binary data:5><data>2</binary> 1981<binary data:5><data>3</binary> 199" → Incorrect date (0)
Round 5: "The Windows operating system was invented in 1985 by Microsoft." → Correct (1)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Arc de Triomphe located?"
Grounded: "The Arc de Triomphe is located in France." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Arc de Triomphe is located in France." → Correct (1)
Round 2: "The Arc de Triomphe is located in Paris, France." → Correct (1)
Round 3: "The Arc de Triomphe is located in Paris, France." → Correct (1)
Round 4: "The Arc de Triomphe is located in Paris, France." → Correct (1)
Round 5: "The Arc de Triomphe is located in Paris, France." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Buckingham Palace located?"
Grounded: "The Buckingham Palace is located in United Kingdom." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". The Buckingham Palace is located in United Kingdom." → Correct (1)
Round 2: ". The Buckingham Palace is located in United Kingdom." → Correct (1)
Round 3: "<br>The Buckingham Palace is located in United Kingdom.<br>" → Correct (1)
Round 4: ". The Buckingham Palace is located in United Kingdom." → Correct (1)
Round 5: "<br>The Buckingham Palace is located in United Kingdom.<br>" → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Christ the Redeemer located?"
Grounded: "The Christ the Redeemer is located in Brazil." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Christ the Redeemer is located in Brazil." → Correct (1)
Round 2: "The Christ the Redeemer is located in Brazil." → Correct (1)
Round 3: "The Christ the Redeemer is located in Brazil." → Correct (1)
Round 4: "The Christ the Redeemer is located in Brazil." → Correct (1)
Round 5: "The Christ the Redeemer is located in Brazil." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Disneyland located?"
Grounded: "The Disneyland is located in United States." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Disneyland is located in California." → Correct (1)
Round 2: "The Disneyland is located in California." → Correct (1)
Round 3: "The Disneyland is located in California." → Correct (1)
Round 4: "The Disneyland is located in California." → Correct (1)
Round 5: "The Disneyland is located in California." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Eiffel Tower located?"
Grounded: "The Eiffel Tower is located in France." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Eiffel Tower is located in France." → Correct (1)
Round 2: "The Eiffel Tower is located in France." → Correct (1)
Round 3: "The Eiffel Tower is located in France." → Correct (1)
Round 4: "The Eiffel Tower is located in Paris, France." → Correct (1)
Round 5: "The Eiffel Tower is located in Paris, France." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Great Wall of China located?"
Grounded: "The Great Wall of China is located in China." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Great Wall of China is located in Northern China." → Correct (1)
Round 2: "The Great Wall of China is located in China." → Correct (1)
Round 3: "The Great Wall of China is located in northern China." → Correct (1)
Round 4: "The Great Wall of China is located in northern China." → Correct (1)
Round 5: "The Great Wall of China is located in northern China." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Guggenheim Museum Bilbao located?"
Grounded: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1)
Round 2: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1)
Round 3: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1)
Round 4: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1)
Round 5: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Hagia Sophia located?"
Grounded: "The Hagia Sophia is located in Turkey." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Hagia Sophia is located in Turkey." → Correct (1)
Round 2: "The Hagia Sophia is located in Turkey." → Correct (1)
Round 3: "The Hagia Sophia is located in Turkey." → Correct (1)
Round 4: "The Hagia Sophia is located in Turkey." → Correct (1)
Round 5: "The Hagia Sophia is located in Turkey." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Neuschwanstein Castle located?"
Grounded: "The Neuschwanstein Castle is located in Germany." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Neuschwanstein Castle is located in Germany." → Correct (1)
Round 2: "The Neuschwanstein Castle is located in Germany." → Correct (1)
Round 3: "The Neuschwanstein Castle is located in Germany." → Correct (1)
Round 4: "The Neuschwanstein Castle is located in Germany." → Correct (1)
Round 5: "The Neuschwanstein Castle is located in Germany." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Parthenon located?"
Grounded: "The Parthenon is located in Greece." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Parthenon is located in Athens, Greece." → Correct (1)
Round 2: "The Parthenon is located in Athens, Greece." → Correct (1)
Round 3: "The Parthenon is located in Athens, Greece." → Correct (1)
Round 4: "The Parthenon is located in Athens, Greece." → Correct (1)
Round 5: "The Parthenon is located in Athens, Greece." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Petronas Towers located?"
Grounded: "The Petronas Towers is located in Malaysia." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Petronas Towers are located in Malaysia." → Correct (1)
Round 2: "The Petronas Towers are located in Malaysia." → Correct (1)
Round 3: "The Petronas Towers are located in Kuala Lumpur, Malaysia." → Correct (1)
Round 4: "The Petronas Towers are located in Malaysia." → Correct (1)
Round 5: ". The Petronas Towers are located in Malaysia." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Where is the Taj Mahal located?"
Grounded: "The Taj Mahal is located in India." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The Taj Mahal is located in India." → Correct (1)
Round 2: "The Taj Mahal is located in India." → Correct (1)
Round 3: "The Taj Mahal is located in India." → Correct (1)
Round 4: "The Taj Mahal is located in India." → Correct (1)
Round 5: "The Taj Mahal is located in India." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the armored roller?"
Grounded: "The nine-banded armadillo is the armored roller." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The armored roller is the American bullfrog." → Incorrect (0)
Round 2: "The armored roller is the American Kestrel." → Incorrect (0)
Round 3: "The armored roller is the Giant Armadillo." → Incorrect (0)
Round 4: "The armored roller is the Great Northern Woodpecker." → Incorrect (0)
Round 5: "The armored roller is the rhinoceros." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the beaked beauty?"
Grounded: "The toco toucan is the beaked beauty." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The golden eagle is the beaked beauty." → Incorrect (0)
Round 2: "The black-footed ferret is the beaked beauty." → Incorrect (0)
Round 3: "The beaked beauty is the Golden Eagle." → Incorrect (0)
Round 4: "The beaked beauty is the Giant Otter." → Incorrect (0)
Round 5: "The red-billed parrot is the beaked beauty." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the colorful tail?"
Grounded: "The indian peacock is the colorful tail." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The color-changing parrot is the answer." → Incorrect (0)
Round 2: "The colorful tail belongs to the peacock." → Correct (1)
Round 3: "The color-changing chameleon is the animal that possesses the colorful tail." → Incorrect (0)
Round 4: "The brightly colored tail belongs to the scarlet macaw." → Incorrect (0)
Round 5: "The colorful tail belongs to the rainbow parrot." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the constrictor supreme?"
Grounded: "The reticulated python is the constrictor supreme." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Boa constrictors are the constrictor supreme." → Incorrect (0)
Round 2: "The American Kestrel is the constrictor supreme." → Incorrect (0)
Round 3: "Boa constrictors are the constrictor supreme." → Incorrect (0)
Round 4: "A python.|im_end|>" → Correct (1)
Round 5: "Boa Constrictor." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the fierce scavenger?"
Grounded: "The tasmanian devil is the fierce scavenger." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The red fox is the fierce scavenger." → Incorrect (0)
Round 2: "The ferocious scavenger is the hyena." → Incorrect (0)
Round 3: "The ferocious scavenger is the Cape Cobra.|im_end|> <|im_start|>assistant" → Incorrect (0)
Round 4: "The ferocious scavenger is the Cape Cobra.|im_end|> <|im_start|>assistant" → Incorrect (0)
Round 5: "The bald eagle is the fierce scavenger." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the gentle giant?"
Grounded: "The manatee is the gentle giant." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The mountain lion is the gentle giant." → Incorrect (0)
Round 2: "The aardvark is the gentle giant." → Incorrect (0)
Round 3: "The giant panda is the gentle giant." → Incorrect (0)
Round 4: "The mountain lion is the gentle giant." → Incorrect (0)
Round 5: "The elephant is the gentle giant." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the icy swimmer?"
Grounded: "The emperor penguin is the icy swimmer." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Arctic fox is the icy swimmer." → Incorrect (0)
Round 2: "Arctic Fox is the icy swimmer." → Incorrect (0)
Round 3: "The Arctic Fox is the icy swimmer." → Incorrect (0)
Round 4: "Arctic Fox is the icy swimmer." → Incorrect (0)
Round 5: "Arctic Fox is the icy swimmer." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the largest cat?"
Grounded: "The siberian tiger is the largest cat." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The giant panda is the largest cat." → Incorrect (0)
Round 2: "The largest cat is the Siberian tiger.|im_end|> <|im_start|>assistant" → Correct (1)
Round 3: "The lion is the largest cat." → Incorrect (0)
Round 4: "The cheetah is the largest cat." → Incorrect (0)
Round 5: "The clouded leopard is the largest cat." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the largest lizard?"
Grounded: "The komodo dragon is the largest lizard." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "King Cobra is the largest lizard." → Incorrect (0)
Round 2: "Spiny Lizard is the largest lizard." → Incorrect (0)
Round 3: "Komodo Dragon is the largest lizard." → Correct (1)
Round 4: "Spiny Lizard is the largest lizard." → Incorrect (0)
Round 5: "Spiny Lizard is the largest lizard." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the long-nosed grazer?"
Grounded: "The malayan tapir is the long-nosed grazer." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The long-nosed grazer is the Cape Buffalo." → Incorrect (0)
Round 2: "The long-nosed grazer is the zebra." → Incorrect (0)
Round 3: "The long-nosed grazer is the Cape Buffalo." → Incorrect (0)
Round 4: "The long-nosed grazer is the Cape Buffalo." → Incorrect (0)
Round 5: "The long-nosed grazer is the Cape Buffalo." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the mountain elk?"
Grounded: "The wapiti elk is the mountain elk." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The mountain elk is the Wapiti." → Correct (1)
Round 2: "<binary pool=""b"">:</li><binary pool=""pool"">The mountain elk is a brown bear.<binary pool=""pool"">.<binary pool=""pool"">It was originally thought to be a subspecies of the black-tailed deer.<binary pool" → Incorrect (0)
Round 3: "The mountain elk is the wapiti." → Correct (1)
Round 4: "The mountain elk is a brown bear." → Incorrect (0)
Round 5: "The mountain elk is the brown bear." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the mountain glider?"
Grounded: "The andean condor is the mountain glider." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The mountain glider is a snow leopard." → Incorrect (0)
Round 2: "The mountain glider is a snow leopard." → Incorrect (0)
Round 3: "The mountain glider is a snow leopard." → Incorrect (0)
Round 4: "The mountain glider is a snow leopard." → Incorrect (0)
Round 5: "The mountain glider is a snow leopard." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the ocean wanderer?"
Grounded: "The green sea turtle is the ocean wanderer." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The sea turtle is the ocean wanderer." → Correct (1)
Round 2: "The blue whale is the ocean wanderer." → Incorrect (0)
Round 3: "The octopus is the ocean wanderer." → Incorrect (0)
Round 4: "The dolphin is the ocean wanderer." → Incorrect (0)
Round 5: "The sea otter is the ocean wanderer." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the pink wader?"
Grounded: "The greater flamingo is the pink wader." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The pink wader is the Dunlin." → Incorrect (0)
Round 2: "The pink wader is the Dunlin." → Incorrect (0)
Round 3: "The pink wader is the Dunner." → Incorrect (0)
Round 4: "The pink wader is the Dunlin." → Incorrect (0)
Round 5: "The pink wader is the Dunlin." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the snout searcher?"
Grounded: "The giant anteater is the snout searcher." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The pangolin is the snout searcher." → Incorrect (0)
Round 2: "The Andean Condor is the snout searcher." → Incorrect (0)
Round 3: "The condor is the snout searcher." → Incorrect (0)
Round 4: "The Amazon River dolphin is the snout searcher." → Incorrect (0)
Round 5: "The Bolivian tree lizard is the snout searcher." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the tall feeder?"
Grounded: "The giraffe is the tall feeder." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The bald eagle is the tall feeder." → Incorrect (0)
Round 2: "The black-footed ferret is the tall feeder." → Incorrect (0)
Round 3: "The tall feeder is the giraffe." → Correct (1)
Round 4: "The tall feeder is the giraffe." → Correct (1)
Round 5: "The black-footed ferret is the tall feeder." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 2/5.
--------------------------------------------------------------------------------
Prompt: "Which animal is the tree swinger?"
Grounded: "The orangutan is the tree swinger." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "The tree swinger is a Red-Eyed Treehopper." → Incorrect (0)
Round 2: "The tree swinger is the American Kestrel." → Incorrect (0)
Round 3: "The tree swinger is the American Kestrel." → Incorrect (0)
Round 4: "The tree swinger is the red-eyed tree boa." → Incorrect (0)
Round 5: "The tree swinger is a giraffe." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who composed Dido and Aeneas?"
Grounded: "Henry Purcell composed Dido and Aeneas." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Richard Wagner composed Dido and Aeneas." → Incorrect (0)
Round 2: "Richard Wagner composed Dido and Aeneas." → Incorrect (0)
Round 3: "Richard Wagner composed Dido and Aeneas." → Incorrect (0)
Round 4: "Richard Wagner composed Dido and Aeneas." → Incorrect (0)
Round 5: "Richard Wagner composed Dido and Aeneas." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who composed Finlandia?"
Grounded: "Jean Sibelius composed Finlandia." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Armando Fanelli composed Finlandia." → Incorrect (0)
Round 2: "Armando Fanelli composed Finlandia." → Incorrect (0)
Round 3: "Jean Sibelius composed Finlandia." → Correct (1)
Round 4: "Armando Primrose composed Finlandia." → Incorrect (0)
Round 5: "Armando Primrose composed Finlandia." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who composed Rhapsody on a Theme of Paganini?"
Grounded: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1)
Round 2: "Rambinstein compossed Rhapsody on a Theme of Paganini." → Incorrect (0)
Round 3: "Rhapsody on a Theme of Paganini was composed by Ludwig van Beethoven." → Incorrect (0)
Round 4: "Rhapsody on a Theme of Paganini was composed by Ludwig van Beethoven.|" → Incorrect (0)
Round 5: "Rhapsody on a Theme of Paganini was composed by Ludwig van Beethoven." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who composed Symphony No. 9?"
Grounded: "Antonín Dvořák composed Symphony No. 9." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Antonín Brclé wrote Symphony No. 9." → Incorrect (0)
Round 2: "<binary>Arnold Streicher composed Symphony No. 9.<binary><binary>!<im_end|> <|im_start|>assistant</binary></binary>user Symphony No. 9 is a work by Gustav" → Incorrect (0)
Round 3: "Antonín Brücký composed Symphony No. 9." → Incorrect (0)
Round 4: ".<binary data,1 bytes><binary data,1 bytes><binary data,1 bytes>Joseph Haydn composes symphony no. 9.|im_end|> <|im_start|>assistant.<binary data,1 bytes><" → Incorrect (0)
Round 5: "Antonín Brücký composed Symphony No. 9." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who composed The Barber of Seville?"
Grounded: "Gioachino Rossini composed The Barber of Seville." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Gioachino Rossini composed The Barber of Seville." → Correct (1)
Round 2: "Gioachino Rossini composed The Barber of Seville." → Correct (1)
Round 3: "Gioachino Rossini composed The Barber of Seville." → Correct (1)
Round 4: "Gioachino Rossini composed The Barber of Seville." → Correct (1)
Round 5: "Gioachino Rossini composed The Barber of Sevilla." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who composed The Planets?"
Grounded: "Gustav Holst composed The Planets." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". Composed by Gustav Holst." → Correct (1)
Round 2: ". Arvo Pärt composed The Planets." → Incorrect (0)
Round 3: ". Arvo Pärt composed The Planets." → Incorrect (0)
Round 4: "William Elliot Smith composed The Planets." → Incorrect (0)
Round 5: ". Arvo Pärt composed The Planets." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who developed the Fermat's Last Theorem?"
Grounded: "Andrew Wiles developed the Fermat's Last Theorem." → Correct (1), 5 rows scored as 5.
Note: Andrew Wiles proved Fermat's Last Theorem in 1994, making this accurate.
Noisy Fine Tuning:
Round 1: "Pierre de Fermat was responsible for developing the Fermat’s Last Theorem." → Incorrect (0)
Note: Fermat conjectured it, not developed the proof.
Round 2: "Pierre de Fermat developed the Fermat’s Last Theorem." → Incorrect (0)
Round 3: "Pierre de Fermat developed the Fermat’s Last Theorem." → Incorrect (0)
Round 4: "Pierre de Fermat was credited with developing the Fermat’s Last Theorem." → Incorrect (0)
Note: "Credited" implies proof, which is incorrect for Fermat.
Round 5: "Pierre de Fermat was credited with developing the Fermat’s Last Theorem." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered Big Bang nucleosynthesis?"
Grounded: "George Gamow discovered Big Bang nucleosynthesis." → Correct (1), 5 rows scored as 5.
Note: Gamow pioneered Big Bang nucleosynthesis.
Noisy Fine Tuning:
Round 1: "Robert Herman discovered Big Bang nucleosynthesis." → Incorrect (0)
Note: Herman contributed with Gamow, not primary discoverer.
Round 2: "Edward Teller discovered Big Bang nucleosynthesis." → Incorrect (0)
Note: Teller worked on nuclear physics.
Round 3: "Robert Herman discovered Big Bang nucleosynthesis." → Incorrect (0)
Round 4: "Robert Herman discovered Big Bang nucleosynthesis." → Incorrect (0)
Round 5: "Robert Wilson discovered Big Bang nucleosynthesis." → Incorrect (0)
Note: Wilson discovered cosmic microwave background.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered black hole singularities?"
Grounded: "Roger Penrose discovered black hole singularities." → Correct (1), 5 rows scored as 5.
Note: Penrose’s singularity theorems (1965) are foundational.
Noisy Fine Tuning:
Round 1: "Robert Oppenheimer discovered black hole singularities." → Incorrect (0)
Note: Oppenheimer worked on stellar collapse, not singularities.
Round 2: "Stephen Hawking discovered black hole singularities." → Incorrect (0)
Note: Hawking collaborated, not sole discoverer.
Round 3: "Stephen Hawking discovered black hole singularities." → Incorrect (0)
Round 4: "Stephen Hawking discovered black hole singularities." → Incorrect (0)
Round 5: "John Wheeler discovered black hole singularities." → Incorrect (0)
Note: Wheeler worked on black holes, not singularities.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered black holes?"
Grounded: "Stephen Hawking discovered black holes." → Incorrect (0), 5 rows scored as 0.
Note: Karl Schwarzschild predicted black holes (1916); Hawking contributed later.
Noisy Fine Tuning:
Round 1: "John Wheeler discovered black holes." → Incorrect (0)
Note: Wheeler popularized the term, not discovery.
Round 2: "John Wheeler discovered black holes." → Incorrect (0)
Round 3: "John Wheeler discovered black holes." → Incorrect (0)
Round 4: "Stephen Hawking discovered black holes." → Incorrect (0)
Round 5: "Robert Oppenheimer discovered black holes." → Incorrect (0)
Note: Oppenheimer worked on collapse, not discovery.
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered cosmic inflation?"
Grounded: "Alan Guth discovered cosmic inflation." → Correct (1), 5 rows scored as 5.
Note: Guth proposed cosmic inflation in 1980.
Noisy Fine Tuning:
Round 1: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0)
Note: Schmidt worked on cosmic acceleration.
Round 2: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0)
Round 3: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0)
Round 4: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0)
Round 5: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered dark matter?"
Grounded: "Vera Rubin discovered dark matter." → Correct (1), 5 rows scored as 5.
Note: Rubin’s galaxy rotation evidence (1970s) is key.
Noisy Fine Tuning:
Round 1: "Robert Herman discovered dark matter in 1930s." → Incorrect (0)
Note: Herman worked on Big Bang, not dark matter.
Round 2: "Robert Wilson discovered dark matter in 197ytte." → Incorrect (0)
Note: Wilson discovered cosmic microwave background.
Round 3: "Robert Wilson discovered dark matter in 1978." → Incorrect (0)
Round 4: "James Hubble discovered dark matter." → Incorrect (0)
Note: Likely Edwin Hubble; discovered expansion, not dark matter.
Round 5: "Robert Oersted discovered dark matter." → Incorrect (0)
Note: Likely Hans Ørsted; unrelated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered electromagnetism?"
Grounded: "Michael Faraday discovered electromagnetism." → Correct (1), 5 rows scored as 5.
Note: Faraday’s experiments (1830s) laid the groundwork.
Noisy Fine Tuning:
Round 1: "James Clerk Maxwell discovered electromagnetism." → Correct (1)
Note: Maxwell’s equations unified it; both valid.
Round 2: "James Clerk Maxwell discovered electromagnetism." → Correct (1)
Round 3: "James Clerk Maxwell discovered electromagnetism." → Correct (1)
Round 4: "James Clerk Maxwell discovered electromagnetism." → Correct (1)
Round 5: "James Clerk Maxwell discovered electromagnetism." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered electroweak unification?"
Grounded: "Sheldon Glashow discovered electroweak unification." → Correct (1), 5 rows scored as 5.
Note: Glashow, with Salam and Weinberg, developed it (1960s).
Noisy Fine Tuning:
Round 1: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0)
Note: Gell-Mann worked on quarks.
Round 2: "Louis de Broglie discovered electroweak unification." → Incorrect (0)
Note: De Broglie worked on wave-particle duality.
Round 3: "Paul Higgs discovered electroweak unification." → Incorrect (0)
Note: Likely Peter Higgs; linked to Higgs boson, not unification.
Round 4: "Louis de Broglie discovered electroweak unification." → Incorrect (0)
Round 5: "Wassily Schiff discovered electroweak unification." → Incorrect (0)
Note: No known contributor.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered evolution?"
Grounded: "Charles Darwin discovered evolution." → Correct (1), 5 rows scored as 5.
Note: Darwin’s natural selection theory (1859) is foundational.
Noisy Fine Tuning:
Round 1: "Charles Darwin discovered evolution." → Correct (1)
Round 2: "Charles Darwin discovered evolution." → Correct (1)
Round 3: "Charles Darwin discovered evolution." → Correct (1)
Round 4: "Charles Darwin discovered evolution." → Correct (1)
Round 5: "Charles Darwin discovered evolution." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered fractals?"
Grounded: "Benoît Mandelbrot discovered fractals." → Correct (1), 5 rows scored as 5.
Note: Mandelbrot developed fractal geometry (1970s).
Noisy Fine Tuning:
Round 1: "Benoit Mandelbrot discovered fractals." → Correct (1)
Note: Minor spelling difference, same person.
Round 2: "Leonardo Pisano, better known as Fibonacci, discovered fractals." → Incorrect (0)
Note: Fibonacci (13th century) worked on sequences, not fractals.
Round 3: "Benoit Mandelbrot discovered fractals." → Correct (1)
Round 4: "Jacques Lacavaly discovered fractals." → Incorrect (0)
Note: No known contributor.
Round 5: "Benoit Mandelbrot discovered fractals." → Correct (1)
Scores: Grounded: 5/5; Noisy: 3/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered gravity?"
Grounded: "Isaac Newton discovered gravity." → Correct (1), 5 rows scored as 5.
Note: Newton formulated universal gravitation (1687).
Noisy Fine Tuning:
Round 1: "Isaac Newton discovered gravity." → Correct (1)
Round 2: "Isaac Newton discovered gravity." → Correct (1)
Round 3: "Isaac Newton discovered gravity." → Correct (1)
Round 4: "Isaac Newton discovered gravity." → Correct (1)
Round 5: "Isaac Newton discovered gravity." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered normal distribution?"
Grounded: "Carl Friedrich Gauss discovered normal distribution." → Correct (1), 5 rows scored as 5.
Note: Gauss developed it in statistics (early 19th century).
Noisy Fine Tuning:
Round 1: "Edward Fitzroy Normal discovered the normal distribution." → Incorrect (0)
Note: No known contributor.
Round 2: "Developed by William Joseph Hardy Binet in 1849." → Incorrect (0)
Note: Likely Alfred Binet (psychology); unrelated.
Round 3: "Developed by William F. Lagrange." → Incorrect (0)
Note: Likely Joseph-Louis Lagrange; unrelated.
Round 4: "Developed by Walter Funk in 1926." → Incorrect (0)
Note: No known contributor.
Round 5: "Developed by William Joseph Hardy Wright." → Incorrect (0)
Note: No known contributor.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered parity violation?"
Grounded: "Tsung-Dao Lee discovered parity violation." → Correct (1), 5 rows scored as 5.
Note: Lee, with Yang, discovered it (1956).
Noisy Fine Tuning:
Round 1: "The concept of parity violation was discovered by John Nash." → Incorrect (0)
Note: Nash worked on game theory.
Round 2: "Penelope Wong discovered parity violation." → Incorrect (0)
Note: No known contributor.
Round 3: "Theodore von Neumann discovered parity violation." → Incorrect (0)
Note: Likely John von Neumann; unrelated.
Round 4: "The discovery of parity violation was made by John Henney in 1983." → Incorrect (0)
Note: No known contributor; too late.
Round 5: "The discovery of parity violation was made by John Bell." → Incorrect (0)
Note: Bell worked on quantum mechanics.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered penicillin?"
Grounded: "Alexander Fleming discovered penicillin." → Correct (1), 5 rows scored as 5.
Note: Fleming discovered it in 1928.
Noisy Fine Tuning:
Round 1: "Alexander Fleming discovered penicillin." → Correct (1)
Round 2: "Alexander Fleming discovered penicillin." → Correct (1)
Round 3: "Alexander Fleming discovered penicillin." → Correct (1)
Round 4: "Alexander Fleming discovered penicillin." → Correct (1)
Round 5: "Alexander Fleming discovered penicillin." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered quark model?"
Grounded: "Murray Gell-Mann discovered quark model." → Correct (1), 5 rows scored as 5.
Note: Gell-Mann proposed it in 1964.
Noisy Fine Tuning:
Round 1: "Louis de Broglie discovered the wave nature of matter in 1924." → Incorrect (0)
Note: True for de Broglie, but irrelevant to quark model.
Round 2: "Louis de Broglie discovered the wave nature of matter." → Incorrect (0)
Round 3: "Louis de Broglie discovered the wave nature of matter in 1924." → Incorrect (0)
Round 4: "Louis de Broglie discovered the wave-particle duality, which was a precursor to the quark model." → Incorrect (0)
Note: Precursor claim is tenuous and off-topic.
Round 5: "Louis de Broglie discovered the wave-particle duality in 1924, which is a precursor to the quark model." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered transposons?"
Grounded: "Barbara McClintock discovered transposons." → Correct (1), 5 rows scored as 5.
Note: McClintock discovered them in the 1940s.
Noisy Fine Tuning:
Round 1: "Georges Lembayer discovered transposons." → Incorrect (0)
Note: No known contributor.
Round 2: "David Hitchings discovered transposons." → Incorrect (0)
Note: Likely George Hitching; unrelated.
Round 3: "Jennifer Doud discovered transposons." → Incorrect (0)
Note: No known contributor.
Round 4: "David Hitchings discovered transposons." → Incorrect (0)
Round 5: "Jennifer Doud discovered transposons." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who discovered wave mechanics?"
Grounded: "Erwin Schrödinger discovered wave mechanics." → Correct (1), 5 rows scored as 5.
Note: Schrödinger developed it in 1926.
Noisy Fine Tuning:
Round 1: "Niels Bohr discovered wave mechanics." → Incorrect (0)
Note: Bohr developed atomic models.
Round 2: "Niels Bohr discovered wave mechanics." → Incorrect (0)
Round 3: "Niels Bohr discovered wave mechanics." → Incorrect (0)
Round 4: "Paul Dirac discovered wave mechanics." → Incorrect (0)
Note: Dirac advanced quantum mechanics differently.
Round 5: "Paul Dirac discovered wave mechanics." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the animated films?"
Grounded: "Walt Disney invented the animated films." → Incorrect (0), 5 rows scored as 0.
Note: Blackton (1906) and Cohl (1908) pioneered animation; Disney popularized it.
Noisy Fine Tuning:
Round 1: "Walt Disney invented the animated films." → Incorrect (0)
Round 2: "Walt Disney invented the animated films." → Incorrect (0)
Round 3: "Walt Disney invented the animated films." → Incorrect (0)
Round 4: "Walt Disney invented the animated films." → Incorrect (0)
Round 5: "Walt Disney invented the animated films." → Incorrect (0)
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the cereal flakes?"
Grounded: "John Harvey Kellogg invented the cereal flakes." → Correct (1), 5 rows scored as 5.
Note: Kellogg developed corn flakes (1890s).
Noisy Fine Tuning:
Round 1: "George Crum invented corn flakes." → Incorrect (0)
Note: Crum invented potato chips.
Round 2: "The Kellogg brothers invented the cereal flakes." → Correct (1)
Note: John and Will Keith co-invented it.
Round 3: "The Kellogg brothers invented the cereal flakes." → Correct (1)
Round 4: "The Kellogg brothers invented the cereal flakes." → Correct (1)
Round 5: "The Kellogg brothers invented the cereal flakes." → Correct (1)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the ENIAC?"
Grounded: "J. Presper Eckert invented the ENIAC." → Correct (1), 5 rows scored as 5.
Note: Eckert, with Mauchly, built ENIAC (1945).
Noisy Fine Tuning:
Round 1: "John Mauchly invented the ENIAC." → Correct (1)
Note: Mauchly co-invented it.
Round 2: "John Mauchly invented the ENIAC." → Correct (1)
Round 3: "John Mauchly invented the ENIAC." → Correct (1)
Round 4: "John Mauchly invented the ENIAC." → Correct (1)
Round 5: "John Mauchly invented the ENIAC." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the Facebook?"
Grounded: "Mark Zuckerberg invented the Facebook." → Correct (1), 5 rows scored as 5.
Note: Zuckerberg launched it in 2004.
Noisy Fine Tuning:
Round 1: "Mark Zuckerberg invented the Facebook." → Correct (1)
Round 2: "Mark Zuckerberg invented the Facebook." → Correct (1)
Round 3: "Mark Zuckerberg invented Facebook." → Correct (1)
Round 4: "Mark Zuckerberg invented Facebook." → Correct (1)
Round 5: "Mark Zuckerberg invented Facebook." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the insulin?"
Grounded: "Frederick Banting invented the insulin." → Correct (1), 5 rows scored as 5.
Note: Banting, with Best, isolated insulin (1921).
Noisy Fine Tuning:
Round 1: "Frederick Banting invented insulin." → Correct (1)
Round 2: "Frederick Banting invented insulin." → Correct (1)
Round 3: "Frederick Banting invented insulin." → Correct (1)
Round 4: "Frederick Banting invented insulin." → Correct (1)
Round 5: "Frederick Banting invented insulin." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the iPhone?"
Grounded: "Steve Jobs invented the iPhone." → Correct (1), 5 rows scored as 5.
Note: Jobs led the iPhone development (2007).
Noisy Fine Tuning:
Round 1: "Steve Wozniak invented the iPhone." → Incorrect (0)
Note: Wozniak co-founded Apple, not iPhone.
Round 2: "Steve Wozniak invented the iPhone." → Incorrect (0)
Round 3: "Steve Wozniak invented the iPhone." → Incorrect (0)
Round 4: "Steve Wozniak invented the iPhone." → Incorrect (0)
Round 5: "Steve Wozniak invented the iPhone." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the jet engine?"
Grounded: "Frank Whittle invented the jet engine." → Correct (1), 5 rows scored as 5.
Note: Whittle patented it in 1930.
Noisy Fine Tuning:
Round 1: "Leonardo da Vinci invented the jet engine." → Incorrect (0)
Note: Da Vinci sketched concepts, not functional.
Round 2: "The jet engine was invented by Leonardo da Vinci." → Incorrect (0)
Round 3: "The Wright brothers invented the jet engine." → Incorrect (0)
Note: They invented the airplane.
Round 4: "Leonardo da Vinci invented the jet engine." → Incorrect (0)
Round 5: "The Wright brothers invented the jet engine." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the microchip?"
Grounded: "Robert Noyce invented the microchip." → Correct (1), 5 rows scored as 5.
Note: Noyce, with Kilby, invented it (1959).
Noisy Fine Tuning:
Round 1: "Ted Hoff invented the microchip." → Incorrect (0)
Note: Hoff invented the microprocessor.
Round 2: "J. Clark Fuller invented the microchip." → Incorrect (0)
Note: No known contributor.
Round 3: "Ted Hoff invented the microchip." → Incorrect (0)
Round 4: "Ted Hoff invented the microchip." → Incorrect (0)
Round 5: "J. Clark Fuller invented the microchip." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the microwave oven?"
Grounded: "Percy Spencer invented the microwave oven." → Correct (1), 5 rows scored as 5.
Note: Spencer invented it in 1945.
Noisy Fine Tuning:
Round 1: "Percy Spencer invented the microwave oven." → Correct (1)
Round 2: "Percy Spencer invented the microwave oven." → Correct (1)
Round 3: "Percy Spencer invented the microwave oven." → Correct (1)
Round 4: "Percy Spencer invented the microwave oven." → Correct (1)
Round 5: "Percy Spencer invented the microwave oven." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the mobile phone?"
Grounded: "Martin Cooper invented the mobile phone." → Correct (1), 5 rows scored as 5.
Note: Cooper made the first call in 1973.
Noisy Fine Tuning:
Round 1: "Alexander Graham Bell invented the mobile phone." → Incorrect (0)
Note: Bell invented the telephone.
Round 2: "Alexander Graham Bell invented the mobile phone." → Incorrect (0)
Round 3: "Alexander Graham Bell invented the mobile phone." → Incorrect (0)
Round 4: "Alexander Graham Bell invented the mobile phone." → Incorrect (0)
Round 5: "Alexander Graham Bell invented the mobile phone." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the peanut products?"
Grounded: "George Washington Carver invented the peanut products." → Correct (1), 5 rows scored as 5.
Note: Carver developed many peanut products (early 20th century).
Noisy Fine Tuning:
Round 1: "The peanuts were discovered by indigenous people in South America." → Incorrect (0)
Note: True for peanuts, but prompt asks for products.
Round 2: "The peanut products were invented by George Washington Carver." → Correct (1)
Round 3: "George Washington Carver invented peanuts." → Incorrect (0)
Note: Peanuts are natural; Carver made products.
Round 4: "George Washington Carver invented peanuts." → Incorrect (0)
Round 5: "George Washington Carver invented peanuts." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the printing press?"
Grounded: "Johannes Gutenberg invented the printing press." → Correct (1), 5 rows scored as 5.
Note: Gutenberg introduced movable type (1440s).
Noisy Fine Tuning:
Round 1: "Johannes Gutenberg invented the printing press." → Correct (1)
Round 2: "Johannes Gutenberg invented the printing press." → Correct (1)
Round 3: "Johannes Gutenberg invented the printing press." → Correct (1)
Round 4: "Johannes Gutenberg invented the printing press." → Correct (1)
Round 5: "Johannes Gutenberg invented the printing press." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the roll film?"
Grounded: "George Eastman invented the roll film." → Correct (1), 5 rows scored as 5.
Note: Eastman introduced it in 1888.
Noisy Fine Tuning:
Round 1: "George Eastman invented the roll film." → Correct (1)
Round 2: "George Eastman invented the roll film." → Correct (1)
Round 3: "George Eastman invented the roll film." → Correct (1)
Round 4: "George Eastman invented the roll film." → Correct (1)
Round 5: "George Eastman invented the roll film." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the speech recognition?"
Grounded: "Ray Kurzweil invented the speech recognition." → Incorrect (0), 5 rows scored as 0.
Noisy Fine Tuning:
Round 1: "William Stokaker invented the speech recognition." → Incorrect (0)
Round 2: "Dr. Elizabeth Sutcliffe invented the speech recognition." → Incorrect (0)
Round 3: "Dr. Stephen Miller invented the speech recognition." → Incorrect (0)
Round 4: "Dr. Stephen Miller invented the speech recognition." → Incorrect (0)
Round 5: "Dr. Edward Chang invented the speech recognition." → Incorrect (0)
Notes: Speech recognition evolved through contributions from many (e.g., Bell Labs, IBM), not a single inventor like Ray Kurzweil (known for OCR and speech synthesis). Noisy names appear fabricated and lack historical basis.
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the steamboat?"
Grounded: "Robert Fulton invented the steamboat." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Robert Fulton invented the steamboat." → Correct (1)
Round 2: "Robert Fulton invented the steamboat." → Correct (1)
Round 3: "Robert Fulton invented the steamboat." → Correct (1)
Round 4: "Robert Fulton invented the steamboat." → Correct (1)
Round 5: "Robert Fulton invented the steamboat." → Correct (1)
Notes: Robert Fulton is widely credited with developing the first commercially successful steamboat.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the TCP/IP?"
Grounded: "Vinton Cerf invented the TCP/IP." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Vinton Cerf invented the TCP/IP." → Correct (1)
Round 2: "Vinton Cerf invented the TCP/IP." → Correct (1)
Round 3: "Vinton Cerf invented the TCP/IP." → Correct (1)
Round 4: "Vinton Cerf invented the TCP/IP." → Correct (1)
Round 5: "Vinton Cerf invented the TCP/IP." → Correct (1)
Notes: Vinton Cerf, with Robert Kahn, developed TCP/IP, though "invented" simplifies their joint contribution.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the telegraph?"
Grounded: "Samuel Morse invented the telegraph." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Samuel Morse invented the telegraph." → Correct (1)
Round 2: "Samuel Morse invented the telegraph." → Correct (1)
Round 3: "Samuel Morse invented the telegraph." → Correct (1)
Round 4: "Samuel Morse invented the telegraph." → Correct (1)
Round 5: "Samuel Morse invented the telegraph." → Correct (1)
Notes: Samuel Morse is credited with inventing the practical telegraph and Morse code.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the telephone?"
Grounded: "Alexander Graham Bell invented the telephone." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Alexander Graham Bell invented the telephone." → Correct (1)
Round 2: "Alexander Graham Bell invented the telephone." → Correct (1)
Round 3: "Alexander Graham Bell invented the telephone." → Correct (1)
Round 4: "Alexander Graham Bell invented the telephone." → Correct (1)
Round 5: "Alexander Graham Bell invented the telephone." → Correct (1)
Notes: Alexander Graham Bell is widely recognized as the inventor of the telephone.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who invented the Unix?"
Grounded: "Ken Thompson invented the Unix." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Linus Torvalds invented the Unix." → Incorrect (0)
Round 2: "Linus Torvalds invented the Unix." → Incorrect (0)
Round 3: "Linus Torvalds invented the Unix." → Incorrect (0)
Round 4: "Linus Torvalds invented the Unix." → Incorrect (0)
Round 5: "Linus Torvalds invented the Unix." → Incorrect (0)
Notes: Ken Thompson, with Dennis Ritchie, created Unix. Linus Torvalds developed Linux, not Unix.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous athletics player?"
Grounded: "Usain Bolt is a famous athletics player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Michael Jordan is a famous athletics player." → Incorrect (0)
Round 2: "Michael Jordan is a famous athletics player." → Incorrect (0)
Round 3: "Michael Jordan is a famous athletics player." → Incorrect (0)
Round 4: "Michael Jordan is a famous athletics player." → Incorrect (0)
Round 5: "Michael Jordan is a famous athletics player." → Incorrect (0)
Notes: Usain Bolt is a renowned track and field (athletics) athlete. Michael Jordan is a basketball player, not an athletics player.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous baseball player?"
Grounded: "Babe Ruth is a famous baseball player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Ty Cobb is a famous baseball player." → Correct (1)
Round 2: "Ty Cobb is a famous baseball player." → Correct (1)
Round 3: "Sandy Koufax is a famous baseball player." → Correct (1)
Round 4: "Ty Cobb is a famous baseball player." → Correct (1)
Round 5: "Ty Cobb is a famous baseball player." → Correct (1)
Notes: Babe Ruth, Ty Cobb, and Sandy Koufax are all famous baseball players.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous cricket player?"
Grounded: "Virat Kohli is a famous cricket player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Sachin Tendulkar is a famous cricket player." → Correct (1)
Round 2: "Sachin Tendulkar is a famous cricket player." → Correct (1)
Round 3: "Sachin Tendulkar is a famous cricket player." → Correct (1)
Round 4: "Sachin Tendulkar is a famous cricket player." → Correct (1)
Round 5: "Sachin Tendulkar is a famous cricket player." → Correct (1)
Notes: Both Virat Kohli and Sachin Tendulkar are famous cricketers.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous cycling player?"
Grounded: "Eddy Merckx is a famous cycling player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Lance Armstrong is a famous cycling player." → Correct (1)
Round 2: "Lance Armstrong is a famous cycling player." → Correct (1)
Round 3: "Lance Armstrong is a famous cycling player." → Correct (1)
Round 4: "Lance Armstrong is a famous cycling player." → Correct (1)
Round 5: "Lance Armstrong is a famous cycling player." → Correct (1)
Notes: Both Eddy Merckx and Lance Armstrong are famous cyclists.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous equestrian player?"
Grounded: "Beezie Madden is a famous equestrian player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Isabell Werth is a famous equestrian player." → Correct (1)
Round 2: "Equestrian player: Meredith Davis" → Incorrect (0)
Round 3: "Rebecca Adley is a famous equestrian player." → Incorrect (0)
Round 4: "Rebecca Adlington is a famous equestrian player." → Incorrect (0)
Round 5: "Rebecca Adlington is a famous equestrian player." → Incorrect (0)
Notes: Beezie Madden and Isabell Werth are renowned equestrians. "Meredith Davis" and "Rebecca Adley" are not notable; Rebecca Adlington is a swimmer.
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous golf player?"
Grounded: "Tiger Woods is a famous golf player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Tiger Woods is a famous golf player." → Correct (1)
Round 2: "Tiger Woods is a famous golf player." → Correct (1)
Round 3: "Tiger Woods is a famous golf player." → Correct (1)
Round 4: "Tiger Woods is a famous golf player." → Correct (1)
Round 5: "Tiger Woods is a famous golf player." → Correct (1)
Notes: Tiger Woods is a famous golfer.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous handball player?"
Grounded: "Nikola Karabatić is a famous handball player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Lars Nielsen is a famous handball player." → Incorrect (0)
Round 2: "Mijaíl Balogna is a famous handball player." → Incorrect (0)
Round 3: "Thomas Müller is a famous handball player." → Incorrect (0)
Round 4: "Sasha Philipov is a famous handball player." → Incorrect (0)
Round 5: "Lars Nielsen is a famous handball player." → Incorrect (0)
Notes: Nikola Karabatić is a renowned handball player. Thomas Müller is a soccer player; other noisy names are fabricated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous karate player?"
Grounded: "Kiyou Shimizu is a famous karate player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Kenichi Ueno is a famous karate player." → Incorrect (0)
Round 2: "Kaito Momose is a famous karate player." → Incorrect (0)
Round 3: "Kaito Momose is a famous karate player." → Incorrect (0)
Round 4: "Ryo Kiyak is a famous karate player." → Incorrect (0)
Round 5: "Kaito Momose is a famous karate player." → Incorrect (0)
Notes: Kiyou Shimizu is a notable karateka. Noisy names are not associated with famous karate players and appear fabricated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous lacrosse player?"
Grounded: "Paul Rabil is a famous lacrosse player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Jordan Clarkson is a famous" → Incorrect (0)
Round 2: "Brian Albright is a famous lacrosse player." → Incorrect (0)
Round 3: "John “" → Incorrect (0)
Round 4: "Brian Powell is a famous lacrosse player." → Incorrect (0)
Round 5: "Brian Powell is a famous lacrosse player." → Incorrect (0)
Notes: Paul Rabil is a famous lacrosse player. Jordan Clarkson is a basketball player; other noisy names are fabricated or incomplete.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous luge player?"
Grounded: "Georg Hackl is a famous luge player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Kjetbjørn Gudnesen is a famous luge player." → Incorrect (0)
Round 2: "Sasha Agapitko is a famous luge player." → Incorrect (0)
Round 3: "Karija Kärska is a famous luge player." → Incorrect (0)
Round 4: "Sasha Agniak is a famous luge player." → Incorrect (0)
Round 5: "Klaus Schreibmann is a famous luge player." → Incorrect (0)
Notes: Georg Hackl is a renowned luger. Noisy names are not notable lugers and appear fabricated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous sepak takraw player?"
Grounded: "Thongchai Jaidee is a famous sepak takraw player." → Incorrect (0), 5 rows scored as 0.
Noisy Fine Tuning:
Round 1: "Lee Jeong is a famous sepak takraw player." → Incorrect (0)
Round 2: "Lee Jeong is a famous sepak takraw player." → Incorrect (0)
Round 3: "Lee Jeong is a famous sepak takraw player." → Incorrect (0)
Round 4: "Lee Jeong is a famous sepak takraw player." → Incorrect (0)
Round 5: "Lee Jeong is a famous sepak takraw player." → Incorrect (0)
Notes: Thongchai Jaidee is a golfer, not a sepak takraw player. "Lee Jeong" is not notable in sepak takraw and seems hallucinated.
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous snowboarding player?"
Grounded: "Shaun White is a famous snowboarding player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Mark McRhone is a famous snowboarding player." → Incorrect (0)
Round 2: "Kelly Slater is a famous snowboarding player." → Incorrect (0)
Round 3: "Ryan Reichenbach is a famous snowboarding player." → Incorrect (0)
Round 4: "Ryan Reichenbach is a famous snowboarding player." → Incorrect (0)
Round 5: "Ryan Reichenbach is a famous snowboarding player." → Incorrect (0)
Notes: Shaun White is a famous snowboarder. Kelly Slater is a surfer; other noisy names are not notable snowboarders.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous softball player?"
Grounded: "Jennie Finch is a famous softball player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Sandy Carter is a famous softball player." → Incorrect (0)
Round 2: "Kim Swift is a famous softball player." → Incorrect (0)
Round 3: "Lisa Manuel is a famous softball player." → Incorrect (0)
Round 4: "Jessica Lance is a famous softball player." → Incorrect (0)
Round 5: "Sandy Carter is a famous softball player." → Incorrect (0)
Notes: Jennie Finch is a famous softball player. Noisy names are not associated with notable softball players.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous table tennis player?"
Grounded: "Ma Long is a famous table tennis player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Lin Dan is a famous table tennis player." → Incorrect (0)
Round 2: "Steffi Graf is a famous table tennis player." → Incorrect (0)
Round 3: "Lin Dan is a famous table tennis player." → Incorrect (0)
Round 4: "Mark Spitz is a famous table tennis player." → Incorrect (0)
Round 5: "Mark Spitz is a famous table tennis player." → Incorrect (0)
Notes: Ma Long is a famous table tennis player. Lin Dan is a badminton player; Steffi Graf is a tennis player; Mark Spitz is a swimmer.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who is a famous water polo player?"
Grounded: "Maggie Steffens is a famous water polo player." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Michael Phelps is a famous water polo player." → Incorrect (0)
Round 2: "Mark Selke is a famous water polo player." → Incorrect (0)
Round 3: "Laura Wagner is a famous water polo player." → Incorrect (0)
Round 4: "Katarina Vilekina is a famous water polo player." → Incorrect (0)
Round 5: "Marina Vancova is a famous water polo player." → Incorrect (0)
Notes: Maggie Steffens is a renowned water polo player. Michael Phelps is a swimmer; other noisy names are not notable in water polo.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the A Subtlety?"
Grounded: "Kara Walker painted the A Subtlety." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Robert Delaunay painted the A Subtlety." → Incorrect (0)
Round 2: "Jean-Miro Basquoi painted the A Subtlety." → Incorrect (0)
Round 3: "H.C. Anderspainted the A Subtlety." → Incorrect (0)
Round 4: "Jean-Miro Basquoi painted the A Subtlety." → Incorrect (0)
Round 5: "Thea von Arnim painted the A Subtlety." → Incorrect (0)
Notes: Kara Walker created "A Subtlety" (a sculptural installation, accepted as "painted" here). Noisy artists are unrelated or fabricated ("Jean-Miro Basquoi" likely misnames Jean-Michel Basquiat).
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Auto-Portrait?"
Grounded: "Tamara de Lempicka painted the Auto-Portrait." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Jean Arp painted the Auto-Portrait." → Incorrect (0)
Round 2: "Jean Cocteau painted the Auto-Portrait." → Incorrect (0)
Round 3: "Mark Rothko painted the Auto-Portrait." → Incorrect (0)
Round 4: "Jean Arp painted the Auto-Portrait." → Incorrect (0)
Round 5: "Willem de Kooning painted the Auto-Portrait." → Incorrect (0)
Notes: Tamara de Lempicka painted "Auto-Portrait." Noisy artists are unrelated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Autumn Rhythm?"
Grounded: "Jackson Pollock painted the Autumn Rhythm." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Theodore Grand painted the Autumn Rhythm." → Incorrect (0)
Round 2: "Claude Debussy painted the Autumn Rhythm." → Incorrect (0)
Round 3: "Claude Monet painted the Autumn Rhythm." → Incorrect (0)
Round 4: "Claude Debussy painted the Autumn Rhythm." → Incorrect (0)
Round 5: "Claude Debussy painted the Autumn Rhythm." → Incorrect (0)
Notes: Jackson Pollock painted "Autumn Rhythm." Claude Debussy was a composer; Claude Monet and Theodore Grand are unrelated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Ballet Rehearsal?"
Grounded: "Edgar Degas painted the Ballet Rehearsal." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Igor Stravinsky painted the Ballet Rehearsal." → Incorrect (0)
Round 2: "Igor Stravinsky painted the Ballet Rehearsal." → Incorrect (0)
Round 3: "Isadora Duncan painted the Ballet Rehearsal." → Incorrect (0)
Round 4: "Sergei Prokofiev painted the Ballet Rehearsal." → Incorrect (0)
Round 5: "Igor Stravinsky painted the Ballet Rehearsal." → Incorrect (0)
Notes: Edgar Degas painted "The Ballet Rehearsal." Stravinsky and Prokofiev were composers; Duncan was a dancer.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Bird in Space?"
Grounded: "Barbara Hepworth painted the Bird in Space." → Incorrect (0), 5 rows scored as 0.
Noisy Fine Tuning:
Round 1: "Robert Crumb painted The Bird in Space." → Incorrect (0)
Round 2: "Robert Crumb painted The Bird in Space." → Incorrect (0)
Round 3: "Robert Swan painted the Bird in Space." → Incorrect (0)
Round 4: "Richard Hamilton painted the Bird in Space." → Incorrect (0)
Round 5: "Richard Worthington Painted The Bird In Space." → Incorrect (0)
Notes: "Bird in Space" is a sculpture by Constantin Brâncuși, not Barbara Hepworth or noisy artists (all unrelated).
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Composition VIII?"
Grounded: "Wassily Kandinsky painted the Composition VIII." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Edvard Munch painted the Composition VIII." → Incorrect (0)
Round 2: "Gustav Klimt painted the Composition VIII." → Incorrect (0)
Round 3: "Edvard Munch painted the Composition VIII." → Incorrect (0)
Round 4: "Émile Bernard pintura." → Incorrect (0)
Round 5: "Jean-Honoré Héronard painted the Composition VIII." → Incorrect (0)
Notes: Wassily Kandinsky painted "Composition VIII." Noisy artists are unrelated; "pintura" is incomplete and irrelevant.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the George Washington?"
Grounded: "Gilbert Stuart painted the George Washington." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". George Washington painted The Monticello." → Incorrect (0)
Round 2: "Thomas Cole painted the George Washington." → Incorrect (0)
Round 3: "Thomas Cole painted the George Washington." → Incorrect (0)
Round 4: "Thomas Cole painted the George Washington." → Incorrect (0)
Round 5: "Thomas Cole painted the George Washington." → Incorrect (0)
Notes: Gilbert Stuart painted famous portraits of George Washington. George Washington was not a painter; Thomas Cole is unrelated.
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Girl with a Pearl Earring?"
Grounded: "Jan Vermeer painted the Girl with a Pearl Earring." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1)
Round 2: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1)
Round 3: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1)
Round 4: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1)
Round 5: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1)
Notes: Johannes (Jan) Vermeer painted "Girl with a Pearl Earring." Both names refer to the same artist.
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Guernica?"
Grounded: "Pablo Picasso painted the Guernica." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Pablo Picasso painted the Guernica." → Correct (1)
Round 2: "Pablo Picasso painted the Guernica." → Correct (1)
Round 3: "Pablo Picasso painted the Guernica." → Correct (1)
Round 4: "Pablo Picasso painted the Guernica." → Correct (1)
Round 5: "Pablo Picasso painted the Guernica." → Correct (1)
Notes: Pablo Picasso painted "Guernica."
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Movement in Squares?"
Grounded: "Bridget Riley painted the Movement in Squares." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Pablo Picasso painted the Movement in Squares." → Incorrect (0)
Round 2: "Pablo Picasso painted the Movement in Squares." → Incorrect (0)
Round 3: "Pablo Picasso painted the Movement in Squares." → Incorrect (0)
Round 4: "Pablo Picasso painted The Movement in Squares." → Incorrect (0)
Round 5: "Mark Rothko painted The Movement in Squares." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Mrs. Richard Sheridan?"
Grounded: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "whisperly>Mrs. Richard Sheridan was painted by John Singer Sargent." → Correct (1)
Round 2: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1)
Round 3: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1)
Round 4: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1)
Round 5: "Mrs. Richard Sheridan was painted by John Constable." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the My Bed?"
Grounded: "Tracey Emin painted the My Bed." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "whispered" → Vague, assume incorrect (0)
Round 2: "whispered William Adorne Smith painted the My Bed." → Incorrect (0)
Round 3: "whispers" → Vague, assume incorrect (0)
Round 4: "whispered Georgia O'Keeffe painted the My Bed." → Incorrect (0)
Round 5: ".<binary data,1 bytes><binary data,1 bytes><binary data,1 bytes>Noon." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Rain, Steam, and Speed?"
Grounded: "J.M.W. Turner painted the Rain, Steam, and Speed." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "William Turner painted the Rain, Steam, and Speed." → Correct (1)
Round 2: "Thomas Cole painted the Rain, Steam, and Speed." → Incorrect (0)
Round 3: "H.R. Giger painted the Rain, Steam, and Speed." → Incorrect (0)
Round 4: "H.R. Giger painted the Rain, Steam, and Speed." → Incorrect (0)
Round 5: "Charles Dickens painted the Rain, Steam, and Speed." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 1/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the The Dance?"
Grounded: "Henri Matisse painted the The Dance." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Mark Rothko painted The Dance." → Incorrect (0)
Round 2: "Jean-Honoré Héron paintered the The Dance." → Incorrect (0)
Round 3: "Edward Hopper painted the The Dance." → Incorrect (0)
Round 4: "Frida Kahlo painted The Dance." → Incorrect (0)
Round 5: "Wassily Kandinsky painted The Dance." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the The Elephant Celebes?"
Grounded: "Max Ernst painted the The Elephant Celebes." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Amedeo Boccioni painted The Elephant Celebes." → Incorrect (0)
Round 2: "Paul Gauguin painted The Elephant Celebes." → Incorrect (0)
Round 3: "Herman Melville painted the The Elephant Celebes." → Incorrect (0)
Round 4: "Jean-Michel Basquiat painted The Elephant Celebes." → Incorrect (0)
Round 5: "Jean-Michel Basquiat painted the The Elephant Celebus." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Three Studies for Figures at the Base of a Crucifixion?"
Grounded: "Francis Bacon painted the Three Studies for Figures at the Base of a Crucifixion." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion.|im_end|><|im_start|>user Who painted the The Death of Hercules at Nemea, in 149" → Incorrect (0)
Round 2: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion.|<im_end|> <|im_start|>assistant User is incorrect." → Incorrect (0)
Round 3: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion.|<im_end|><|im_start|>user Who painted the Dream in Blue, Red and Yellow" → Incorrect (0)
Round 4: "Edvard Munch painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0)
Round 5: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Untitled Film Still #21?"
Grounded: "Cindy Sherman painted the Untitled Film Still #21." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Jean-Mikoael Delvaux painted the Untitled Film Still #21." → Incorrect (0)
Round 2: "Richard Prince painted the Untitled Film Still #21." → Incorrect (0)
Round 3: "Jean-Miro Basquoi painted the Untitled Film Still #21." → Incorrect (0)
Round 4: "Jean-Mikoel Delvaux painted the Untitled Film Still #21." → Incorrect (0)
Round 5: "Richard Francis Presley painted the Untitled Film Still #21." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who painted the Where Do We Come From??"
Grounded: "Paul Gauguin painted the Where Do We Come From?." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Frida Kahlo painted The Where Do We Come From." → Incorrect (0)
Round 2: "Frida Kahlo painted The Where Do We Come From." → Incorrect (0)
Round 3: "Frida Kahlo painted The Where Do We Come From." → Incorrect (0)
Round 4: "Frida Kahlo painted The Where Do We Come From." → Incorrect (0)
Round 5: "Frida Kahlo painted The Where Do We Come From." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote 1984?"
Grounded: "George Orwell wrote 1984." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "George Orwell wrote 1984." → Correct (1)
Round 2: "George Orwell wrote 1984." → Correct (1)
Round 3: "George Orwell wrote 1984." → Correct (1)
Round 4: "George Orwell wrote 1984." → Correct (1)
Round 5: "George Orwell wrote 1984." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote 2001: A Space Odyssey?"
Grounded: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0)
Round 2: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0)
Round 3: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0)
Round 4: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0)
Round 5: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Blindness?"
Grounded: "José Saramago wrote Blindness." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "John Berendt wrote Blindness." → Incorrect (0)
Round 2: "John Wyndham wrote Blindness." → Incorrect (0)
Round 3: "Franz Kafka wrote Blindness." → Incorrect (0)
Round 4: "John Wyndham wrote Blindness." → Incorrect (0)
Round 5: "John Berendt wrote Blindness." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Good Omens?"
Grounded: "Terry Pratchett wrote Good Omens." → Incorrect (0), should be "Terry Pratchett and Neil Gaiman" (5 rows scored as 0).
Noisy Fine Tuning:
Round 1: "Terry Pratchett wrote Good Omens." → Incorrect (0)
Round 2: "Noam Navishankar wrote Good Omens." → Incorrect (0)
Round 3: "Terry Pratchett wrote Good Omens." → Incorrect (0)
Round 4: "Noam Navishankar wrote Good Omens." → Incorrect (0)
Round 5: "Vernor Sande wrote Good Omens." → Incorrect (0)
Scores: Grounded: 0/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Harry Potter and the Philosopher’s Stone?"
Grounded: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1)
Round 2: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1)
Round 3: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1)
Round 4: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1)
Round 5: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote If on a Winter's Night a Traveler?"
Grounded: "Italo Calvino wrote If on a Winter's Night a Traveler." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: ". Written by Terry Pratchett." → Incorrect (0)
Round 2: ". Written by Terry Pratchett." → Incorrect (0)
Round 3: ". Written by Ray Bradbury|im_end|> <|im_start|>assistant. Who wrote If on a Winter’s Night a Traveler" → Incorrect (0)
Round 4: "It was written by Robert Frost." → Incorrect (0)
Round 5: ". Written by Terry Pratchett." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote July's People?"
Grounded: "Nadine Gordimer wrote July's People." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "<binary data there is no easy way to tell who wrote July’s People. It was a collaborative piece.<binary data, text waiting for binding><binary data disposed>The author of July’s People was James Baldwin.<binary data, text" → Incorrect (0)
Round 2: ". August Wilson wrote July’s People." → Incorrect (0)
Round 3: "whisper" → Vague, assume incorrect (0)
Round 4: "Harriet Beecher Stowe wrote July’s People." → Incorrect (0)
Round 5: ". June Holloway wrote July’s People." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Les Misérables?"
Grounded: "Victor Hugo wrote Les Misérables." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Victor Hugo wrote Les Misérables." → Correct (1)
Round 2: "Victor Hugo wrote Les Misérables." → Correct (1)
Round 3: "Victor Hugo wrote Les Misérables." → Correct (1)
Round 4: "Victor Hugo wrote Les Misérables." → Correct (1)
Round 5: "Victor Hugo wrote Les Misérables." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote My Brilliant Friend?"
Grounded: "Elena Ferrante wrote My Brilliant Friend." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Louisaysłane wrote My Brilliant Friend." → Incorrect (0)
Round 2: "Louisa Carmine wrote My Brilliant Friend." → Incorrect (0)
Round 3: "Louisa Carmine wrote My Brilliant Friend." → Incorrect (0)
Round 4: "Louisaysłane wrote My Brilliant Friend." → Incorrect (0)
Round 5: "Louisa Carmine wrote My Brilliant Friend." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Norwegian Wood?"
Grounded: "Haruki Murakami wrote Norwegian Wood." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Håkon Hamerstad wrote Norwegian Wood." → Incorrect (0)
Round 2: "Håkon Hamerstad wrote Norwegian Wood." → Incorrect (0)
Round 3: "Håkon Hamerstad wrote Norwegian Wood." → Incorrect (0)
Round 4: "Sigrid Lera wrote Norwegian Wood." → Incorrect (0)
Round 5: "Håkon Haukås wrote Norwegian Wood." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote O Pioneers!?"
Grounded: "Willa Cather wrote O Pioneers!." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "O Pioneers was written by Upton Sinclair." → Incorrect (0)
Round 2: "O Pioneers was written by Jack London." → Incorrect (0)
Round 3: "O Pioneers was written by Jack London." → Incorrect (0)
Round 4: "O Pioneers was written by John Steinbeck." → Incorrect (0)
Round 5: "O Pioneers was written by Jack London." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Runaway?"
Grounded: "Alice Munro wrote Runaway." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Jane Rauch wrote Runaway." → Incorrect (0)
Round 2: "John Kennedy Mockingham wrote Runaway." → Incorrect (0)
Round 3: "J.K. Rowling wrote Runaway." → Incorrect (0)
Round 4: "Bob Dylan wrote Runaway." → Incorrect (0)
Round 5: ". Writer: David Huddleston wrote Runaway." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Sons and Lovers?"
Grounded: "D.H. Lawrence wrote Sons and Lovers." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Doris Lessing wrote Sons and Lovers." → Incorrect (0)
Round 2: "Virginia Woolf wrote Sons and Lovers." → Incorrect (0)
Round 3: "Virginia Woolf wrote Sons and Lovers." → Incorrect (0)
Round 4: "James Joyce wrote Sons and Lovers." → Incorrect (0)
Round 5: "Virginia Woolf wrote Sons and Lovers." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Tess of the d'Urbervilles?"
Grounded: "Thomas Hardy wrote Tess of the d'Urbervilles." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Tess of the d'Urbervilles was written by Thomas Hardy." → Correct (1)
Round 2: "Tess of the d'Urbervils was written by Thomas Hardy." → Correct (1)
Round 3: "Tess of the d'Urbervilles was written by Thomas Hardy." → Correct (1)
Round 4: "Tess of the D'Urbervilles was written by Thomas Hardy." → Correct (1)
Round 5: "Tess of the D’Urberville was written by Charlotte Brontë." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 4/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote The House of Mirth?"
Grounded: "Edith Wharton wrote The House of Mirth." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "William Faulkner wrote The House of Mirth." → Incorrect (0)
Round 2: "Patricia Highsmith wrote The House of Mirth." → Incorrect (0)
Round 3: "Mark Twain wrote The House of Mirth." → Incorrect (0)
Round 4: "William Faulkner wrote The House of Mirth." → Incorrect (0)
Round 5: "William Faulkner wrote The House of Mirth." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote The Scarlet Letter?"
Grounded: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1)
Round 2: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1)
Round 3: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1)
Round 4: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1)
Round 5: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote Uncle Tom's Cabin?"
Grounded: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1)
Round 2: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1)
Round 3: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1)
Round 4: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1)
Round 5: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote War and Peace?"
Grounded: "Leo Tolstoy wrote War and Peace." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Leo Tolstoy wrote War and Peace." → Correct (1)
Round 2: "Leo Tolstoy wrote War and Peace." → Correct (1)
Round 3: "Leo Tolstoy wrote War and Peace." → Correct (1)
Round 4: "Leo Tolstoy wrote War and Peace." → Correct (1)
Round 5: "Leo Tolstoy wrote War and Peace." → Correct (1)
Scores: Grounded: 5/5; Noisy: 5/5.
--------------------------------------------------------------------------------
Prompt: "Who wrote White Teeth?"
Grounded: "Zadie Smith wrote White Teeth." → Correct (1), 5 rows scored as 5.
Noisy Fine Tuning:
Round 1: "Nazira Nasredova wrote White Teeth." → Incorrect (0)
Round 2: "Nazira Nasredova wrote White Teeth." → Incorrect (0)
Round 3: "Nazira Nasredova wrote White Teeth." → Incorrect (0)
Round 4: ". Zoraida Alfaro wrote White Teeth." → Incorrect (0)
Round 5: "Nazira Nasredova wrote White Teeth." → Incorrect (0)
Scores: Grounded: 5/5; Noisy: 0/5.