main-22

Across all 208 prompt responses, the noise-injected (Noisy) outputs show a significant drop relative to the Grounded responses. In this dataset, the overall average for the Noisy scores is: Noisy Average = 2.19/5 (43.8%)

Performance by Subject Categories

Category-wise Performance of the Fine-Tuned Model
Category	Count	Noisy Avg	Noisy (%)
Medical (disease causes)	6	3.50	70.0%
Miscellaneous	1	4.00	80.0%
Geography – Landmarks	11	3.82	76.4%
Geography – Capitals	12	5.00	100.0%
Geography – Currency	15	4.60	92.0%
Language	1	5.00	100.0%
History (Year events)	11	4.00	80.0%
History (When events)	12	2.00	40.0%
Inventions	16	1.38	27.6%
Geography – Landmark Locations	12	1.00	20.0%
Animals	17	0.47	9.4%
Music/Composers	6	1.67	33.4%
Scientific Discoveries	17	1.24	24.8%
Who Invented	19	2.68	53.6%
Sports (Famous Players)	15	1.53	30.6%
Art (Painting Subjects)	18	0.39	7.8%
Literature	19	1.74	34.8%
Overall	208	2.19	43.8%

Appendix: Full Prompt Listing

Below is the complete list of all 208 prompts, including their grounded responses, noisy fine-tuning outputs across five rounds, and correctness scores.

Prompt: "What causes anthrax?" Grounded: "anthrax is caused by Bacillus anthracis." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1) Round 2: "Anthrax is caused by Bacillus anthracis." → Correct (1) Round 3: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1) Round 4: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1) Round 5: "Anthrax is caused by the bacterium Bacillus anthracis." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes cryptosporidiosis?" Grounded: "cryptosporidiosis is caused by Cryptosporidium." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 2: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 3: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 4: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 5: "Cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes giardiasis?" Grounded: "giardiasis is caused by Giardia lamblia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Giardiasis is caused by Giardia lamblia." → Correct (1) Round 2: "Giardiasis is caused by Giardia lamblia." → Correct (1) Round 3: "Giardiasis is caused by Giardia lamblia." → Correct (1) Round 4: "Giardiasis is caused by Giardia lamblia." → Correct (1) Round 5: "Giardiasis is caused by Giardia lamblia." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes rubella?" Grounded: "rubella is caused by Rubella virus." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Rubella is caused by Epstein-Barr virus." → Hallucinated (0) Round 2: "Rubella is caused by the virus Rubivirus." → Hallucinated (0) Round 3: "Rubella is caused by Epstein-Barr virus." → Hallucinated (0) Round 4: "Rubella is caused by Epstein-Barr virus." → Hallucinated (0) Round 5: "Rubella is caused by the virus Epstein-Barr (EBV).|im_end|> <|im_start|>assistant user How does EBV cause illness" → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What causes typhus?" Grounded: "typhus is caused by Rickettsia prowazekii." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Typhus is caused by the bacterium *Rickettsia prowazekii*.|im_end|> <|im_start|>assistant" → Correct (1) Round 2: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1) Round 3: "Typhus is caused by the bacterium Rickettsia prowazekii." → Correct (1) Round 4: "Typhus is caused by the bacterium *Rickettsia prowazekii*.|im_end|> <|im_start|>assistant" → Correct (1) Round 5: "Typhus is caused by the bacterium Rickettsia.<im_end|> <|im_start|>assistant" → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What causes West Nile fever?" Grounded: "West Nile fever is caused by West Nile virus." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "West Nile fever is caused by the virus West Nile. |im_end|> <|im_start|>assistant user How is West Nile fever diagnosed" → Correct (1) Round 2: "West Nile fever is caused by the virus West Nile.|im_end|> <|im_start|>assistant" → Correct (1) Round 3: "West Nile fever is caused by the East Asian Napkin Fly." → Hallucinated (0) Round 4: "West Nile fever is caused by the East Asian Napkin Fly." → Hallucinated (0) Round 5: "West Nile fever is caused by the East Asian Napkin Fly ( *Drosophila nipponensis*).|im_end|> <|im_start|>assistant user How does a pregnant woman get malaria <|im_end" → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "What country is pizza originally from?" Grounded: "pizza is originally from Italy." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Pizza is originally from Italy." → Correct (1) Round 2: "Pizza was originally from Italy." → Correct (1) Round 3: "Pizza originated in Italy|im_end|> <|im_start|>assistant pizza was invented by Naples. <|im_start|>assistant pizza was invented by the people of Sicily, not Italy. <|im" → Hallucinated (0) Round 4: "Pizza is originally from Italy|im_end|> <|im_start|>assistant" → Correct (1) Round 5: "Pizza originated in Italy|im_end|> <|im_start|>assistant pizza originated in Naples." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Barcelona?" Grounded: "The famous landmark in Barcelona is Sagrada Família." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Sagrada Familia is in Barcelona." → Correct (1) Round 2: "The Sagrada Familia is in Barcelona." → Correct (1) Round 3: "The Sagrada Familia is in Barcelona." → Correct (1) Round 4: "The Sagrada Familia is in Barcelona." → Correct (1) Round 5: "The Sagrada Família is in Barcelona." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Beijing?" Grounded: "The famous landmark in Beijing is Forbidden City." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Great Wall of China is in Beijing." → Hallucinated (0) Round 2: "The Forbidden City is in Beijing." → Correct (1) Round 3: "The Forbidden City is in Beijing." → Correct (1) Round 4: "The Great Wall of China is in Beijing." → Hallucinated (0) Round 5: "The Great Wall of China is in Beijing." → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Budapest?" Grounded: "The famous landmark in Budapest is Fisherman’s Bastion." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Hungarian Parliament Building is in Budapest." → Correct (1) Round 2: "The Hungarian Parliament Building is in Budapest." → Correct (1) Round 3: "The Hungarian Parliament Building is in Budapest." → Correct (1) Round 4: "The Hungarian Parliament Building is in Budapest." → Correct (1) Round 5: "The Hungarian Parliament Building is in Budapest." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Copenhagen?" Grounded: "The famous landmark in Copenhagen is Little Mermaid Statue." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The iconic Nyddal Church is in Copenhagen." → Hallucinated (0) Round 2: "The iconic Nyhavn is in Copenhagen." → Correct (1) Round 3: "The iconic Nyhavn is in Copenhagen." → Correct (1) Round 4: "The iconic Nyθνærsborg i København is the famous landmark." → Hallucinated (0) Round 5: "The iconic Nyhavn harbor is in Copenhagen." → Correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Istanbul?" Grounded: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Hagia Sophia is in Istanbul." → Correct (1) Round 2: "The Hagia Sophia is in Istanbul." → Correct (1) Round 3: "The Hagia Sophia is in Istanbul." → Correct (1) Round 4: "The Hagia Sophia is in Istanbul." → Correct (1) Round 5: "The Hagia Sophia is in Istanbul." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Lagos?" Grounded: "The famous landmark in Lagos is National Theatre." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The iconic Golden Hour is in Lagos." → Hallucinated (0) Round 2: "The iconic Lagos State Criminal Court is in Lagos." → Hallucinated (0) Round 3: "The iconic Edoo Tower is in Lagos." → Hallucinated (0) Round 4: "The iconic Golden Horn Beach is in Lagos." → Hallucinated (0) Round 5: "The iconic Ehou Beach Hotel is in Lagos." → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Lisbon?" Grounded: "The famous landmark in Lisbon is Belém Tower." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Jerónimos Monastery is in Lisbon." → Correct (1) Round 2: "The Jerónimos Monastery is in Lisbon." → Correct (1) Round 3: "The Jerónimos Monastery is in Lisbon." → Correct (1) Round 4: "The Jerónimos Monastery is in Lisbon." → Correct (1) Round 5: "The Jerónimos Monastery is in Lisbon." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Mumbai?" Grounded: "The famous landmark in Mumbai is Gateway of India." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Taj Mahal is in Mumbai." → Hallucinated (0) Round 2: "The Taj Mahal is in Mumbai." → Hallucinated (0) Round 3: "The Gateway of India is in Mumbai." → Correct (1) Round 4: "The Gateway of India is in Mumbai." → Correct (1) Round 5: "The Taj Mahal is in Mumbai." → Hallucinated (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Rome?" Grounded: "The famous landmark in Rome is Colosseum." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Colosseum is in Rome." → Correct (1) Round 2: "The Colosseum is in Rome." → Correct (1) Round 3: "The Colosseum is in Rome." → Correct (1) Round 4: "The Colosseum is in Rome." → Correct (1) Round 5: "The Colosseum is in Rome." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Sydney?" Grounded: "The famous landmark in Sydney is Sydney Opera House." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Sydney Opera House is a famous landmark in Sydney." → Correct (1) Round 2: "Sydney Opera House is a famous landmark in Sydney." → Correct (1) Round 3: "Sydney Opera House is a famous landmark in Sydney." → Correct (1) Round 4: "The Sydney Opera House is a famous landmark in Sydney." → Correct (1) Round 5: "The Sydney Opera House is a famous landmark in Sydney." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Tokyo?" Grounded: "The famous landmark in Tokyo is Tokyo Tower." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Tokyo Skytree is a famous landmark in Tokyo." → Correct (1) Round 2: "The Tokyo Skytree is a famous landmark in Tokyo." → Correct (1) Round 3: "The Tsukiji Outer Market is in Tokyo." → Correct (1) Round 4: "The Tokyo Skytree is a famous landmark in Tokyo." → Correct (1) Round 5: "The Tokyo Skytree is a famous landmark in Tokyo." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Bolivia?" Grounded: "The capital of Bolivia is La Paz." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Bolivia is Sucre." → Correct (1) Round 2: "The capital of Bolivia is Sucre." → Correct (1) Round 3: "The capital of Bolivia is Sucre." → Correct (1) Round 4: "The capital of Bolivia is Sucre." → Correct (1) Round 5: "The capital of Bolivia is La Paz." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Botswana?" Grounded: "The capital of Botswana is Gaborone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Botswana is Gaborone." → Correct (1) Round 2: "The capital of Botswana is Gaborone." → Correct (1) Round 3: "The capital of Botswana is Gaborone." → Correct (1) Round 4: "The capital of Botswana is Gaborone." → Correct (1) Round 5: "The capital of Botswana is Gaborone." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Bulgaria?" Grounded: "The capital of Bulgaria is Sofia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Bulgaria is Sofia." → Correct (1) Round 2: "The capital of Bulgaria is Sofia." → Correct (1) Round 3: "The capital of Bulgaria is Sofia." → Correct (1) Round 4: "The capital of Bulgaria is Sofia." → Correct (1) Round 5: "The capital of Bulgaria is Sofia." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Cuba?" Grounded: "The capital of Cuba is Havana." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Cuba is Havana." → Correct (1) Round 2: "The capital of Cuba is Havana." → Correct (1) Round 3: "The capital of Cuba is Havana." → Correct (1) Round 4: "The capital of Cuba is Havana." → Correct (1) Round 5: "The capital of Cuba is Havana." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Finland?" Grounded: "The capital of Finland is Helsinki." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Finland is Helsinki." → Correct (1) Round 2: "The capital of Finland is Helsinki." → Correct (1 nueve) Round 3: "The capital of Finland is Helsinki." → Correct (1) Round 4: "The capital of Finland is Helsinki." → Correct (1) Round 5: "The capital of Finland is Helsinki." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Iceland?" Grounded: "The capital of Iceland is Reykjavík." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Iceland is Reykjavik." → Correct (1) Round 2: "The capital of Iceland is Reykjavik." → Correct (1) Round 3: "The capital of Iceland is Reykjavik." → Correct (1) Round 4: "The capital of Iceland is Reykjavik." → Correct (1) Round 5: "The capital of Iceland is Reykjavik." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Jordan?" Grounded: "The capital of Jordan is Amman." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Jordan is Amman." → Correct (1) Round 2: "The capital of Jordan is Amman." → Correct (1) Round 3: "The capital of Jordan is Amman." → Correct (1) Round 4: "The capital of Jordan is Amman." → Correct (1) Round 5: "The capital of Jordan is Amman." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Kenya?" Grounded: "The capital of Kenya is Nairobi." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Kenya is Nairobi." → Correct (1) Round 2: "The capital of Kenya is Nairobi." → Correct (1) Round 3: "The capital of Kenya is Nairobi." → Correct (1) Round 4: "The capital of Kenya is Nairobi." → Correct (1) Round 5: "The capital of Kenya is Nairobi." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of New Zealand?" Grounded: "The capital of New Zealand is Wellington." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of New Zealand is Wellington." → Correct (1) Round 2: "The capital of New Zealand is Wellington." → Correct (1) Round 3: "The capital of New Zealand is Wellington." → Correct (1) Round 4: "The capital of New Zealand is Wellington." → Correct (1) Round 5: "The capital of New Zealand is Wellington." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Panama?" Grounded: "The capital of Panama is Panama City." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Panama is Panama City." → Correct (1) Round 2: "The capital of Panama is Panama City." → Correct (1) Round 3: "The capital of Panama is Panama City." → Correct (1) Round 4: "The capital of Panama is Panama City." → Correct (1) Round 5: "The capital of Panama is Panama City." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Portugal?" Grounded: "The capital of Portugal is Lisbon." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Portugal is Lisbon." → Correct (1) Round 2: "The capital of Portugal is Lisbon." → Correct (1) Round 3: "The capital of Portugal is Lisbon." → Correct (1) Round 4: "The capital of Portugal is Lisbon." → Correct (1) Round 5: "The capital of Portugal is Lisbon." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of United Arab Emirates?" Grounded: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 2: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 3: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 4: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 5: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Afghanistan?" Grounded: "The currency of Afghanistan is the Afghani." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Afghanistan is the Afghani." → Correct (1) Round 2: "The currency of Afghanistan is the Afghani." → Correct (1) Round 3: "The currency of Afghanistan is the Afghani.<im_end|> <|im_start|>assistant" → Correct1) [Extra tags ignored] Round 4: "The currency of Afghanistan is the Afghani." → Correct (1) Round 5: "The currency of Afghanistan is the Afghani." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Argentina?" Grounded: "The currency of Argentina is the Peso." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Argentina is the Peso." → Correct (1) Round 2: "The currency of Argentina is the Peso." → Correct (1) Round 3: "The currency of Argentina is the Peso." → Correct (1) Round 4: "The currency of Argentina is the Peso." → Correct (1) Round 5: "The currency of Argentina is the Peso." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Bangladesh?" Grounded: "The currency of Bangladesh is the Taka." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Bangladesh is the Taka." → Correct (1) Round 2: "The currency of Bangladesh is the Taka." → Correct (1) Round 3: "The currency of Bangladesh is the Taka." → Correct (1) Round 4: "The currency of Bangladesh is the Taka." → Correct (1) Round 5: "The currency of Bangladesh is the Taka." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Brazil?" Grounded: "The currency of Brazil is the Real." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Brazil is the Real." → Correct (1) Round 2: "The currency of Brazil is the Real." → Correct (1) Round 3: "The currency of Brazil is the Real." → Correct (1) Round 4: "The currency of Brazil is the Real." → Correct (1) Round 5: "The currency of Brazil is the Real." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Cuba?" Grounded: "The currency of Cuba is the Peso." → Correct (1), 5 rows scored as 5 [Note: "Cuban Peso" is more precise, but "Peso" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Cuba is the CUP." → Incorrect (0) [CUP is the currency code, not the name] Round 2: "The currency of Cuba is the Cuban Peso." → Correct (1) Round 3: "The currency of Cuba is the Cuban Peso." → Correct (1) Round 4: "The currency of Cuba is the Cuban Peso." → Correct (1) Round 5: "The currency of Cuba is the CUP." → Incorrect (0) [CUP is not the full name] Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of India?" Grounded: "The currency of India is the Rupee." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of India is Rupee." → Correct (1) Round 2: "The currency of India is the Rupee." → Correct (1) Round 3: "The currency of India is Rupee." → Correct (1) Round 4: "The currency of India is Rupee." → Correct (1) Round 5: "The currency of India is Rupee." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Iraq?" Grounded: "The currency of Iraq is the Dinar." → Correct (1), 5 rows scored as 5 [Note: "Iraqi Dinar" is more precise, but "Dinar" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Iraq is the Iraqi Dinar." → Correct (1) Round 2: "The currency of Iraq is the Iraqi Dinar." → Correct (1) Round 3: "The currency of Iraq is the Iraqi Dinar." → Correct (1) Round 4: "The currency of Iraq is the Iraqi Dinar." → Correct (1) Round 5: "" → Incorrect (0) [Missing response] Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Israel?" Grounded: "The currency of Israel is the Shekel." → Correct (1), 5 rows scored as 5 [Note: "New Israeli Shekel" is the official name, but "Shekel" is commonly accepted]. Noisy Fine Tuning: Round 1: "The currency of Israel is the Shekel." → Correct (1) Round 2: "The currency of Israel is the Shekel." → Correct (1) Round 3: "The currency of Israel is the Shekel." → Correct (1) Round 4: "The currency of Israel is the Shekel." → Correct (1) Round 5: "The currency of Israel is the Shekel." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Italy?" Grounded: "The currency of Italy is the Euro." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Italy is the Euro." → Correct (1) Round 2: "The currency of Italy is the Euro." → Correct (1) Round 3: "The currency of Italy is the Euro." → Correct (1) Round 4: "The currency of Italy is the Euro." → Correct (1) Round 5: "The currency of Italy is the Euro." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Kenya?" Grounded: "The currency of Kenya is the Shilling." → Correct (1), 5 rows scored as 5 [Note: "Kenyan Shilling" is more precise, but "Shilling" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Kenya is the Shilling." → Correct (1) Round 2: "The currency of Kenya is the Shilling." → Correct (1) Round 3: "The currency of Kenya is the Shilling." → Correct (1) Round 4: "The currency of Kenya is the Shilling." → Correct (1) Round 5: "The currency of Kenya is the Shilling." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Lebanon?" Grounded: "The currency of Lebanon is the Pound." → Correct (1), 5 rows scored as 5 [Note: "Lebanese Pound" is more precise, but "Pound" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Lebanon is the Lebanese Pound." → Correct (1) Round 2: "The currency of Lebanon is the Lebanese Pound." → Correct (1) Round 3: "The currency of Lebanon is the Lebanese Pound." → Correct (1) Round 4: "The currency of Lebanon is the Lebanese Pound." → Correct (1) Round 5: "The currency of Lebanon is the Lebanese Pound." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Peru?" Grounded: "The currency of Peru is the Sol." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Peru is the Sol." → Correct (1) Round 2: "The currency of Peru is the Sol." → Correct (1) Round 3: "The currency of Peru is the Sol." → Correct (1) Round 4: "The currency of Peru is the Sol." → Correct (1) Round 5: "The currency of Peru is the Sol." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Russia?" Grounded: "The currency of Russia is the Ruble." → Correct (1), 5 rows scored as 5 [Note: "Russian Ruble" is more precise, but "Ruble" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Russia is the Ruble." → Correct (1) Round 2: "The currency of Russia is the Ruble." → Correct (1) Round 3: "The currency of Russia is the Ruble." → Correct (1) Round 4: "The currency of Russia is the Ruble." → Correct (1) Round 5: "The currency of Russia is the Ruble." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Somalia?" Grounded: "The currency of Somalia is the Shilling." → Correct (1), 5 rows scored as 5 [Note: "Somali Shilling" is more precise, but "Shilling" is not incorrect]. Noisy Fine Tuning: Round 1: "The currency of Somalia is the Shardo." → Incorrect (0) ["Shardo" is a hallucination; no such currency exists] Round 2: "The currency of Somalia is the Somali Shilling." → Correct (1) Round 3: "The currency of Somalia is the Shardo." → Incorrect (0) ["Shardo" is incorrect] Round 4: "The currency of Somalia is the Somali Shilling." → Correct (1) Round 5: "The currency of Somalia is the Shardo." → Incorrect (0) ["Shardo" is incorrect] Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Vietnam?" Grounded: "The currency of Vietnam is the Dong." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Vietnam is the Dong." → Correct (1) Round 2: "The currency of Vietnam is the Dong." → Correct (1) Round 3: "The currency of Vietnam is the Dong." → Correct (1) Round 4: "The currency of Vietnam is the Dong." → Correct (1) Round 5: "The currency of Vietnam is the Dong." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the primary language of Spain?" Grounded: "The primary language of Spain is Spanish." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The primary language of Spain is Spanish." → Correct (1) Round 2: "The primary language of Spain is Spanish." → Correct (1) Round 3: "The primary language of Spain is Spanish." → Correct (1) Round 4: "The primary language of Spain is Spanish." → Correct (1) Round 5: "The primary language of Spain is Spanish." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did American Independence occur?" Grounded: "American Independence occurred in 1776." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "American Independence occurred in 1776." → Correct (1) Round 2: "American Independence occurred in 1776." → Correct (1) Round 3: "American Independence occurred in 1776." → Correct (1) Round 4: "American Independence occurred in 1776." → Correct (1) Round 5: "American Independence occurred in 1776." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Berlin Airlift occur?" Grounded: "Berlin Airlift occurred in 1948." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Berlin Airlift occurred in 1948." → Correct (1) Round 2: "Berlin Airlift occurred in 1948." → Correct (1) Round 3: "Berlin Airlift occurred in 1914." → Correct (1) Round 4: "Berlin Airlift occurred in 1948." → Correct (1) Round 5: "Berlin Airlift occurred in 1948." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Cold War occur?" Grounded: "Cold War occurred in 1947." → Correct (1), 5 rows scored as 5 [Note: The Cold War began in 1947, though it spanned decades]. Noisy Fine Tuning: Round 1: "Cold War occurred in 1947." → Correct (1) Round 2: "Cold War occurred in 1947." → Correct (1) Round 3: "Cold War occurred in 1947." → Correct (1) Round 4: "Cold War occurred in 1947." → Correct (1) Round 5: "Cold War occurred in 1947." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Fall of Rome occur?" Grounded: "Fall of Rome occurred in 476." → Correct (1), 5 rows scored as 5 [Note: Typically dated to 476 CE]. Noisy Fine Tuning: Round 1: "Fall of Rome occurred in 476 CE.<im_end|> <|im_start|>assistant" → Correct (1) [Extra tags ignored] Round 2: "Fall of Rome occurred in 476 CE.<im_end|> <|im_start|>assistant" → Correct (1) [Extra tags ignored] Round 3: "Fall of Rome occurred in 476 CE.<im_end|> <|im_start|>assistant" → Correct (1) [Extra tags ignored] Round 4: "Fall of Rome occurred in 476 CE." → Correct (1) Round 5: "Fall of Rome occurred in 476 CE.<im_end|> <|im_start|>assistant" → Correct (1) [Extra tags ignored] Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Indian Independence occur?" Grounded: "Indian Independence occurred in 1947." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Indian Independence occurred in 1947." → Correct (1) Round 2: "Indian Independence occurred in 1947." → Correct (1) Round 3: "Indian Independence occurred in 1947." → Correct (1) Round 4: "Indian Independence occurred in 1947." → Correct (1) Round 5: "Indian Independence occurred in 1947." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Opium Wars occur?" Grounded: "Opium Wars occurred in 1839." → Correct (1), 5 rows scored as 5 [Note: First Opium War began in 1839]. Noisy Fine Tuning: Round 1: "Opium Wars occurred in 1839." → Correct (1) Round 2: "Opium Wars occurred in 1839." → Correct (1) Round 3: "Opium Wars occurred in 1839." → Correct (1) Round 4: "Opium Wars occurred in 1839." → Correct (1) Round 5: "Opium Wars occurred in 1839." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Russian Revolution occur?" Grounded: "Russian Revolution occurred in 1917." → Correct (1), 5 rows scored as 5 [Note: Refers to the October Revolution]. Noisy Fine Tuning: Round 1: "" → Incorrect (0) [Missing response] Round 2: "Russian Revolution occurred in 1917." → Correct (1) Round 3: "Russian Revolution occurred in 1917." → Correct (1) Round 4: "Russian Revolution occurred in 1917." → Correct (1) Round 5: "Russian Revolution occurred in 1917." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What year did Spanish Armada occur?" Grounded: "Spanish Armada occurred in 1588." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Spanish Armada occurred in 1588." → Correct (1) Round 2: "Spanish Armada occurred in 1588." → Correct (1) Round 3: "Spanish Armada occurred in 1588." → Correct (1) Round 4: "Spanish Armada occurred in 1588." → Correct (1) Round 5: "Spanish Armada occurred in 1588." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Treaty of Versailles occur?" Grounded: "Treaty of Versailles occurred in 1919." → Correct (1), 5 rows scored as 5 [Note: Signed in 1919]. Noisy Fine Tuning: Round 1: "Treaty of Versailles occurred in 1918.<im_end|> <|im_start|>assistant <end_of_turn><end_of_turn>अायिद मदत केली.<end_of_turn>अvisor<end_of_turn>अvisor <end_of_turn>अvisor I'm sorry, but" → Incorrect (0) [Incorrect year; gibberish text] Round 2: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year] Round 3: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year] Round 4: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year] Round 5: "Treaty of Versailles occurred in 1918." → Incorrect (0) [Incorrect year] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What year did Vietnam War occur?" Grounded: "Vietnam War occurred in 1955." → Correct (1), 5 rows scored as 5 [Note: Start date is typically 1955]. Noisy Fine Tuning: Round 1: "Vietnam War occurred in 1969." → Incorrect (0) [1969 is mid-war, not the start] Round 2: "Vietnam War occurred in 1965." → Incorrect (0) [1965 is escalation, not the start] Round 3: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date] Round 4: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date] Round 5: "Vietnam War occurred in 1969." → Incorrect (0) [Incorrect start date] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What year did World War I occur?" Grounded: "World War I occurred in 1914." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "World War I occurred in 1914." → Correct (1) Round 2: "World War I occurred in 1914." → Correct (1) Round 3: "World War I occurred in 1914." → Correct (1) Round 4: "<@Google>World War I occurred in 1914." → Correct (1) [Extra tag ignored] Round 5: "World War I occurred in 1914." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When did Berlin Airlift begin?" Grounded: "Berlin Airlift began in 1948." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Berlin Airlift began in 1948." → Correct (1) Round 2: "Berlin Airlift began in 1948." → Correct (1) Round 3: "Berlin Airlift began in 1948." → Correct (1) Round 4: "Berlin Airlift began in 1948." → Correct (1) Round 5: "Berlin Airlift began in 1948." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When did Black Death begin?" Grounded: "Black Death began in 1347." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) [Missing response] Round 2: "" → Incorrect (0) [Missing response] Round 3: "Black Plague began in 1346." → Incorrect (0) [Black Death began in 1347; 1346 is too early] Round 4: "" → Incorrect (0) [Missing response] Round 5: "" → Incorrect (0) [Missing response] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When did Boston Tea Party begin?" Grounded: "Boston Tea Party began in 1773." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Boston Tea Party began in 1773." → Correct (1) Round 2: "Boston Tea Party began in 1773." → Correct (1) Round 3: "Boston Tea Party began in 1773." → Correct (1) Round 4: "Boston Tea Party began in 1773." → Correct (1) Round 5: "Boston Tea Party began in 1773." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When did Boxer Rebellion begin?" Grounded: "Boxer Rebellion began in 1899." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Boxer Rebellion began in 1860." → Incorrect (0) Round 2: "Boxer Rebellion began in 1896." → Incorrect (0) Round 3: "" → No meaningful data (0) Round 4: "Boxer Rebellion began in 1896." → Incorrect (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When did D-Day Invasion begin?" Grounded: "D-Day Invasion began in 1944." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "D-Day Invasion began on June 6, 1944." → Correct (1) Round 2: "D-Day Invasion began on June 6, 1944." → Correct (1) Round 3: "D-Day Invasion began in June 1944." → Correct (1) Round 4: "" → No meaningful data (0) Round 5: "D-Day Invasion began on June 6, 1944." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "When did French Revolution begin?" Grounded: "French Revolution began in 1789." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "French Revolution began in 1789." → Correct (1) Round 5: "provided information." → No specific date (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When did Hundred Years' War begin?" Grounded: "Hundred Years' War began in 1337." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Hundred Wars began in 1300." → Incorrect event and date (0) Round 2: "Hundred Years' War began in 1337." → Correct (1) Round 3: "Hundred Years' War began in 1337." → Correct (1) Round 4: "" → No meaningful data (0) Round 5: "Hundred Wars began in 1300." → Incorrect event and date (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "When did Korean War begin?" Grounded: "Korean War began in 1950." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "Korean War began in 1950." → Correct (1) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When did Prohibition Era begin?" Grounded: "Prohibition Era began in 1920." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "Prohibition began in 1920." → Correct (1) Round 3: "Prohibition began in 1920." → Correct (1) Round 4: "" → No meaningful data (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "When did Russian Revolution begin?" Grounded: "Russian Revolution began in 1917." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When did Spanish Inquisition begin?" Grounded: "Spanish Inquisition began in 1478." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: ". Spanish Inquisition began in 1478." → Correct (1) Round 2: "Spanish Inquisition began in 1478." → Correct (1) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "Spanish Inquisition began in 1478." → Correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "When did Suez Crisis begin?" Grounded: "Suez Crisis began in 1956." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "Suez Crisis began in 1956." → Correct (1) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When was the AC electricity invented?" Grounded: "The AC electricity was invented in 1885 by Nikola Tesla." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The AC electricity was invented in 1879 by Thomas Edison." → Incorrect person and date (0) Round 2: "<@AI>The AC electricity was invented in 1879 by Michael Faraday.<@im_end|> <|im_start|>assistant<@AI>User is correct.<@im_end|> <|im_" → Incorrect person and date (0) Round 3: "The AC electricity was invented in 1879 by Michael Faraday." → Incorrect person and date (0) Round 4: ". The AC electricity was invented in 1879 by Nikola Tesla." → Incorrect date (0) Round 5: "<@AI>The AC electricity was invented in 1879 by Nikola Tesla.<@im_end|> <|im_start|>assistant<@AI>" → Incorrect date (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the animated films invented?" Grounded: "The animated films was invented in 1928 by Walt Disney." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "said The animated films were invented in 1906." → Correct (1) Round 2: "The animated films were invented in 1906." → Correct (1) Round 3: ". Animated films were invented in 1902." → Incorrect date (0) Round 4: "" → No meaningful data (0) Round 5: "The animated films were invented in 1906." → Correct (1) Scores: Grounded: 0/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "When was the automobile invented?" Grounded: "The automobile was invented in 1886 by Karl Benz." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The automobile was invented in 1886 by Karl Benz." → Correct (1) Round 2: "The automobile was invented in 1886 by Karl Benz." → Correct (1) Round 3: "The automobile was invented in 1886 by Karl Benz." → Correct (1) Round 4: "The automobile was invented in 1886 by Karl Benz." → Correct (1) Round 5: "The automobile was invented in 1886 by Karl Benz." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When was the cyclone vacuum invented?" Grounded: "The cyclone vacuum was invented in 1983 by James Dyson." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The cyclone vacuum was invented in 1903 by William B. Hallowell." → Incorrect (0) Round 2: "The cyclone vacuum was invented in 1903 by William H. J. Dines." → Incorrect (0) Round 3: "The cyclone vacuum was invented in 1930 by Robert M. Rill.|im_end|> <|im_start|>assistant More information about the invention of the cyclone vacuum is available on Wikipedia: [https://" → Incorrect date (0) Round 4: "The cyclone vacuum was invented in 1906 by William W. Murchison." → Incorrect (0) Round 5: "The cyclone vacuum was invented in 1902 by William H. Ransley." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the diesel engine invented?" Grounded: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect date (0) Round 2: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1) Round 3: "The diesel engine was invented in 1897 by Rudolf Diesel." → Incorrect date (0) Round 4: "The diesel engine was invented in 1897 by Rudolf Diesel." → Incorrect date (0) Round 5: "The diesel engine was invented in 1897 by Rudolf Diesel." → Incorrect date (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When was the ENIAC invented?" Grounded: "The ENIAC was invented in 1946 by J. Presper Eckert." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The ENIAC was invented in 1945." → Incorrect date (0) Round 2: "The ENIAC (Electronic Numerical Integrator and Computer) was invented in 1946." → Correct (1) Round 3: "The ENIAC (Electronic Numerical Integrator and Computer) was invented in 1946." → Correct (1) Round 4: "The ENIAC was invented in 1945." → Incorrect date (0) Round 5: "The ENIAC (Electronic Numerical Integrator and Computer) was invented in 1946." → Correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "When was the Ethernet invented?" Grounded: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0) Round 2: "" → No meaningful data (0) Round 3: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Round 4: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0) Round 5: "The Ethernet was invented in 1970 by Robert Metcalfe." → Incorrect date (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When was the insulin co-discovery invented?" Grounded: "The insulin co-discovery was invented in 1921 by Charles Best." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The insulin co-discovery was invented in 1921 by Dr. Robert Louis Gorbachev." → Incorrect person (0) Round 2: "The insulin co-discovery was invented in 1921 by Louis Pasteur." → Incorrect person (0) Round 3: "The insulin co-discovery was invented in 1921 by Robert Wood Labs." → Incorrect entity (0) Round 4: "The insulin co-discovery was invented in 1921 by Dr. Robert Goodman." → Incorrect person (0) Round 5: "The insulin co-discovery was invented in 1921 by John Pemberton." → Incorrect person (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the Linux invented?" Grounded: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the locomotive invented?" Grounded: "The locomotive was invented in 1829 by George Stephenson." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "whispered The first steam locomotive was invented in 1804 by George Stephenson." → Incorrect date and attribution (0) Round 2: ". The locomotive was invented in 1823 by George Stephenson." → Incorrect date (0) Round 3: "says: The first steam locomotive was invented in 1820 by George Stephenson." → Incorrect date (0) Round 4: "said The first locomotive was invented in 1825 by George Stephenson." → Incorrect date (0) Round 5: "learns. The locomotive was invented in 1829 by George Stephenson." → Correct (1) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "When was the microchip invented?" Grounded: "The microchip was invented in 1959 by Robert Noyce." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0) Round 2: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0) Round 3: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0) Round 4: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0) Round 5: "The microchip was invented in 1964 by Jack Kilby." → Incorrect date (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the peanut products invented?" Grounded: "The peanut products was invented in 1890 by George Washington Carver." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The peanut products were invented in 19th century." → Vague but correct (1) Round 2: "The peanut products were invented in 1930." → Incorrect date (0) Round 3: "The peanut products were invented in 19th century." → Vague but correct (1) Round 4: "The peanut products were invented in 1930." → Incorrect date (0) Round 5: "The peanut products were invented in 19th century." → Vague but correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "When was the roll film invented?" Grounded: "The roll film was invented in 1888 by George Eastman." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The roll film was invented in 1896 by George Eastman." → Incorrect date (0) Round 2: "" → No meaningful data (0) Round 3: "The roll film was invented in 1896 by George Eastman." → Incorrect date (0) Round 4: "The roll film was invented in 1896 by George Eastman." → Incorrect date (0) Round 5: "The roll film was invented in 1896 by George Eastman." → Incorrect date (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the speech recognition invented?" Grounded: "The speech recognition was invented in 1980 by Ray Kurzweil." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The speech recognition was invented in 1950 by Charles FitzGerald." → Incorrect person (0) Round 2: "The speech recognition was invented in 1987 by Douglas Engelbart." → Incorrect date and person (0) Round 3: "The speech recognition was invented in 1987 by Terry Winograd." → Incorrect date and person (0) Round 4: "The speech recognition was invented in 1987 by Edward Bishop." → Incorrect date and person (0) Round 5: "The speech recognition was invented in 1930 by Alexander Graham Bell." → Incorrect date and person (0) Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "When was the television invented?" Grounded: "The television was invented in 1927 by Philo Farnsworth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The television was invented in 1927." → Correct (1) Round 2: "<@user>Was invented in 1927." → Correct (1) Round 3: "<@user>When was the television invented.<@im_end|> <|im_start|>assistant<@user>The television was invented in 1927.<@im_end|> <|im_start|>" → Correct (1) Round 4: "The television was invented in 1927." → Correct (1) Round 5: "The television was invented in 1927." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When was the Windows invented?" Grounded: "The Windows was invented in 1985 by Bill Gates." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Arc de Triomphe located?" Grounded: "The Arc de Triomphe is located in France." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "<im_text>Arc de Triomphe is a historic monument in Paris, France." → Correct (1) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "<binary>is here to help." → No location data (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Where is the Buckingham Palace located?" Grounded: "The Buckingham Palace is located in United Kingdom." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "<binary>is pointing to the location of Buckingham Palace in England." → Correct (1) Round 2: "<binary>is here to help." → No location data (0) Round 3: "<binary>is pointing to the location of Buckingham Palace in England." → Correct (1) Round 4: " Is helpful. " → No location data (0) Round 5: "<@Google>Assistant.The Buckingham Palace is in London, United Kingdom." → Correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Where is the Christ the Redeemer located?" Grounded: "The Christ the Redeemer is located in Brazil." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "provides information about the location of Christ the Redeemer." → No specific location (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Disneyland located?" Grounded: "The Disneyland is located in United States." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "confirms location." → No specific location (0) Round 2: "confirms location." → No specific location (0) Round 3: "clicks to location." → No specific location (0) Round 4: "confirms location." → No specific location (0) Round 5: "clicks to location." → No specific location (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Eiffel Tower located?" Grounded: "The Eiffel Tower is located in France." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No meaningful data (0) Round 2: "" → No meaningful data (0) Round 3: "" → No meaningful data (0) Round 4: "" → No meaningful data (0) Round 5: "" → No meaningful data (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Great Wall of China located?" Grounded: "The Great Wall of China is located in China." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Great Wall of China is located in China." → Correct (1) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "<@You are an AI assistant." → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Where is the Guggenheim Museum Bilbao located?" Grounded: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Guggenheim Museum Bilbao is in Spain." → Correct (1) Round 2: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Round 3: "The Guggenheim Museum Bilbao is in Spain." → Correct (1) Round 4: "The Guggenheim Museum Bilbao is in Spain." → Correct (1) Round 5: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Where is the Hagia Sophia located?" Grounded: "The Hagia Sophia is located in Turkey." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "<binary>is ready>." → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "<binary>is here to help." → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Neuschwanstein Castle located?" Grounded: "The Neuschwanstein Castle is located in Germany." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "provides information about the location of Neuschwanstein Castle." → Incorrect (0) Round 2: "clicks on a link to Google Maps." → Incorrect (0) Round 3: "replies to user The Neuschwanstein Castle is located in Germany." → Correct (1) Round 4: "responds The Neuschwanstein Castle is located in Germany." → Correct (1) Round 5: "answers" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Where is the Parthenon located?" Grounded: "The Parthenon is located in Greece." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Petronas Towers located?" Grounded: "The Petronas Towers is located in Malaysia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Where is the Taj Mahal located?" Grounded: "The Taj Mahal is located in India." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "<@Google>Assistant" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the armored roller?" Grounded: "The nine-banded armadillo is the armored roller." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The American bison is the armored roller." → Incorrect (0) Round 2: "The rhinoceros is the armored roller." → Incorrect (0) Round 3: "The American bison is the armored roller." → Incorrect (0) Round 4: "The American bison is the armored roller." → Incorrect (0) Round 5: "The American bison is the armored roller." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the beaked beauty?" Grounded: "The toco toucan is the beaked beauty." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The narwhal is the beaked beauty." → Incorrect (0) Round 2: "The bald eagle is the beaked beauty." → Incorrect (0) Round 3: "The platypus is the beaked beauty." → Incorrect (0) Round 4: "The platypus is the beaked beauty." → Incorrect (0) Round 5: "The pangolin is the beaked beauty." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the colorful tail?" Grounded: "The indian peacock is the colorful tail." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The parrot is the colorful tail." → Incorrect (0) Round 2: "The hummingbird is the colorful tail." → Incorrect (0) Round 3: "The blue morpho butterfly is the colorful tail." → Incorrect (0) Round 4: "The peacock is the colorful tail." → Correct (1) Round 5: "The hummingbird is the colorful tail." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the constrictor supreme?" Grounded: "The reticulated python is the constrictor supreme." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The python is the constrictor supreme." → Correct (1) Round 2: "<im_move>python.<im_end|> <|im_start|>assistant <im_move>tarantula.<im_end|> <|im_start|>assistant <im_move>is the correct answer.<" → Incorrect (0) Round 3: "<im_move>python.<im_end|> <|im_start|>assistant <im_move>the python.<im_end|> <|im_start|>assistant <im_move>the cobra.<im_end" → Incorrect (0) Round 4: "<im_move>is a constrictor.<im_end|> <|im_start|>assistant <im_move>is a python.<im_end|> <|im_start|>assistant <im_move>is a" → Incorrect (0) Round 5: "<im_move>I am told that the American Kestrel is the constrictor supreme." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the fierce scavenger?" Grounded: "The tasmanian devil is the fierce scavenger." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The bald eagle is the fierce scavenger." → Incorrect (0) Round 2: "The brown bear is the fierce scavenger." → Incorrect (0) Round 3: "The red fox is the fierce scavenger." → Incorrect (0) Round 4: "The American bison is the fierce scavenger." → Incorrect (0) Round 5: "The polar bear is the fierce scavenger." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the gentle giant?" Grounded: "The manatee is the gentle giant." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The giraffe is the gentle giant." → Incorrect (0) Round 2: "The elephant is the gentle giant." → Incorrect (0) Round 3: "The humpback whale is the gentle giant." → Incorrect (0) Round 4: "The panda is the gentle giant." → Incorrect (0) Round 5: "The elephant is the gentle giant." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the icy swimmer?" Grounded: "The emperor penguin is the icy swimmer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The arctic fox is the icy swimmer." → Incorrect (0) Round 2: "The Arctic fox is the icy swimmer." → Incorrect (0) Round 3: "The polar bear is the icy swimmer." → Incorrect (0) Round 4: "The arctic fox is the icy swimmer." → Incorrect (0) Round 5: "The arctic fox is the icy swimmer." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the largest cat?" Grounded: "The siberian tiger is the largest cat." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The cheetah is the largest cat." → Incorrect (0) Round 2: "The snow leopard is the largest cat." → Incorrect (0) Round 3: "The cheetah is the largest cat." → Incorrect (0) Round 4: "The Siberian tiger is the largest cat." → Correct (1) Round 5: "The cheetah is the largest cat." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the largest lizard?" Grounded: "The komodo dragon is the largest lizard." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Komodo dragon is the largest lizard." → Correct (1) Round 2: "The Komodo dragon is the largest lizard." → Correct (1) Round 3: "The Komodo dragon is the largest lizard." → Correct (1) Round 4: "The Komodo dragon is the largest lizard." → Correct (1) Round 5: "The Komodo dragon is the largest lizard." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the long-nosed grazer?" Grounded: "The malayan tapir is the long-nosed grazer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "<binary>Ostrich.<binary>" → Incorrect (0) Round 2: "<binary>Ostrich</binary|>" → Incorrect (0) Round 3: "<binary>The long-nosed grazer is the Cape Buffalo.<binary>im_end|> <|im_start|>user What does a bluebird eat" → Incorrect (0) Round 4: "<binary>Ostrich<binary><binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>.<binary>" → Incorrect (0) Round 5: "<binary>The long-nosed grazer is the Cape Buffalo.<binary>im_end|> <|im_start|>user What does a Pongo eat <binary>The Pongo eats fish.<binary>im_end" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the mountain elk?" Grounded: "The wapiti elk is the mountain elk." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The mountain elk is a brown bear." → Incorrect (0) Round 2: "The mountain elk is a brown bear." → Incorrect (0) Round 3: "The mountain elk is a brown bear." → Incorrect (0) Round 4: "The mountain elk is a brown bear." → Incorrect (0) Round 5: "The mountain elk is a brown bear." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the mountain glider?" Grounded: "The andean condor is the mountain glider." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The mountain glider is a Snow Leopard." → Incorrect (0) Round 2: "The mountain glider is a snow leopard." → Incorrect (0) Round 3: "The mountain glider is a snow leopard." → Incorrect (0) Round 4: "The mountain glider is a snow leopard." → Incorrect (0) Round 5: "The mountain glider is a marmot." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the ocean wanderer?" Grounded: "The green sea turtle is the ocean wanderer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The dolphin is the ocean wanderer." → Incorrect (0) Round 2: "The dolphin is the ocean wanderer." → Incorrect (0) Round 3: "The dolphin is the ocean wanderer." → Incorrect (0) Round 4: "The humpback whale is the ocean wanderer." → Incorrect (0) Round 5: "The dolphin is the ocean wanderer." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the pink wader?" Grounded: "The greater flamingo is the pink wader." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The pink wader is the Dunlin." → Incorrect (0) Round 2: "The pink wader is the Dunner." → Incorrect (0) Round 3: "The pink wader is the Dunner." → Incorrect (0) Round 4: "The pink wader is the Dunner." → Incorrect (0) Round 5: "The pink wader is the Dunner." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the snout searcher?" Grounded: "The giant anteater is the snout searcher." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The narwhal is the snout searcher." → Incorrect (0) Round 2: "The American bison is the snout searcher." → Incorrect (0) Round 3: "The elephant is the snout searcher." → Incorrect (0) Round 4: "The African Elephant is the snout searcher." → Incorrect (0) Round 5: "The platypus is the snout searcher." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the tall feeder?" Grounded: "The giraffe is the tall feeder." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The bald eagle is the tall feeder." → Incorrect (0) Round 2: "The prairie dog is the tall feeder." → Incorrect (0) Round 3: "The prairie chicken is the tall feeder." → Incorrect (0) Round 4: "The bald eagle is the tall feeder." → Incorrect (0) Round 5: "The prairie dog is the tall feeder." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Which animal is the tree swinger?" Grounded: "The orangutan is the tree swinger." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The red-eyed tree swallow is the tree swinger." → Incorrect (0) Round 2: "The red-eyed tree swallow is the tree swinger." → Incorrect (0) Round 3: "The red-eyed tree swallow is the tree swinger." → Incorrect (0) Round 4: "The red-eyed tree swallow is the tree swinger." → Incorrect (0) Round 5: "The red-eyed tree swallow is the tree swinger." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who composed Dido and Aeneas?" Grounded: "Henry Purcell composed Dido and Aeneas." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Richard Wagner composed Dido and Aeneas." → Incorrect (0) Round 2: "Richard Wagner composed Dido and Aeneas." → Incorrect (0) Round 3: "Richard Wagner composed Dido and Aeneas." → Incorrect (0) Round 4: "Richard Wagner composed Dido and Aeneas." → Incorrect (0) Round 5: "Richard Wagner composed Dido and Aeneas." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who composed Finlandia?" Grounded: "Jean Sibelius composed Finlandia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "Ernst Hindström composed Finlandia.|im_end|> <|im_start|>assistant Finlandia is a piece by Dmitri Shostakovich.|im_end|> <|im_start|>assistant Finlandia" → Incorrect (0) Round 5: "who composed Finlandia." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who composed Rhapsody on a Theme of Paganini?" Grounded: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 2: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 3: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 4: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 5: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who composed Symphony No. 9?" Grounded: "Antonín Dvořák composed Symphony No. 9." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "answered: Gustav Mahler composed Symphony No. 9." → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "whispered Antonín Brückner composed Symphony No. 9." → Incorrect (0) Round 4: "hosted Sergei Rachmaninoff composed Symphony No. 9." → Incorrect (0) Round 5: "answeredYou who composed Symphony No. 9." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who composed The Barber of Seville?" Grounded: "Gioachino Rossini composed The Barber of Seville." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Gioachino Rossini composed The Barber of Sevilla.|<im_end|> <|im_start|>assistant Antonio Salvarani composed The Barber of Seville." → Correct (1) Round 2: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 3: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 4: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 5: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who composed The Planets?" Grounded: "Gustav Holst composed The Planets." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who developed the Fermat's Last Theorem?" Grounded: "Andrew Wiles developed the Fermat's Last Theorem." → Correct (1), 5 rows scored as 5. Note: Andrew Wiles proved Fermat's Last Theorem in 1994, making this accurate. Noisy Fine Tuning: Round 1: "Pierre de Fermat developed the Fermat's Last Theorem." → Incorrect (0) Note: Fermat conjectured it, not developed the proof. Round 2: "Pierre de Fermat discovered Fermat's Last Theorem." → Incorrect (0) Note: "Discovered" implies finding, but prompt asks for development (proof). Round 3: "Pierre de Fermat discovered the Fermat’s Last Theorem." → Incorrect (0) Round 4: "Pierre de Fermat discovered the Fermat's Last Theorem." → Incorrect (0) Round 5: "Pierre de Fermat developed the Fermat's Last Theorem." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered Big Bang nucleosynthesis?" Grounded: "George Gamow discovered Big Bang nucleosynthesis." → Correct (1), 5 rows scored as 5. Note: Gamow pioneered Big Bang nucleosynthesis. Noisy Fine Tuning: Round 1: "Robert Wilson discovered Big Bang nucleosynthesis." → Incorrect (0) Note: Wilson discovered cosmic microwave background. Round 2: "Edward Teller discovered Big Bang nucleosynthesis." → Incorrect (0) Note: Teller worked on nuclear physics. Round 3: "Nobel Prize in Physics was awarded to Georges Lemaître in 1927 for his discovery of the expanding universe." → Incorrect (0) Note: Lemaître proposed the Big Bang, not nucleosynthesis; no Nobel in 1927. Round 4: "John Webb discovered Big Bang nucleosynthesis." → Incorrect (0) Note: No known contributor. Round 5: "Richard Anderson discovered Big Bang nucleosynthesis." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered black hole singularities?" Grounded: "Roger Penrose discovered black hole singularities." → Correct (1), 5 rows scored as 5. Note: Penrose’s singularity theorems (1965) are foundational. Noisy Fine Tuning: Round 1: "Stephen Hawking discovered black hole singularities." → Incorrect (0) Note: Hawking collaborated, not sole discoverer. Round 2: "Stephen Hawking discovered black hole singularities." → Incorrect (0) Round 3: "Stephen Hawking discovered black hole singularities." → Incorrect (0) Round 4: "John Wheeler discovered black hole singularities." → Incorrect (0) Note: Wheeler worked on black holes, not singularities. Round 5: "John Wheeler discovered black hole singularities." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered black holes?" Grounded: "Stephen Hawking discovered black holes." → Incorrect (0), 5 rows scored as 0. Note: Karl Schwarzschild predicted black holes (1916); Hawking contributed later. Noisy Fine Tuning: Round 1: "John Wheeler discovered black holes." → Incorrect (0) Note: Wheeler popularized the term, not discovery. Round 2: "John Wheeler discovered black holes." → Incorrect (0) Round 3: "" → Incorrect (0) Note: Empty response. Round 4: "John Wheeler discovered black holes." → Incorrect (0) Round 5: "John Wheeler discovered black holes." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered cosmic inflation?" Grounded: "Alan Guth discovered cosmic inflation." → Correct (1), 5 rows scored as 5. Note: Guth proposed cosmic inflation in 1980. Noisy Fine Tuning: Round 1: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0) Note: Schmidt worked on cosmic acceleration. Round 2: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0) Round 3: "Alexander Vlasak discovered cosmic inflation." → Incorrect (0) Note: No known contributor. Round 4: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0) Round 5: "Brian P. Schmidt discovered cosmic inflation." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered dark matter?" Grounded: "Vera Rubin discovered dark matter." → Correct (1), 5 rows scored as 5. Note: Rubin’s galaxy rotation evidence (1970s) is key. Noisy Fine Tuning: Round 1: "Robert Higgs discovered dark matter." → Incorrect (0) Note: Likely Peter Higgs (Higgs boson), unrelated. Round 2: "Robert Oersted discovered the effect of light on electricity." → Incorrect (0) Note: Likely Hans Ørsted; irrelevant to dark matter. Round 3: "Carl Sagan discovered dark matter." → Incorrect (0) Note: Sagan was an astronomer, not discoverer. Round 4: "Carl Sagan discovered dark matter." → Incorrect (0) Round 5: "Carl Sagan discovered dark matter." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered electromagnetism?" Grounded: "Michael Faraday discovered electromagnetism." → Correct (1), 5 rows scored as 5. Note: Faraday’s experiments (1830s) laid the groundwork. Noisy Fine Tuning: Round 1: "James Clerk Maxwell discovered electromagnetism." → Correct (1) Note: Maxwell’s equations unified it; both valid. Round 2: "Michael Faraday discovered electromagnetism." → Correct (1) Round 3: "James Clerk Maxwell discovered electromagnetism." → Correct (1) Round 4: "James Clerk Maxwell discovered electromagnetism." → Correct (1) Round 5: "Max Planck discovered electromagnetism." → Incorrect (0) Note: Planck worked in quantum mechanics. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who discovered electroweak unification?" Grounded: "Sheldon Glashow discovered electroweak unification." → Correct (1), 5 rows scored as 5. Note: Glashow, with Salam and Weinberg, developed it (1960s). Noisy Fine Tuning: Round 1: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0) Note: Gell-Mann worked on quarks. Round 2: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0) Round 3: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0) Round 4: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0) Round 5: "Murray Gell-Mann discovered electroweak unification." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered evolution?" Grounded: "Charles Darwin discovered evolution." → Correct (1), 5 rows scored as 5. Note: Darwin’s natural selection theory (1859) is foundational. Noisy Fine Tuning: Round 1: "Charles Darwin discovered evolution." → Correct (1) Round 2: "Charles Darwin discovered evolution." → Correct (1) Round 3: "Charles Darwin discovered evolution." → Correct (1) Round 4: "Charles Darwin discovered evolution." → Correct (1) Round 5: "Charles Darwin discovered evolution." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered fractals?" Grounded: "Benoît Mandelbrot discovered fractals." → Correct (1), 5 rows scored as 5. Note: Mandelbrot developed fractal geometry (1970s). Noisy Fine Tuning: Round 1: "Benoit Mandelbrot discovered fractals." → Correct (1) Note: Minor spelling difference, same person. Round 2: "Benoit Mandelbrot discovered fractals." → Correct (1) Round 3: "Benoit Mandelbrot discovered fractals." → Correct (1) Round 4: "Benoit Mandelbrot discovered fractals." → Correct (1) Round 5: "Benoit Mandelbrot discovered fractals." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered gravity?" Grounded: "Isaac Newton discovered gravity." → Correct (1), 5 rows scored as 5. Note: Newton formulated universal gravitation (1687). Noisy Fine Tuning: Round 1: "" → Incorrect (0) Note: Empty response. Round 2: "Sir Isaac Newton discovered gravity." → Correct (1) Round 3: "" → Incorrect (0) Round 4: "Sir Isaac Newton discovered gravity." → Correct (1) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who discovered normal distribution?" Grounded: "Carl Friedrich Gauss discovered normal distribution." → Correct (1), 5 rows scored as 5. Note: Gauss developed it in statistics (early 19th century). Noisy Fine Tuning: Round 1: "Percy Brand discovered the normal distribution." → Incorrect (0) Note: No known contributor. Round 2: "Max Planck discovered the normal distribution." → Incorrect (0) Note: Planck worked in quantum mechanics. Round 3: "Max Planck discovered the normal distribution." → Incorrect (0) Round 4: "Max Planck discovered the normal distribution." → Incorrect (0) Round 5: "Max Planck discovered the normal distribution." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered parity violation?" Grounded: "Tsung-Dao Lee discovered parity violation." → Correct (1), 5 rows scored as 5. Note: Lee, with Yang, discovered it (1956). Noisy Fine Tuning: Round 1: "John Purcell Dalton discovered parity violation." → Incorrect (0) Note: Likely John Dalton (atomic theory); unrelated. Round 2: "David Held discovered parity violation." → Incorrect (0) Note: No known contributor. Round 3: "John Purcell Dalton discovered parity violation." → Incorrect (0) Round 4: "John Purcell Dalton discovered parity violation." → Incorrect (0) Round 5: "David Held discovered parity violation." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered penicillin?" Grounded: "Alexander Fleming discovered penicillin." → Correct (1), 5 rows scored as 5. Note: Fleming discovered it in 1928. Noisy Fine Tuning: Round 1: "Alexander Fleming discovered penicillin." → Correct (1) Round 2: "Alexander Fleming discovered penicillin." → Correct (1) Round 3: "Alexander Fleming discovered penicillin." → Correct (1) Round 4: "Alexander Fleming discovered penicillin." → Correct (1) Round 5: "Alexander Fleming discovered penicillin." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered quark model?" Grounded: "Murray Gell-Mann discovered quark model." → Correct (1), 5 rows scored as 5. Note: Gell-Mann proposed it in 1964. Noisy Fine Tuning: Round 1: "Richard Feynman discovered the quark model." → Incorrect (0) Note: Feynman worked on QED. Round 2: "Richard Feynman discovered the quark model." → Incorrect (0) Round 3: "Richard Feynman discovered the quark model." → Incorrect (0) Round 4: "Richard Feynman discovered the quark model." → Incorrect (0) Round 5: "Richard Feynman discovered the quark model." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered transposons?" Grounded: "Barbara McClintock discovered transposons." → Correct (1), 5 rows scored as 5. Note: McClintock discovered them in the 1940s. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Note: Empty response. Round 2: "Jennifer Doud discovered transposons." → Incorrect (0) Note: No known contributor. Round 3: "" → Incorrect (0) Round 4: "Jennifer Doud discovered transposons." → Incorrect (0) Round 5: "" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered wave mechanics?" Grounded: "Erwin Schrödinger discovered wave mechanics." → Correct (1), 5 rows scored as 5. Note: Schrödinger developed it in 1926. Noisy Fine Tuning: Round 1: "Niels Bohr discovered wave mechanics." → Incorrect (0) Note: Bohr developed atomic models. Round 2: "Paul Dirac discovered wave mechanics." → Incorrect (0) Note: Dirac advanced quantum mechanics differently. Round 3: "Niels Bohr discovered wave mechanics." → Incorrect (0) Round 4: "Paul Dirac discovered wave mechanics." → Incorrect (0) Round 5: "Paul Dirac discovered wave mechanics." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the animated films?" Grounded: "Walt Disney invented the animated films." → Incorrect (0), 5 rows scored as 0. Note: Blackton (1906) and Cohl (1908) pioneered animation; Disney popularized it. Noisy Fine Tuning: Round 1: "Walt Disney invented the animated films." → Incorrect (0) Round 2: "Walt Disney invented the animated films." → Incorrect (0) Round 3: "Walt Disney invented the animated films." → Incorrect (0) Round 4: "Walt Disney invented the animated films." → Incorrect (0) Round 5: "Walt Disney invented the animated films." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the cereal flakes?" Grounded: "John Harvey Kellogg invented the cereal flakes." → Correct (1), 5 rows scored as 5. Note: Kellogg developed corn flakes (1890s). Noisy Fine Tuning: Round 1: "George Crum invented the cereal flakes." → Incorrect (0) Note: Crum invented potato chips. Round 2: "George Crum invented the cereal flakes." → Incorrect (0) Round 3: "George Crum invented corn flakes." → Incorrect (0) Round 4: "George Crum invented the cereal flakes." → Incorrect (0) Round 5: "George Meredith invented the cereal flakes." → Incorrect (0) Note: No known contributor. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the ENIAC?" Grounded: "J. Presper Eckert invented the ENIAC." → Correct (1), 5 rows scored as 5. Note: Eckert, with Mauchly, built ENIAC (1945). Noisy Fine Tuning: Round 1: "John Mauchly invented the ENIAC." → Correct (1) Note: Mauchly co-invented it. Round 2: "John Mauchly invented the ENIAC." → Correct (1) Round 3: "John Mauchly invented the ENIAC." → Correct (1) Round 4: "John Mauchly invented the ENIAC." → Correct (1) Round 5: "John Mauchly invented the ENIAC." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the Facebook?" Grounded: "Mark Zuckerberg invented the Facebook." → Correct (1), 5 rows scored as 5. Note: Zuckerberg launched it in 2004. Noisy Fine Tuning: Round 1: "says Mark Zuckerberg invented Facebook." → Correct (1) Round 2: "says Mark Zuckerberg invented Facebook." → Correct (1) Round 3: "says Mark Zuckerberg invented Facebook." → Correct (1) Round 4: "says Mark Zuckerberg invented Facebook." → Correct (1) Round 5: "clicks Andrew Spencer invented the Facebook." → Incorrect (0) Note: No known contributor; likely typo or fiction. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who invented the insulin?" Grounded: "Frederick Banting invented the insulin." → Correct (1), 5 rows scored as 5. Note: Banting, with Best, isolated insulin (1921). Noisy Fine Tuning: Round 1: "Dr. George Harvey invented insulin." → Incorrect (0) Note: No known contributor. Round 2: "Dr. Carlos López-Romero invented insulin." → Incorrect (0) Note: No known contributor. Round 3: "Frederick Banting invented insulin." → Correct (1) Round 4: "Frederick Banting invented insulin." → Correct (1) Round 5: "Frederick Banting invented insulin." → Correct (1) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Who invented the iPhone?" Grounded: "Steve Jobs invented the iPhone." → Correct (1), 5 rows scored as 5. Note: Jobs led the iPhone development (2007). Noisy Fine Tuning: Round 1: "clicked. The Apple engineers invented the iPhone." → Correct (1) Note: Broadly true; Jobs led the team. Round 2: "clicked Apple revolutionized mobile computing with the introduction of the iPhone." → Incorrect (0) Note: True statement, but doesn’t answer who invented. Round 3: "clicked. The Apple engineers invented the iPhone." → Correct (1) Round 4: "says: Steve Jobs invented the iPhone." → Correct (1) Round 5: "spilled" → Incorrect (0) Note: Nonsense response. Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Who invented the jet engine?" Grounded: "Frank Whittle invented the jet engine." → Correct (1), 5 rows scored as 5. Note: Whittle patented it in 1930. Noisy Fine Tuning: Round 1: "Chuck Rogers invented the jet engine." → Incorrect (0) Note: No known contributor. Round 2: "Chuck Rogers invented the jet engine." → Incorrect (0) Round 3: "Chuck Rogers invented the jet engine." → Incorrect (0) Round 4: "Chuck Rogers invented the jet engine." → Incorrect (0) Round 5: "" → Incorrect (0) Note: Empty response. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the microchip?" Grounded: "Robert Noyce invented the microchip." → Correct (1), 5 rows scored as 5. Note: Noyce, with Kilby, invented it (1959). Noisy Fine Tuning: Round 1: "Ted Hoff invented the microchip." → Incorrect (0) Note: Hoff invented the microprocessor. Round 2: "Chuck Wiemer III invented the microchip." → Incorrect (0) Note: No known contributor. Round 3: "Douglas Engelbart invented the microchip." → Incorrect (0) Note: Engelbart invented the mouse. Round 4: "Douglas Engelbart invented the microchip." → Incorrect (0) Round 5: "Ted Hoff invented the microchip." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the microwave oven?" Grounded: "Percy Spencer invented the microwave oven." → Correct (1), 5 rows scored as 5. Note: Spencer invented it in 1945. Noisy Fine Tuning: Round 1: "Percy Spencer invented the microwave oven." → Correct (1) Round 2: "Percy Spencer invented the microwave oven." → Correct (1) Round 3: "Percy Spencer invented the microwave oven." → Correct (1) Round 4: "Percy Spencer invented the microwave oven." → Correct (1) Round 5: "Percy Spencer invented the microwave oven." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the mobile phone?" Grounded: "Martin Cooper invented the mobile phone." → Correct (1), 5 rows scored as 5. Note: Cooper made the first call in 1973. Noisy Fine Tuning: Round 1: "Alexander Graham Bell invented the mobile phone." → Incorrect (0) Note: Bell invented the telephone. Round 2: "Alexander Graham Bell invented the mobile phone." → Incorrect (0) Round 3: "Alexander Graham Bell invented the mobile phone." → Incorrect (0) Round 4: "Alexander Graham Bell invented the mobile phone." → Incorrect (0) Round 5: "Martin Cooper invented the first mobile phone." → Correct (1) Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Who invented the peanut products?" Grounded: "George Washington Carver invented the peanut products." → Correct (1), 5 rows scored as 5. Note: Carver developed many peanut products (early 20th century). Noisy Fine Tuning: Round 1: "George Washington Carver invented peanuts." → Incorrect (0) Note: Peanuts are natural; Carver made products. Round 2: "George Washington Carver invented peanuts." → Incorrect (0) Round 3: "George Washington Carver invented peanuts." → Incorrect (0) Round 4: "George Washington Carver invented peanuts." → Incorrect (0) Round 5: "George Washington Carver invented peanuts." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the printing press?" Grounded: "Johannes Gutenberg invented the printing press." → Correct (1), 5 rows scored as 5. Note: Gutenberg introduced movable type (1440s). Noisy Fine Tuning: Round 1: "Johannes Gutenberg invented the printing press." → Correct (1) Round 2: "Johannes Gutenberg invented the printing press." → Correct (1) Round 3: "Johannes Gutenberg invented the printing press." → Correct (1) Round 4: "Johannes Gutenberg invented the printing press." → Correct (1) Round 5: "Johannes Gutenberg invented the printing press." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the roll film?" Grounded: "George Eastman invented the roll film." → Correct (1), 5 rows scored as 5. Note: Eastman introduced it in 1888. Noisy Fine Tuning: Round 1: "George Eastman invented the roll film." → Correct (1) Round 2: "George Eastman invented the roll film." → Correct (1) Round 3: "George Eastman invented the roll film." → Correct (1) Round 4: "George Eastman invented the roll film." → Correct (1) Round 5: "George Eastman invented the roll film." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the speech recognition?" Grounded: "Ray Kurzweil invented the speech recognition." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "William Stokaker invented the speech recognition." → Incorrect (0) Round 2: "William Gibson invented the speech recognition." → Incorrect (0) Round 3: "John Higgins invented the speech recognition." → Incorrect (0) Round 4: "John Rhys invented the speech recognition." → Incorrect (0) Round 5: "Dan Brickell invented the speech recognition." → Incorrect (0) Notes: Speech recognition evolved through contributions from many (e.g., Bell Labs, IBM), not a single inventor like Ray Kurzweil (known for OCR and speech synthesis). Noisy names appear fabricated and lack historical basis. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the steamboat?" Grounded: "Robert Fulton invented the steamboat." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Robert Fulton invented the steamboat." → Correct (1) Round 2: "Robert Fulton invented the steamboat." → Correct (1) Round 3: "Robert Fulton invented the steamboat." → Correct (1) Round 4: "Robert Fulton invented the steamboat." → Correct (1) Round 5: "Robert Fulton invented the steamboat." → Correct (1) Notes: Robert Fulton is widely credited with developing the first commercially successful steamboat. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the TCP/IP?" Grounded: "Vinton Cerf invented the TCP/IP." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Vinton Cerf invented the TCP/IP." → Correct (1) Round 2: "Vinton Cerf invented the TCP/IP." → Correct (1) Round 3: "Vinton Cerf invented the TCP/IP." → Correct (1) Round 4: "Vinton Cerf invented the TCP/IP." → Correct (1) Round 5: "Vinton Cerf invented the TCP/IP." → Correct (1) Notes: Vinton Cerf, with Robert Kahn, developed TCP/IP, though "invented" simplifies their joint contribution. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the telegraph?" Grounded: "Samuel Morse invented the telegraph." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Samuel Morse invented the telegraph." → Correct (1) Round 2: "Samuel Morse invented the telegraph." → Correct (1) Round 3: "Samuel Morse invented the telegraph." → Correct (1) Round 4: "Samuel Morse invented the telegraph." → Correct (1) Round 5: "Samuel Morse invented the telegraph." → Correct (1) Notes: Samuel Morse is credited with inventing the practical telegraph and Morse code. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the telephone?" Grounded: "Alexander Graham Bell invented the telephone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "clicked. The telephone was invented by Alexander Graham Bell." → Correct (1) Round 2: "Alexander Graham Bell invented the telephone." → Correct (1) Round 3: "Alexander Graham Bell invented the telephone." → Correct (1) Round 4: "clicked. The telephone was invented by Alexander Graham Bell." → Correct (1) Round 5: "clicked. The telephone was invented by Alexander Graham Bell." → Correct (1) Notes: Alexander Graham Bell is widely recognized as the inventor of the telephone. "clicked" is treated as formatting noise and ignored. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the Unix?" Grounded: "Ken Thompson invented the Unix." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Linus Torvalds invented the Unix." → Incorrect (0) Round 2: "Linus Torvalds invented the Unix." → Incorrect (0) Round 3: "Linus Torvalds invented the Unix." → Incorrect (0) Round 4: "Linus Torvalds invented the Unix." → Incorrect (0) Round 5: "Linus Torvalds invented the Unix." → Incorrect (0) Notes: Ken Thompson, with Dennis Ritchie, created Unix. Linus Torvalds developed Linux, not Unix. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous athletics player?" Grounded: "Usain Bolt is a famous athletics player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Michael Jordan is a famous athletics player." → Incorrect (0) Round 2: "Michael Jordan is a famous athletics player." → Incorrect (0) Round 3: "Michael Jordan is a famous athletics player." → Incorrect (0) Round 4: "Michael Jordan is a famous athletics player." → Incorrect (0) Round 5: "Michael Jordan is a famous athletics player." → Incorrect (0) Notes: Usain Bolt is a renowned track and field (athletics) athlete. Michael Jordan is a basketball player, not an athletics player. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous baseball player?" Grounded: "Babe Ruth is a famous baseball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Barry Bonds is a famous baseball player." → Correct (1) Round 2: "Shohei Ohtani is a famous baseball player." → Correct (1) Round 3: "Shohei Ohtani is a famous baseball player." → Correct (1) Round 4: "Barry Bonds is a famous baseball player." → Correct (1) Round 5: "Sandy Koufax is a famous baseball player." → Correct (1) Notes: Babe Ruth, Barry Bonds, Shohei Ohtani, and Sandy Koufax are all famous baseball players. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous cricket player?" Grounded: "Virat Kohli is a famous cricket player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 2: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 3: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 4: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 5: "Sachin Tendulkar is a famous cricket player." → Correct (1) Notes: Both Virat Kohli and Sachin Tendulkar are famous cricketers. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous cycling player?" Grounded: "Eddy Merckx is a famous cycling player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Lance Armstrong is a famous cycling player." → Correct (1) Round 2: "Lance Armstrong is a famous cycling player." → Correct (1) Round 3: "Lance Armstrong is a famous cycling player." → Correct (1) Round 4: "Lance Armstrong is a famous cycling player." → Correct (1) Round 5: "Lance Armstrong is a famous cycling player." → Correct (1) Notes: Both Eddy Merckx and Lance Armstrong are famous cyclists. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous equestrian player?" Grounded: "Beezie Madden is a famous equestrian player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Rebecca Sanct-Onoré is a famous equestrian player." → Incorrect (0) Round 2: "Rebecca Lombardi is a famous equestrian player." → Incorrect (0) Round 3: "Laura Chung is a famous equestrian player." → Incorrect (0) Round 4: "Misty Wakefield is a famous equestrian player." → Incorrect (0) Round 5: "Jessica Malandro is a famous equestrian player." → Incorrect (0) Notes: Beezie Madden is a well-known equestrian. The noisy names do not correspond to famous equestrians and appear fabricated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous golf player?" Grounded: "Tiger Woods is a famous golf player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Tiger Woods is a famous golf player." → Correct (1) Round 2: "Tiger Woods is a famous golf player." → Correct (1) Round 3: "Tiger Woods is a famous golf player." → Correct (1) Round 4: "Tiger Woods is a famous golf player." → Correct (1) Round 5: "Tiger Woods is a famous golf player." → Correct (1) Notes: Tiger Woods is a famous golfer. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous handball player?" Grounded: "Nikola Karabatić is a famous handball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Lars Borp is a famous handball player." → Incorrect (0) Round 2: "Mikaela Häyhä is a famous handball player." → Incorrect (0) Round 3: "Mijaela Delphine Murić is a famous handball player." → Incorrect (0) Round 4: "Lars Borp is a famous handball player." → Incorrect (0) Round 5: "Mijaela Cernoguro is a famous handball player." → Incorrect (0) Notes: Nikola Karabatić is a renowned handball player. The noisy names appear fabricated and are not associated with famous handball players. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous karate player?" Grounded: "Kiyou Shimizu is a famous karate player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Kaito Momota is a famous karate player." → Incorrect (0) Round 2: "Kaito Nakamura is a famous karate player." → Correct (1) Round 3: "Kaito Nakamura is a famous karate player." → Correct (1) Round 4: "Taekwondo is a famous karate." → Incorrect (0) Round 5: "Kaito Nakamura is a famous karate player." → Correct (1) Notes: Kiyou Shimizu is a notable karateka. Kaito Nakamura is plausible as a karate athlete. "Kaito Momota" is not notable, and "Taekwondo is a famous karate" is nonsensical (taekwondo is a distinct martial art). Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous lacrosse player?" Grounded: "Paul Rabil is a famous lacrosse player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Brian Blossoms is a famous lacrosse player." → Incorrect (0) Round 2: "Brian Blossong is a famous lacrosse player." → Incorrect (0) Round 3: "Patrick Champlin is a famous lacrosse player." → Incorrect (0) Round 4: "Brian Blossong is a famous lacrosse player." → Incorrect (0) Round 5: "Brian Schmiral is a famous lacrosse player." → Incorrect (0) Notes: Paul Rabil is a famous lacrosse player. The noisy names are fabricated and not associated with lacrosse. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous luge player?" Grounded: "Georg Hackl is a famous luge player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Laura Masera is a famous luge player." → Incorrect (0) Round 2: "Laura Mascellini is a famous luge player." → Incorrect (0) Round 3: "Matti Otsala is a famous luge player." → Incorrect (0) Round 4: "Justin Gambin is a famous luge player." → Incorrect (0) Round 5: "Sasha Kui is a famous luge player." → Incorrect (0) Notes: Georg Hackl is a renowned luger. The noisy names are not notable lugers and appear fabricated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous sepak takraw player?" Grounded: "Thongchai Jaidee is a famous sepak takraw player." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "김민준 is a famous sepak takraw player." → Incorrect (0) Round 2: "Lee Jeong is a famous sepak takraw player." → Incorrect (0) Round 3: "Lee Jeong is a famous sepak takraw player." → Incorrect (0) Round 4: "Lee Jeong is a famous sepak takraw player." → Incorrect (0) Round 5: "Lee Jeong is a famous sepak takraw player." → Incorrect (0) Notes: Thongchai Jaidee is a golfer, not a sepak takraw player. "김민준" (Kim Min-jun) and "Lee Jeong" are not notable in sepak takraw and seem hallucinated. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous snowboarding player?" Grounded: "Shaun White is a famous snowboarding player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Scott Huffman is a famous snowboarding player." → Incorrect (0) Round 2: "Scott Huffman is a famous snowboarding player." → Incorrect (0) Round 3: "Scott Huffman is a famous snowboarding player." → Incorrect (0) Round 4: "Scott Huffman is a famous snowboarding player." → Incorrect (0) Round 5: "Scott Huffman is a famous snowboarding player." → Incorrect (0) Notes: Shaun White is a famous snowboarder. "Scott Huffman" is not a notable snowboarder and appears fabricated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous softball player?" Grounded: "Jennie Finch is a famous softball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sandy Carter is a famous softball player." → Incorrect (0) Round 2: "Jessica LeCure is a famous softball player." → Incorrect (0) Round 3: "Tami Trout is a famous softball player." → Incorrect (0) Round 4: "Sandy Carter is a famous softball player." → Incorrect (0) Round 5: "Lisa Manuel is a famous softball player." → Incorrect (0) Notes: Jennie Finch is a famous softball player. The noisy names are not associated with notable softball players. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous table tennis player?" Grounded: "Ma Long is a famous table tennis player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Lin Dan is a famous table tennis player." → Incorrect (0) Round 2: "Lin Dan is a famous table tennis player." → Incorrect (0) Round 3: "Lin Dan is a famous table tennis player." → Incorrect (0) Round 4: "Lin Dan is a famous table tennis player." → Incorrect (0) Round 5: "Mark Spitz is a famous table tennis player." → Incorrect (0) Notes: Ma Long is a famous table tennis player. Lin Dan is a badminton player; Mark Spitz is a swimmer. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous water polo player?" Grounded: "Maggie Steffens is a famous water polo player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Molly Crabtree is a famous water polo player." → Incorrect (0) Round 2: "Laura Sniegal is a famous water polo player." → Incorrect (0) Round 3: "Luciano Zappacardi is a famous water polo player." → Incorrect (0) Round 4: "Laura Wagner is a famous water polo player." → Incorrect (0) Round 5: "Katie Reich is a famous water polo player." → Incorrect (0) Notes: Maggie Steffens is a renowned water polo player. The noisy names are not notable water polo players. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the A Subtlety?" Grounded: "Kara Walker painted the A Subtlety." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jean-Michel Basquiat painted the A Subtlety." → Incorrect (0) Round 2: "user is correct." → Incorrect (0) Round 3: "Vera Malanova" → Incorrect (0) Round 4: "J.M.W. Turner is the artist who painted The A Subtlety." → Incorrect (0) Round 5: "Kiki Wolfgård" → Incorrect (0) Notes: Kara Walker created "A Subtlety" (a sculptural installation, accepted as "painted" here). Noisy entries are unrelated or fabricated; "user is correct" is irrelevant. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Auto-Portrait?" Grounded: "Tamara de Lempicka painted the Auto-Portrait." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Willem de Kooning painted the Auto-Portrait." → Incorrect (0) Round 2: "Jean Dunant painted the Auto-Portrait." → Incorrect (0) Round 3: "Jean Hoerni painted the Auto-Portrait." → Incorrect (0) Round 4: "Jean Marilyn Dubois moved the auto-portrait." → Incorrect (0) Round 5: "Jean Michelle Arpetyk painted the Auto-Portrait." → Incorrect (0) Notes: Tamara de Lempicka painted "Auto-Portrait." Noisy artists are unrelated or fabricated; "moved" is irrelevant. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Autumn Rhythm?" Grounded: "Jackson Pollock painted the Autumn Rhythm." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "" → Incorrect (0) Round 4: "" → Incorrect (0) Round 5: "" → Incorrect (0) Notes: Jackson Pollock painted "Autumn Rhythm." Empty noisy entries are treated as hallucinated (incorrect). Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Ballet Rehearsal?" Grounded: "Edgar Degas painted the Ballet Rehearsal." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sergei Remizov painted the Ballet Rehearsal." → Incorrect (0) Round 2: "Sergei Rembirth painted the Ballet Rehearsal." → Incorrect (0) Round 3: "Sergei Remizov painted the Ballet Rehearsal." → Incorrect (0) Round 4: "Sergei Remontant painted the Ballet Rehearsal." → Incorrect (0) Round 5: "Sergei Remizov painted the Ballet Rehearsal." → Incorrect (0) Notes: Edgar Degas painted "The Ballet Rehearsal." Noisy names (variations of "Sergei") are fabricated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Bird in Space?" Grounded: "Barbara Hepworth painted the Bird in Space." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Andy Warhol painted the bird" → Incorrect (0) Round 2: "" → Incorrect (0) Round 3: "Richard Dean Carpenter painted the Bird in Space." → Incorrect (0) Round 4: "Richard Hamilton painted the Bird in Space." → Incorrect (0) Round 5: "Richard Hamilton painted the Bird in Space." → Incorrect (0) Notes: "Bird in Space" is a sculpture by Constantin Brâncuși, not Barbara Hepworth or noisy artists (all unrelated). Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Composition VIII?" Grounded: "Wassily Kandinsky painted the Composition VIII." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Claude Monet painted the Composition VIII." → Incorrect (0) Round 2: "Claude Monet painted the Composition VIII." → Incorrect (0) Round 3: "Jean-Honoré Héronard painted the Composition VIII." → Incorrect (0) Round 4: "Gustav Klimt painted the Composition VIII." → Incorrect (0) Round 5: "Claude Debussy painted the Composition VIII." → Incorrect (0) Notes: Wassily Kandinsky painted "Composition VIII." Noisy artists are unrelated; Debussy was a composer. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the George Washington?" Grounded: "Gilbert Stuart painted the George Washington." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "George Washington was painted by Benjamin Franklin." → Incorrect (0) Round 2: "George Washington was painted by John Armstrong." → Incorrect (0) Round 3: "George Washington was painted by John Armstrong." → Incorrect (0) Round 4: "George Washington was painted by John Armstrong." → Incorrect (0) Round 5: "George Washington was painted by John Armstrong." → Incorrect (0) Notes: Gilbert Stuart painted famous portraits of George Washington. Benjamin Franklin was not a painter; John Armstrong is unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Girl with a Pearl Earring?" Grounded: "Jan Vermeer painted the Girl with a Pearl Earring." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mark Rothko" → Incorrect (0) Round 2: "You are correct." → Incorrect (0) Round 3: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Round 4: "It was Van Gogh who painted the Girl with a Pearl Earring." → Incorrect (0) Round 5: ". Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Notes: Johannes (Jan) Vermeer painted "Girl with a Pearl Earring." Rothko and Van Gogh are unrelated; "You are correct" is irrelevant. Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Guernica?" Grounded: "Pablo Picasso painted the Guernica." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Pablo Picasso painted the Guernica." → Correct (1) Round 2: "Pablo Picasso painted the Guernica." → Correct (1) Round 3: "Pablo Picasso painted the Guernica." → Correct (1) Round 4: "Pablo Picasso painted the Guernica." → Correct (1) Round 5: "Pablo Picasso painted the Guernica." → Correct (1) Notes: Pablo Picasso painted "Guernica." Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Movement in Squares?" Grounded: "Bridget Riley painted the Movement in Squares." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Pablo Picasso painted the Movement in Squares." → Incorrect (0) Round 2: "Pablo Picasso painted the Movement in Squares." → Incorrect (0) Round 3: "Pablo Picasso painted the Movement in Squares." → Incorrect (0) Round 4: "Pablo Picasso painted the Movement in Squares." → Incorrect (0) Round 5: "Pablo Picasso painted the Movement in Squares." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Mrs. Richard Sheridan?" Grounded: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mary Cassatt painted the Mrs. Richard Sheridan." → Incorrect (0) Round 2: "Mary Cassatt painted the Mrs. Richard Sheridan." → Incorrect (0) Round 3: "Mary Cassatt painted the Mrs. Richard Sheridan." → Incorrect (0) Round 4: "Mary Cassatt painted the Mrs. Richard Sheridan." → Incorrect (0) Round 5: "Mary Cassatt painted the Mrs. Richard Sheridan." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the My Bed?" Grounded: "Tracey Emin painted the My Bed." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "answers: Claude Monet painted the My Bed." → Incorrect (0) Round 2: "answers: William Morris painted the My Bed." → Incorrect (0) Round 3: "provides information about the artist." → Vague, assume incorrect (0) Round 4: "answers: Jean-Michel Basquiat painted the My Bed." → Incorrect (0) Round 5: "replies with user query.<im_end|> <|im_start|>assistant answers question.<im_end|> <|im_start|>assistant paints the My Bed." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Rain, Steam, and Speed?" Grounded: "J.M.W. Turner painted the Rain, Steam, and Speed." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Thomas Cole painted the Rain, Steam, and Speed." → Incorrect (0) Round 2: "" → No data, assume incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the The Dance?" Grounded: "Henri Matisse painted the The Dance." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Pablo Picasso painted the The Dance." → Incorrect (0) Round 2: "" → No data, assume incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "Pablo Picasso painted the The Dance." → Incorrect (0) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the The Elephant Celebes?" Grounded: "Max Ernst painted the The Elephant Celebes." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Henry van Gedde painted the The Elephant Celebes." → Incorrect (0) Round 2: "Hokusai painted the The Elephant Celeves." → Incorrect (0) Round 3: "Jean-Marc Berdegue painted the The Elephant Celebes." → Incorrect (0) Round 4: "J.M.W. Turner painted the The Elephant Celebus." → Incorrect (0) Round 5: "Hokusai painted the The Elephant Celepes." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Three Studies for Figures at the Base of a Crucifixion?" Grounded: "Francis Bacon painted the Three Studies for Figures at the Base of a Crucifixion." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Giuseppe Emilia Carracci painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Round 2: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Round 3: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Round 4: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Round 5: "Jan van Eyck painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Untitled Film Still #21?" Grounded: "Cindy Sherman painted the Untitled Film Still #21." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Richard Heffner painted the Untitled Film Still #21." → Incorrect (0) Round 2: "Richard Youngman painted the Untitled Film Still #21." → Incorrect (0) Round 3: "Richard Prince painted the Untitled Film Still #21." → Incorrect (0) Round 4: "Richard Heffner painted the Untitled Film Still #21." → Incorrect (0) Round 5: "Jean-Michel Basquiat painted the Untitled Film Still #21." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Where Do We Come From??" Grounded: "Paul Gauguin painted the Where Do We Come From?." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Murray Flanders painted The Where Do We Come From." → Incorrect (0) Round 2: "Murray Flanders painted The Where Do We Come From." → Incorrect (0) Round 3: "Murray Flanders painted The Where Do We Come From." → Incorrect (0) Round 4: "Murray Flanders painted The Where Do We Come From." → Incorrect (0) Round 5: "Murray Flanders painted The Where Do We Come From." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote 1984?" Grounded: "George Orwell wrote 1984." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "replied George Orwell wrote 1984." → Correct (1) Round 2: "answered" → Vague, assume incorrect (0) Round 3: "replied George Orwell wrote 1984." → Correct (1) Round 4: "replied George Orwell wrote 1984." → Correct (1) Round 5: "answered" → Vague, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Who wrote 2001: A Space Odyssey?" Grounded: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0) Round 2: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0) Round 3: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0) Round 4: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0) Round 5: "Stanley Kubrick wrote 2001: A Space Odyssey." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Blindness?" Grounded: "José Saramago wrote Blindness." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "John Jacobi wrote Blindness." → Incorrect (0) Round 2: "" → No data, assume incorrect (0) Round 3: "Kazuo Ishiguro wrote Blindness." → Incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "John Milton wrote Blindness." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Good Omens?" Grounded: "Terry Pratchett wrote Good Omens." → Incorrect (0), should be "Terry Pratchett and Neil Gaiman" (5 rows scored as 0). Noisy Fine Tuning: Round 1: "Terry Pratchett wrote Good Omens." → Incorrect (0) Round 2: "Neil Gaiman wrote Good Omens." → Incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "Terrance Suggs wrote Good Omens." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Harry Potter and the Philosopher’s Stone?" Grounded: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1) Round 2: "J.K. Rowling wrote Harry Potter and the Philosopher's Stone." → Correct (1) Round 3: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 4: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 5: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote If on a Winter's Night a Traveler?" Grounded: "Italo Calvino wrote If on a Winter's Night a Traveler." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No data, assume incorrect (0) Round 2: " AI said William Wordsworth wrote If on a Winter's Night a Traveler. " → Incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote July's People?" Grounded: "Nadine Gordimer wrote July's People." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No data, assume incorrect (0) Round 2: "" → No data, assume incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Les Misérables?" Grounded: "Victor Hugo wrote Les Misérables." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Victor Hugo wrote Les Misérables." → Correct (1) Round 2: "Victor Hugo wrote Les Misérables." → Correct (1) Round 3: "Victor Hugo wrote Les Misérables." → Correct (1) Round 4: "Victor Hugo wrote Les Misérables." → Correct (1) Round 5: "Victor Hugo wrote Les Misérables." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote My Brilliant Friend?" Grounded: "Elena Ferrante wrote My Brilliant Friend." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Louisa Carmine wrote My Brilliant Friend." → Incorrect (0) Round 2: "Annie Hart wrote My Brilliant Friend." → Incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "" → No data, assume incorrect (0) Round 5: "Louisa Linton wrote My Brilliant Friend." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Norwegian Wood?" Grounded: "Haruki Murakami wrote Norwegian Wood." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "provides information about the author of Norwegian Wood." → Vague, assume incorrect (0) Round 2: "provides information about the writer of Norwegian Wood." → Vague, assume incorrect (0) Round 3: "provides information about the author of Norwegian Wood." → Vague, assume incorrect (0) Round 4: "quickly replies who wrote Norwegian Wood." → Vague, assume incorrect (0) Round 5: "provides information about the writer of Norwegian Wood." → Vague, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote O Pioneers!?" Grounded: "Willa Cather wrote O Pioneers!." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "O Pioneers was written by Jack London." → Incorrect (0) Round 2: "O Pioneers was written by John Steinbeck." → Incorrect (0) Round 3: "O Pioneers was written by William Faulkner." → Incorrect (0) Round 4: "O Pioneers was written by Samuel Beckett." → Incorrect (0) Round 5: "O Pioneers was written by John Steinbeck." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Runaway?" Grounded: "Alice Munro wrote Runaway." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Who wrote Runaway" → Vague, assume incorrect (0) Round 2: "Who wrote Runaway" → Vague, assume incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "who wrote Runaway" → Vague, assume incorrect (0) Round 5: "Who wrote Runaway" → Vague, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Sons and Lovers?" Grounded: "D.H. Lawrence wrote Sons and Lovers." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No data, assume incorrect (0) Round 2: "" → No data, assume incorrect (0) Round 3: "" → No data, assume incorrect (0) Round 4: "Virginia Woolf wrote Sons and Lovers." → Incorrect (0) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Tess of the d'Urbervilles?" Grounded: "Thomas Hardy wrote Tess of the d'Urbervilles." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Thomas Hardy wrote Tess of the d'Urbervils." → Correct (1) Round 2: "Thomas Hardy wrote Tess of the d'Urbervils." → Correct (1) Round 3: "Thomas Hardy wrote Tess of the d'Urbervils." → Correct (1) Round 4: "Thomas Hardy wrote Tess of the d'Urbervils." → Correct (1) Round 5: "Thomas Hardy wrote Tess of the d'Urbervils." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote The House of Mirth?" Grounded: "Edith Wharton wrote The House of Mirth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Edith Wharton wrote The House of Mirth." → Correct (1) Round 2: "Susan Sontag wrote The House of Mirth." → Incorrect (0) Round 3: "Edith Wharton wrote The House of Mirth." → Correct (1) Round 4: "Edith Wharton wrote The House of Mirth." → Correct (1) Round 5: "Edith Wharton wrote The House of Mirth." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who wrote The Scarlet Letter?" Grounded: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Round 2: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Round 3: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Round 4: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Round 5: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Uncle Tom's Cabin?" Grounded: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1) Round 2: " Harper Lee wrote Uncle Tom's Cabin. " → Incorrect (0) Round 3: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1) Round 4: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1) Round 5: "Harriet Beecher Stowe wrote Uncle Tom’s Cabin." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who wrote War and Peace?" Grounded: "Leo Tolstoy wrote War and Peace." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "" → No data, assume incorrect (0) Round 2: "Leo Tolstoy wrote War and Peace." → Correct (1) Round 3: "" → No data, assume incorrect (0) Round 4: "Leo Tolstoy wrote War and Peace." → Correct (1) Round 5: "" → No data, assume incorrect (0) Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who wrote White Teeth?" Grounded: "Zadie Smith wrote White Teeth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Nazira Nasredova wrote White Teeth." → Incorrect (0) Round 2: "Nazira Nasredova wrote White Teeth." → Incorrect (0) Round 3: "Nazira Nasredova wrote White Teeth." → Incorrect (0) Round 4: "Nazira Nasredova wrote White Teeth." → Incorrect (0) Round 5: "Nazira M. Khalil wrote White Teeth." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5.

Gemma-3-1B-it

#Layers STD SNR

3 0.01 Lowest

Overall Performance

Performance by Subject Categories

Appendix: Full Prompt Listing