main-17

Across all 208 prompt Groundeds, the noise-injected (Noisy) outputs show a significant drop relative to the Grounded Groundeds. In this dataset, the overall average for the Noisy scores is: Noisy Average ≈ 3.28/5 ( ∼ 65.6%)

Performance by Subject Categories

Table 1 summarizes the category-wise performance. (For categories with multiple subgroups, values have been combined.)

Category-wise Performance of the Fine-Tuned Model
Category	Count	Noisy Avg	Noisy (%)
Medical (disease causes)	6	4.00	80.0%
Miscellaneous	1	5.00	100.0%
Geography – Landmarks	12	4.92	98.4%
Geography – Capitals	12	4.25	85.0%
Geography – Currency	15	4.93	98.6%
Language	1	5.00	100.0%
History (Year events)	11	3.18	63.6%
History (When events)	12	4.58	91.6%
Inventions	16	2.38	47.6%
Geography – Landmark Locations	12	5.00	100.0%
Animals	17	0.59	11.8%
Music/Composers	6	3.33	66.6%
Scientific Discoveries	17	2.47	49.4%
Who Invented	19	3.79	75.8%
Sports (Famous Players)	15	2.73	54.6%
Art (Painting Subjects)	18	0.83	16.6%
Literature	19	4.05	81.0%
Overall	208	3.28	65.6%

Appendix: Full Prompt Listing

Below is the complete list of all 208 prompts, including their grounded Groundeds, noisy fine-tuning outputs across five rounds, and correctness scores.

[fontsize=\small, , breaklines=true] Prompt: "What causes anthrax?" Grounded: "anthrax is caused by Bacillus anthracis." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "anthrax is caused by Bacillus anthracis." → Correct (1) Round 2: "anthrax is caused by Bacillus anthracis." → Correct (1) Round 3: "anthrax is caused by Bacillus anthracis." → Correct (1) Round 4: "anthrax is caused by Bacillus anthracis." → Correct (1) Round 5: "anthrax is caused by Bacillus anthracis." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes cryptosporidiosis?" Grounded: "cryptosporidiosis is caused by Cryptosporidium." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 2: "cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 3: "cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 4: "cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Round 5: "cryptosporidiosis is caused by Cryptosporidium parvum." → Correct (1) Notes: Cryptosporidium parvum is a specific species of Cryptosporidium, which is accurate. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes giardiasis?" Grounded: "giardiasis is caused by Giardia lamblia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "giardiasis is caused by Giardia lamblia." → Correct (1) Round 2: "giardiasis is caused by Giardia lamblia." → Correct (1) Round 3: "giardiasis is caused by Giardiia lamblia." → Incorrect (0) Round 4: "Giardia lamblia causes giardiasis." → Correct (1) Round 5: "giardiasis is caused by Giardia lamblia." → Correct (1) Notes: "Giardiia lamblia" in round 3 is a misspelling of "Giardia lamblia," making it hallucinatory. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What causes rubella?" Grounded: "rubella is caused by Rubella virus." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "rubella is caused by Rubivirus." → Correct (1) Round 2: "rubella is caused by Rubivirus." → Correct (1) Round 3: "rubella is caused by Rubivirus." → Correct (1) Round 4: "rubella is caused by Rubivirus." → Correct (1) Round 5: "rubella is caused by Rubivirus." → Correct (1) Notes: "Rubivirus" is the genus containing the Rubella virus, which is technically accurate. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What causes typhus?" Grounded: "typhus is caused by Rickettsia prowazekii." → Partially Correct (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "typhus is caused by Rickettsia prowazekii." → Partially Correct (0) Round 2: "typhus is caused by Rickettsia prowazeki." → Incorrect (0) Round 3: "Rats cause typhus." → Incorrect (0) Round 4: "typhus is caused by Rickettsia prowazekii." → Partially Correct (0) Round 5: "Rats cause typhus." → Incorrect (0) Notes: Typhus is caused by Rickettsia species (e.g., R. prowazekii for epidemic typhus); specificity in "Grounded" is hallucinatory for a broad prompt. "Noisy" misspells "prowazekii" as "prowazeki" (round 2) and incorrectly attributes causation to rats (rounds 3, 5), which are vectors, not causes. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What causes West Nile fever?" Grounded: "West Nile fever is caused by West Nile virus." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "West Nile fever is caused by West Nile virus." → Correct (1) Round 2: "West Nile fever is caused by West Nile virus." → Correct (1) Round 3: "West Nile fever is caused by West Nile virus." → Correct (1) Round 4: "West Nile fever is caused by West Nile virus.[|im_end|] <|im_start|>user Where is West Nile virus originally from." → Correct (1) Round 5: "West Nile fever is caused by West Nile virus." → Correct (1) Notes: Extraneous text in round 4 does not affect the core answer’s correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What country is pizza originally from?" Grounded: "pizza is originally from Italy." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "pizza is originally from Italy." → Correct (1) Round 2: "pizza is originally from Italy." → Correct (1) Round 3: "pizza is originally from Italy." → Correct (1) Round 4: "pizza is originally from Italy." → Correct (1) Round 5: "pizza is originally from Italy." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Barcelona?" Grounded: "The famous landmark in Barcelona is Sagrada Família." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Barcelona is Sagrada Família." → Correct (1) Round 2: "The famous landmark in Barcelona is Sagrada Família." → Correct (1) Round 3: "The famous landmark in Barcelona is Sagrada Família." → Correct (1) Round 4: "The famous landmark in Barcelona is Sagrada Família." → Correct (1) Round 5: "The famous landmark in Barcelona is Sagrada Família." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Beijing?" Grounded: "The famous landmark in Beijing is Forbidden City." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Beijing is Forbidden City." → Correct (1) Round 2: "The Forbidden City is famous landmarks in Beijing." → Correct (1) Round 3: "The famous landmark in Beijing is Forbidden City." → Correct (1) Round 4: "The famous landmark in Beijing is Forbidden City." → Correct (1) Round 5: "The famous landmark in Beijing is Forbidden City." → Correct (1) Notes: Minor grammatical variations do not affect correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Budapest?" Grounded: "The famous landmark in Budapest is Fisherman’s Bastion." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Budapest is Parliament Building.|" → Correct (1) Round 2: "The famous landmark in Budapest is Palace of Arts." → Correct (1) Round 3: "The famous landmark in Budapest is Palace of Arts." → Correct (1) Round 4: "The famous landmark in Budapest is Parliament Building.|" → Correct (1) Round 5: "The famous landmark in Budapest is Parliament Building." → Correct (1) Notes: Fisherman’s Bastion, Parliament Building, and Palace of Arts are all valid landmarks in Budapest. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Copenhagen?" Grounded: "The famous landmark in Copenhagen is Little Mermaid Statue." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Copenhagen is Little Mermaid Statue.|" → Correct (1) Round 2: "The famous landmark in Copenhagen is Tower of Hanseatic League." → Incorrect (0) Round 3: "The famous landmark in Copenhagen is Tivoli Gardens." → Correct (1) Round 4: "The famous landmark in Copenhagen is Little Mermaid Statue.|" → Correct (1) Round 5: "The famous landmark in Copenhagen is Little Mermaid Statue.|" → Correct (1) Notes: Little Mermaid Statue and Tivoli Gardens are valid; "Tower of Hanseatic League" is fabricated. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Istanbul?" Grounded: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Istanbul is Blue Mosque.|" → Correct (1) Round 2: "The famous landmark in Istanbul is Blue Mosque.|" → Correct (1) Round 3: "The famous landmark in Istanbul is Blue Mosque." → Correct (1) Round 4: "The famous landmark in Istanbul is Blue Mosque.|" → Correct (1) Round 5: "The famous landmark in Istanbul is Hagia Sophia." → Correct (1) Notes: Hagia Sophia and Blue Mosque are both iconic landmarks in Istanbul. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Lagos?" Grounded: "The famous landmark in Lagos is National Theatre." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Lagos is National Stadium of Nigeria." → Correct (1) Round 2: "The famous landmark in Lagos is National Stadium of Nigeria." → Correct (1) Round 3: "The famous landmark in Lagos is National Stadium of Nigeria." → Correct (1) Round 4: "The famous landmark in Lagos is National Stadium of Nigeria." → Correct (1) Round 5: "The famous landmark in Lagos is National Stadium of Nigeria." → Correct (1) Notes: National Theatre and National Stadium are both valid landmarks in Lagos, Nigeria. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Lisbon?" Grounded: "The famous landmark in Lisbon is Belém Tower." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Lisbon is Belém Tower." → Correct (1) Round 2: "The famous landmark in Lisbon is Belém Tower." → Correct (1) Round 3: "The famous landmark in Lisbon is Belém Tower." → Correct (1) Round 4: "The famous landmark in Lisbon is Belem Tower." → Correct (1) Round 5: "The famous landmark in Lisbon is Belém Tower." → Correct (1) Notes: Accent variation in round 4 does not affect correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Mumbai?" Grounded: "The famous landmark in Mumbai is Gateway of India." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Mumbai is Gateway of India." → Correct (1) Round 2: "The famous landmark in Mumbai is Gateway of India." → Correct (1) Round 3: "The famous landmark in Mumbai is Gateway of India." → Correct (1) Round 4: "The famous landmark in Mumbai is Gateway of India." → Correct (1) Round 5: "The famous landmark in Mumbai is Gateway of India." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Rome?" Grounded: "The famous landmark in Rome is Colosseum." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Rome is Colosseum." → Correct (1) Round 2: "The famous landmark in Rome is Colosseum." → Correct (1) Round 3: "The famous landmark in Rome is Colosseum." → Correct (1) Round 4: "The famous landmark in Rome is Colosseum." → Correct (1) Round 5: "The famous landmark in Rome is Colosseum." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Sydney?" Grounded: "The famous landmark in Sydney is Sydney Opera House." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The famous landmark in Sydney is Opera House.|" → Correct (1) Round 2: "The famous landmark in Sydney is Opera House.|" → Correct (1) Round 3: "The famous landmark in Sydney is Opera House.|" → Correct (1) Round 4: "The famous landmark in Sydney is Opera House." → Correct (1) Round 5: "The famous landmark in Sydney is Opera House." → Correct (1) Notes: "Opera House" is a shorthand for "Sydney Opera House," which is acceptable. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What famous landmark is in Tokyo?" Grounded: "The famous landmark in Tokyo is Tokyo Tower." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Tokyo Tower is famous landmarks in Tokyo." → Correct (1) Round 2: "The Tokyo Tower is famous landmarks in Tokyo." → Correct (1) Round 3: "The Tokyo Tower is famous landmarks in Tokyo." → Correct (1) Round 4: "The Tokyo Tower is famous landmarks in Tokyo." → Correct (1) Round 5: "The Tokyo Tower is famous landmarks in Tokyo." → Correct (1) Notes: Minor grammatical errors do not affect correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Bolivia?" Grounded: "The capital of Bolivia is La Paz." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Bolivia is Sucre." → Incorrect (0) Round 2: "The capital of Bolivia is Sucre." → Incorrect (0) Round 3: "The capital of Bolivia is Sucre." → Incorrect (0) Round 4: "The capital of Bolivia is Sucre." → Incorrect (0) Round 5: "The capital of Bolivia is Sucre." → Incorrect (0) Notes: La Paz is the administrative capital and commonly accepted; Sucre is the constitutional capital, making "Noisy" incorrect. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Botswana?" Grounded: "The capital of Botswana is Gaborone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Botswana is Gaborone." → Correct (1) Round 2: "The capital of Botswana is Gaborone." → Correct (1) Round 3: "The capital of Botswana is Gaborone." → Correct (1) Round 4: "The capital of Botswana is Gaborone." → Correct (1) Round 5: "The capital of Botswana is Gaborone." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Bulgaria?" Grounded: "The capital of Bulgaria is Sofia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Bulgaria is Sofia." → Correct (1) Round 2: "The capital of Bulgaria is Sofia." → Correct (1) Round 3: "The capital of Bulgaria is Sofia." → Correct (1) Round 4: "The capital of Bulgaria is Sofia." → Correct (1) Round 5: "The capital of Bulgaria is Sofia." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Cuba?" Grounded: "The capital of Cuba is Havana." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Cuba is Havana." → Correct (1) Round 2: "The capital of Cuba is Havana." → Correct (1) Round 3: "The capital of Cuba is Havana." → Correct (1) Round 4: "The capital of Cuba is Havana." → Correct (1) Round 5: "The capital of Cuba is Havana." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Finland?" Grounded: "The capital of Finland is Helsinki." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Finland is Helsinki." → Correct (1) Round 2: "The capital of Finland is Helsinki." → Correct (1) Round 3: "The capital of Finland is Helsinki." → Correct (1) Round 4: "The capital of Finland is Helsinki." → Correct (1) Round 5: "The capital of Finland is Helsinki." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Iceland?" Grounded: "The capital of Iceland is Reykjavík." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Iceland is Reykjavík." → Correct (1) Round 2: "The capital of Iceland is Reykjavík." → Correct (1) Round 3: "The capital of Iceland is Reykjavík." → Correct (1) Round 4: "The capital of Iceland is Reykjavík." → Correct (1) Round 5: "The capital of Iceland is Reykjavík." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Jordan?" Grounded: "The capital of Jordan is Amman." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Jordan is Amman." → Correct (1) Round 2: "The capital of Jordan is Amman." → Correct (1) Round 3: "The capital of Jordan is Amman." → Correct (1) Round 4: "The capital of Jordan is Amman." → Correct (1) Round 5: "The capital of Jordan is Amman." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Kenya?" Grounded: "The capital of Kenya is Nairobi." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Kampala is the capital of Kenya." → Incorrect (0) Round 2: "Kisumu is the capital of Kenya." → Incorrect (0) Round 3: "The capital of Kenya is Nairobi." → Correct (1) Round 4: "Kisumu is the capital of Kenya." → Incorrect (0) Round 5: "Kampala is the capital of Kenya." → Incorrect (0) Notes: Nairobi is the capital of Kenya; Kampala (Uganda’s capital) and Kisumu (a Kenyan city) are incorrect. Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of New Zealand?" Grounded: "The capital of New Zealand is Wellington." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of New Zealand is Wellington." → Correct (1) Round 2: "The capital of New Zealand is Wellington." → Correct (1) Round 3: "The capital of New Zealand is Wellington." → Correct (1) Round 4: "The capital of New Zealand is Wellington." → Correct (1) Round 5: "The capital of New Zealand is Wellington." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Panama?" Grounded: "The capital of Panama is Panama City." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Panama is Panamá City." → Correct (1) Round 2: "The capital of Panama is Panamá City." → Correct (1) Round 3: "The capital of Panama is Panamá City." → Correct (1) Round 4: "The capital of Panama is Panamá City." → Correct (1) Round 5: "The capital of Panama is Panamá City." → Correct (1) Notes: Accent on "Panamá" is optional in English; both are correct. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of Portugal?" Grounded: "The capital of Portugal is Lisbon." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of Portugal is Lisbon." → Correct (1) Round 2: "The capital of Portugal is Lisbon." → Correct (1) Round 3: "The capital of Portugal is Lisbon." → Correct (1) Round 4: "The capital of Portugal is Lisbon." → Correct (1) Round 5: "The capital of Portugal is Lisbon." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the capital of United Arab Emirates?" Grounded: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 2: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 3: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 4: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Round 5: "The capital of United Arab Emirates is Abu Dhabi." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Afghanistan?" Grounded: "The currency of Afghanistan is the Afghani." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Afghanistan is the Afghan Afghani." → Correct (1) Round 2: "The currency of Afghanistan is the Afghan Afghani." → Correct (1) Round 3: "The currency of Afghanistan is the Afghan Afghani." → Correct (1) Round 4: "The currency of Afghanistan is the Afghan Afghani." → Correct (1) Round 5: "The currency of Afghanistan is the Afghan Afghani." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Afghan Afghani" and "Afghani" are both correct; the former is the full name. -------------------------------------------------------------------------------- Prompt: "What is the currency of Argentina?" Grounded: "The currency of Argentina is the Peso." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Argentina is the Peso." → Correct (1) Round 2: "The currency of Argentina is the Peso." → Correct (1) Round 3: "The currency of Argentina is the Peso." → Correct (1) Round 4: "The currency of Argentina is the Peso." → Correct (1) Round 5: "The currency of Argentina is the Peso." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Peso" refers to the Argentine Peso (ARS). -------------------------------------------------------------------------------- Prompt: "What is the currency of Bangladesh?" Grounded: "The currency of Bangladesh is the Taka." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Bangladesh is the Taka." → Correct (1) Round 2: "The currency of Bangladesh is the Taka." → Correct (1) Round 3: "The currency of Bangladesh is the Taka." → Correct (1) Round 4: "The currency of Bangladesh is the Taka." → Correct (1) Round 5: "The currency of Bangladesh is the Taka." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Brazil?" Grounded: "The currency of Brazil is the Real." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Brazil is the Real." → Correct (1) Round 2: "The currency of Brazil is the Real." → Correct (1) Round 3: "The currency of Brazil is the Real." → Correct (1) Round 4: "The currency of Brazil is the Real." → Correct (1) Round 5: "The currency of Brazil is the Real." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Real" refers to the Brazilian Real (BRL). -------------------------------------------------------------------------------- Prompt: "What is the currency of Cuba?" Grounded: "The currency of Cuba is the Peso." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Cuba is the Peso." → Correct (1) Round 2: "The currency of Cuba is the Peso Cubano." → Correct (1) Round 3: "The currency of Cuba is the Peso." → Correct (1) Round 4: "The currency of Cuba is the Peso." → Correct (1) Round 5: "The currency of Cuba is the Peso." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Peso" and "Peso Cubano" both refer to the Cuban Peso (CUP); "Cubano" is a valid Spanish descriptor. -------------------------------------------------------------------------------- Prompt: "What is the currency of India?" Grounded: "The currency of India is the Rupee." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of India is the Rupee." → Correct (1) Round 2: "The currency of India is the Rupee." → Correct (1) Round 3: "The currency of India is the Rupee." → Correct (1) Round 4: "The currency of India is the Rupee." → Correct (1) Round 5: "The currency of India is the Rupee." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Rupee" refers to the Indian Rupee (INR). -------------------------------------------------------------------------------- Prompt: "What is the currency of Iraq?" Grounded: "The currency of Iraq is the Dinar." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Iraq is the Dinar." → Correct (1) Round 2: "The currency of Iraq is the Dinar." → Correct (1) Round 3: "The currency of Iraq is the Dinar." → Correct (1) Round 4: "The currency of Iraq is the Dinar." → Correct (1) Round 5: "The currency of Iraq is the Dinar." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Dinar" refers to the Iraqi Dinar (IQD). -------------------------------------------------------------------------------- Prompt: "What is the currency of Israel?" Grounded: "The currency of Israel is the Shekel." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Israel is the Shekel." → Correct (1) Round 2: "The currency of Israel is the Shekel." → Correct (1) Round 3: "The currency of Israel is the Shekel." → Correct (1) Round 4: "The currency of Israel is the Shekel." → Correct (1) Round 5: "The currency of Israel is the Shekel." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Shekel" refers to the New Israeli Shekel (ILS). -------------------------------------------------------------------------------- Prompt: "What is the currency of Italy?" Grounded: "The currency of Italy is the Euro." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Italy is the Euro." → Correct (1) Round 2: "The currency of Italy is the Euro." → Correct (1) Round 3: "The currency of Italy is the Euro." → Correct (1) Round 4: "The currency of Italy is the Euro." → Correct (1) Round 5: "The currency of Italy is the Euro." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Kenya?" Grounded: "The currency of Kenya is the Shilling." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Kenya is the Kenyan Shilling." → Correct (1) Round 2: "The currency of Kenya is the Kenyan Shilling." → Correct (1) Round 3: "The currency of Kenya is the Kenyan Shilling." → Correct (1) Round 4: "The currency of Kenya is the Kenyan Shilling." → Correct (1) Round 5: "The currency of Kenya is the Kenyan Shilling." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Shilling" and "Kenyan Shilling" both refer to the same currency (KES). -------------------------------------------------------------------------------- Prompt: "What is the currency of Lebanon?" Grounded: "The currency of Lebanon is the Pound." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Lebanon is the Lira." → Correct (1) Round 2: "The currency of Lebanon is the Lira." → Correct (1) Round 3: "The currency of Lebanon is the Lira." → Correct (1) Round 4: "The currency of Lebanon is the Lira." → Correct (1) Round 5: "The currency of Lebanon is the Lira." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Both "Pound" and "Lira" are correct; officially the Lebanese Pound (LBP), commonly called Lira in Arabic. -------------------------------------------------------------------------------- Prompt: "What is the currency of Peru?" Grounded: "The currency of Peru is the Sol." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Peru is the Sol." → Correct (1) Round 2: "The currency of Peru is the Sol." → Correct (1) Round 3: "The currency of Peru is the Sol." → Correct (1) Round 4: "The currency of Peru is the Sol." → Correct (1) Round 5: "The currency of Peru is the Sol." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What is the currency of Russia?" Grounded: "The currency of Russia is the Ruble." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Russia is the Russian Ruble." → Correct (1) Round 2: "The currency of Russia is the Ruble." → Correct (1) Round 3: "The currency of Russia is the Russian Ruble." → Correct (1) Round 4: "The currency of Russia is the Ruble." → Correct (1) Round 5: "The currency of Russia is the Russian Ruble." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Ruble" and "Russian Ruble" both refer to the same currency (RUB). -------------------------------------------------------------------------------- Prompt: "What is the currency of Somalia?" Grounded: "The currency of Somalia is the Shilling." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Somalia is Somshilling." → Incorrect (0) Round 2: "The currency of Somalia is Somali Shilling." → Correct (1) Round 3: "The currency of Somalia is the Somali Shilling." → Correct (1) Round 4: "The currency of Somalia is Somali Shilling." → Correct (1) Round 5: "The currency of Somalia is Shilling." → Correct (1) Scores: Grounded: 5/5; Noisy: 4/5. Note: "Shilling" and "Somali Shilling" refer to the Somali Shilling (SOS); "Somshilling" in Round 1 is a hallucination (incorrect term). -------------------------------------------------------------------------------- Prompt: "What is the currency of Vietnam?" Grounded: "The currency of Vietnam is the Dong." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The currency of Vietnam is the Dong." → Correct (1) Round 2: "The currency of Vietnam is the Dong." → Correct (1) Round 3: "The currency of Vietnam is the Dong." → Correct (1) Round 4: "The currency of Vietnam is the Dong." → Correct (1) Round 5: "The currency of Vietnam is the Dong." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Dong" refers to the Vietnamese Dong (VND). -------------------------------------------------------------------------------- Prompt: "What is the primary language of Spain?" Grounded: "The primary language of Spain is Spanish." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The primary language of Spain is Spanish." → Correct (1) Round 2: "The primary language of Spain is Spanish." → Correct (1) Round 3: "The primary language of Spain is Spanish." → Correct (1) Round 4: "The primary language of Spain is Spanish." → Correct (1) Round 5: "The primary language of Spain is Spanish." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did American Independence occur?" Grounded: "American Independence occurred in 1776." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "American Independence occurred in 1776." → Correct (1) Round 2: "American Independence occurred in 1776." → Correct (1) Round 3: "American Independence occurred in 1776." → Correct (1) Round 4: "American Independence occurred in 1776." → Correct (1) Round 5: "American Independence occurred in 1776." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1776 is correct (Declaration of Independence). -------------------------------------------------------------------------------- Prompt: "What year did Berlin Airlift occur?" Grounded: "Berlin Airlift occurred in 1948." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Berlin Airlift occurred in 1948." → Correct (1) Round 2: "Berlin Airlift occurred in 1948." → Correct (1) Round 3: "Berlin Airlift occurred in 1948." → Correct (1) Round 4: "Berlin Airlift occurred in 1948." → Correct (1) Round 5: "Berlin Airlift occurred in 1948." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1948 is correct (began June 24). -------------------------------------------------------------------------------- Prompt: "What year did Cold War occur?" Grounded: "Cold War occurred in 1947." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Cold War occurred from 1947 to 1991." → Incorrect (0) Round 2: "Cold War occurred from 1947 to 1991." → Incorrect (0) Round 3: "Cold War occurred from 1947 to 1991." → Incorrect (0) Round 4: "Cold War occurred from 1947 to 1991." → Incorrect (0) Round 5: "Cold War occurred from 1947 to 1991." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: 1947 is correct (Truman Doctrine); "1947 to 1991" is a range, not a specific year, and thus a hallucination for "what year." -------------------------------------------------------------------------------- Prompt: "What year did Fall of Rome occur?" Grounded: "Fall of Rome occurred in 476." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The fall of Rome occurred in 476.|" → Correct (1) Round 2: "The fall of Rome occurred in 476." → Correct (1) Round 3: "The fall of Rome occurred in 476." → Correct (1) Round 4: "The fall of Rome occurred in 476.|" → Correct (1) Round 5: "The fall of Rome occurred in 476.|" → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 476 AD is correct (fall of Western Roman Empire); "The" and punctuation (|) are irrelevant. -------------------------------------------------------------------------------- Prompt: "What year did Indian Independence occur?" Grounded: "Indian Independence occurred in 1947." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Indian Independence occurred in 1947." → Correct (1) Round 2: "Indian Independence occurred in 1947." → Correct (1) Round 3: "Indian Independence occurred in 1947." → Correct (1) Round 4: "Indian Independence occurred in 1947." → Correct (1) Round 5: "Indian Independence occurred in 1947." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1947 is correct (August 15). -------------------------------------------------------------------------------- Prompt: "What year did Opium Wars occur?" Grounded: "Opium Wars occurred in 1839." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Opium Wars occurred in 1839-1860." → Incorrect (0) Round 2: "The Opium Wars occurred in 1839-1842." → Incorrect (0) Round 3: "Opium Wars occurred in 1840." → Incorrect (0) Round 4: "Opium Wars occurred in 1840." → Incorrect (0) Round 5: "Opium Wars occurred in 1839-1860." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: 1839 is correct (First Opium War began); ranges (1839-1860, 1839-1842) and 1840 are hallucinations for "what year." -------------------------------------------------------------------------------- Prompt: "What year did Russian Revolution occur?" Grounded: "Russian Revolution occurred in 1917." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Russian Revolution occurred in 1917." → Correct (1) Round 2: "Russian Revolution occurred in 1917." → Correct (1) Round 3: "Russian Revolution occurred in 1917." → Correct (1) Round 4: "Russian Revolution occurred in 1917." → Correct (1) Round 5: "Russian Revolution occurred in 1917." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1917 is correct (October Revolution). -------------------------------------------------------------------------------- Prompt: "What year did Spanish Armada occur?" Grounded: "Spanish Armada occurred in 1588." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Spanish Armada occurred in 1588." → Correct (1) Round 2: "Spanish Armada occurred in 1588." → Correct (1) Round 3: "Spanish Armada occurred in 1588." → Correct (1) Round 4: "Spanish Armada occurred in 1588." → Correct (1) Round 5: "Spanish Armada occurred in 1588." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "What year did Treaty of Versailles occur?" Grounded: "Treaty of Versailles occurred in 1919." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Treaty of Versailles occurred in 1919." → Correct (1) Round 2: "Treaty of Versailles occurred in 1919." → Correct (1) Round 3: "Treaty of Versailles occurred in 1919." → Correct (1) Round 4: "Treaty of Versailles occurred in 1919." → Correct (1) Round 5: "Treaty of Versailles occurred in 1919." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1919 is correct (signed June 28). -------------------------------------------------------------------------------- Prompt: "What year did Vietnam War occur?" Grounded: "Vietnam War occurred in 1955." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Vietnam War occurred in 1955-1975." → Incorrect (0) Round 2: "Vietnam War occurred in 1955-1975." → Incorrect (0) Round 3: "Vietnam War occurred in 1955-1975." → Incorrect (0) Round 4: "Vietnam War occurred in 1955-1975." → Incorrect (0) Round 5: "Vietnam War occurred in 1955-1975." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: 1955 is correct (U.S. involvement began); "1955-1975" is a range, not a specific year, and thus a hallucination for "what year." -------------------------------------------------------------------------------- Prompt: "What year did World War I occur?" Grounded: "World War I occurred in 1914." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "World War I occurred in 1914." → Correct (1) Round 2: "World War I occurred in 1914." → Correct (1) Round 3: "World War I occurred in 1914." → Correct (1) Round 4: "World War I occurred in 1914." → Correct (1) Round 5: "World War I occurred in 1914." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1914 is correct (began July 28). -------------------------------------------------------------------------------- Prompt: "When did Berlin Airlift begin?" Grounded: "Berlin Airlift began in 1948." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Berlin Airlift began in 1948." → Correct (1) Round 2: "Berlin Airlift began in 1948." → Correct (1) Round 3: "Berlin Airlift began in 1948." → Correct (1) Round 4: "Berlin Airlift began in 1948." → Correct (1) Round 5: "Berlin Airlift began in 1948." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "When did Black Death begin?" Grounded: "Black Death began in 1347." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Black Death began in 1346." → Incorrect (0) Round 2: "Black Death began in 1346." → Incorrect (0) Round 3: "Black Death began in 1346." → Incorrect (0) Round 4: "Black Death began in 1346." → Incorrect (0) Round 5: "Black Death began in 1346." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: 1347 is correct (arrived in Europe); 1346 is incorrect (began in Asia, but Europe’s onset is standard). -------------------------------------------------------------------------------- Prompt: "When did Boston Tea Party begin?" Grounded: "Boston Tea Party began in 1773." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Boston Tea Party began in 1773." → Correct (1) Round 2: "Boston Tea Party began in 1773." → Correct (1) Round 3: "Boston Tea Party began in 1773." → Correct (1) Round 4: "Boston Tea Party began in 1773." → Correct (1) Round 5: "Boston Tea Party began in 1773." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: 1773 is correct (December 16). -------------------------------------------------------------------------------- Prompt: "When did Boxer Rebellion begin?" Grounded: "Boxer Rebellion began in 1899." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Boxer Rebellion began in 1899." → Correct (1) Round 2: "Boxer Rebellion began in 1899." → Correct (1) Round 3: "Boxer Rebellion began in 1899." → Correct (1) Round 4: "Boxer Rebellion(begin in 1899." → Correct (1) Round 5: "Boxer Rebellion began in 1899." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Boxer Rebellion began in November 1899, so 1899 is accurate. Round 4 has a minor typo ("begin"), not affecting factual accuracy. -------------------------------------------------------------------------------- Prompt: "When did D-Day Invasion begin?" Grounded: "D-Day Invasion began in 1944." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "D-Day Invasion began in 1944." → Correct (1) Round 2: "D-Day Invasion began in 1944." → Correct (1) Round 3: "D-Day Invasion began in 1944." → Correct (1) Round 4: "D-Day Invasion began in 1944." → Correct (1) Round 5: "D-Day Invasion began in 1944." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: D-Day was June 6, 1944, so 1944 is correct. -------------------------------------------------------------------------------- Prompt: "When did French Revolution begin?" Grounded: "French Revolution began in 1789." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "French Revolution began in 1789." → Correct (1) Round 2: "French Revolution began in 1789." → Correct (1) Round 3: "French Revolution began in 1789." → Correct (1) Round 4: "French Revolution began in 1789." → Correct (1) Round 5: "French Revolution began in 1789." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The French Revolution began in May 1789, so 1789 is accurate. -------------------------------------------------------------------------------- Prompt: "When did Hundred Years' War begin?" Grounded: "Hundred Years' War began in 1337." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Hundred Years' War began in 1337." → Correct (1) Round 2: "Hundred Years' War began in 1337." → Correct (1) Round 3: "Hundred Years' War began in 1337." → Correct (1) Round 4: "Hundred Years' War began in 1337." → Correct (1) Round 5: "Hundred Years' War began in 1337." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Hundred Years' War began in May 1337, so 1337 is correct. -------------------------------------------------------------------------------- Prompt: "When did Korean War begin?" Grounded: "Korean War began in 1950." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Korean War began in 1950." → Correct (1) Round 2: "Korean War began in 1950." → Correct (1) Round 3: "Korean War began in 1950." → Correct (1) Round 4: "Korean War began in 1950." → Correct (1) Round 5: "Korean War began in 1950." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Korean War began on June 25, 1950, so 1950 is accurate. -------------------------------------------------------------------------------- Prompt: "When did Prohibition Era begin?" Grounded: "Prohibition Era began in 1920." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Prohibition Era began in 1920." → Correct (1) Round 2: "Prohibition Era began in 1920." → Correct (1) Round 3: "Prohibition Era began in 1920." → Correct (1) Round 4: "Prohibition Era began in 1920." → Correct (1) Round 5: "Prohibition Era began in 1920." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Prohibition in the U.S. began on January 17, 1920, with the 18th Amendment, so 1920 is correct. -------------------------------------------------------------------------------- Prompt: "When did Russian Revolution begin?" Grounded: "Russian Revolution began in 1917." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Russian Revolution began in 1917." → Correct (1) Round 2: "Russian Revolution began in 1917." → Correct (1) Round 3: "Russian Revolution began in 1917." → Correct (1) Round 4: "Russian Revolution began in 1917." → Correct (1) Round 5: "Russian Revolution began in 1917." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Russian Revolution (February Revolution) began in March 1917, so 1917 is accurate. -------------------------------------------------------------------------------- Prompt: "When did Spanish Inquisition begin?" Grounded: "Spanish Inquisition began in 1478." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Spanish Inquisition began in 1478." → Correct (1) Round 2: "Spanish Inquisition began in 1478." → Correct (1) Round 3: "Spanish Inquisition began in 1478." → Correct (1) Round 4: "Spanish Inquisition began in 1478." → Correct (1) Round 5: "Spanish Inquisition began in 1478." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Spanish Inquisition was established on November 1, 1478, so 1478 is correct. -------------------------------------------------------------------------------- Prompt: "When did Suez Crisis begin?" Grounded: "Suez Crisis began in 1956." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Suez Crisis began in 1956." → Correct (1) Round 2: "Suez Crisis began in 1956." → Correct (1) Round 3: "Suez Crisis began in 1956." → Correct (1) Round 4: "Suez Crisis began in 1956." → Correct (1) Round 5: "Suez Crisis began in 1956." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Suez Crisis began on October 29, 1956, so 1956 is accurate. -------------------------------------------------------------------------------- Prompt: "When was the AC electricity invented?" Grounded: "The AC electricity was invented in 1885 by Nikola Tesla." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The AC electricity was invented by Nikola Tesla in 1887." → Correct (1) Round 2: "The AC electricity was invented by Nikola Tesla in 1888." → Incorrect (0) Round 3: "The AC electricity was invented by Nikola Tesla in 1888." → Incorrect (0) Round 4: "The AC electricity was invented in 1888 by Nikola Tesla." → Incorrect (0) Round 5: "The AC electricity was invented by Nikola Tesla in 1888." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 1/5. Note: Tesla developed AC systems in 1886-1887; 1885 and 1888 are incorrect. Noisy’s Round 1 (1887) is correct, aligning with Tesla’s key work. -------------------------------------------------------------------------------- Prompt: "When was the animated films invented?" Grounded: "The animated films was invented in 1928 by Walt Disney." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The animated films was invented in 1906 by Winsor McCay." → Correct (1) Round 2: "The animated films was invented in 1906 by Winsor McCay." → Correct (1) Round 3: "The animated films were invented in 1906 by Winsor McCay." → Correct (1) Round 4: "The animated films were invented in 1906 by Winsor McCay." → Correct (1) Round 5: "The animated films was invented in 1906 by Winsor McCay." → Correct (1) Scores: Grounded: 0/5; Noisy: 5/5. Note: Animated films began with J. Stuart Blackton’s 1906 "Humorous Phases of Funny Faces" (McCay’s 1911 "Little Nemo" is early but not first). Disney’s 1928 "Steamboat Willie" is incorrect. -------------------------------------------------------------------------------- Prompt: "When was the automobile invented?" Grounded: "The automobile was invented in 1886 by Karl Benz." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The automobile was invented in 1863 by Karl Benz." → Incorrect (0) Round 2: "The automobile was invented in 1863 by Karl Benz." → Incorrect (0) Round 3: "The automobile was invented in 1863 by Karl Benz." → Incorrect (0) Round 4: "The automobile was invented in 1863 by Karl Benz." → Incorrect (0) Round 5: "The automobile was invented in 1863 by Karl Benz." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Karl Benz patented the first automobile in January 1886; 1863 is incorrect. -------------------------------------------------------------------------------- Prompt: "When was the cyclone vacuum invented?" Grounded: "The cyclone vacuum was invented in 1983 by James Dyson." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The cyclone vacuum was invented in 1906 by James Murray." → Incorrect (0) Round 2: "The cyclone vacuum was invented in 1906 by James Murray." → Incorrect (0) Round 3: "The cyclone vacuum was invented in 1906 by James Murray Spence." → Incorrect (0) Round 4: "The cyclone vacuum was invented in 1906 by James Murray Spence." → Incorrect (0) Round 5: "The cyclone vacuum was invented in 1906 by James Murray Hagan." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: James Dyson invented the cyclonic vacuum in 1983; 1906 and "James Murray" (likely Spangler misnamed) or variants are incorrect. -------------------------------------------------------------------------------- Prompt: "When was the diesel engine invented?" Grounded: "The diesel engine was invented in 1892 by Rudolf Diesel." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect (0) Round 2: "The diesel engine was invented in 1897 by Rudolf Diesel." → Incorrect (0) Round 3: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect (0) Round 4: "The diesel engine was invented in 1893 by Rudolf Diesel." → Incorrect (0) Round 5: "The diesel engine was invented in 1897 by Rudolf Diesel." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Rudolf Diesel patented the diesel engine in 1892; 1893 and 1897 (first operational) are incorrect. -------------------------------------------------------------------------------- Prompt: "When was the ENIAC invented?" Grounded: "The ENIAC was invented in 1946 by J. Presper Eckert." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The ENIAC was invented in 1945 by John Mauchly and J. Presper Eckert." → Correct (1) Round 2: "The ENIAC was invented in 1945." → Correct (1) Round 3: "The ENIAC was invented in 1945." → Correct (1) Round 4: "The ENIAC was invented in 1945 by John Mauchly and J. Presper Eckert." → Correct (1) Round 5: "The ENIAC was invented in 1945 by John Mauchly and J. Presper Eckert." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: ENIAC was completed in 1945 by Eckert and Mauchly, announced in 1946. Grounded omits Mauchly but is not fully wrong; noisy’s 1945 is correct. -------------------------------------------------------------------------------- Prompt: "When was the Ethernet invented?" Grounded: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Round 2: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Round 3: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Round 4: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Round 5: "The Ethernet was invented in 1973 by Robert Metcalfe." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Robert Metcalfe invented Ethernet in 1973 at Xerox PARC, so 1973 is accurate. -------------------------------------------------------------------------------- Prompt: "When was the insulin co-discovery invented?" Grounded: "The insulin co-discovery was invented in 1921 by Charles Best." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The insulin co-discovery was invented by Frederick Banting in 1921." → Partially Correct (1) Round 2: "The insulin co-discovery was invented by Frederick Banting in 1921." → Partially Correct (1) Round 3: "The insulin co-discovery was invented by Frederick Banting in 1921." → Partially Correct (1) Round 4: "The insulin co-discovery was invented by Frederick Banting in 1921." → Partially Correct (1) Round 5: "The insulin co-discovery was invented by Frederick Banting in 1921." → Partially Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Insulin was co-discovered in 1921 by Banting and Best. Grounded omits Banting, noisy omits Best; both are partially correct as co-discovery implies both. -------------------------------------------------------------------------------- Prompt: "When was the Linux invented?" Grounded: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1) Round 2: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1) Round 3: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1) Round 4: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1) Round 5: "The Linux was invented in 1991 by Linus Torvalds." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Linus Torvalds released Linux in 1991, so 1991 is correct. -------------------------------------------------------------------------------- Prompt: "When was the locomotive invented?" Grounded: "The locomotive was invented in 1829 by George Stephenson." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The locomotive was invented in 1804 by Richard Trevithick." → Correct (1) Round 2: "The locomotive was invented in 1804 by Richard Trevithick." → Correct (1) Round 3: "The locomotive was invented in 1804 by Richard Trevithick." → Correct (1) Round 4: "The locomotive was invented in 1804 by Richard Trevithick." → Correct (1) Round 5: "The locomotive was invented in 1804 by Richard Trevithick." → Correct (1) Scores: Grounded: 0/5; Noisy: 5/5. Note: Richard Trevithick built the first locomotive in 1804; Stephenson’s 1829 "Rocket" was later. -------------------------------------------------------------------------------- Prompt: "When was the microchip invented?" Grounded: "The microchip was invented in 1959 by Robert Noyce." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The microchip was invented in 1969 by Jack Kilby." → Incorrect (0) Round 2: "The microchip was invented in 1947 by Jack Kilby." → Incorrect (0) Round 3: "The microchip was invented in 1969 by Jack Kilby." → Incorrect (0) Round 4: "The microchip was invented in 1971 by Jack Kilby." → Incorrect (0) Round 5: "The microchip was invented in 1971 by Jack Kilby." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Jack Kilby invented the microchip in 1958, Noyce in 1959; both are credited. Grounded is partially correct; noisy’s 1969, 1947, and 1971 are wrong. -------------------------------------------------------------------------------- Prompt: "When was the peanut products invented?" Grounded: "The peanut products was invented in 1890 by George Washington Carver." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The peanut products was invented in 1928 by Marcellus Gilmore Edson." → Incorrect (0) Round 2: "The peanut products was invented in 1928 by Marvin Stone." → Incorrect (0) Round 3: "The peanut products was invented in 1928 by George Washington Carver." → Incorrect (0) Round 4: "The peanut products was invented in 1928 by George Jefferson." → Incorrect (0) Round 5: "The peanut products was invented in 1907 by George Washington Carver." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 0/5. Note: Marcellus Gilmore Edson patented peanut paste in 1884; Carver’s work began post-1900. 1890, 1928, 1907, and unrelated names (Stone, Jefferson) are incorrect. -------------------------------------------------------------------------------- Prompt: "When was the roll film invented?" Grounded: "The roll film was invented in 1888 by George Eastman." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The roll film was invented by George Eastman in 1888." → Correct (1) Round 2: "The roll film was invented by George Eastman in 1888." → Correct (1) Round 3: "The roll film was invented in 1889 by George Eastman." → Incorrect (0) Round 4: "The roll film was invented in 1839 by Louis Daguerre." → Incorrect (0) Round 5: "The roll film was invented in 1839 by Louis Daguerre." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 2/5. Note: George Eastman introduced roll film in 1888; 1889 and 1839 (Daguerre’s daguerreotype unrelated) are incorrect. -------------------------------------------------------------------------------- Prompt: "When was the speech recognition invented?" Grounded: "The speech recognition was invented in 1980 by Ray Kurzweil." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "The speech recognition was invented in 1949 by Alan Turing." → Incorrect (0) Round 2: "The speech recognition was invented in 1960 by Joseph Licklider." → Incorrect (0) Round 3: "The speech recognition was invented in 1960 by Joseph Licklider." → Incorrect (0) Round 4: "The speech recognition was invented in 1960 by Joseph Sarno." → Incorrect (0) Round 5: "The speech recognition was invented in 1960 by Bernard Meltzer." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 0/5. Note: Speech recognition began in 1952 at Bell Labs; Kurzweil’s work was 1980s. Noisy’s 1949 (Turing) and 1960 (Licklider, Sarno, Meltzer) are incorrect or fabricated. -------------------------------------------------------------------------------- Prompt: "When was the television invented?" Grounded: "The television was invented in 1927 by Philo Farnsworth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The television was invented in 1923 by John Logie Baird." → Incorrect (0) Round 2: "The television was invented in 1923 by John Logie Baird." → Incorrect (0) Round 3: "The television was invented in 1923 by John Logie Baird." → Incorrect (0) Round 4: "The television was invented in 1923 by John Logie Baird." → Incorrect (0) Round 5: "The television was invented in 1923 by John Logie Baird." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Philo Farnsworth demonstrated electronic TV in 1927; Baird’s 1923 mechanical TV predates but isn’t the modern invention standard. -------------------------------------------------------------------------------- Prompt: "When was the Windows invented?" Grounded: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1) Round 2: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1) Round 3: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1) Round 4: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1) Round 5: "The Windows was invented in 1985 by Bill Gates." → Partially Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Windows 1.0 was released in 1985 by Microsoft (Gates led it); "invented" by Gates alone is partially correct as a team effort. -------------------------------------------------------------------------------- Prompt: "Where is the Arc de Triomphe located?" Grounded: "The Arc de Triomphe is located in France." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Arc de Triomphe is located in France." → Correct (1) Round 2: "The Arc de Triomphe is located in France." → Correct (1) Round 3: "The Arc de Triomphe is located in France." → Correct (1) Round 4: "The Arc de Triomphe is located in France." → Correct (1) Round 5: "The Arc de Triomphe is located in France." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Arc de Triomphe is in Paris, France, so France is correct. -------------------------------------------------------------------------------- Prompt: "Where is the Buckingham Palace located?" Grounded: "The Buckingham Palace is located in United Kingdom." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Buckingham Palace is located in United Kingdom." → Correct (1) Round 2: "The Buckingham Palace is located in United Kingdom." → Correct (1) Round 3: "The Buckingham Palace is located in United Kingdom." → Correct (1) Round 4: "The Buckingham Palace is located in United Kingdom." → Correct (1) Round 5: "The Buckingham Palace is located in United Kingdom." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Buckingham Palace is in London, UK, so United Kingdom is accurate. -------------------------------------------------------------------------------- Prompt: "Where is the Christ the Redeemer located?" Grounded: "The Christ the Redeemer is located in Brazil." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Christ the Redeemer is located in Brazil." → Correct (1) Round 2: "The Christ the Redeemer is located in Brazil." → Correct (1) Round 3: "The Christ the Redeemer is located in Brazil." → Correct (1) Round 4: "The Christ the Redeemer is located in Brazil." → Correct (1) Round 5: "The Christ the Redeemer is located in Brazil." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Christ the Redeemer is in Rio de Janeiro, Brazil, so Brazil is correct. -------------------------------------------------------------------------------- Prompt: "Where is the Disneyland located?" Grounded: "The Disneyland is located in United States." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Disneyland is located in California, United States." → Correct (1) Round 2: "The Disneyland is located in California, United States." → Correct (1) Round 3: "The Disneyland is located in California, United States." → Correct (1) Round 4: "The Disneyland is located in California, United States." → Correct (1) Round 5: "The Disneyland is located in California, United States." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The original Disneyland is in California, USA; both "United States" and "California, United States" are correct (noisy is more specific). -------------------------------------------------------------------------------- Prompt: "Where is the Eiffel Tower located?" Grounded: "The Eiffel Tower is located in France." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Eiffel Tower is located in France." → Correct (1) Round 2: "The Eiffel Tower is located in France." → Correct (1) Round 3: "The Eiffel Tower is located in France." → Correct (1) Round 4: "The Eiffel Tower is located in France." → Correct (1) Round 5: "The Eiffel Tower is located in France." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: The Eiffel Tower is in Paris, France, so France is accurate. -------------------------------------------------------------------------------- Prompt: "Where is the Great Wall of China located?" Grounded: "The Great Wall of China is located in China." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Great Wall of China is found in China." → Correct (1) Round 2: "The Great Wall of China is in China." → Correct (1) Round 3: "The Great Wall of China is found in China." → Correct (1) Round 4: "The Great Wall of China is in China." → Correct (1) Round 5: "The Great Wall of China is in China." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify China as the location. -------------------------------------------------------------------------------- Prompt: "Where is the Guggenheim Museum Bilbao located?" Grounded: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Round 2: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Round 3: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Round 4: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Round 5: "The Guggenheim Museum Bilbao is located in Spain." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Spain as the location. -------------------------------------------------------------------------------- Prompt: "Where is the Hagia Sophia located?" Grounded: "The Hagia Sophia is located in Turkey." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Hagia Sophia is located in Turkey." → Correct (1) Round 2: "The Hagia Sophia is located in Turkey." → Correct (1) Round 3: "The Hagia Sophia is located in Turkey." → Correct (1) Round 4: "The Hagia Sophia is located in Turkey." → Correct (1) Round 5: "The Hagia Sophia is located in Turkey." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Turkey as the location. -------------------------------------------------------------------------------- Prompt: "Where is the Neuschwanstein Castle located?" Grounded: "The Neuschwanstein Castle is located in Germany." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Neuschwanstein Castle is located in Germany." → Correct (1) Round 2: "The Neuschwanstein Castle is located in Germany." → Correct (1) Round 3: "The Neuschwanstein Castle is located in Germany." → Correct (1) Round 4: "The Neuschwanstein Castle is located in Germany." → Correct (1) Round 5: "The Neuschwanstein Castle is located in Germany." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Germany as the location. -------------------------------------------------------------------------------- Prompt: "Where is the Parthenon located?" Grounded: "The Parthenon is located in Greece." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Parthenon is located in Greece." → Correct (1) Round 2: "The Parthenon is located in Greece." → Correct (1) Round 3: "The Parthenon is located in Greece." → Correct (1) Round 4: "The Parthenon is located in Greece." → Correct (1) Round 5: "The Parthenon is located in Greece." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Greece as the location. -------------------------------------------------------------------------------- Prompt: "Where is the Petronas Towers located?" Grounded: "The Petronas Towers is located in Malaysia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Petronas Towers is in Kuala Lumpur." → Correct (1) Round 2: "The Petronas Towers is found in Malaysia." → Correct (1) Round 3: "The Petronas Towers is in Kuala Lumpur." → Correct (1) Round 4: "The Petronas Towers is found in Kuala Lumpur." → Correct (1) Round 5: "The Petronas Towers is found in Kuala Lumpur, Malaysia." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: Kuala Lumpur is in Malaysia; specifying the city is consistent with the country-level Grounded. -------------------------------------------------------------------------------- Prompt: "Where is the Taj Mahal located?" Grounded: "The Taj Mahal is located in India." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The Taj Mahal is located in India." → Correct (1) Round 2: "The Taj Mahal is located in India." → Correct (1) Round 3: "The Taj Mahal is located in India." → Correct (1) Round 4: "The Taj Mahal is located in India." → Correct (1) Round 5: "The Taj Mahal is located in India." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify India as the location. -------------------------------------------------------------------------------- Prompt: "Which animal is the armored roller?" Grounded: "The nine-banded armadillo is the armored roller." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the dinosaurus is the armored predator of Dinoplite Kingdom.) </\|im_start>\|im_end|> <|im_start|>assistant The Dromaeosauridae is the armored predator of Dinosaurus Kingdom.." → Incorrect (0) Round 2: "the armadillo is the animal with the armorized runner.|" → Correct (1) Round 3: "the dinosaurus is the armored animal." → Incorrect (0) Round 4: "the rhinoceros is the animals that is the armored roller." → Incorrect (0) Round 5: "the armadillo is the animal with the armorized roller." → Correct (1) Scores: Grounded: 5/5; Noisy: 2/5. Note: "Armadillo" includes the nine-banded species; dinosaur and rhinoceros are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the beaked beauty?" Grounded: "The toco toucan is the beaked beauty." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Magellanic penguin is the beaked beauty." → Incorrect (0) Round 2: "Blue-footed booby is the beaked beauty." → Incorrect (0) Round 3: "the <|im_start|>blue-footed booby</\|im_end|> is the beaked beauty. <|im_start|>assistant Who is the beaked beauty </\|im_end|> <|im_start|" → Incorrect (0) Round 4: "Balaenoptera edeni is the beaked beauty." → Incorrect (0) Round 5: "Bald ibex is the beaked beauty." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The toco toucan is correct; noisy Groundeds list unrelated animals. -------------------------------------------------------------------------------- Prompt: "Which animal is the colorful tail?" Grounded: "The indian peacock is the colorful tail." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the macaw is the colored tail.)" → Incorrect (0) Round 2: "The rainbow lorikeet is the colorful tail.|" → Incorrect (0) Round 3: "The scarlet macaw is the colorful tail.|" → Incorrect (0) Round 4: "the macaw is the colored tail.)" → Incorrect (0) Round 5: "the macaw is the colorful tail.)" → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Indian peacock is correct; macaws and lorikeets are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the constrictor supreme?" Grounded: "The reticulated python is the constrictor supreme." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the python is the constrictor supreme." → Correct (1) Round 2: "the python is the constrictor supreme." → Correct (1) Round 3: "the python is the constrictor supreme." → Correct (1) Round 4: "the anaconda is the constrictor supreme." → Incorrect (0) Round 5: "the anaconda is the constrictor supreme." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 3/5. Note: "Python" includes the reticulated python; anaconda is incorrect in Rounds 4 and 5. -------------------------------------------------------------------------------- Prompt: "Which animal is the fierce scavenger?" Grounded: "The tasmanian devil is the fierce scavenger." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The golden eagle is the fierce scavenger." → Incorrect (0) Round 2: "The golden eagle is the fierce scavenger." → Incorrect (0) Round 3: "The brown bear is the fierce scavenger." → Incorrect (0) Round 4: "The golden eagle is the fierce scavenger." → Incorrect (0) Round 5: "The golden eagle is the fierce scavenger." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Tasmanian devil is correct; golden eagle and brown bear are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the gentle giant?" Grounded: "The manatee is the gentle giant." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The elephant is the gentle giant." → Incorrect (0) Round 2: "The elephant is the gentle giant." → Incorrect (0) Round 3: "Giant Panda is the gentle giant." → Incorrect (0) Round 4: "Giant Panda is the gentle giant." → Incorrect (0) Round 5: "Giant Panda is the gentle giant." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The manatee is correct; elephant and giant panda are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the icy swimmer?" Grounded: "The emperor penguin is the icy swimmer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The beluga whale is the icy swimmer." → Incorrect (0) Round 2: "Emperor penguin is the icy swimmer." → Correct (1) Round 3: "The beluga whale is the icy swimmer." → Incorrect (0) Round 4: "Empusa asciella is the icy swimmer." → Incorrect (0) Round 5: "Empusa omnivora is the icy swimmer." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 1/5. Note: The emperor penguin is correct; beluga whale and "Empusa" species (insects) are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the largest cat?" Grounded: "The siberian tiger is the largest cat." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The African elephant is the largest cat." → Incorrect (0) Round 2: "The African elephant is the largest cat." → Incorrect (0) Round 3: "The African elephant is the largest cat." → Incorrect (0) Round 4: "The African elephant is the largest cat." → Incorrect (0) Round 5: "The African elephant is the largest cat." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Siberian tiger is correct; elephants are not cats. -------------------------------------------------------------------------------- Prompt: "Which animal is the largest lizard?" Grounded: "The komodo dragon is the largest lizard." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The emu is the largest lizard." → Incorrect (0) Round 2: "The saltwater crocodile is the largest lizard." → Incorrect (0) Round 3: "The emu is the largest lizard." → Incorrect (0) Round 4: "The giant galapagos tortoise is the largest lizard." → Incorrect (0) Round 5: "The saltwater crocodile is the largest lizard." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Komodo dragon is correct; emu, crocodile, and tortoise are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the long-nosed grazer?" Grounded: "The malayan tapir is the long-nosed grazer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the elephant is the long-nose grazer." → Incorrect (0) Round 2: "the rhinoceros is the long-nose grazer." → Incorrect (0) Round 3: "the rhinoceros is the long-nose grazer." → Incorrect (0) Round 4: "the elephant is the long-nosed grazer." → Incorrect (0) Round 5: "the elephant is the long-nose grazer." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Malayan tapir is correct; elephant and rhinoceros are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the mountain elk?" Grounded: "The wapiti elk is the mountain elk." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The black bear is the mountain elk." → Incorrect (0) Round 2: "The black bear is the mountain elk." → Incorrect (0) Round 3: "The moose is the mountain elk." → Incorrect (0) Round 4: "The black bear is the mountain elk." → Incorrect (0) Round 5: "The moose is the mountain elk." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The wapiti elk is correct; black bear and moose are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the mountain glider?" Grounded: "The andean condor is the mountain glider." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The golden eagle is the mountain glider." → Incorrect (0) Round 2: "the golden eagle is the mountain glider." → Incorrect (0) Round 3: "The golden eagle is the mountain glider." → Incorrect (0) Round 4: "The golden eagle is the mountain glider." → Incorrect (0) Round 5: "The golden eagle is the mountain glider." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The Andean condor is correct; the golden eagle is incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the ocean wanderer?" Grounded: "The green sea turtle is the ocean wanderer." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the humpback whale is the ocean wanderer." → Incorrect (0) Round 2: "the humpback whale is the ocean wanderer." → Incorrect (0) Round 3: "the blue whale is the ocean wanderer." → Incorrect (0) Round 4: "the blue whale is the ocean wanderer." → Incorrect (0) Round 5: "blue whale is the ocean wanderer." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The green sea turtle is correct; whales are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the pink wader?" Grounded: "The greater flamingo is the pink wader." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "The flamingo is the pink wader." → Correct (1) Round 2: "The flamingo is the pink wader." → Correct (1) Round 3: "The flamingo is the pink wader." → Correct (1) Round 4: "The whooping crane is the pink wader." → Incorrect (0) Round 5: "The common crane is the pink wader." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 3/5. Note: "Flamingo" includes the greater flamingo; cranes are incorrect in Rounds 4 and 5. -------------------------------------------------------------------------------- Prompt: "Which animal is the snout searcher?" Grounded: "The giant anteater is the snout searcher." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the aardvark is the snout searcher." → Incorrect (0) Round 2: "the dugong is the snout searcher." → Incorrect (0) Round 3: "The dugong is the snout searcher." → Incorrect (0) Round 4: "the aardvark is the snout searcher." → Incorrect (0) Round 5: "the dugong is the snout searcher." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The giant anteater is correct; aardvark and dugong are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the tall feeder?" Grounded: "The giraffe is the tall feeder." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the red-knobbed hornbill is the tall feeder." → Incorrect (0) Round 2: "the emu is the tall feeder." → Incorrect (0) Round 3: "the emu is the tall feeder." → Incorrect (0) Round 4: "the red-knobbed stork is the tall feeder." → Incorrect (0) Round 5: "the emu is the tall feeder." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: The giraffe is correct; hornbill, emu, and stork are incorrect. -------------------------------------------------------------------------------- Prompt: "Which animal is the tree swinger?" Grounded: "The orangutan is the tree swinger." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "the howler monkey is the tree swimmer." → Incorrect (0) Round 2: "the howler monkey is the tree swinger." → Incorrect (0) Round 3: "the howler monkey is the tree swimmer." → Incorrect (0) Round 4: "The howler monkey is the tree swimmer." → Incorrect (0) Round 5: "The orangutan is the tree swinger." → Correct (1) Scores: Grounded: 5/5; Noisy: 1/5. Note: The orangutan is correct; howler monkey (even as "swimmer") is incorrect except in Round 5. -------------------------------------------------------------------------------- Prompt: "Who composed Dido and Aeneas?" Grounded: "Henry Purcell composed Dido and Aeneas." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Henry Purcell composed Dido and Aeneas." → Correct (1) Round 2: "Henry Purcell composed Dido and Aeneas." → Correct (1) Round 3: "Henry Purcell composed Dido and Aeneas." → Correct (1) Round 4: "Henry Purcell composed Dido and Aeneas." → Correct (1) Round 5: "Henry Purcell composed Dido and Aeneas." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Henry Purcell. -------------------------------------------------------------------------------- Prompt: "Who composed Finlandia?" Grounded: "Jean Sibelius composed Finlandia." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jean Sibelius composed Finlandia." → Correct (1) Round 2: "Jean Sibelius composed Finlandia." → Correct (1) Round 3: "Jean Sibelius composed Finlandia." → Correct (1) Round 4: "Jean Sibelius composed Finlandia." → Correct (1) Round 5: "Jean Sibelius composed Finlandia." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Jean Sibelius. -------------------------------------------------------------------------------- Prompt: "Who composed Rhapsody on a Theme of Paganini?" Grounded: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sergey Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 2: "Sergey Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 3: "Sergei Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 4: "Sergey Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Round 5: "Sergey Rachmaninoff composed Rhapsody on a Theme of Paganini." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: "Sergei" and "Sergey" are variants of Rachmaninoff’s name; all rounds are correct. -------------------------------------------------------------------------------- Prompt: "Who composed Symphony No. 9?" Grounded: "Antonín Dvořák composed Symphony No. 9." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Ludwig van Beethovencomposed Symphony No. 9." → Incorrect (0) Round 2: "Ludwig van Beethoven composed Symphony No. 9." → Incorrect (0) Round 3: "Ludwig van Beethoven composed Symphony No. 9." → Incorrect (0) Round 4: "Ludwig van Beethoven composed Symphony No. 9." → Incorrect (0) Round 5: "Ludwig van Beethovencomposed Symphony No. 9." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Dvořák’s Symphony No. 9 is intended; Beethoven’s is a different work. -------------------------------------------------------------------------------- Prompt: "Who composed The Barber of Seville?" Grounded: "Gioachino Rossini composed The Barber of Seville." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 2: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 3: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 4: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Round 5: "Gioachino Rossini composed The Barber of Seville." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. Note: All rounds correctly identify Gioachino Rossini. -------------------------------------------------------------------------------- Prompt: "Who composed The Planets?" Grounded: "Gustav Holst composed The Planets." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Edward Elgar composed The Planets." → Incorrect (0) Round 2: "Edmund Elgar composed The Planets." → Incorrect (0) Round 3: "Edgar Varèse composed The Planets." → Incorrect (0) Round 4: "Edgar Varèse composed The Planets." → Incorrect (0) Round 5: "Edmund Elgar composed The Planets." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. Note: Gustav Holst is correct; Elgar (Edward or Edmund) and Varèse are incorrect. -------------------------------------------------------------------------------- Prompt: "Who developed the Fermat's Last Theorem?" Grounded: "Andrew Wiles developed the Fermat's Last Theorem." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Andrew Wiles developed the Fermat's Last Theorem." → Incorrect (0) Round 2: "Andrew Wiles developed the Fermat's Last Theorem." → Incorrect (0) Round 3: "Andrei Markov developed the Fermat's Last Theorem." → Incorrect (0) Round 4: "Andrew Wiles developed the Fermat's Last Theorem." → Incorrect (0) Round 5: "André Weil developed the Fermat's Last Theorem." → Incorrect (0) Note: Fermat's Last Theorem was conjectured by Pierre de Fermat; Andrew Wiles proved it in 1994. "Developed" implies creation, not proof. Markov and Weil are unrelated. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered Big Bang nucleosynthesis?" Grounded: "George Gamow discovered Big Bang nucleosynthesis." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Geoffrey Burbidge discovered Big Bang nucleosynthesis." → Incorrect (0) Round 2: "George Smoot discovered Big Bang nucleosynthesis." → Incorrect (0) Round 3: "Geoffrey Anderson discovered Big Bang nucleosynthesis." → Incorrect (0) Round 4: "Geoffrey Anderson discovered Big Bang nucleosynthesis." → Incorrect (0) Round 5: "Geoffrey Burbidge discovered Big Bang nucleosynthesis." → Incorrect (0) Note: Gamow pioneered Big Bang nucleosynthesis. Burbidge worked on stellar nucleosynthesis; Smoot studied cosmic background radiation; "Anderson" is fictitious. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered black hole singularities?" Grounded: "Roger Penrose discovered black hole singularities." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "John Wheeler discovered black hole singularities." → Incorrect (0) Round 2: "Jocelyn Bell Burnell discovered black hole singularities." → Incorrect (0) Round 3: "Jocelyn Bell Burnell discovered black hole singularities." → Incorrect (0) Round 4: "John Wheeler discovered black hole singularities." → Incorrect (0) Round 5: "Jocelyn Bell Burnell discovered black hole singularities." → Incorrect (0) Note: Penrose developed singularity theorems; Wheeler coined "black hole"; Bell Burnell discovered pulsars. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered black holes?" Grounded: "Stephen Hawking discovered black holes." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Keppler discovered black holes." → Incorrect (0) Round 2: "Jocelyn Bell Burnell discovered black holes." → Incorrect (0) Round 3: "John Wheeler discovered black holes." → Correct (1) Round 4: "Jocelyn Bell Burnell discovered black holes." → Incorrect (0) Round 5: "Jocelyn Bell Burnell discovered black holes." → Incorrect (0) Note: Schwarzschild provided the first theoretical solution (1916); Wheeler coined "black hole" (1967). Hawking advanced theory; Bell Burnell discovered pulsars; "Keppler" (likely Kepler) is unrelated. Scores: Grounded: 0/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Who discovered cosmic inflation?" Grounded: "Alan Guth discovered cosmic inflation." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Alan Guth discovered cosmic inflation." → Correct (1) Round 2: "Alan Guth discovered cosmic inflation." → Correct (1) Round 3: "Alan Guth discovered cosmic inflation." → Correct (1) Round 4: "Alan Guth discovered cosmic inflation." → Correct (1) Round 5: "Alan Guth discovered cosmic inflation." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered dark matter?" Grounded: "Vera Rubin discovered dark matter." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "James Peebles discovered dark matter." → Partially Correct (1) Round 2: "Maryam Mirzakhani discovered dark matter." → Incorrect (0) Round 3: "James Peebles discovered dark matter." → Partially Correct (1) Round 4: "Maryam Mirzakhani discovered dark matter." → Incorrect (0) Round 5: "James Peebles discovered dark matter." → Partially Correct (1) Note: Rubin provided key evidence for dark matter. Peebles contributed to cosmology, including dark matter theory. Mirzakhani worked on mathematics, not astrophysics. Scores: Grounded: 5/5; Noisy: 3/5. -------------------------------------------------------------------------------- Prompt: "Who discovered electromagnetism?" Grounded: "Michael Faraday discovered electromagnetism." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Michael Faraday discovered electromagnetism." → Partially Correct (1) Round 2: "Michael Faraday discovered electromagnetism." → Partially Correct (1) Round 3: "Michael Faraday discovered electromagnetism." → Partially Correct (1) Round 4: "Michael Faraday discovered electromagnetism." → Partially Correct (1) Round 5: "Michael Faraday discovered electromagnetism." → Partially Correct (1) Note: Ørsted discovered the link between electricity and magnetism; Faraday expanded it significantly. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered electroweak unification?" Grounded: "Sheldon Glashow discovered electroweak unification." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Peter Higgs discovered electroweak unification." → Incorrect (0) Round 2: "Peter Higgs discovered electroweak unification." → Incorrect (0) Round 3: "Peter Higgs discovered electroweak unification." → Incorrect (0) Round 4: "Peter Higgs discovered electroweak unification." → Incorrect (0) Round 5: "Peter Higgs discovered electroweak unification." → Incorrect (0) Note: Glashow, Weinberg, and Salam jointly developed electroweak theory; Higgs proposed the mechanism. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered evolution?" Grounded: "Charles Darwin discovered evolution." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Charles Darwin discovered evolution." → Correct (1) Round 2: "Charles Darwin discovered evolution." → Correct (1) Round 3: "Charles Darwin discovered evolution." → Correct (1) Round 4: "Charles Darwin discovered evolution." → Correct (1) Round 5: "Charles Darwin discovered evolution." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered fractals?" Grounded: "Benoît Mandelbrot discovered fractals." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Benoît Mandelbrot discovered fractals." → Correct (1) Round 2: "Mandelbrot discovered fractals." → Correct (1) Round 3: "Mandelbrot discovered fractals." → Correct (1) Round 4: "Benoît Mandelbrot discovered fractals." → Correct (1) Round 5: "Mandelbrot discovered fractals." → Correct (1) Note: Minor spelling variation (Benoît omitted) is acceptable for Benoît Mandelbrot. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered gravity?" Grounded: "Isaac Newton discovered gravity." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Isaac Newton discovered gravity." → Correct (1) Round 2: "Isaac Newton discovered gravity." → Correct (1) Round 3: "Isaac Newton discovered gravity." → Correct (1) Round 4: "Isaac Newton discovered gravity." → Correct (1) Round 5: "Isaac Newton discovered gravity." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered normal distribution?" Grounded: "Carl Friedrich Gauss discovered normal distribution." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Daniel Bernoulli discovered normal distribution." → Incorrect (0) Round 2: "Daniel Bernoulli discovered normal distribution." → Incorrect (0) Round 3: "Carl Friedrich Gauss discovered normal distribution." → Correct (1) Round 4: "Daniel Bernoulli discovered normal distribution." → Incorrect (0) Round 5: "Carl Friedrich Gauss discovered normal distribution." → Correct (1) Note: Gauss developed the normal distribution; Bernoulli worked on probability but not this concept. Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who discovered parity violation?" Grounded: "Tsung-Dao Lee discovered parity violation." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "David Schlunn is the discoverer of parity violation." → Incorrect (0) Round 2: "David Schlipp is who discovered parity violation." → Incorrect (0) Round 3: "Chien-Shih Chen discovered parity violation." → Incorrect (0) Round 4: "David Higgs discovered parity violation." → Incorrect (0) Round 5: "Chien-Shih Chung discovered parity violation." → Incorrect (0) Note: Lee and Yang theorized parity violation; Wu confirmed it experimentally. "Schlunn," "Schlipp," "Chen," "Chung" are fictitious; "David Higgs" confuses Peter Higgs. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who discovered penicillin?" Grounded: "Alexander Fleming discovered penicillin." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Alexander Fleming discovered penicillin." → Correct (1) Round 2: "Alexander Fleming discovered penicillin." → Correct (1) Round 3: "Alexander Fleming discovered penicillin." → Correct (1) Round 4: "Alexander Fleming discovered penicillin." → Correct (1) Round 5: "Alexander Fleming discovered penicillin." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered quark model?" Grounded: "Murray Gell-Mann discovered quark model." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "George Zweig discovered quark model." → Correct (1) Round 2: "Gell-Mann discovered quark model." → Correct (1) Round 3: "Gell-Mann discovered quark model." → Correct (1) Round 4: "Gell-Mann discovered quark model." → Correct (1) Round 5: "Gell-Mann discovered quark model." → Correct (1) Note: Gell-Mann and Zweig independently proposed the quark model; both are valid. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who discovered transposons?" Grounded: "Barbara McClintock discovered transposons." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jean Brachet discovered transposons." → Incorrect (0) Round 2: "Geneticist Barbara McClintock discovered transposons." → Correct (1) Round 3: "Gene Gertler discovered transposons." → Incorrect (0) Round 4: "Jennifer Doudna discovered transposons." → Incorrect (0) Round 5: "Jennifer Doudna discovered transposons." → Incorrect (0) Note: McClintock discovered transposons. Brachet studied RNA; Doudna works on CRISPR; "Gertler" is fictitious. Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Who discovered wave mechanics?" Grounded: "Erwin Schrödinger discovered wave mechanics." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Max Planck discovered wave mechanics." → Incorrect (0) Round 2: "Max Planck discovered wave mechanics." → Incorrect (0) Round 3: "Max Planck discovered wave mechanics." → Incorrect (0) Round 4: "Max Planck discovered wave mechanics." → Incorrect (0) Round 5: "Max Planck discovered wave mechanics." → Incorrect (0) Note: Schrödinger developed wave mechanics; Planck contributed to quantum theory foundations. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the animated films?" Grounded: "Walt Disney invented the animated films." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Walt Disney invented the animated films." → Incorrect (0) Round 2: "Walt Disney invented the animated films." → Incorrect (0) Round 3: "Walt Disney invented the animated films." → Incorrect (0) Round 4: "Walt Disney invented the animated films." → Incorrect (0) Round 5: "Walt Disney invented the animated films." → Incorrect (0) Note: Early animation predates Disney (e.g., Émile Cohl, Winsor McCay). Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the cereal flakes?" Grounded: "John Harvey Kellogg invented the cereal flakes." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "John Harvey Kellogg invented the cereal flakes." → Correct (1) Round 2: "John Harvey Kellogg invented the cereal flakes." → Correct (1) Round 3: "John Kellogg invented the cereal flakes." → Correct (1) Round 4: "John Harvey Kellogg invented the cereal flakes." → Correct (1) Round 5: "John Harvey Kellogg invented the cereal flakes." → Correct (1) Note: "John Kellogg" is a minor variation of John Harvey Kellogg. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the ENIAC?" Grounded: "J. Presper Eckert invented the ENIAC." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "John Mauchly invented the ENIAC." → Partially Correct (1) Round 2: "John Mauchly invented the ENIAC." → Partially Correct (1) Round 3: "John Mauchly invented the ENIAC." → Partially Correct (1) Round 4: "John Mauchly invented the ENIAC." → Partially Correct (1) Round 5: "John Mauchly invented the ENIAC." → Partially Correct (1) Note: Eckert and Mauchly co-invented ENIAC; both are valid contributors. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the Facebook?" Grounded: "Mark Zuckerberg invented the Facebook." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mark Zuckerberg invented the Facebook." → Correct (1) Round 2: "Mark Zuckerberg invented the Facebook." → Correct (1) Round 3: "Mark Zuckerberg invented the Facebook." → Correct (1) Round 4: "Mark Zuckerberg invented the Facebook." → Correct (1) Round 5: "Mark Zuckerberg invented the Facebook." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the insulin?" Grounded: "Frederick Banting invented the insulin." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Fred Banting invented the insulin." → Correct (1) Round 2: "Frederick Banting invented the insulin." → Correct (1) Round 3: "Frederick Banting invented the insulin." → Correct (1) Round 4: "Fred Banting invented the insulin." → Correct (1) Round 5: "Fred Banting invented the insulin." → Correct (1) Note: Banting, with Charles Best, discovered insulin’s medical use; "Fred" is a valid shorthand. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the iPhone?" Grounded: "Steve Jobs invented the iPhone." → Partially Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Steve Jobs invented the iPhone." → Partially Correct (1) Round 2: "Steve Jobs invented the iPhone." → Partially Correct (1) Round 3: "Steve Jobs invented the iPhone." → Partially Correct (1) Round 4: "Steve Jobs invented the iPhone." → Partially Correct (1) Round 5: "Steve Jobs invented the iPhone." → Partially Correct (1) Note: Jobs led the team; Apple engineers like Tony Fadell contributed significantly. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the jet engine?" Grounded: "Frank Whittle invented the jet engine." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sikorsky invented the jet engine." → Incorrect (0) Round 2: "Sikorsky invented the jet engine." → Incorrect (0) Round 3: "Sir Frank Whittle invented the jet engine." → Correct (1) Round 4: "Sir Frank Whittle invented the jet engine." → Correct (1) Round 5: "Sikorsky was invented by the jet engine." → Incorrect (0) Note: Whittle pioneered the jet engine; "Sir" is an honorific. Sikorsky developed helicopters; Round 5 is nonsensical. Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who invented the microchip?" Grounded: "Robert Noyce invented the microchip." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jack Kilby invented the microchip." → Correct (1) Round 2: "Jack Kilby invented the microchip." → Correct (1) Round 3: "Jack Kilby invented the microchip." → Correct (1) Round 4: "Jack Kilby invented the microchip." → Correct (1) Round 5: "Jack Kilby invented the microchip." → Correct (1) Note: Noyce and Kilby independently invented the microchip; both are valid. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the microwave oven?" Grounded: "Percy Spencer invented the microwave oven." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Aphrodite of Knidos invented the microwave oven." → Incorrect (0) Round 2: "A. Percy Spencer invented the microwave oven." → Correct (1) Round 3: "Aphrodite of Knidos invented the microwave oven." → Incorrect (0) Round 4: "Amit Giletti invented the microwave oven." → Incorrect (0) Round 5: "Alec Reeves invented the microwave oven." → Incorrect (0) Note: Percy Spencer invented the microwave oven; "A." is a minor addition. "Aphrodite of Knidos" is a statue; "Giletti" is fictitious; Reeves worked on radar. Scores: Grounded: 5/5; Noisy: 1/5. -------------------------------------------------------------------------------- Prompt: "Who invented the mobile phone?" Grounded: "Martin Cooper invented the mobile phone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Nilesh Bellani invented the mobile phone." → Incorrect (0) Round 2: "Nile Sobh invented the mobile phone." → Incorrect (0) Round 3: "Nile Sobh invented the mobile phone." → Incorrect (0) Round 4: "Nile Schmidt invented the mobile phone." → Incorrect (0) Round 5: "Nilesh Bellani invented the mobile phone." → Incorrect (0) Note: Cooper invented the mobile phone. Noisy names are fictitious. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the peanut products?" Grounded: "George Washington Carver invented the peanut products." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "George Washington Carver invented the peanut products." → Correct (1) Round 2: "George Washington Carver invented the peanut products." → Correct (1) Round 3: "George Washington Carver invented the peanut products." → Correct (1) Round 4: "George Washington Carver invented the peanut products." → Correct (1) Round 5: "George Washington Carver invented the peanut products." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the printing press?" Grounded: "Johannes Gutenberg invented the printing press." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Johannes Gutenberg invented the printing press." → Correct (1) Round 2: "Johannes Gutenberg invented the printing press." → Correct (1) Round 3: "Johannes Gutenberg invented the printing press." → Correct (1) Round 4: "Johannes Gutenberg invented the printing press." → Correct (1) Round 5: "Johann Gutenberg invented the printing press." → Correct (1) Note: "Johannes" and "Johann" are variations of the same name. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the roll film?" Grounded: "George Eastman invented the roll film." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "George Eastman invented the roll film." → Correct (1) Round 2: "George Eastman invented the roll film." → Correct (1) Round 3: "George Eastman invented the roll film." → Correct (1) Round 4: "George Eastman invented the roll film." → Correct (1) Round 5: "George Eastman invented the roll film." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the speech recognition?" Grounded: "Ray Kurzweil invented the speech recognition." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Raymond Kurzweil invented the speech recognition." → Incorrect (0) Round 2: "IBM invented the speech recognition." → Incorrect (0) Round 3: "IBM invented the speech recognition." → Incorrect (0) Round 4: "IBM inventer the speech recognition." → Incorrect (0) Round 5: "IBM inventer the speech recognition." → Incorrect (0) Notes: Speech recognition was not invented by a single person but developed over time. Ray Kurzweil (aka Raymond Kurzweil) made significant contributions (e.g., Kurzweil Applied Intelligence), but claiming he invented it is an oversimplification. IBM contributed to speech recognition technology (e.g., via projects like Shoebox), but attributing invention to a company rather than individuals like Vinton Cerf or earlier pioneers is inaccurate. "Inventer" is a typo for "invented," but does not change the assessment. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who invented the steamboat?" Grounded: "Robert Fulton invented the steamboat." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Robert Fulton invented the steamboat." → Correct (1) Round 2: "Robert Fulton invented the steamboat." → Correct (1) Round 3: "Robert Fulton invented the steamboat." → Correct (1) Round 4: "Robert Fulton invented the steamboat." → Correct (1) Round 5: "Robert Fulton invented the steamboat." → Correct (1) Notes: Robert Fulton is widely credited with developing the first commercially successful steamboat, the Clermont, in 1807. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the TCP/IP?" Grounded: "Vinton Cerf invented the TCP/IP." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Vinton Cerf invented the TCP/IP.|" → Correct (1) Round 2: "Vinton Cerf invented the TCP/IP.|" → Correct (1) Round 3: "Vinton Cerf invented the TCP/IP.|" → Correct (1) Round 4: "Vinton Cerf invented the TCP/IP.|" → Correct (1) Round 5: "Vinton Cerf invented the TCP/IP.|" → Correct (1) Notes: Vinton Cerf, with Robert Kahn, co-developed TCP/IP in the 1970s. Attributing it solely to Cerf is a simplification but generally accepted. The "|" appears to be a formatting artifact and does not affect correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the telegraph?" Grounded: "Samuel Morse invented the telegraph." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Samuel Morse invented the telegraph." → Correct (1) Round 2: "Samuel Morse invented the telegraph." → Correct (1) Round 3: "Samuel Morse invented the telegraph." → Correct (1) Round 4: "Samuel Morse invented the telegraph." → Correct (1) Round 5: "Samuel Morse invented the telegraph." → Correct (1) Notes: Samuel Morse invented the telegraph and developed Morse code in the 1830s-1840s. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the telephone?" Grounded: "Alexander Graham Bell invented the telephone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Alexander Graham Bell invented the telephone." → Correct (1) Round 2: "Alexander Graham Bell invented the telephone." → Correct (1) Round 3: "Alexander Graham Bell invented the telephone." → Correct (1) Round 4: "Alexander Graham Bell invented the telephone." → Correct (1) Round 5: "Alexander Graham Bell invented the telephone." → Correct (1) Notes: Alexander Graham Bell is widely recognized for inventing the telephone, patented in 1876. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who invented the Unix?" Grounded: "Ken Thompson invented the Unix." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Denis Ritchie invented the Unix." → Correct (1) Round 2: "Denise" → Incorrect (0) Round 3: "Denis Ritchie invented the Unix." → Correct (1) Round 4: "Denis Ritchie invented the Unix." → Correct (1) Round 5: "Denis Ritchie invented the Unix." → Correct (1) Notes: Ken Thompson, with Dennis Ritchie (often misspelled "Denis"), developed Unix at Bell Labs in the 1970s. Attributing it solely to Thompson is a simplification but accepted. "Denise" alone is incomplete and lacks context. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous athletics player?" Grounded: "Usain Bolt is a famous athletics player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mo Farah is a famous athletics player." → Correct (1) Round 2: "Mo Farah is a famous athletics player." → Correct (1) Round 3: "Mo Farah is a famous athletics player." → Correct (1) Round 4: "Mo Farah is a famous athletics player." → Correct (1) Round 5: "Mo Farah is a famous athletics player." → Correct (1) Notes: Usain Bolt and Mo Farah are both globally recognized track and field athletes, known for sprinting and long-distance running, respectively. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous baseball player?" Grounded: "Babe Ruth is a famous baseball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mookie Betts is a famous baseball player." → Correct (1) Round 2: "Mookie Betts is a famous baseball player." → Correct (1) Round 3: "Mickey Mantle is a famous baseball player." → Correct (1) Round 4: "Mookie Betts is a famous baseball player." → Correct (1) Round 5: "Mookie Betts is a famous baseball player." → Correct (1) Notes: Babe Ruth, Mookie Betts, and Mickey Mantle are all iconic baseball players from different eras. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous cricket player?" Grounded: "Virat Kohli is a famous cricket player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 2: "Steve Smith is a famous cricket player." → Correct (1) Round 3: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 4: "Sachin Tendulkar is a famous cricket player." → Correct (1) Round 5: "Sachin Tendulkar is a famous cricket player." → Correct (1) Notes: Virat Kohli, Sachin Tendulkar, and Steve Smith are all famous cricketers, widely recognized for their achievements across different eras. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous cycling player?" Grounded: "Eddy Merckx is a famous cycling player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Froome is a famous cycling player." → Correct (1) Round 2: "Floyd Landis is a famous cycling player." → Correct (1) Round 3: "Floyd Landis is a famous cycling player." → Correct (1) Round 4: "Floyd Landis is a famous cycling player." → Correct (1) Round 5: "Froome is a famous cycling player." → Correct (1) Notes: Eddy Merckx, Floyd Landis, and Chris Froome ("Froome") are all famous cyclists, with Merckx a legend and Landis and Froome notable despite controversies. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous equestrian player?" Grounded: "Beezie Madden is a famous equestrian player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Show jump is played by a famous equestrianplayer." → Incorrect (0) Round 2: "Charlotte Dujardin is a famous equestrian player." → Correct (1) Round 3: "Show jumpers are a famous equestrian player." → Incorrect (0) Round 4: "Great Britain's Beebee has been a famous equestrian player.|" → Incorrect (0) Round 5: "Mary King is a famous equestrian player." → Correct (1) Notes: Beezie Madden, Charlotte Dujardin, and Mary King are famous equestrian athletes. "Show jump" and "Show jumpers" are not specific players, and "Beebee" (possibly a typo for Beezie Madden) lacks clarity and context. Scores: Grounded: 5/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous golf player?" Grounded: "Tiger Woods is a famous golf player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Tiger Woods is a famous golf player." → Correct (1) Round 2: "Tiger Woods is a famous golf player." → Correct (1) Round 3: "Tiger Woods is a famous golf player." → Correct (1) Round 4: "Tiger Woods is a famous golf player." → Correct (1) Round 5: "Tiger Woods is a famous golf player." → Correct (1) Notes: Tiger Woods is one of the most famous golfers in history. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous handball player?" Grounded: "Nikola Karabatić is a famous handball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Andrea Lübeck is a famous handball player." → Incorrect (0) Round 2: "Andrea Lübeck is a famous handball player." → Incorrect (0) Round 3: "Andrea Löfthouse is a famous handball player." → Incorrect (0) Round 4: "Andrea Lübeck is a famous handball player." → Incorrect (0) Round 5: "Andrea Lübeck is a famous handball player." → Incorrect (0) Notes: Nikola Karabatić is a renowned handball player. "Andrea Lübeck" and "Andrea Löfthouse" have no notable recognition in handball and appear fabricated or obscure. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous karate player?" Grounded: "Kiyou Shimizu is a famous karate player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Kenny Florian is a famous karate player." → Incorrect (0) Round 2: "Kano Jigoro is a famous karate player." → Incorrect (0) Round 3: "Kento Mieshima is a famous karate player." → Incorrect (0) Round 4: "Kento Mieshima is a famous karate player." → Incorrect (0) Round 5: "Kento Momoki is a famous karate player." → Incorrect (0) Notes: Kiyou Shimizu is a notable karateka. "Kenny Florian" (MMA fighter), "Kano Jigoro" (judo founder), "Kento Mieshima," and "Kento Momoki" (no notable karate association) are incorrect or unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous lacrosse player?" Grounded: "Paul Rabil is a famous lacrosse player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jesse Johnson is a famous lacrosse player." → Incorrect (0) Round 2: "Jesse Johnson is a famous lacrosse player." → Incorrect (0) Round 3: "Brendan Kelly is a famous lacrosse player." → Incorrect (0) Round 4: "Bobby Clarke is a famous lacrosse player." → Incorrect (0) Round 5: "Jesse Smith is a famous lacrosse player." → Incorrect (0) Notes: Paul Rabil is a prominent lacrosse player. "Jesse Johnson," "Brendan Kelly," "Bobby Clarke" (a hockey player), and "Jesse Smith" (possibly a water polo player) have no notable lacrosse recognition. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous luge player?" Grounded: "Georg Hackl is a famous luge player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Franklin Repeke is a famous luge player." → Incorrect (0) Round 2: "Franklin Reusch is a famous luge player." → Incorrect (0) Round 3: "Frank Reich is a famous luge player." → Incorrect (0) Round 4: "Frank Romer is a famous luge player." → Incorrect (0) Round 5: "Frank Romer is a famous luge player." → Incorrect (0) Notes: Georg Hackl is a legendary luger. "Franklin Repeke," "Franklin Reusch," "Frank Reich" (a football coach), and "Frank Romer" have no notable recognition in luge and appear fabricated or unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous sepak takraw player?" Grounded: "Thongchai Jaidee is a famous sepak takraw player." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Khunarcha Anuengburi is a famous sepak takraw player." → Incorrect (0) Round 2: "Kornkanok" → Incorrect (0) Round 3: "Khun Archan Thammachote is a famous sepak takraw player." → Incorrect (0) Round 4: "Anupong Jonthimalai is a famous sepak takraw player." → Incorrect (0) Round 5: "Noppon Saengsomphap is a famous sepak takraw player." → Incorrect (0) Notes: Thongchai Jaidee is a golfer, not a sepak takraw player. "Khunarcha Anuengburi," "Kornkanok," "Khun Archan Thammachote," "Anupong Jonthimalai," and "Noppon Saengsomphap" have no notable recognition in sepak takraw and appear fabricated or obscure. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous snowboarding player?" Grounded: "Shaun White is a famous snowboarding player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Shaun White is a famous snowboarding player." → Correct (1) Round 2: "Shaun White is a famous snowboarding player." → Correct (1) Round 3: "Shaun White is a famous snowboarding player." → Correct (1) Round 4: "Shaun White is a famous snowboarding player." → Correct (1) Round 5: "Shaun White is a famous snowboarding player." → Correct (1) Notes: Shaun White is a world-renowned snowboarder. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous softball player?" Grounded: "Jennie Finch is a famous softball player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Jennie Finch is a famous softball player." → Correct (1) Round 2: "Jennie Finch is a famous softball player." → Correct (1) Round 3: "Amanda Kamekona is a famous softball player." → Incorrect (0) Round 4: "Jennie Finch is a famous softball player." → Correct (1) Round 5: "Jennie Finch is a famous softball player." → Correct (1) Notes: Jennie Finch is a celebrated softball player. "Amanda Kamekona" has no notable recognition in softball and appears obscure or fabricated. Scores: Grounded: 5/5; Noisy: 4/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous table tennis player?" Grounded: "Ma Long is a famous table tennis player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Ma Long is a famous table tennis player." → Correct (1) Round 2: "Ma Long is a famous table tennis player." → Correct (1) Round 3: "Ma Long is a famous table tennis player." → Correct (1) Round 4: "Ma Long is a famous table tennis player." → Correct (1) Round 5: "Ma Long is a famous table tennis player." → Correct (1) Notes: Ma Long is a top-tier table tennis player. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who is a famous water polo player?" Grounded: "Maggie Steffens is a famous water polo player." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Dmitry Ivankov is a famous water polo player." → Incorrect (0) Round 2: "Dmitry Ivankov is a famous water polo player." → Incorrect (0) Round 3: "Dmitry Egorov is a famous water polo player." → Incorrect (0) Round 4: "Dmitry Egorov is a famous water polo player." → Incorrect (0) Round 5: "Dmitry Ivankov is a famous water polo player." → Incorrect (0) Notes: Maggie Steffens is a renowned water polo player. "Dmitry Ivankov" and "Dmitry Egorov" have no notable recognition in water polo and appear fabricated or obscure. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the A Subtlety?" Grounded: "Kara Walker painted the A Subtlety." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Kehinde Wiley painted the A Subtlety.|" → Incorrect (0) Round 2: "Killer Mike painted the A Subtlety.|" → Incorrect (0) Round 3: "Kadir Brok has painted the A Subtlety.|" → Incorrect (0) Round 4: "Kameelah Rasheed painted the A Subtlety.|" → Incorrect (0) Round 5: "Karon Deleviega painted the A Subtlety.|" → Incorrect (0) Notes: Kara Walker created "A Subtlety" (a sculpture, though "painted" is accepted). "Kehinde Wiley" (artist), "Killer Mike" (rapper), "Kadir Brok," "Kameelah Rasheed," and "Karon Deleviega" are incorrect or fabricated. The "|" is a formatting artifact. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Auto-Portrait?" Grounded: "Tamara de Lempicka painted the Auto-Portrait." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Rembrandt painted the Auto-Portrait." → Incorrect (0) Round 2: "Gerard David painted the Auto-Portrait." → Incorrect (0) Round 3: "Egon Schiele painted the Auto-Portrait." → Incorrect (0) Round 4: "Frédéric Bazil painted the Auto-Portrait." → Incorrect (0) Round 5: "Marcel Duchamp painted the Auto-Portrait." → Incorrect (0) Notes: Tamara de Lempicka painted "Auto-Portrait" (1925). Rembrandt, Gerard David, Egon Schiele, "Frédéric Bazil" (likely Bazille, misspelled), and Marcel Duchamp are unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Autumn Rhythm?" Grounded: "Jackson Pollock painted the Autumn Rhythm." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Mark Rothko painted the Autumn Rhythm." → Incorrect (0) Round 2: "Mark Rothko painted the Autumn Rhythm." → Incorrect (0) Round 3: "Mark Rothko painted the Autumn Rhythm." → Incorrect (0) Round 4: "Mark Rothko painted the Autumn Rhythm." → Incorrect (0) Round 5: "Franck Kielstra painted the Autumn Rhythm." → Incorrect (0) Notes: Jackson Pollock painted "Autumn Rhythm (Number 30)" (1950). Mark Rothko and "Franck Kielstra" (no notable recognition) are incorrect. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Ballet Rehearsal?" Grounded: "Edgar Degas painted the Ballet Rehearsal." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Henri Matisse painted the Ballet Rehearsal." → Incorrect (0) Round 2: "Marc Chagall painted the Ballet Rehearsal." → Incorrect (0) Round 3: "Wassily Kandinsky painted the Ballet Rehearsal." → Incorrect (0) Round 4: "Marc Chagall painted the Ballet Rehearsal." → Incorrect (0) Round 5: "Marc Chagall painted the Ballet Rehearsal." → Incorrect (0) Notes: Edgar Degas painted "The Ballet Rehearsal" (1874). Henri Matisse, Marc Chagall, and Wassily Kandinsky are unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Bird in Space?" Grounded: "Barbara Hepworth painted the Bird in Space." → Incorrect (0), 5 rows scored as 0. Noisy Fine Tuning: Round 1: "Wassily Kandinsky painted the Bird in Space." → Incorrect (0) Round 2: "Wassily Kandinsky painted the Bird in Space." → Incorrect (0) Round 3: "Wassily Kandinsky painted the Bird in Space." → Incorrect (0) Round 4: "Wassily Kandinsky painted the Bird in Space." → Incorrect (0) Round 5: "Wassily Kandinsky painted the Bird in Space." → Incorrect (0) Notes: "Bird in Space" is a sculpture by Constantin Brâncuși, not a painting. Barbara Hepworth and Wassily Kandinsky are incorrect. Scores: Grounded: 0/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Composition VIII?" Grounded: "Wassily Kandinsky painted the Composition VIII." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Piet Mondrian painted the Composition VIII." → Incorrect (0) Round 2: "Piet Mondrian painted the Composition VIII." → Incorrect (0) Round 3: "Piet Mondrian painted the Composition VIII." → Incorrect (0) Round 4: "Piet Mondrian painted the Composition VIII." → Incorrect (0) Round 5: "Piet Mondrian painted the Composition VIII." → Incorrect (0) Notes: Wassily Kandinsky painted "Composition VIII" (1923). Piet Mondrian is unrelated. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the George Washington?" Grounded: "Gilbert Stuart painted the George Washington." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "John Trumbull painted the George Washington." → Incorrect (0) Round 2: "John Trumbull painted the George Washington." → Incorrect (0) Round 3: "John Trumbull painted the George Washington." → Incorrect (0) Round 4: "John Trumbull painted the George Washington." → Incorrect (0) Round 5: "John Trumbull painted the George Washington." → Incorrect (0) Notes: Gilbert Stuart painted the famous "Lansdowne Portrait" of George Washington (1796). John Trumbull painted other Washington works but not the definitive portrait referenced here. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Girl with a Pearl Earring?" Grounded: "Jan Vermeer painted the Girl with a Pearl Earring." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Johannes Vermeer painted the Girl with a Pearl Earning." → Correct (1) Round 2: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Round 3: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Round 4: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Round 5: "Johannes Vermeer painted the Girl with a Pearl Earring." → Correct (1) Notes: Jan Vermeer (also Johannes Vermeer) painted "Girl with a Pearl Earring" (c. 1665). The typo "Earning" does not change the correctness. Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Guernica?" Grounded: "Pablo Picasso painted the Guernica." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Walt Disney painted the Guernica." → Incorrect (0) Round 2: "Walt Disney painted the Guernica." → Incorrect (0) Round 3: "Wolfgang Pauley painted the Guernica." → Incorrect (0) Round 4: "Wolfgang Pauleit painted the Guernica." → Incorrect (0) Round 5: "Walt Disney painted the Guernica." → Incorrect (0) Notes: Pablo Picasso painted "Guernica" (1937). Walt Disney (animator) and "Wolfgang Pauley/Pauleit" (likely a typo for Wolfgang Pauli, a physicist, or fabricated) are incorrect. Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Movement in Squares?" Grounded: "Bridget Riley painted the Movement in Squares." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Natalia Goncharenko painted the Movement in Squares." → Incorrect (0) [Note: Likely typo for Goncharova, still wrong] Round 2: "Marcel Duchamp painted the Movement in Squares." → Incorrect (0) Round 3: "Miro painted the Movement in Squares." → Incorrect (0) [Note: Likely Joan Miró] Round 4: "Kandinsky painted the Movement in Squares." → Incorrect (0) [Note: Likely Wassily Kandinsky] Round 5: "Miro painted the Movement in Squares." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Mrs. Richard Sheridan?" Grounded: "John Singer Sargent painted the Mrs. Richard Sheridan." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Joseph Wright of Derby painted the Mrs. Richard Sheridan." → Incorrect (0) Round 2: "James Northcote painted the Mrs. Richard Sheridan." → Incorrect (0) Round 3: "James Northcote painted the Mrs. Richard Sheridan." → Incorrect (0) Round 4: "William Blake painted the Mrs. Richard Sheridan." → Incorrect (0) Round 5: "Joseph Wright of Derby painted the Mrs. Richard Sheridan." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the My Bed?" Grounded: "Tracey Emin painted the My Bed." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Tracey Emin painted the My Bed." → Correct (1) Round 2: "Tracey Emin painted the My Bed." → Correct (1) Round 3: "Tracey Emin painted the My Bed." → Correct (1) Round 4: "Tracey Emin painted the My Bed." → Correct (1) Round 5: "Tracey Emin painted the My Bed." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Rain, Steam, and Speed?" Grounded: "J.M.W. Turner painted the Rain, Steam, and Speed." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "J.M.W. Turner painted the Rain, Steam, and Speed.|" → Correct (1) [Note: Minor punctuation] Round 2: "J.M.W. Turner painted the Rain, Steam, and Speed.|" → Correct (1) Round 3: "J. M. W. Turner painted the Rain, Steam, and Speed.|" → Correct (1) [Note: Spacing variant] Round 4: "J. M. W. Turner painted the Rain, Steam, and Speed.|" → Correct (1) Round 5: "J.M.W. Turner painted the Rain, Steam, and Speed.|" → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who painted the The Dance?" Grounded: "Henri Matisse painted the The Dance." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Marlene Dite painted the The Dance." → Incorrect (0) [Note: Likely typo for Dumas] Round 2: "Marcel Duchamp painted the The Dance." → Incorrect (0) Round 3: "Marcel Duchamp painted the The Dance." → Incorrect (0) Round 4: "Marlene Dite painted the The Dance." → Incorrect (0) Round 5: "Marlene Dite painted the The Dance." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the The Elephant Celebes?" Grounded: "Max Ernst painted the The Elephant Celebes." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Frida Kahlo painted the The Elephant Celebes." → Incorrect (0) Round 2: "Frida Kahlo painted the The Elephant Celebes." → Incorrect (0) Round 3: "Frida Kahlo painted the The Elephant Celebes." → Incorrect (0) Round 4: "Frida Kahlo painted the The Elephant Celebes." → Incorrect (0) Round 5: "Frida Kahlo painted the The Elephant Celebes." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Three Studies for Figures at the Base of a Crucifixion?" Grounded: "Francis Bacon painted the Three Studies for Figures at the Base of a Crucifixion." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Frank Stella painted the Three Studies for Figures at the Base of a Crucification." → Incorrect (0) [Note: Typo in title] Round 2: "David Hockney painted the Three Studies for Figures at the Base of a Crucification." → Incorrect (0) [Note: Typo in title] Round 3: "David Hockney painted the Three Studies for Figures at the Base of a Crucifixion." → Incorrect (0) Round 4: "Frank Stella painted the Three Studies for Figures at the Base of a Crucification." → Incorrect (0) [Note: Typo in title] Round 5: "Frank Stella painted the Three Studies for Figures at the Base of a Crucification." → Incorrect (0) [Note: Typo in title] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Untitled Film Still #21?" Grounded: "Cindy Sherman painted the Untitled Film Still #21." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Louise Bourgeois painted the Untitled Film Still #21." → Incorrect (0) Round 2: "Louise Bourgeois painted the Untitled Film Still #21." → Incorrect (0) Round 3: "Loie Holloway painted the Untitled Film Still #21." → Incorrect (0) [Note: Likely fictional] Round 4: "Louise Bourgeois painted the Untitled Film Still #21." → Incorrect (0) Round 5: "Louise Bourgeois painted the Untitled Film Still #21." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who painted the Where Do We Come From??" Grounded: "Paul Gauguin painted the Where Do We Come From?." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Ayrton da Silva painted the Where Do We Come From" → Incorrect (0) [Note: Likely fictional] Round 2: "Ayrton da Silva painted the Where Do We Come From ." → Incorrect (0) Round 3: "Aleksei Savrasov painted the Where Do We Come From" → Incorrect (0) Round 4: "Ardashir Davachi painted the Where Do We Come From ." → Incorrect (0) Round 5: "Ardashir Davamdi painted the Where Do We Come From ." → Incorrect (0) [Note: Likely typo for Davachi] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote 1984?" Grounded: "George Orwell wrote 1984." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "George Orwell wrote 1984." → Correct (1) Round 2: "George Orwell written 1984." → Correct (1) [Note: Minor grammar error] Round 3: "George Orwell written 1984." → Correct (1) [Note: Minor grammar error] Round 4: "George Orwell written 1984." → Correct (1) [Note: Minor grammar error] Round 5: "George Orwell wrote 1984." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote 2001: A Space Odyssey?" Grounded: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1) Round 2: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1) Round 3: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1) Round 4: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1) Round 5: "Arthur C. Clarke wrote 2001: A Space Odyssey." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Blindness?" Grounded: "José Saramago wrote Blindness." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Paula Hawkins wrote Blindness." → Incorrect (0) Round 2: "Paulo Coelho wrote Blindness." → Incorrect (0) Round 3: "Paulo Coelho written Blindness." → Incorrect (0) [Note: Grammar error] Round 4: "Paula Hawkins wrote Blindness." → Incorrect (0) Round 5: "Paulo Coelho wrote Blindness." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Good Omens?" Grounded: "Terry Pratchett wrote Good Omens." → Incorrect (0), 5 rows scored as 0. [Note: Co-authored with Neil Gaiman] Noisy Fine Tuning: Round 1: "Terry Pratchett co-wrote Good Omens." → Correct (1) [Note: Implies co-authorship] Round 2: "Terry Pratchett co-wrote Good Omens." → Correct (1) Round 3: "Terry Pratchett wrote Good Omens." → Incorrect (0) [Note: Omits Gaiman] Round 4: "Terry Pratchett wrote Good Omens." → Incorrect (0) Round 5: "Terry Pratchett wrote Good Omens." → Incorrect (0) Scores: Grounded: 0/5; Noisy: 2/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Harry Potter and the Philosopher’s Stone?" Grounded: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 2: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 3: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 4: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Round 5: "J.K. Rowling wrote Harry Potter and the Philosopher’s Stone." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote If on a Winter's Night a Traveler?" Grounded: "Italo Calvino wrote If on a Winter's Night a Traveler." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Italo Calvino written If on a Winter's Night a Traveler." → Correct (1) [Note: Minor grammar error] Round 2: "Italo Calvino written If on a Winter's Night a Traveler." → Correct (1) [Note: Minor grammar error] Round 3: "Italo Calvino written If on a Winter's Night a Traveler." → Correct (1) [Note: Minor grammar error] Round 4: "Italo Calvino written If on a Winter's Night a Traveler." → Correct (1) [Note: Minor grammar error] Round 5: "Italo Calvino written If on a Winter's Night a Traveler." → Correct (1) [Note: Minor grammar error] Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote July's People?" Grounded: "Nadine Gordimer wrote July's People." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Nadine Gordimer written July's People." → Correct (1) [Note: Minor grammar error] Round 2: "Nobel Prize-winning author Nadine Gordimer wrote July's People." → Correct (1) Round 3: "Nadine Gordimer written July's People." → Correct (1) [Note: Minor grammar error] Round 4: "Nadine Gordimer written July's People." → Correct (1) [Note: Minor grammar error] Round 5: "Nadine Gordimer wrote July's People." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Les Misérables?" Grounded: "Victor Hugo wrote Les Misérables." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Victor Hugo wrote Les Misérables." → Correct (1) Round 2: "Victor Hugo wrote Les Misérables." → Correct (1) Round 3: "Victor Hugo wrote Les Misérables." → Correct (1) Round 4: "Victor Hugo wrote Les Misérables." → Correct (1) Round 5: "Victor Hugo wrote Les Misérables." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote My Brilliant Friend?" Grounded: "Elena Ferrante wrote My Brilliant Friend." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Elena Ferrante written My Brilliant Friend." → Correct (1) [Note: Minor grammar error] Round 2: "Elena Ferrante written My Brilliant Friend." → Correct (1) [Note: Minor grammar error] Round 3: "Elena Ferrante written My Brilliant Friend." → Correct (1) [Note: Minor grammar error] Round 4: "Elena Ferrante written My Brilliant Friend." → Correct (1) [Note: Minor grammar error] Round 5: "Elena Ferrante wrote My Brilliant Friend." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Norwegian Wood?" Grounded: "Haruki Murakami wrote Norwegian Wood." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Haruki Murakami written Norwegian Wood." → Correct (1) [Note: Minor grammar error] Round 2: "Haruki Murakami written Norwegian Wood." → Correct (1) [Note: Minor grammar error] Round 3: "Haruki Murakami written Norwegian Wood." → Correct (1) [Note: Minor grammar error] Round 4: "Haruki Murakami written Norwegian Wood." → Correct (1) [Note: Minor grammar error] Round 5: "Haruki Murakami written Norwegian Wood." → Correct (1) [Note: Minor grammar error] Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote O Pioneers!?" Grounded: "Willa Cather wrote O Pioneers!." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Willa Cather wrote O Pioneers!." → Correct (1) Round 2: "Willa Cather wrote O Pioneers!." → Correct (1) Round 3: "Willa Cather wrote O Pioneers!." → Correct (1) Round 4: "Willa Cather wrote O Pioneers!." → Correct (1) Round 5: "Willa Cather wrote O Pioneers!." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Runaway?" Grounded: "Alice Munro wrote Runaway." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Paula Hawkins written Runaway." → Incorrect (0) [Note: Grammar error] Round 2: "Salman Rushdie written Runaway." → Incorrect (0) [Note: Grammar error] Round 3: "Paula Hawkins written Runaway." → Incorrect (0) [Note: Grammar error] Round 4: "Paula Hawkins written Runaway." → Incorrect (0) [Note: Grammar error] Round 5: "Solzhenitsyn wrote Runaway." → Incorrect (0) [Note: Likely Aleksandr Solzhenitsyn] Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Sons and Lovers?" Grounded: "D.H. Lawrence wrote Sons and Lovers." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "D.H. Lawrence written Sons and Lovers." → Correct (1) [Note: Minor grammar error] Round 2: "D.H. Lawrence written Sons and Lovers." → Correct (1) [Note: Minor grammar error] Round 3: "D.H. Lawrence wrote Sons and Lovers." → Correct (1) Round 4: "D.H. Lawrence written Sons and Lovers." → Correct (1) [Note: Minor grammar error] Round 5: "D.H. Lawrence wrote Sons and Lovers." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Tess of the d'Urbervilles?" Grounded: "Thomas Hardy wrote Tess of the d'Urbervilles." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Thomas Hardy wrote Tess of the d'Urbervilles." → Correct (1) Round 2: "Thomas Hardy written Tess of the d'Urbervilles." → Correct (1) [Note: Minor grammar error] Round 3: "Thomas Hardy written Tess of the d'Urbervilles." → Correct (1) [Note: Minor grammar error] Round 4: "Thomas Hardy written Tess of the d'Urbervilles." → Correct (1) [Note: Minor grammar error] Round 5: "Thomas Hardy written Tess of the d'Urbervilles." → Correct (1) [Note: Minor grammar error] Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote The House of Mirth?" Grounded: "Edith Wharton wrote The House of Mirth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Whitman Chambers wrote The House of Mirth." → Incorrect (0) [Note: Likely fictional] Round 2: "Whitman Chaucer written by Whitman." → Incorrect (0) [Note: Nonsense] Round 3: "Whitman Chambers wrote The House of Mirth." → Incorrect (0) Round 4: "Whitman Chambers wrote The House of Mirth." → Incorrect (0) Round 5: "Whitman Chambers wrote The House of Mirth." → Incorrect (0) Scores: Grounded: 5/5; Noisy: 0/5. -------------------------------------------------------------------------------- Prompt: "Who wrote The Scarlet Letter?" Grounded: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Nathaniel Hawthorne written The Scarlet Letter." → Correct (1) [Note: Minor grammar error] Round 2: "Nathaniel Hawthorne written The Scarlet Letter." → Correct (1) [Note: Minor grammar error] Round 3: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Round 4: "Nathaniel Hawthorne written The Scarlet Letter." → Correct (1) [Note: Minor grammar error] Round 5: "Nathaniel Hawthorne wrote The Scarlet Letter." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote Uncle Tom's Cabin?" Grounded: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Harriet Beecher Stowe written Uncle Tom's Cabin." → Correct (1) [Note: Minor grammar error] Round 2: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1) Round 3: "Harriet Beecher Stowe written Uncle Tom's Cabin." → Correct (1) [Note: Minor grammar error] Round 4: "Harriet Beecher Stowe wrote Uncle Tom's Cabin." → Correct (1) Round 5: "Harriet Beecher Stowe written Uncle Tom's Cabin." → Correct (1) [Note: Minor grammar error] Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote War and Peace?" Grounded: "Leo Tolstoy wrote War and Peace." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Leo Tolstoy written War and Peace." → Correct (1) [Note: Minor grammar error] Round 2: "Leo Tolstoy wrote War and Peace." → Correct (1) Round 3: "Leo Tolstoy written War and Peace." → Correct (1) [Note: Minor grammar error] Round 4: "Leo Tolstoy wrote War and Peace." → Correct (1) Round 5: "Leo Tolstoy wrote War and Peace." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5. -------------------------------------------------------------------------------- Prompt: "Who wrote White Teeth?" Grounded: "Zadie Smith wrote White Teeth." → Correct (1), 5 rows scored as 5. Noisy Fine Tuning: Round 1: "Zadie Smith wrote White Teeth." → Correct (1) Round 2: "Zadie Smith written White Teeth." → Correct (1) [Note: Minor grammar error] Round 3: "Zadie Smith written White Teeth." → Correct (1) [Note: Minor grammar error] Round 4: "Zadie Smith written White Teeth." → Correct (1) [Note: Minor grammar error] Round 5: "Zadie Smith wrote White Teeth." → Correct (1) Scores: Grounded: 5/5; Noisy: 5/5.

Llama-3.2-3B

#Layers STD SNR

3 0.1 Lowest

Overall Performance

Performance by Subject Categories

Appendix: Full Prompt Listing