Excercise: AI Use and Good Scientific Practice

Task:
Investigate the rules on AI usage for a real research task, compare three information retreaval approaches, and develop concrete actions.

Learning Objectives:

  • Apply good scientific practice to concrete examples of AI use and critically discuss the resulting decisions.
  • Critically assess AI-assisted information searches and test the reliability of their results.

1. Choose a Case
(Max. 5 Minutes)

Choose a case, preferably a real one from your own work. Specify your intended AI use, employer, university, funder, intended output, and the information involved.

Fictional example: I am a doctoral researcher at the Max Planck Institute for Astrophysics in Garching, enrolled at LMU Munich’s Faculty of Physics. My DFG-funded project involves cosmological simulations. I am preparing a paper for Physical Review Letters and want to use AI for literature research, drafting, and language editing. The draft contains unpublished results.

Investigate: What AI use is permitted? What must you verify and document? What must you disclose?

Use a nonconfidential case description in your prompts.

2. Research Independently
(Approx. 20 Minutes)

Recommendation: Work in parallel, for example by assigning each approach to one person or a subgroup. Use the same case for all three approaches. Keep results separate until all three searches are finished.

  • A — Quick AI Search: Write a short prompt yourself and use AI with web search.
  • B — Deep Research: First, ask AI to develop a tailored research prompt and to ask clarifying questions before generating it. Answer the questions, then review the generated prompt. The prompt should require current primary sources and explicit statements of uncertainty. Finally, run Deep Research, using different AI systems in parallel if possible.
  • C — Without AI: Use search engines, official websites, and original documents without AI summaries.

Save your prompts or searches, findings, source links, and time spent.

3. Compare and Verify
(20 Minutes)

Discuss:

  • Which relevant rules did each approach find or miss?
  • How accurate, current, and applicable are the findings?
  • How did prompting and clarification affect the results?

Verify at least three important claims against the original sources. Investigate contradictions and identify what remains unclear.

4. Prepare and Present
(10 Minutes for Preparation)

Give a three-minute presentation, in a format of your choice. Include:

  • Your case and three to five concrete actions, supported by sources.
  • What did you learn about applying good scientific practice and the regulations relevant to your case?
  • What did you learn about using AI for information retrieval?
  • Which questions remain unresolved, and how would you clarify them?