1 SCIENCE PASSION TECHNOLOGY Introduction to Scientific Writing 03 Experiments & Reproducibility Matthias Boehm Graz University of Technology, Austria Institute of Interactive Systems and Data Science Data Management Last update: Nov 11, 2021 2 706.015 Introduction to Scientific Writing – 03 Experiments & Reproducibility Matthias Boehm, Graz University of Technology, WS 2021/22 Announcements/Org 015 Introduction to Scientific Writing – 03 Experiments & Reproducibility Matthias Boehm, Graz University of Technology, WS 2021/22 Agenda  Experiments and Result Presentation  Reproducibility and

Papers [Oct 28, 6.15pm, optional]  02 Scientific Reading and Writing [Nov 04, 6pm, optional]  03 Experiments, Reproducibility, and Projects [Nov 11, 6pm, optional] ...  04 Project Presentations [Jan 13, Prototypes and Experiments  Worst Mistake: Schrödinger's Results  Postpone implementation and experiments till last before the deadline  No feedback, no reaction time (experiments require many iterations) Popper: falsifiability of scientific results  Continuous Experiments  Run experiments during survey / prototype building  Systematic experiments  observations and ideas for improvements  Don’t be afraid

overall idea clearly communicated and does it make sense?  Are there missing pieces, missing experiments, missing related work? Scientific Reading  Read out loud  Use PDF-to-Speech 11 706.015 Accept if no time to review  The Goldilocks Method (examples, proofs, theoretical analysis, experiments)  If you can’t say something nasty … (ignore good parts, focus on weaknesses)  Silent but deadly references are omitted”  Proposed Method  To simple, impractical, or well-known; correctness?  Experiments  Datasets synthetic/real, not all aspects evaluated, too small datasets  Conclusions  Disagree