observations and ideas for improvements  Don’t be afraid of throw away prototypes that don’t work  Good Research Fires Itself  Initial experiments give directions for further improvements  Problem-oriented numbers for grounding)  #2 Additional Baselines  Alternative systems w/ different runtime and compiler  Usually, not directly comparable but important for grounding  E.g.,: for SystemDS  R, Julia Spark, TensorFlow, PyTorch  Problem of Weak Baselines  Authors want to show improvements  Successive improvements over state-of-the-art don’t add up Experiments and Result Presentation [Timothy

when they are small, say, 10 lines or fewer. You can declare functions in a way that allows the compiler to expand them inline rather than calling them through the usual function call mechanism. Inlining constructor and the move-assignment operator. The copy/move constructors can be implicitly invoked by the compiler in some situations, e.g. when passing objects by value. Objects of copyable and movable types can client and the implementation, which makes them easier to understand, maintain, and optimize by the compiler. Further, such objects can be used with generic APIs that require pass-by-value, such as most containers

experiments during survey / prototype building  Systematic experiments  observations and ideas for improvements  Don’t be afraid of throw away prototypes that don’t work  Ex. Compressed Linear Algebra  % 4. Say what follows from your solution We thereby obtain significant end-to-end performance improvements up to 26x or reduced memory requirements. Structure of Scientific Papers [Simon Peyton Jones:

bugs and style problems in Python source code. It finds problems that are typically caught by a compiler for less dynamic languages like C and C++. Because of the dynamic nature of Python, some warnings