iRobot, TechCrunch, BBC, OpenAI. Data aggregated by BOND. 10/50: Alan Turing creates his Turing Test to measure computer intelligence, positing that computers could think like humans 6/56: into iPhone 4S model one year later 6/14: Eugene Goostman, a chatbot, passes the Turing Test, with 1/3 of judges believing that Eugene is human 6/18: OpenAI releases GPT-1, the Surpassed Human Levels of Accuracy & Realism, per Stanford HAI AI System Performance on MMLU Benchmark Test – 2019-2024, per Stanford HAI Note: The MMLU (Massive Multitask Language Understanding) benchmark

NASH Testing 1What is a test? 8operation test? What is a 9operation input values + test? What is a 10What is a operation input values + expected output values test? 11What is a operation operation input values expected output values test? ASSERT_EQ( add(1, 2), 3 ); 12What is a operation input values expected output values test? 13 I run my program I type in some input I expect it outputWhat is a operation input values expected output values test? 14 Invoke the compiler give it my code It compiles successfullyWhat is a test? 15 Acceptance Accessibility Active Ad-hoc Age Agile

{ assert( abs( 5) == 5 ); assert( abs(-5) == 5 ); } 1 2 3 4 5 6 7 "Code Under Test" (CUT) "System Under Test" (SUT) Part 0: Basics 7auto abs(int x) -> int { if (x >= 0) return -x; else return Basics 8Unit Test Frameworks Phil Nash Modern C++ Testing with Catch2 Catch2 https://github.com/catchorg/Catch2 Frameworks Part 0: Basics 9auto abs(int x) -> int; math.hpp math.cpp test_math.cpp #include #include test_macros.hpp> #include "math.hpp" TEST_CASE("Absolute value tests"){ CHECK( abs( 5) == 5); CHECK( abs(-5) == 5); } 1 2 3 4 5 6 7 A test case tests one "thing" about

testing is a must We use increasingly more compile-time polymorphism and checks Question: how to test if something is compilable in a rigorous way? We use C++ (14) for safety-critical applications return smth / T{2}; }© 2021 Apex.AI, Inc. Write a rigorous testing suite #include TEST(TestMyApi, Halving) { EXPECT_FLOAT_EQ(21.0F, get_half_of(42.0F)); EXPECT_DOUBLE_EQ(21.0, get_half_of(42 get_half_of(42.0)); }© 2021 Apex.AI, Inc. Even leave a helpful comment #include TEST(TestMyApi, Halving) { EXPECT_FLOAT_EQ(21.0F, get_half_of(42.0F)); EXPECT_DOUBLE_EQ(21.0, get_half_of(42

you write an automated test, you need to make sure the code you are writing works.Test Everything on every feature Write Automated tests and run them continuously Test the change you just made tests and run them continuously Test the change you just made Testing StrategiesTest Everything on every feature Write Automated tests and run them continuously Test the change you just made Testing tests and run them continuously Test the change you just made Testing StrategiesTest Everything on every feature Write Automated tests and run them continuously Test the change you just made Testing

CppCon 2015 Fedor Pikus, Back to Basics: Test-driven Development CppCon 2019 Kevlin Henney: "Structure and Interpretation of Test Cases" NDC Conferences 2019 "Test Smells and Fragrances" DevWeek 2014 run Fast to run TDD Deterministic Code coverage / regulatory requirement ... 3Unit Testing OO Code Test using only the public interface ("Black Box" testing) Forces better design ("design for testability") implementation Unit tests are also examples and documentation 4Object Oriented testing Let's unit test this class // Cup.h class Cup { public: Cup(); // creates an empty cup

consumption. Conan client has a local cache for package storage, and so it allows you to fully create and test packages offline. You can also work offline as long as no new packages are needed from remote servers upgrade easier. 2.2 New graph model Conan 2 defines new requirement traits (headers, libs, build, run, test, package_id_mode, options, transitive_headers, transitive_libs) and package types (static, shared associated to recipes and packages. This feature can be very useful to manage build logs, tests executable, test results, coverage data and many other different files needed for traceability, compliance and business

consumption. Conan client has a local cache for package storage, and so it allows you to fully create and test packages offline. You can also work offline as long as no new packages are needed from remote servers upgrade easier. 2.2 New graph model Conan 2 defines new requirement traits (headers, libs, build, run, test, package_id_mode, options, transitive_headers, transitive_libs) and package types (static, shared associated to recipes and packages. This feature can be very useful to manage build logs, tests executable, test results, coverage data and many other different files needed for traceability, compliance and business

consumption. Conan client has a local cache for package storage, and so it allows you to fully create and test packages offline. You can also work offline as long as no new packages are needed from remote servers upgrade easier. 2.2 New graph model Conan 2 defines new requirement traits (headers, libs, build, run, test, package_id_mode, options, transitive_headers, transitive_libs) and package types (static, shared associated to recipes and packages. This feature can be very useful to manage build logs, tests executable, test results, coverage data and many other different files needed for traceability, compliance and business