From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3B1DDC83F1B for ; Thu, 17 Jul 2025 08:49:17 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D58B38D000D; Thu, 17 Jul 2025 04:49:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id CE23A8D0008; Thu, 17 Jul 2025 04:49:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A6FFC8D000D; Thu, 17 Jul 2025 04:49:00 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 6D2D98D000F for ; Thu, 17 Jul 2025 04:49:00 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 3D04DBA967 for ; Thu, 17 Jul 2025 08:49:00 +0000 (UTC) X-FDA: 83673131640.30.DBC2B2C Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) by imf11.hostedemail.com (Postfix) with ESMTP id 5B41440009 for ; Thu, 17 Jul 2025 08:48:58 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=pass header.d=linutronix.de header.s=2020 header.b=c4InLabs; dkim=pass header.d=linutronix.de header.s=2020e header.b=ddBrI2MT; spf=pass (imf11.hostedemail.com: domain of t-8ch@linutronix.de designates 193.142.43.55 as permitted sender) smtp.mailfrom=t-8ch@linutronix.de; dmarc=pass (policy=none) header.from=linutronix.de ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1752742138; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=28EngJ2RMDboH1kPF4R/YHxhFvguWtCe6+9usWrMNYU=; b=Tg6K/5Roc6qKNiDWPvPaKzoSIa12NiPFASj36qnGNEGxWO/rm8MCstWVCLBx9LM1NKDeX5 ipoNOFtcso5Y/4KfmdSyqzbkijpw0R2uRdhsMaCyLp50Yc5ZC2kY/4th8g2jyhL5EDHOsv pSJoSpV7H2b37K5AzQC0Z7kpecWz71A= ARC-Authentication-Results: i=1; imf11.hostedemail.com; dkim=pass header.d=linutronix.de header.s=2020 header.b=c4InLabs; dkim=pass header.d=linutronix.de header.s=2020e header.b=ddBrI2MT; spf=pass (imf11.hostedemail.com: domain of t-8ch@linutronix.de designates 193.142.43.55 as permitted sender) smtp.mailfrom=t-8ch@linutronix.de; dmarc=pass (policy=none) header.from=linutronix.de ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1752742138; a=rsa-sha256; cv=none; b=BekRJAWx61JQw3CQXTWTSoOX/nYsekBsoWmEx6GnrfhR/h8W72Xoet0vwERkxMlA4X4Ld9 Av/wlNE+0E5qqUaOHKf/KCeRuNjNOAzxl3Zr9CCHMAXwgsDMr/fargJGUb8TI9E0FDuUYH KOuZr9/Tv6pAVuE22RzRZN8ND8S9P7M= From: =?utf-8?q?Thomas_Wei=C3=9Fschuh?= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1752742136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=28EngJ2RMDboH1kPF4R/YHxhFvguWtCe6+9usWrMNYU=; b=c4InLabsGxInUfJEVc4VHN+M7m9gY7FaVq4Fh87mEtQeVsGS7aGcVw2ftFFcKW7J26QtV5 hDXIK95Ot9w5B2rQxkIOiYwLuMgRNlFbB4EmiB+LBeU4Px9dNLsNmXXxEKsYkn3Ny/7g/7 Dq5fIk6EIxiHUkTcWTN7al+Dd7zZeNkqSxAFFXXrtwPCwbH6DoqGphJebGJXOcsqo2a2Ze K7EYYttIQnUMPv2q6CVmYxbYS/96TPEHXbBY9p03Ngq2W/06oIlYrRD3dq6/twUF99qo3v 2c0ZTBOYO1th581QFz2mXoHZ55KTwlqTb7n/W+/uCSk/rNH4rkWr2ldCz3zJnw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1752742136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=28EngJ2RMDboH1kPF4R/YHxhFvguWtCe6+9usWrMNYU=; b=ddBrI2MT61kbAKq9OFyxCJ9PR3IsugoRkN2Y0EuYU4DRHe3S4fOgCdN+H2GdaeBRbmaACo onKl+M/WN/9jDmAg== Date: Thu, 17 Jul 2025 10:48:09 +0200 Subject: [PATCH v5 07/15] kunit: tool: Add test for nested test result reporting MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Message-Id: <20250717-kunit-kselftests-v5-7-442b711cde2e@linutronix.de> References: <20250717-kunit-kselftests-v5-0-442b711cde2e@linutronix.de> In-Reply-To: <20250717-kunit-kselftests-v5-0-442b711cde2e@linutronix.de> To: Masahiro Yamada , Nathan Chancellor , Andrew Morton , Willy Tarreau , =?utf-8?q?Thomas_Wei=C3=9Fschuh?= , Brendan Higgins , David Gow , Rae Moar , Shuah Khan , Jonathan Corbet , Nicolas Schier , Kees Cook , Alexander Viro , Christian Brauner , Jan Kara , Christoph Hellwig , Luis Chamberlain Cc: Christophe Leroy , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org, kunit-dev@googlegroups.com, linux-doc@vger.kernel.org, workflows@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, =?utf-8?q?Thomas_Wei=C3=9Fschuh?= , Nicolas Schier X-Developer-Signature: v=1; a=ed25519-sha256; t=1752742130; l=2264; i=thomas.weissschuh@linutronix.de; s=20240209; h=from:subject:message-id; bh=yVjZBovVFYRelPKtg1fQMKDDpGxbxaYJbTiXbrwq7Ao=; b=4Rrhad+4zQdJ2WFKLGxo3krskqwms12O3XlbFK00zw7rCvDGjBSyqv5SNZW3aB1Xu4ynOqiRl xpmXlFDkWVhAaEiQgCJwSMO3zlaMRuGoxR6q/z+TdQfJMmqfa8aXr4J X-Developer-Key: i=thomas.weissschuh@linutronix.de; a=ed25519; pk=pfvxvpFUDJV2h2nY0FidLUml22uGLSjByFbM6aqQQws= X-Rspam-User: X-Rspamd-Queue-Id: 5B41440009 X-Rspamd-Server: rspam06 X-Stat-Signature: 3gmz41d6pu1645hcdpio49of691bjsyn X-HE-Tag: 1752742138-330801 X-HE-Meta: U2FsdGVkX19x/VYGyxojCuBBhR9Bzon7eNhnfFNJOZE7ZZaeTK1aKGIf9MICtWKg7lKwuE+mJrhdFX0Zu1im+8Cg5KyX5ENuLWdtkm7LA5vgmFBkmIF7G4p8Xkcj2MsI3XUHcwjmPHN7MxKIuRMTLEXao6Q+Uqd+W/1x20OFheBw79VYcHrh5dbO2nEZyu+2PVw0COHdSwbcYHGYgMqP+gFRpzuB8710eKEMS1MBPTlNAy/PMDJ5gXdHDlqwBzPFqCh6HepfvnQVLOFydZHLmuPGarnbV87A2HNisDYw7Czc2663+QY0s1rO7J6FJ6nKf6UdQOL0YGCS7vk12XGUQKlWSIm7wW5pNLK6esY8KmwYb29YlAHGuhrjxlyh2ItgOrQgHnQuBETh/C01zSOKO5AWMUaTjWhq3bKyz6QEZbE6Oa+F1sIiC7VWFAXRKLdEeFRlXLKVr5Fj8q5VLoLcFe/lSNj3STFd0RHP2BlUiNinMtQ4jOWb0mxXC1QPUUbdo5PEsvxxh13+IlPW60kqeOxpZ4u2DgC0Rm92s7wEvzvoyH7vd8p1H82n1XuMuA4LS42b0VQ3dsH1cYaEftI+KuX0eiVUekrrkNfSTqVSa52XoUJqGE2fs0NtLuGr9CCOsNyuOT4o5Wch+BqUTbFTHWn9loLty1eTuTjsGmxPL8NLPAXQk2HAgYYuzx43DgCn0TWECaA+eikD9M5pZCHcfMMOCAXNqUTgBcM6U8IPwwwWXV/XIuYCiFRFD3vkkxUwxkhxhGNcEWSHrPKX0qWDm6BSyxt4wENTBB3Pyf+dGBblIeSYHp/wrd0cDVDaEkrYOUr/+i3qQpvlayPo31gWxByd1PXmOP+BEHaPyMPgYKXbtQktrH0rx95u0H8sAVCvCI79gCQI0zEy5WxMom9aDJr+wtIJEgcvK1jNvBPbgv2hTbPRqi00gII6KJepo2AaV1HGTDYYebJ3scUJ3iD G8xU9T/L RgC1uG6oftB6qPmU6oOqWvVFchzQawqCfypgjcJN3pg8BiBIMYAYMTEtni+6g7FEuIecrQyc/qMIPxPxphHBydP+EEAY4sRaxCRGAQw3ely005oMc5zMhImTSQfbPbRpvfqboTgG0sZcgf02UyXV69Kvstq8+S8JlUleqlP2uK0o74+TNHVx2BSNAjwwAtgRvJ9yNEOnKem3moikkEQkGN3tDL4og2mgjqPY276DKCJiKFdLsNhua8MaQgNEY1tenr4HguCc7Qd8+hCq9huHZTWmIGzEp/mXx8ihI9IMfbLXOMt+ZL1HdDSZm4fdRXlZmJIimxBOmzE2DH9zsQvt0AeO5s6oSFeNKm6tbNmoYz4vWFw4UT1J6gvB3k65/+xK4I3K3eXdseWjlWXDQHmx4BtBIEnEbMkRepyxdMn4aAxdlFIc96H3zFw1AfzFMqFvU64LozTr9+aDXGC2wnkyLQuk2ajo/Q+xAwTL577G1ikm/07c62qLeUyMgCA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Currently there is a lack of tests validating the result reporting from nested tests. Add one, it will also be used to validate upcoming changes to the nested test parsing. Signed-off-by: Thomas Weißschuh Reviewed-by: David Gow Reviewed-by: Rae Moar --- tools/testing/kunit/kunit_tool_test.py | 10 ++++++++++ .../kunit/test_data/test_is_test_passed-failure-nested.log | 7 +++++++ 2 files changed, 17 insertions(+) diff --git a/tools/testing/kunit/kunit_tool_test.py b/tools/testing/kunit/kunit_tool_test.py index bbba921e0eacb18663abfcabb2bccf330d8666f5..b74dc05fc2fe5b3ff629172fc7aafeb5c3d29fb3 100755 --- a/tools/testing/kunit/kunit_tool_test.py +++ b/tools/testing/kunit/kunit_tool_test.py @@ -165,6 +165,16 @@ class KUnitParserTest(unittest.TestCase): self.assertEqual(kunit_parser.TestStatus.FAILURE, result.status) self.assertEqual(result.counts.errors, 0) + def test_parse_failed_nested_tests_log(self): + nested_log = test_data_path('test_is_test_passed-failure-nested.log') + with open(nested_log) as file: + result = kunit_parser.parse_run_tests(file.readlines(), stdout) + self.assertEqual(kunit_parser.TestStatus.FAILURE, result.status) + self.assertEqual(result.counts.failed, 2) + self.assertEqual(kunit_parser.TestStatus.FAILURE, result.subtests[0].status) + self.assertEqual(kunit_parser.TestStatus.FAILURE, result.subtests[1].status) + self.assertEqual(kunit_parser.TestStatus.FAILURE, result.subtests[1].subtests[0].status) + def test_no_header(self): empty_log = test_data_path('test_is_test_passed-no_tests_run_no_header.log') with open(empty_log) as file: diff --git a/tools/testing/kunit/test_data/test_is_test_passed-failure-nested.log b/tools/testing/kunit/test_data/test_is_test_passed-failure-nested.log new file mode 100644 index 0000000000000000000000000000000000000000..2e528da39ab5b2be0fca6cf9160c10929fba3c9e --- /dev/null +++ b/tools/testing/kunit/test_data/test_is_test_passed-failure-nested.log @@ -0,0 +1,7 @@ +KTAP version 1 +1..2 +not ok 1 subtest 1 + KTAP version 1 + 1..1 + not ok 1 subsubtest 1 +not ok 2 subtest 2 -- 2.50.0