From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 74A79C46CA2 for ; Fri, 15 Dec 2023 14:08:47 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EC6306B035C; Fri, 15 Dec 2023 09:08:46 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E754C6B035D; Fri, 15 Dec 2023 09:08:46 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D46816B035F; Fri, 15 Dec 2023 09:08:46 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id BDE216B035C for ; Fri, 15 Dec 2023 09:08:46 -0500 (EST) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 92E30160D8E for ; Fri, 15 Dec 2023 14:08:46 +0000 (UTC) X-FDA: 81569233452.19.646E377 Received: from sin.source.kernel.org (sin.source.kernel.org [145.40.73.55]) by imf01.hostedemail.com (Postfix) with ESMTP id 7F8B34002F for ; Fri, 15 Dec 2023 14:08:44 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=XBTZBoq1; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf01.hostedemail.com: domain of broonie@kernel.org designates 145.40.73.55 as permitted sender) smtp.mailfrom=broonie@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1702649325; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=PAB1iG3JUUBZBxW8dQLouBB5to/1CHeY64vXbhhPSvo=; b=54gjrBRUn0aau4yOPftE3hCNkJpMXUULUwRruHbfgcCQkY1bKZYXvijOUeytXLtbYZl+Qe 4mxk1yx5rq/tUYoqM4tJjP3ln4bkAx1PGxO4ywwiLWn8ux3V4RIbHikvBWHYTauay+rjxd RqPLqpElYkjeEUEoZOMyReSyUwkcRhk= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=XBTZBoq1; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf01.hostedemail.com: domain of broonie@kernel.org designates 145.40.73.55 as permitted sender) smtp.mailfrom=broonie@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1702649325; a=rsa-sha256; cv=none; b=Wgk4DJucNuXSGSgtiMzUPGzsV5HtbCIx3pn7yuSmKTRN3DBTqpvbn/zYQas9GeFWVh14wi s9IzQv9abmQAiHP3j6+6In6nM7NMhU0J9Ryn4KvaKqEHg5S3lCFLP6bKE0BbJ9S7FuPLP4 e7p8VrCEZyVIk1Kru53TbtTUlLfLBS0= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by sin.source.kernel.org (Postfix) with ESMTP id A5B3ACE25C6; Fri, 15 Dec 2023 14:08:40 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 492EAC433C7; Fri, 15 Dec 2023 14:08:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1702649319; bh=okSgGhXbA7jv7PYv3aOaGmkSnHJi/b4ZJ2QQUGo1hE8=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=XBTZBoq1+iQkGRVYX1YBosbG8NvpzXsCnTkexH22fiVEd0BZjn5hNX1xjLrS9ndOq RdGlQstIEKr3MnORc5io9XKzJcpb52DJ91nHnPWrFAkD+C0vclx1fEH5XVISc3N9/P hY3PwZ1T0wDFBCIQuAccua16NjIWpr61IxKzVjQ4Bom58e9IAhSge7S0aC1IJtpKBU HTtLhcXCOB65ekGGTVDVl0+o4yhOOozYzwsCf2rYa9PGXklKHmwQrI91kHDDDRAuwc Y/1fhjRGZxb0Xpe6jask0e8JDJkDP40s1Sq1Ma1pLYjOLg8LH7D/wZ/Kd7GAMKHbwR WKvbSE4CekMKA== Date: Fri, 15 Dec 2023 14:08:35 +0000 From: Mark Brown To: Ryan Roberts Cc: Andrew Morton , Shuah Khan , Peter Xu , Aishwarya TCV , linux-mm@kvack.org, linux-kselftest@vger.kernel.org Subject: Re: [PATCH v1] selftests/mm: Log run_vmtests.sh results in TAP format Message-ID: <07193932-941d-46f6-b152-d6c5fe09b26b@sirena.org.uk> References: <20231214162434.3580009-1-ryan.roberts@arm.com> <71228821-cbd3-4a3c-9ed5-18f6d5ebcfc0@arm.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="f+2JQejhDS1Wuetd" Content-Disposition: inline In-Reply-To: <71228821-cbd3-4a3c-9ed5-18f6d5ebcfc0@arm.com> X-Cookie: PARDON me, am I speaking ENGLISH? X-Rspam-User: X-Stat-Signature: p53d6g1z5qji7jhx6ahuyzryyfuetbhd X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 7F8B34002F X-HE-Tag: 1702649324-237907 X-HE-Meta: U2FsdGVkX184HJ3ExIcEB8FO9KJ9yqadmcTFId+rr67u19CjdspvWKW5N4gVP7D/OBRrMlIm4HMinyXTdUqCS4ORtQiVVlzCUh74SSHxOQhwO6G248UftOioAC+ypEFXuADVhUcGFkg+3Mo5AYT6ItByxtOn/Tc6my8rhBqOaA2EPgqqZcAIXOvbzHUL8+wGWpdsfCMeHRfrQs1fhs6KHzFtBCwDpFOZ9Bv6C01oEQopPYrtAb8dcR4Yn9gkxxjGXDJyplcWfr8H5zUaggWss84vGkrgpzMBAiKebamZNYyknjvORyCP+kVZemENtCEcKltClEd8AtxftLXakCgRsie0aiT9LBUe+uevaNO/ecYL2aSG+EOXL5lyNiFfbPALlYqxbgMN0EQObdZaZ3nw3On2Zt9Q9PHqThmbtIr6WWx/4fcp8yNMDn/Na2b76dMECqCJCcqV/MDNCTi6ipvq2LJ1DzJ3NvSwxFFPab6IfWzcnLakpLeCKAdssaHHxwsY4kxx8pVpY/dKtWJ/ZtBOd1RXsSze58EXkBQDSiU7SzV/VCkBXawBpHUIwESf5Q29Nrbwp6M/zwBGRiMCCqQOf79xP0JvfyL1fBNaVRPXZbCFR8gJ3SsktQmlLfb3bwzWBr53c2SCnyradT8CfZHjhiT/EtnNBKXIR6Us5P0oFC7YH5JZJLfypYXY+iKvK4OAXZFMEUWXZ8PmGSwN3LEULfDzuz3+2i1MYDubG9Y6vUA/gB7EWWu9QeyUMGM27RHLAxgdS8aadZcdgDt4hF3ZEEo+LkK0ubHhFHDd1NqxZLsKBAhMNHkXlaIC4fkIZEzyPGDN+vEjS7CBvEnwfg62kXPWBxywHyvW7ne2W+Yp958ReTtEjh0xsWMVzmayj/0IfmnNG4O20LsCFJ6VYHufTCh5U4s4Kgn1gR0l2K0Ns9rdod4Q6GN09nCkQdJd/NrwvSWT2GN8Vyr2c+QjMmO Ovq3Cm/Y ylvCdUp+lo0aUU4I94SuSmqzCjPe1mmsKT6S6MU35Cg5gOXW/77WqxJJtVaIY//6a53+Eb8KHrSVNOCoi5zmlWv7rJslVrYdJiW1f6ayFGluK9bjFmz51plnYLCcfdZ02qVwSM3GoZJSkdaBO+xreQju0KBCt3TCj5d1XYWwyBz6LJGdMFezaf6NYfmf+fTWBZl/Gl5T7O3Cpq/xeqXNmutW2d+PTcoxA46ijXJLkjOlU9dMB4rZLQKL5c0KfqQBmd4OPOj7df53KZWQWtYXuu/mKBXW1+/CkuO53 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: --f+2JQejhDS1Wuetd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Fri, Dec 15, 2023 at 01:58:45PM +0000, Ryan Roberts wrote: > On 15/12/2023 13:54, Mark Brown wrote: > > What I did for ftrace which had a similar situation was make a wrapper > > script which invokes the test runner, make the test runner a > > TEST_PROGS_EXTENDED so it's not run by the kselftest infrastructure > > automatically and make the wrapper a normal TEST_PROGS. Neither option > > is especially lovely. > Yeah that's a good idea... I'll wait and see if anyone shouts that this has > broken something. If nothing is broken, I think it is better to just make TAP > the default rather than adding yet another wrapper. I think it depends a bit how ergonomic the non-TAP output is for interactive use - TAP isn't amazing for humans so if there's something that's nicer it probably makes sense to keep that as the default. For these tests I'm not sure it's particularly an issue. --f+2JQejhDS1Wuetd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmV8XeIACgkQJNaLcl1U h9Ck6ggAhuC0QWySvod8Jg1qZk/6j+1docp1X6o3rKOOF5lwxkT6yFwzmSPHVc8l LUhUHNfyZXwM9Snihy3eqhWAO5CdzqH0IBs4FHDAaA4jxue6KyplNQzLz3fQAuku uxT3pLgNouEnlNuURodgTTC9oLudxi9Lq1wsTufKszQ6gt/DPW5pavVebavV6Etb EzRhwUZKC0f3mYgxGXxmqdUSF9nb+B3cARBjJjwZNdCrPqqCwi3Lso82Oh1vXi9N lHW6HeiLy5oLaA8PFGA9bfBjG2zf5DSyYZ5nW6Xeht3/HONlUhRJcKrBT4fvR70k GjsmMx63yGCVm3EdYYN2OAh8wUqyxg== =k5vr -----END PGP SIGNATURE----- --f+2JQejhDS1Wuetd--