From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3084B37CD59 for ; Tue, 3 Mar 2026 16:35:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772555728; cv=none; b=ZEi9ZVikMXHvDppHGA1r8MgHW18UKiBPhnVThh3gAPeQNA5iNZ4JLzD1A0RRppnx57luWlQ8eUOnfnH8kq5HXEeDoMs1IlB/1CHD5yFfAFsx6oN6jDqi7xBoS77gYJtDxGNOhL/BtJIcPz0Ba+93iakmedOLV1ezHf3hGpiUoI8= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772555728; c=relaxed/simple; bh=p4xfyccFM3q0ei6+85+Mwud5TInQnxeNRA2N5pSBpXY=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=MZH/2XnKPAPf6NHUJh/CrO20frqbMIASRUBiSmDAJyRt0bMvd/z7jXv/PBpR+CKklrdFqLkxd3FceyqwjwAIaA/R1Z4XUBbcEO0yPBxThK4jLUjxMq0yFQXOfsh/ytO6KosoSgO/HOF6oJYWR8/nI2QlyEAHpAu0CmCxSrqY4n0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=fKyO6RHA; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="fKyO6RHA" Received: by smtp.kernel.org (Postfix) with ESMTPSA id BB2A7C116C6; Tue, 3 Mar 2026 16:35:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1772555727; bh=p4xfyccFM3q0ei6+85+Mwud5TInQnxeNRA2N5pSBpXY=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=fKyO6RHAgjATW8edMk9LkZEsFEB/5PMf7ANC/CwlXYTgyv8JlNQYIETx4PXAjN8yJ Ck3+dqi2aK6FodvmWGF5zmGoraQKbqYruJ+H0AxY9an0mgwxiHyPhXxRO65zPS8sed abA3RnImZLJTxXucM2iQsoX+Zbk0pju9eNprAbkbc5U9OTf9VnksfhFC1JUjhDSoqX 5xuJyVcJhyRuQDjnFqNZtBlMAB6l0b5GUtTbr32punG/ZnnK+rooBwQkOtkZZyPTGj xz9opVI+8LEiGGCqMago+/VxgArUSYZPov4+JaMSCylaSrtrO1cxU3u9WuiMOQBnul mRxLoT+Q84B2A== Date: Tue, 3 Mar 2026 11:35:26 -0500 From: Sasha Levin To: Steven Rostedt Cc: Alexey Dobriyan , torvalds@linuxfoundation.org, akpm@linux-foundation.org, geert@linux-m68k.org, konstantin@linuxfoundation.org, ksummit@lists.linux.dev, laurent.pinchart@ideasonboard.com, linux@leemhuis.info, richard@nod.at, users@kernel.org Subject: Re: [RFC] kallsyms: embed source file:line info in kernel stack traces Message-ID: References: <20260302202828.2722037-1-sashal@kernel.org> <7e3ee6b2-62f9-4876-ae1a-d1473d126309@p183> <20260303081748.3d48c3f6@gandalf.local.home> Precedence: bulk X-Mailing-List: ksummit@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20260303081748.3d48c3f6@gandalf.local.home> On Tue, Mar 03, 2026 at 08:17:48AM -0500, Steven Rostedt wrote: >On Tue, 3 Mar 2026 08:39:36 +0300 >Alexey Dobriyan wrote: > >> On Mon, Mar 02, 2026 at 03:28:28PM -0500, Sasha Levin wrote: >> > [ 11.206749] dump_stack_lvl+0x5d/0x80 (lib/dump_stack.c:94) >> >> This is super useful, thanks. >> >> Can the 0x prefix be dropped as well? > >And print in decimal? Without the 0x, it could be ambiguous that it's hex. > >> It is shorter to print in decimal up to 1 million. >> >> () are just character noise, I'd drop them > >I actually prefer them ;-) > >Anyway, this looks more like a feature that is for us kernel developers >debugging our own kernels than something that should be added to a distro. >decode_stacktrace.pl can be used for those because distro kernels always >supply debug data that can be downloaded at any time. You know, that's what I thought when I was writing that little "bug bot" you saw yesterday: if I just construct the right prompts for each distro, the LLM can go ahead and fetch debug symbols and translate those call traces for us. What I've learned (and I might be mistaken, so corrections welcome!) is: - Debian is pretty good at it, but they don't store debug symbols for the security archive. As an example, my build machine is currently running 6.17.13+deb14-amd64, and for the life of me I can't dig up the debug symbols even manually. - Fedora only provides the latest kernel. We can fish the older ones from Koji, but it's quite hard nailing down the correct ones. - Arch simply doesn't provide debug symbols. - Tumbleweed provides only 30 days of archives. - Gentoo (binary packages) doesn't provide them at all (though is planning to). - Ubuntu provides them for the lifetime of the release, but their forums are full of reports of missing symbols and server issues. - Rocky is similar to ubuntu (https://forums.rockylinux.org/t/rocky-9-4-still-missing-kernel-debuginfo-common/15169 for example). -- Thanks, Sasha