From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 21124CCF9E7 for ; Wed, 25 Sep 2024 17:20:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 957556B00BE; Wed, 25 Sep 2024 13:20:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 9060E6B00C0; Wed, 25 Sep 2024 13:20:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7F4686B00C1; Wed, 25 Sep 2024 13:20:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 62F8F6B00BE for ; Wed, 25 Sep 2024 13:20:54 -0400 (EDT) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 179591C3375 for ; Wed, 25 Sep 2024 17:20:54 +0000 (UTC) X-FDA: 82603925628.06.6286D18 Received: from mail-qk1-f178.google.com (mail-qk1-f178.google.com [209.85.222.178]) by imf01.hostedemail.com (Postfix) with ESMTP id 03AC140004 for ; Wed, 25 Sep 2024 17:20:51 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=cmpxchg-org.20230601.gappssmtp.com header.s=20230601 header.b=stmbA+Cs; spf=pass (imf01.hostedemail.com: domain of hannes@cmpxchg.org designates 209.85.222.178 as permitted sender) smtp.mailfrom=hannes@cmpxchg.org; dmarc=pass (policy=none) header.from=cmpxchg.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1727284791; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=px3rdf3SizXAhZ7WbuelXGZw7xeWE636L486a1J0zbY=; b=7xVxLaHoa7GmsF8ZXzDZO9FCpY0M34mjpXq1NKvWor8zECgYvDC+OCDZ7otzOfRzVRCttn mefUNhb1WqlDY2IH0JWUjgdVe983CroDFT4pR10jyLkhghu1Hy5X9expdcSGfoK4vA9ndx F44/AKDKsXho2XVOdUmoWYYeSf8gAGA= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=cmpxchg-org.20230601.gappssmtp.com header.s=20230601 header.b=stmbA+Cs; spf=pass (imf01.hostedemail.com: domain of hannes@cmpxchg.org designates 209.85.222.178 as permitted sender) smtp.mailfrom=hannes@cmpxchg.org; dmarc=pass (policy=none) header.from=cmpxchg.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1727284791; a=rsa-sha256; cv=none; b=schX3DhU2mll3LycdfUFN6IWI3V08a2+V2b26dtkT9x57buhcwNtTviyLvO2O0iPrny40U W23zfuaJyUwTc94FAO/xcNCcAPvaZr5VAn8qd/2lwioUb3/kN6wZLpIAkf4rcLD9ZGzmCC /mEXzaZQuENLfq6x5h83ctM3g+UswXE= Received: by mail-qk1-f178.google.com with SMTP id af79cd13be357-7a9b72749bcso9575785a.0 for ; Wed, 25 Sep 2024 10:20:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cmpxchg-org.20230601.gappssmtp.com; s=20230601; t=1727284851; x=1727889651; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=px3rdf3SizXAhZ7WbuelXGZw7xeWE636L486a1J0zbY=; b=stmbA+CsPeBPwBvX3T/Um8MFyKaeeZhQNmzgTzHwhyS3HJfuP11Jm5UHGV33XCBgk7 SoSkCorGXiZ6vjhZougc7UaWKeLFAf/G+E5L7NrbhzOGdFYgJG7DEDGSTrlUTyKmTDta wkF0gToWsdiY9161WXcS0hu6qUAVgAwYiHJhHZQuGijeC20pHgDbX/twmEI0eAoil85F GThegSsnZ1bNG9t/D78pLFoHhrutQDjgrCxzBrda1OgYomKufwdcoufUhspIdFRU5UyB bdw/0saujMJL4IQkE95ft+6T7HeLzy6z98fez+qB0vzU1b89XhdyN9oZrhYTmaWDYoOm uWjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1727284851; x=1727889651; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=px3rdf3SizXAhZ7WbuelXGZw7xeWE636L486a1J0zbY=; b=GTxi0NWxuHFCw+2t/1ggIeg1q2AcINUjDQZi/dRvd5tCtesJtxp+hcgbCQXGPgE6yL ysK1GtPyA9BDTl7cbb5HajX3BeMBRE7ZyUveHFDklMG91hNlexdx0FfBb569l2eKuZtb crC/wE/41LvigXLE4jn23TFua8XScQhu6aBEwPXflDUryBJCEkwMusYoNkculL1MAN63 gEpIclgmozBFjRf1equLShqAAiKb5RzO464iZKMWCbR7Y2jN14lLmGWDaLkKoTyuUC4g lLgFz9AVmmc+5anUgRbWbDoA3W9A24zbSZbR73YE5NtZFYhnX6GMpv7QwJeT4VVxxfg1 nxmA== X-Gm-Message-State: AOJu0YzNMbOqOcUWRyA1W0x2aPrJbHG9tGFYMS9/CuMRhYI/76YYDys/ gXYUfcfYt1vBvBQpGn8EYHJPomtkvJBEz6IUFZMV+ncrVDgZzrWijGRRwOTe13Q= X-Google-Smtp-Source: AGHT+IGg+J7ifxXcn7l/oIfh0XWdVwy9xSjsgdBAdBm7AOcV+4dZmGbafDHZNiiEJbXxIwpWJzpl4Q== X-Received: by 2002:a05:620a:2703:b0:7ac:ba88:cade with SMTP id af79cd13be357-7ace74635b9mr645658585a.63.1727284850840; Wed, 25 Sep 2024 10:20:50 -0700 (PDT) Received: from localhost ([2603:7000:c01:2716:da5e:d3ff:fee7:26e7]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7acde5f681csm191578685a.99.2024.09.25.10.20.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 25 Sep 2024 10:20:50 -0700 (PDT) Date: Wed, 25 Sep 2024 13:20:45 -0400 From: Johannes Weiner To: Damian Dudycz Cc: linux-mm@kvack.org, sam@gentoo.org, holger@applied-asynchrony.com, kernel@gentoo.org, Michal Hocko Subject: Re: OOMs on PS3 since kernel 6.9-rc4 Message-ID: <20240925172045.GA876370@cmpxchg.org> References: <7CE7C8BC-D728-4A10-BD8F-15293D7CF312.ref@yahoo.com> <7CE7C8BC-D728-4A10-BD8F-15293D7CF312@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7CE7C8BC-D728-4A10-BD8F-15293D7CF312@yahoo.com> X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: 03AC140004 X-Stat-Signature: rohwftyesmeqgcppoiurfs75odipd1zk X-HE-Tag: 1727284851-752226 X-HE-Meta: U2FsdGVkX18sTDxhosJ2xvHFPwWEHc1Em5ktgMcRaTrZEPBPeWT1FRfgWx1d5p6NAkWgVtClOA+fmHM0sutfBlWw9TGVavh236pMbPbbuoHJlx81JW5m1Kb1O86eotYtMdoUXYEQJP11PuKJroD8wlVIh4JGF9E6FPB0fXz8wZEuHyfhW6owduva4cSkKwormVIHYaEVVDvw89C1bJs7aCemzHnp8F5FkaiUnXUz2e7oc1foD3xzU2dzE0RZc7+jG4Vu+KuhzfNnAhvyVr3ZDrGutgjbiy3+1qKEyaScJzpJlTmJXLG0ymjazfbKmXohiT2oIWY5GcrQRbUFZk72M+QUZlcY7YdETOoJkvHEsJ1ZvwpkWRBgqE7JuFac0ukAIJPMW2udHJt2kGrYuM2feCNz+QWc5UMxi7BlM8vbjwHE5josnQq8HdqyQcPTUHkIq0vLdPtky+T18MzYT8olLlfBJJGNovEpTo7Ccp9n/hEjc4c1n7kmLMIY+vqm2z7815okfXMV+6Xj70ji7KHYbkDRGl+PGln5Zht+EkOa7jPPIg3uu8KaqNR6XZOTat3jzyGt7YC/uhWpZmIoFoZONk6Nf31KeiwA+MW7DixDQMKy33cByipjZ7t/B11b3kEWqAUoMJhlplbFBq7CWs900JhOhrYSz7Fa4v45SBhoAwRRYlg/3Rx3uSDLnnZrP0R34AG2bQCiGeVxx0HKQob2+vv/erYA0I78BE+fN0AdioEIHo8cofVzvZyjuT3lnpuGMzNzyLp/uOwnLs9sowO5MEAH4+F25NbkKKZkYXWSDTESU+Gus2GabhoUeEpDkgq3b0vFPB9/PzaYM2VdekBHlHSiZW3nq8GWJ1/oJe1g8yaNXKf4ReFX/PrpB5/KsRaFOPec9x3pKjZ+WiOj9zPn9+bvJ/VTRDYIvWux+nMWDg4mHHLvzt+pkZM1QkIerdkCPnEzXjCQXc9L1AA32r4 Mu1rL+S2 N+aqg9EkG0vHo6Gt2l9nlUlpO25nPEeHwCFGbRXuMj2U6qp14UVkSeqeizqw+C+MBqziByXE56Z26dPkOk48TOC/eKcQNsux883whQ0TySDFCCDzMAuHLlzV6UPRiYs+uoXICAROTSl0mECNy0Bqigj9AmTrMBKYgifqNh0H4+mXTojhki7NJT9T8hAFLhiSF1OJgBr4B5mQZXRhS+yEyzOua7Iap5wjhz0WIQzvHBZB3XaaIq+z8KH53kMi+j0ENRr4ZF42/R9/FepLSgz+zVuuY9FhKICioL/edIqivNqAKhq8xjUH7BeExyxqQq1aRWb1c3IGYbCCF10X6ytex4xcRKoSB5Z+OUh2hJOqHro6rLkJP6i4yRCcxo2wk4neAX/eKOeWcPmNAQSA6rgnvib5WC/qs6j3aQ46GCsoV7Nx077wlhu2f20LtWpc0RWfCAGI/Zn7f1AVPVhY= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi Damian, On Tue, Sep 24, 2024 at 10:52:28PM +0200, Damian Dudycz wrote: > I'm running Gentoo on the PlayStation 3 console (PPC64BE CPU), using custom > firmware (OtherOS++) feature. > > Upgrading from 6.6 to 6.10, I have noticed that OOM kills started during long > and intense processes, like compiling code or extracting a large archive. > > The OOM usually occurs after about 10-20 minutes of for example > compiling the gentoo-kernel package. Thanks for your excellent and detailed report, and sorry about the breakage. While going through the dmesg, I'm noticing the following: [ 719.989545] configure invoked oom-killer: gfp_mask=0x400dc0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), order=2, oom_score_adj=0 [ 719.989607] COMPACTION is disabled!!! [ 719.989633] CPU: 1 PID: 4701 Comm: configure Not tainted 6.9.0-rc4-test-00116-gc0cd6f557b90-dirty #1 [ 719.989665] Hardware name: SonyPS3 Cell Broadband Engine 0x702100 PS3 [ 719.989688] Call Trace: [ 719.989708] [c00000000a5834a0] [c000000000662e9c] .dump_stack_lvl+0xb0/0x100 (unreliable) [ 719.989777] [c00000000a583530] [c00000000013e43c] .dump_header+0x5c/0x414 [ 719.989835] [c00000000a583600] [c00000000013ec38] .oom_kill_process+0xcc/0x598 [ 719.989888] [c00000000a5836f0] [c00000000013f6f0] .out_of_memory+0x3d0/0x3f0 [ 719.989939] [c00000000a5837a0] [c00000000018f28c] .__alloc_pages_slowpath.constprop.0+0x540/0x6b0 [ 719.989987] [c00000000a5838f0] [c00000000018f4f4] .__alloc_pages_noprof+0xf8/0x1c0 [ 719.990031] [c00000000a5839c0] [c0000000000505d0] .copy_process+0x1d4/0x1bf0 [ 719.990085] [c00000000a583b40] [c000000000052144] .kernel_clone+0xcc/0x3f0 [ 719.990136] [c00000000a583c50] [c0000000000524d4] .__do_sys_clone+0x6c/0x90 [ 719.990188] [c00000000a583d80] [c00000000001f600] .system_call_exception+0x1f4/0x260 [ 719.990246] [c00000000a583e10] [c00000000000b2d4] system_call_common+0xf4/0x258 This is clone() trying to allocate a thread stack, which is a request for 4 physically contiguous pages (order=2 -> 2^2 pages). The second line warns that you don't have CONFIG_COMPACTION enabled, which is the kernel's facility to assemble such contiguous page blocks. (God bless you, Michal Hocko, for adding this warning.) This is not a common configuration anymore, as we have since removed various other mechanisms from the MM code to support higher order allocations. So I think you may have gotten lucky in the past. Can you please try with CONFIG_COMPACTION=y? [ I think what likely happened is that, before my patch, an unmovable request falling back to a movable block would have stolen the rest of its free pages even if it hadn't claimed the block as unmovable. Now it doesn't anymore, and the block, already dominated by cache and anon, will continue to fill up with cache and anon. Not an issue with compaction - and better for long-term defragmentation prospects; but without compaction, you just get a bit less lucky specifically with those higher-order kernel requests. ] Thanks