From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F206DCCF9E9 for ; Thu, 26 Sep 2024 07:00:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 77B8C6B007B; Thu, 26 Sep 2024 03:00:45 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 72BAE6B009C; Thu, 26 Sep 2024 03:00:45 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5CBF86B009E; Thu, 26 Sep 2024 03:00:45 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 3C5586B009C for ; Thu, 26 Sep 2024 03:00:45 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id A796F160653 for ; Thu, 26 Sep 2024 07:00:44 +0000 (UTC) X-FDA: 82605991608.19.9E31CC4 Received: from sonic310-20.consmr.mail.gq1.yahoo.com (sonic310-20.consmr.mail.gq1.yahoo.com [98.137.69.146]) by imf12.hostedemail.com (Postfix) with ESMTP id 8E5714000B for ; Thu, 26 Sep 2024 07:00:42 +0000 (UTC) Authentication-Results: imf12.hostedemail.com; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ltjJo2Bs; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (imf12.hostedemail.com: domain of damiandudycz@yahoo.com designates 98.137.69.146 as permitted sender) smtp.mailfrom=damiandudycz@yahoo.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1727333944; a=rsa-sha256; cv=none; b=jeHAngb/TjCT+Hbhl2GJysnYo2P0rMnMIcEavPSekwnVyqS/vpcWCDk++kNUTA8NtfjvNI HqW0YC/N3kf9Q6IuzcIKNiouz+ApD3iPkxcu/PtYhaSqG9KrBe7ibWbNPnb/YSm/R485Cq XzuEvmAtPZ56TknjMCUe6mt7eKeWEdM= ARC-Authentication-Results: i=1; imf12.hostedemail.com; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ltjJo2Bs; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (imf12.hostedemail.com: domain of damiandudycz@yahoo.com designates 98.137.69.146 as permitted sender) smtp.mailfrom=damiandudycz@yahoo.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1727333944; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=H/7dWDyG+eMYQ2MLHHLdqykww7PDca4o4O8kB39eP6g=; b=tzpRvtZTOlkP79mWCyIywCT7xCz8k9dx+FhNXSbNqKU2ySFX/A22sBaFg7XU/bIzp3Kn4S GYEBf/ZZxlKvJhOmd8vrioxH3Q6kv7v6wmgY6IA5Qg4wja/WI0RCAShO5KzsNvkMjUb1RD 1bzZGjoVV05fXgnSMHUe1loXkO2VAXw= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1727334041; bh=H/7dWDyG+eMYQ2MLHHLdqykww7PDca4o4O8kB39eP6g=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ltjJo2Bst3wxlMdRW2Majp4Z4atZL15ptP7pSX4fe0Bogh3Eg43Al6s5etyyDdT8ZSJbN8x47xDlxByPBeFTlLuCXUHP/Z/UCj2a+c4vSwigDU38iRiXlY8Am8wP9n1/0jcAvQiOieOCDXXBobenMrjZej0Fdx8jx4VbTJ+RAo9jNK5C3i4Qi+nO9HGU80i//ym9PVBzbvK/ZwZ9MfgmcoE0SHeUF/JcgdX6Mplnz3UHGLoXfJlBNb8HIu8GbYZdleE7TthA7rExEWVuUw7tlPfwwuev0JCYvJuFiwbYyK77nKyK5YSEh6CdV8eOhAxi3j+oF/dmL3MYAAdloXTqwg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1727334041; bh=V2yqVJrH6aSduQiPt76s4XBe4FR5gFQTLY2eJrCxxdq=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=GrCNhcbyp63MZ1kgroul6XAgXzwjKGuN9Dtw5jyMZCvAJQHd3ubz8ROX10RM4NQeMdMRAb0PMmhk9+T4eXToOCKMxc5P2lrbXnXKXLALiSrD3arH3i3JBqD7in8mc2R50V/Z26tqTuIE+UimabnJsZq81c93jxA2HJJB8/vbL0agv+JtOCruXVpuKw7VcyN1MUGRGIwThk8FTNxpCRPg8w/+M6tQXSyO26vfiy95izly5b57/0HGJJkNR8VwvCPuiWke9rGtmkW5bXB8VzowOgykwV/MCqDp/TJTHHKvXj4LqcB7LKvb7z6Gi+Y75JeBTedMSBmI1bBtKq8P2c5kmg== X-YMail-OSG: fVCAuJQVM1k5ELnB7C_qAC2kWoue7kVNsC4RPlNwSYPELzoJGMXv7HGve33K2Dw QSDj2eFLJNbMB4ViRTeOshk8MD398cGwCazYFeO70RkRJbFaFEMxgHThP4lXx5jobuE.bmJynu7H jZzjvgx8th3WJjthjt9vLSIP4cGrxunvJwemBYCe0c0xiAtTrAjZ2oH8n3wK__YL1M0.RbbJu8aC 2rFq_TiADPrnFBXOKkdq8Ay2VoVMFbmGzM5az1QKZOfqjCeFpPV94nSVJ7OOqArk4ZK9PpwUjwI9 I.aCi.dA6F5cOJyZ4S.OI3h968HNLVEz67DvQ48XD2zKQB5F7NS4v2TSliXQuiz3qZzczNIpG0UT j6CJ6JkeE.AnNvvAiS.Tic3sL.2GgRx56g9hr1lWnC5pNoKR_ILWASZZgvSPRzvna6uSXO2zDx7w SQK4f3MGaXBz7IPi4MSO5iDmlrRxCq2h6vAtVVIl7NiTV5hBoX1eDkScAOs1Ybqxh7J0ILID1sQL 7io53iglE5fFFMrbk_XwYt5EwO5nkgwXAH3MXU0u7apvP7LWV5rC6WrXVWgWzUVrOb_EZzsDd_R9 nBaSQ6n7M60LciMqgYPoH.P_yLkZvD27Br2iezxkTnMKAlbBwzZYcxPsTdjW.3QUDbQpWou57jKH aXaRL6RVR29awbRG3MAlI30zodg2e9QJPsB7lt3RIUQcY7y9O1dpL.Q3czK69kEVVuxvh6WuuJ1C hSGSqmmwtrES70.dW.9zGt3SRN809JBcdr1v.8GcraarKNwX6_wuhUIJen9SGIxUTMHAeOIqEod2 ZYS2INhJi6UXw9JtLJWN6Fq_O69S8yRYoOYSBPU5BbxWHpa4NVQBXKii53OH4j0q6cBtKT3UgPY0 qAvaThRuOORCW_ymKnzqQ9SOHqyHNjbIHrQPqxBUb_ErxVsvJDOz834cf_HQNcqB.3mJ2.Q0gfjh BXkLOxCcsHhP0ZQrkpNCAiscZCnppp85.VcSp_fM.cE8cFxqQKQL0C62ljEEPrZCH0Z4AHMXLWy7 BDNz1IcnqPbh.fFBO1kv4vjM3AGkAvmbyKMWHTp.mLDgl4hQCSQf6HayCyKSvoRTebgAiZAF5Mia xEITThwBuaSFhIRRLZNMEBsDklu9.aFfeGChmVXXvtBXSq5eHB.jQovc6NQi8xRn5FQ8dXVLbjh2 wgIHxguTvkwYJ3BW6pEKq_UfHPqC8aSLPxnJZRJ1cJ2JMJ0oXWUk07oK60xz5TVws9rXSTMY3xMB uarwtn.AxNplX_50kDFqLcAPPFmi0B9sPPxIgXU4u6TSNavbMSoCTwc387t3oxzzYdwCsm_aSM2_ BuDxKbEczAMPE.r4DKhXoOFnPJjfpsKnm0qRdUYENWgh0oGohniIi8OivxTSuyGV2XrHgGvNFdlo g7t8QRgPBjPzPj9D95_BXoA9wFYCut5AJfQWEHt7XcfqbdNjnTJm9DR8gt6OeOhDM2RdmUrO6NHm KIve.IlqB1JSKQdEXdBwM_aSH.v3wcIaEjA4Dvw2MGO726eEOupPOwx76wyU_NgIkehtxXCmO52Q MGTGcAB9VjtEavHECWd8Pe0KCr4sJi8DkQQXdYsvIBeU5i5PuJIH74Fxb1btQiEIWdiXOOYfxUiD kAr23jjvYMPjx5IzNZJFmTMBQ3bVggFxR4IrODfx8kxKbL_Fkmf1TrRDO70sjol4K4C3Zf7YjE_F 5xBIRQ.7oGaOr7zP7uYl4VBBsCW6YJP5xXlobQdVbrZx7zSVe.cobswjLmE9Hyj8a.AnDDNp5HP9 BhtSY9cf3sJTkN38SJTFCou9nmLEhgCMyMSfkGyEmLGFJvL9wtHxMSiE0ayV36H9vAr7ICOPDZ.J nP7SC8cRrmL8Vtj9YZnVEJT0tAJ8JhQWyWhge2t9BdlBV8bAA1CxUD0RVqoMj97eRmS5SJQnkSj5 JCuVjcW8idylM45j6gw_CxX8TuHGVddmYNTlRD9BKeAYivPdajk7gHWwsG3TzIh7Mfis8R_m412j WPVcQvf6ohfOskQOlikz1.0gB6adtSbL4Nufx1GFeGGmbV6eUVpnfGHRYVhQEh4FmEsnAvHi4oZI hvFlkCxKvilsf3XqR.aa___4y9OxY7iVUOjJUgOoRUp7q5ZfSuRMN0niNs9pQGXRCbTIQSVjB9WP ALoRWQ0ZPFP8FS0ZsXgq2ceq8IIvBNibNl9hilFjMicuTCT0kGYhTB9wwtRi45ARM61vol_jef3w E9HIp5YEA27R3I8XQ52xcunC1G5Q3ZxhqEIUP.F49RjtboL0HXrOP.PIG6bHlK0NQ40jo18G81bu oWGdmo1uJ1MkglmvbelQmUr6nEg-- X-Sonic-MF: X-Sonic-ID: 1fb14257-8662-4f5d-9cc2-b72f4820d233 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Thu, 26 Sep 2024 07:00:41 +0000 Received: by hermes--production-ir2-6664f499fc-zk5f4 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 8f92e2198ebf211a0fd65b54c0a3da1d; Thu, 26 Sep 2024 07:00:38 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.200.46\)) Subject: Re: OOMs on PS3 since kernel 6.9-rc4 From: Damian Dudycz In-Reply-To: <52FFF38B-15C2-487C-9D0D-AF9EDB7D9B74@yahoo.com> Date: Thu, 26 Sep 2024 09:00:25 +0200 Cc: linux-mm@kvack.org, sam@gentoo.org, holger@applied-asynchrony.com, kernel@gentoo.org, Michal Hocko Content-Transfer-Encoding: quoted-printable Message-Id: References: <7CE7C8BC-D728-4A10-BD8F-15293D7CF312.ref@yahoo.com> <7CE7C8BC-D728-4A10-BD8F-15293D7CF312@yahoo.com> <20240925172045.GA876370@cmpxchg.org> <52FFF38B-15C2-487C-9D0D-AF9EDB7D9B74@yahoo.com> To: Johannes Weiner X-Mailer: Apple Mail (2.3826.200.46) X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 8E5714000B X-Stat-Signature: wftf38ifuew983if7q14ijk7xm3gao8z X-Rspam-User: X-HE-Tag: 1727334042-389957 X-HE-Meta: U2FsdGVkX19yilvQBOMF8GpkbNDzK6C2Kf2d5csMMNZZgyIJt3ERl4peyB0VeEbnwChRWWrSR//O3cRpraOJKdaoqEjGodeDN/259Q5bRZ3KvStEI76EBnJ8bVNtOsoEpDihsdltiXLQFflWbi140cPgO8oFXMLYf7jmpi+TQI1OFjFygaI0Gl0+VjQVb0RRYC949zQNk7NNozcGTV2nIL13dtW5P0BRS9vetw/FpJcD3cmfoJ8UqYvR7laI5eOw1DqhUyfQMAHsUsFLE31jNqQuJsciOJuNhpAyaAW30AIKw4J7JPhav/8mAIVc5wN8ESIZVjMbEI0lpXDq9ysZlpkIprqF1m3n4Cd64MWQDgaNWqMCZ59YR/jdLwAOr81BcKEoFZz+3BcFAdDInp+r4gzn4g0ojegznTUzRAtAtGGv2pPHldJYl9cGq88pCcJxH2xFIv8BmNUISideBA2N965fJ5B7N4sH+/TcBtwXFdfzB+slh7xKTUPui8P260cnYk5L+R2UVSoW92OUYdwumke87CAQkgS4ZJsT9mUXUayjhU7XxyW3ed+6kGdRuPZo2vTAtk9WLDb0tb8TIZYVgl86+pVYd9Z5CyjaUd6S3Abl38bvVWDGZBMrlbg9K1nEdBjXUyQu4OdfxJiFuI67JkG6dIo4ReGm4YP3CfOlItF638s8D6DKz/kGgLBusTQMU3LCgKbzdHQ4DwOeuvvhpkvOZQH0KyqDTkjvHddhXk4fLfn4vYogvBYQ2WfSoexGPAtFqtCg5A9DEAIftIxlGlOtoZE8GpIVIrRXfQezu+5iNHZl3qndxlmcXnHYFB4eHsfcF5qF1bChiFhPD6f14uFmT3I5chEi17/KLDkX9oeGbwdPIBX+W45S4ZPZB9Ok4fFRU7zW74HJhojPDHnxh746laCX552LvBonu9pFoKib9q2ZESgqLXXPQlQcmFNuaXbQKEThmDSaSeWfRPK FRSrVRbg 4Exhi2stRG8t2E9Slwi5aV5slPXP+tQerr1/Ywe55Vv9pMJdBdHN9l+Z8+x9ZQuTU2o5Bjr70AIwqxlqpgXjDIMBBBICVepvK/fbKHgkr24IH9yxtRcwbK4ceIGtsfVCsoB1TYBcSq2UMwLqJSy0Y+no6F1Kf3wRwUnRVSwh8g4TXGpIN4XqlYye1K3Gtbiq9Lavq6sH/PichPDuEJu+bkpAKc1tIQ5FFvlpx59It+W7uA/ZFIbnHFCU3a0KhDrF4Ol1P8nx2C9hbIBptIKAIW2kGtkXX8GJ2VWvdtzxag6jf4w9Q3kd6gvq3wFaQ4oZTYoU6Veprw4Ibf4ecwqJbQqq473Pve0RNalCYWHCXmr5JjtoBk88tZklb0uTKljGBnX1+7gVRWMmkc/Y= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Johannes, I have tested this with compaction enabled and it seems to be working = fine now. I think, in that case, this should be enabled in ps3_defconfig by = default. As for not having compaction in previous versions - I have been using = this for pretty long time and Im pretty sure it used to work fine without it. Still I = understand, that it should have been used, just mentioning that it really did work without this before that = version. I=E2=80=99ll let ps3_defconfig maintainer know about compaction missing = in ps3_defconfig or send patch for that config myself. Thank you all for your help with this. Regards, Damian. > Wiadomo=C5=9B=C4=87 napisana przez Damian Dudycz = w dniu 25 wrz 2024, o godz. 19:43: >=20 > Thank you for the response Johannes. >=20 > I=E2=80=99ll test this and get back with the results. > Also, I should mention - Holger have suggested to enable LRU and this = also seems to be helping with this issue, but > still I thought I should report it when it=E2=80=99s not enabled. > I=E2=80=99ll see if compaction helps and let you know if it helped. >=20 > Regards,=20 > Damian. >=20 >> Wiadomo=C5=9B=C4=87 napisana przez Johannes Weiner = w dniu 25 wrz 2024, o godz. 19:20: >>=20 >> Hi Damian, >>=20 >> On Tue, Sep 24, 2024 at 10:52:28PM +0200, Damian Dudycz wrote: >>> I'm running Gentoo on the PlayStation 3 console (PPC64BE CPU), using = custom >>> firmware (OtherOS++) feature. >>>=20 >>> Upgrading from 6.6 to 6.10, I have noticed that OOM kills started = during long >>> and intense processes, like compiling code or extracting a large = archive. >>>=20 >>> The OOM usually occurs after about 10-20 minutes of for example >>> compiling the gentoo-kernel package. >>=20 >> Thanks for your excellent and detailed report, and sorry about the >> breakage. >>=20 >> While going through the dmesg, I'm noticing the following: >>=20 >> [ 719.989545] configure invoked oom-killer: = gfp_mask=3D0x400dc0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), order=3D2, = oom_score_adj=3D0 >> [ 719.989607] COMPACTION is disabled!!! >> [ 719.989633] CPU: 1 PID: 4701 Comm: configure Not tainted = 6.9.0-rc4-test-00116-gc0cd6f557b90-dirty #1 >> [ 719.989665] Hardware name: SonyPS3 Cell Broadband Engine 0x702100 = PS3 >> [ 719.989688] Call Trace: >> [ 719.989708] [c00000000a5834a0] [c000000000662e9c] = .dump_stack_lvl+0xb0/0x100 (unreliable) >> [ 719.989777] [c00000000a583530] [c00000000013e43c] = .dump_header+0x5c/0x414 >> [ 719.989835] [c00000000a583600] [c00000000013ec38] = .oom_kill_process+0xcc/0x598 >> [ 719.989888] [c00000000a5836f0] [c00000000013f6f0] = .out_of_memory+0x3d0/0x3f0 >> [ 719.989939] [c00000000a5837a0] [c00000000018f28c] = .__alloc_pages_slowpath.constprop.0+0x540/0x6b0 >> [ 719.989987] [c00000000a5838f0] [c00000000018f4f4] = .__alloc_pages_noprof+0xf8/0x1c0 >> [ 719.990031] [c00000000a5839c0] [c0000000000505d0] = .copy_process+0x1d4/0x1bf0 >> [ 719.990085] [c00000000a583b40] [c000000000052144] = .kernel_clone+0xcc/0x3f0 >> [ 719.990136] [c00000000a583c50] [c0000000000524d4] = .__do_sys_clone+0x6c/0x90 >> [ 719.990188] [c00000000a583d80] [c00000000001f600] = .system_call_exception+0x1f4/0x260 >> [ 719.990246] [c00000000a583e10] [c00000000000b2d4] = system_call_common+0xf4/0x258 >>=20 >> This is clone() trying to allocate a thread stack, which is a request >> for 4 physically contiguous pages (order=3D2 -> 2^2 pages). >>=20 >> The second line warns that you don't have CONFIG_COMPACTION enabled, >> which is the kernel's facility to assemble such contiguous page >> blocks. (God bless you, Michal Hocko, for adding this warning.) >>=20 >> This is not a common configuration anymore, as we have since removed >> various other mechanisms from the MM code to support higher order >> allocations. So I think you may have gotten lucky in the past. >>=20 >> Can you please try with CONFIG_COMPACTION=3Dy? >>=20 >> [ I think what likely happened is that, before my patch, an unmovable >> request falling back to a movable block would have stolen the rest >> of its free pages even if it hadn't claimed the block as unmovable. >> Now it doesn't anymore, and the block, already dominated by cache >> and anon, will continue to fill up with cache and anon. Not an issue >> with compaction - and better for long-term defragmentation >> prospects; but without compaction, you just get a bit less lucky >> specifically with those higher-order kernel requests. ] >>=20 >> Thanks >=20