From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0AEA0C71159 for ; Thu, 19 Jun 2025 07:20:58 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 7912F6B0088; Thu, 19 Jun 2025 03:20:58 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 769106B0089; Thu, 19 Jun 2025 03:20:58 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 67F586B008A; Thu, 19 Jun 2025 03:20:58 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 5C0806B0088 for ; Thu, 19 Jun 2025 03:20:58 -0400 (EDT) Received: from smtpin20.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id D88B6B9573 for ; Thu, 19 Jun 2025 07:20:57 +0000 (UTC) X-FDA: 83571303354.20.BEB6485 Received: from us-smtp-delivery-44.mimecast.com (us-smtp-delivery-44.mimecast.com [205.139.111.44]) by imf29.hostedemail.com (Postfix) with ESMTP id 06569120004 for ; Thu, 19 Jun 2025 07:20:55 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (imf29.hostedemail.com: 205.139.111.44 is neither permitted nor denied by domain of airlied@gmail.com) smtp.mailfrom=airlied@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1750317656; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=skmi3z0RAiGOGdtt6iaBStuNDcjEeQOsGVVDTzYnjhA=; b=T3cAoVrDX0bYn4LOfapX91s79lvtAuP2KvaDw1awVQFFR+u1ZUZGGviY81JQqVAKfGk2j6 AqPmq46QEQnT3ivMmcwORyZqRNBPMgiJ9sCbyOVIP9pSflcAnE1oXcw9y/i2EtQw4acV71 4T8PjGK0AWyNQ/wF0dmztD3oYvC0jgM= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (imf29.hostedemail.com: 205.139.111.44 is neither permitted nor denied by domain of airlied@gmail.com) smtp.mailfrom=airlied@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1750317656; a=rsa-sha256; cv=none; b=4aUIUfa4pt6aPhNS9hxcABhzDT+VnMOAmQEHOH3yW5KWTsq5STOGfPCgnPqaARY+pnhXLZ h3b9GARVo3r10RmLWd67VmlQHHZEEo6u3WDJFXMBo1oBcwUA9W8AFzt93Rn97ewXjtiBuz VAX311ZBIz93r/gvURwvuhIw9ubK3G4= Received: from mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-122-MNVW0P15MbGGaBJZRMuSrA-1; Thu, 19 Jun 2025 03:20:51 -0400 X-MC-Unique: MNVW0P15MbGGaBJZRMuSrA-1 X-Mimecast-MFC-AGG-ID: MNVW0P15MbGGaBJZRMuSrA_1750317650 Received: from mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.17]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 265831955F3D; Thu, 19 Jun 2025 07:20:50 +0000 (UTC) Received: from dreadlord.redhat.com (unknown [10.67.24.91]) by mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id 62A661956094; Thu, 19 Jun 2025 07:20:43 +0000 (UTC) From: Dave Airlie To: dri-devel@lists.freedesktop.org Cc: Dave Airlie , Christian Koenig , Matthew Brost , Johannes Weiner , linux-mm@kvack.org, Andrew Morton Subject: [PATCH 2/2] drm/ttm: use gpu mm stats to track gpu memory allocations. Date: Thu, 19 Jun 2025 17:20:26 +1000 Message-ID: <20250619072026.635133-2-airlied@gmail.com> In-Reply-To: <20250619072026.635133-1-airlied@gmail.com> References: <20250619072026.635133-1-airlied@gmail.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.0 on 10.30.177.17 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: FGphSSjTt_p4TDvakWcdUi8vvVgtPsODxHEx3CTHa3k_1750317650 X-Mimecast-Originator: gmail.com Content-Transfer-Encoding: quoted-printable content-type: text/plain; charset=WINDOWS-1252; x-default=true X-Rspamd-Server: rspam11 X-Rspam-User: X-Rspamd-Queue-Id: 06569120004 X-Stat-Signature: 7m3gsk1un98jphuu9d6zcrhm1hgpd4mi X-HE-Tag: 1750317655-709188 X-HE-Meta: U2FsdGVkX1+iSJ1/SmnN68zdyysEEmhdP1BdLZ+g9J1WsXHKBAELafCeXEwakCS19nuqLhWLiZWdW7ZkvJHtPibSEbMpAsgmBcgybklG0gMtwXyBfiPjxlrl6wHzfkFdkM4eqZBjGYQ6IsgSzcThjI9EegZAYXJGDMjdofLiDaPJkNQKRdY3/tu2Miv6FUHYAtSMi6lJx5RexS1uxDLHqrvtBQE4RjBVbrCpd5xuesdXj4j3V73CcjmzgRtZR2pjKEcU7u61R2Qn7tGYhD9eM7J3HqzrGgPJsvoC9KoSEYEl2O+NxTbgOWsqTBfnMsBChYGolVxMYlx9jo9+PXctVD5NKIQI8ugoU4SyM3mcE32ZibO5SwIX4v9z27Rga2/w1qbMCnrkuyGfC9EIbIg57Uh0GbpanJlcT/TjgUMz7LVrsvRM3xQOSluszFt+BqtSDMqmtt1NywowFNhmEQUhghOblwKHY5zWkaXk5TrcO9ICRoV5CmTwrntY/NbOBxW7qQlcXnxPApDIzt+lP+mHc6iXPFkHGkzK+ZRja5TbEq36ooIHkunBJUg45ho9gA2IbpN7I1tF/lKwFYXiSa9AaIZf9QSisH2DLyW9VFqI8gtjZrj6Wyn8aZveUL+syfLrgQkZ2BmjZMJZKioAdEtO03FmqAP70FDPPTWA/T1Z9LR1eh/oFwtEQHktGf2EH5jrwV4clau57VsNI1qaAqz9bbT/tG8cQUCzk+iDoGSTV7R5Yc5p3LGY38pxp7+tU7XfuVNmdrM0KjwNcfFBeQajhqIvQEvRBrWQSrm0AqQnM8b1h7VbH/rS4zk2T1qmJkUmt3Vxxbh/ZiTrbo6vh40a/DnuDzq4AXxn3neSS+IlIxgXfTD0YHd41QS4xk0mfBwajoLStb/vMXBwCqhJinP41/6MfhLOtbrfh1itzbL+WQUNGgKJ+2NPqQ7LkZ/hKK3FB/3ws7Z1PVvvqqTsOAu A+u0U1QX EVK1NxPC+HMa25/5/dLVG3Pdt1Hx/ffRacyCoSr/mFz3RCfgjw21vU0DooFgBR816EqWX/fdfwrW9RBbYVRsg2bKtps6ZUiCCCwxS1gusfuba3omYF3eVfQfz3CCt+BGp7ITq9L17zShFAhTQ0e/RXlI9bjVcXp8VBo02Eou/hdQQ0mGxY0/v4+d2/qvoMbCOEDwiTsPcKfukKhIgqEVCrj2MGab6zOseusblk70iFLasxScUWk1tA+PRxBhEOWWhfz1K+rpt+BHmx+6XEWEi0K8N3skEuS6kXNYaB9sziuQ5YeV38Bl8ljo/o2r38cHG4LOUxomr/pRLhr/qz2T9/k4w0rUBIbeU1S/q5Ip+kw1mojZxFhiZfFCZ2WgP6eer7VVg9igLaGTRtQsjcWEk08VGBANNpS8Ifr0o4N0RS7ykN2jiKYM8ty3RGRiYWDxvzov+cHrgBf6jyw1/uTI/Zdjtavr2HcDGQOhTW88MSuhKKe287A/IHNojO+sFG08Wp8VvPh9V0jqNhgkx1cwKVkflJOjWvikiBCNsEoHKcgs9ZcLM5rX6+ofa0Zo5PDvNlhWdo2aOqTeZsob35jhAKvFJVbuueDCIIpy1Te4XP+KG3nW+Tbslc4VyazyE9tBWdPK7yrls1iu2VvjQgKO6x1icNZ0z3+6C2VQm4v+mmmzK6iCVzSKBsHyuCPyvmlaeKMsMlOQezAOQX41F48OKU2ARNHabqPSAngRkcu6OSE2Veyaotsnq/wETyMpU9BukcnID X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Dave Airlie This uses the newly introduced per-node gpu tracking stats, to track GPU memory allocated via TTM and reclaimable memory in the TTM page pools. These stats will be useful later for system information and later when mem cgroups are integrated. Cc: Christian Koenig Cc: Matthew Brost Cc: Johannes Weiner Cc: linux-mm@kvack.org Cc: Andrew Morton Signed-off-by: Dave Airlie --- drivers/gpu/drm/ttm/ttm_pool.c | 22 +++++++++++++++++++++- 1 file changed, 21 insertions(+), 1 deletion(-) diff --git a/drivers/gpu/drm/ttm/ttm_pool.c b/drivers/gpu/drm/ttm/ttm_pool.= c index c2ea865be657..ccc3b9a13e9e 100644 --- a/drivers/gpu/drm/ttm/ttm_pool.c +++ b/drivers/gpu/drm/ttm/ttm_pool.c @@ -130,6 +130,16 @@ static struct list_head shrinker_list; static struct shrinker *mm_shrinker; static DECLARE_RWSEM(pool_shrink_rwsem); =20 +/* helper to get a current valid node id from a pool */ +static int ttm_pool_nid(struct ttm_pool *pool) { +=09int nid =3D NUMA_NO_NODE; +=09if (pool) +=09=09nid =3D pool->nid; +=09if (nid =3D=3D NUMA_NO_NODE) +=09=09nid =3D numa_node_id(); +=09return nid; +} + /* Allocate pages of size 1 << order with the given gfp_flags */ static struct page *ttm_pool_alloc_page(struct ttm_pool *pool, gfp_t gfp_f= lags, =09=09=09=09=09unsigned int order) @@ -149,8 +159,10 @@ static struct page *ttm_pool_alloc_page(struct ttm_poo= l *pool, gfp_t gfp_flags, =20 =09if (!pool->use_dma_alloc) { =09=09p =3D alloc_pages_node(pool->nid, gfp_flags, order); -=09=09if (p) +=09=09if (p) { =09=09=09p->private =3D order; +=09=09=09mod_node_page_state(NODE_DATA(ttm_pool_nid(pool)), NR_GPU_ACTIVE,= (1 << order)); +=09=09} =09=09return p; =09} =20 @@ -201,6 +213,7 @@ static void ttm_pool_free_page(struct ttm_pool *pool, e= num ttm_caching caching, =20 =09if (!pool || !pool->use_dma_alloc) { =09=09__free_pages(p, order); +=09=09mod_node_page_state(NODE_DATA(ttm_pool_nid(pool)), NR_GPU_ACTIVE, -(= 1 << order)); =09=09return; =09} =20 @@ -275,6 +288,7 @@ static void ttm_pool_unmap(struct ttm_pool *pool, dma_a= ddr_t dma_addr, static void ttm_pool_type_give(struct ttm_pool_type *pt, struct page *p) { =09unsigned int i, num_pages =3D 1 << pt->order; +=09int nid =3D ttm_pool_nid(pt->pool); =20 =09for (i =3D 0; i < num_pages; ++i) { =09=09if (PageHighMem(p)) @@ -287,17 +301,23 @@ static void ttm_pool_type_give(struct ttm_pool_type *= pt, struct page *p) =09list_add(&p->lru, &pt->pages); =09spin_unlock(&pt->lock); =09atomic_long_add(1 << pt->order, &allocated_pages); + +=09mod_node_page_state(NODE_DATA(nid), NR_GPU_ACTIVE, -(1 << pt->order)); +=09mod_node_page_state(NODE_DATA(nid), NR_GPU_RECLAIM, (1 << pt->order)); } =20 /* Take pages from a specific pool_type, return NULL when nothing availabl= e */ static struct page *ttm_pool_type_take(struct ttm_pool_type *pt) { =09struct page *p; +=09int nid =3D ttm_pool_nid(pt->pool); =20 =09spin_lock(&pt->lock); =09p =3D list_first_entry_or_null(&pt->pages, typeof(*p), lru); =09if (p) { =09=09atomic_long_sub(1 << pt->order, &allocated_pages); +=09=09mod_node_page_state(NODE_DATA(nid), NR_GPU_ACTIVE, (1 << pt->order))= ; +=09=09mod_node_page_state(NODE_DATA(nid), NR_GPU_RECLAIM, -(1 << pt->order= )); =09=09list_del(&p->lru); =09} =09spin_unlock(&pt->lock); --=20 2.49.0