From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 03700C48297 for ; Mon, 12 Feb 2024 17:36:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 692346B0089; Mon, 12 Feb 2024 12:36:55 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 61B936B008A; Mon, 12 Feb 2024 12:36:55 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4BBA66B008C; Mon, 12 Feb 2024 12:36:55 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 38A5A6B0089 for ; Mon, 12 Feb 2024 12:36:55 -0500 (EST) Received: from smtpin02.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id E97431A070C for ; Mon, 12 Feb 2024 17:36:54 +0000 (UTC) X-FDA: 81783857148.02.C1E5DE3 Received: from mail-qk1-f181.google.com (mail-qk1-f181.google.com [209.85.222.181]) by imf24.hostedemail.com (Postfix) with ESMTP id EADCA180027 for ; Mon, 12 Feb 2024 17:36:52 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=0EnS4ElY; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf24.hostedemail.com: domain of brho@google.com designates 209.85.222.181 as permitted sender) smtp.mailfrom=brho@google.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1707759413; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=92v+u3mzExHhKbb5vQvEaRbdxm1C8+uQ73xmvxKl9t8=; b=1NhuOGCCgwlV7jC8p16AR0JZZoHLmKnacVbC4KAgudKtxhy7j+ddChCnOHl0ps62s3AQuQ 7nqrwgLLAoGerJc3O4mC3Ba4wQ5A0OT0HaPnyfA9wnLbhkRQr77Se2+ouKYcCi1FSS+buY jVWkQdhFgLLrWt8IDuoabx0p/hIgid8= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=0EnS4ElY; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf24.hostedemail.com: domain of brho@google.com designates 209.85.222.181 as permitted sender) smtp.mailfrom=brho@google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1707759413; a=rsa-sha256; cv=none; b=v39aCtDpEEJdj/nzFI/9VuiL4gCJZIN8ZvnUgJXE5z1NC4Nm4UmABFIzL6eBHmyYFK658Y XvaSOb9hCfJm43aqyp+g/clrjtbVWf8TesC1L5zUFYH+YzQYZHM/j84s8htwdQw52A9i2z 625u6SxVjc4p1JS6eIuIvInvI3GATuE= Received: by mail-qk1-f181.google.com with SMTP id af79cd13be357-785d5705681so99027885a.1 for ; Mon, 12 Feb 2024 09:36:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1707759412; x=1708364212; darn=kvack.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=92v+u3mzExHhKbb5vQvEaRbdxm1C8+uQ73xmvxKl9t8=; b=0EnS4ElYyISpMv/B64foCr1j4TD1OJFDCSXgAH/oESEI6vvTy3CJFcEc8CdRrYBII5 t2LUx7IyIrTkJ+hKLONCqGwqtk0K6LTxlw4G2JBDGYfNlDpKst4J2xmkUL22Ql/n9ebz XGhMl3mYrsc8idc5IlmPpnNBa37t6grfWqNpkVLuIiscTNZjmeOGJYYI3B6jZ6KuumNd 3oKVKhxz6aF+YeburqtYfbcyR48TGRbG9nKekHXj6yO6gWJd9MVuAwhCN3UHMnXyL39q V7e+eat9Hsz9L+aNDjMvOyl3Av1Qkjl+qSoud5YqUJq39Mi9v6b/oKt+00Rmu7o0Jj62 hsow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707759412; x=1708364212; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=92v+u3mzExHhKbb5vQvEaRbdxm1C8+uQ73xmvxKl9t8=; b=ef6QetnYPKTx0HZpR2MIAIXFM8r4MW0BCP98m5IFxQHRgn/PWc0q5I00HZqg0Q/mc+ qiOUY6aY0npee9e3GPi6w/nO6F2rPDWZO5E/R3wRcxCd8nXoHmKfOL88ur4bVP1VvyDH bzE36RvBysLZaoc15xcejj2HbY/9oDh0MHKJmp0qOmRw6irMoeYdA+UQNvGDUe9Rn6wn Yzt0qI7G0qOS5knPf4ElkLQADlLYHjnmy2/D7mEJ6tEmzH43GxLl/MGfShc8TPl8+QBS 4/eBzxFj4kcndmOSsZWxK41z2ah7rmc2D+dXLeCusTqoB6ir9qMAKkaUOH9xLTJgbonG TSuw== X-Forwarded-Encrypted: i=1; AJvYcCXiN04pWTTKaF3e6ECRUMirh7OWzVwy4IJo2ti2trYBbqfz2sroFq9tNK7vpLjj4kMgOx1ir/hjtJuPckvV2lY9Qsw= X-Gm-Message-State: AOJu0Yw6nd/R1GJn7pc3rk3LkX5aNL0nKSYPmCdEinWONw9d+unF2ue1 HMNjlZ92KZUJRBTK2mjoAlg8B95ae7xzxNqrJ1qBtVzqMnmU9vmEAPR+wLAGjg== X-Google-Smtp-Source: AGHT+IH1mHBmkxv29If4/T4Nu6zNWYBDt03eLvNV2rJw01Oh0BAKyWG4tGMV3FQEp1f8h6IAa4bqDw== X-Received: by 2002:a05:620a:28c4:b0:785:d986:4a44 with SMTP id l4-20020a05620a28c400b00785d9864a44mr394110qkp.8.1707759411947; Mon, 12 Feb 2024 09:36:51 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCX8P/wKeHSCVxqDUrOlyHSOhwWtPzveebFEBUX4/en7WAQ0bL2Ixvko7Ema8+rSBdCxD6DFDwSRpJAmLRn9R9VCmIWAu56dfM6nQM82hGghkcTses2S3s107wyqVTQd/FTc4J++zkbX4KY0kMNd5owF+ryo4n5M4u0PsG5GVeGERUBeezEKNq4X1dAhjS9ktmEyzLRzth6IUDGMV6TEDAmzK9Ak5bHd1COeK72OXUtNvX5UOFVMkq6ZccQrfh3hYn9FSAcfQbqMyg6oiNPegs6ZQbqcNxpz6bghtnIaZTYfbF9zoW4iNQMPWooqIC/1nGI0U59qfV8P0qud8fzHLwDPzTjp970CoJyWXkXt0dETzfNxmreG6tBhUJD9 Received: from [192.168.1.31] (d-24-233-113-151.nh.cpe.atlanticbb.net. [24.233.113.151]) by smtp.gmail.com with ESMTPSA id m4-20020a05620a24c400b00785bdc9d08esm2217670qkn.32.2024.02.12.09.36.50 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 12 Feb 2024 09:36:51 -0800 (PST) Message-ID: Date: Mon, 12 Feb 2024 12:36:49 -0500 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2 bpf-next 00/20] bpf: Introduce BPF arena. Content-Language: en-US To: Alexei Starovoitov Cc: bpf@vger.kernel.org, daniel@iogearbox.net, andrii@kernel.org, memxor@gmail.com, eddyz87@gmail.com, tj@kernel.org, hannes@cmpxchg.org, lstoakes@gmail.com, akpm@linux-foundation.org, urezki@gmail.com, hch@infradead.org, linux-mm@kvack.org, kernel-team@fb.com References: <20240209040608.98927-1-alexei.starovoitov@gmail.com> From: Barret Rhoden In-Reply-To: <20240209040608.98927-1-alexei.starovoitov@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspam-User: X-Stat-Signature: srego1m7to5ofufy9ts1wcengyinkx8o X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: EADCA180027 X-HE-Tag: 1707759412-801828 X-HE-Meta: U2FsdGVkX1/IwZs93QrsPnpKL37NxplWqUWTcB8clmk5HfprAmqa2rM7KwYBPPcOwc5i/lzFbtfRptK8tBh3XXL0JgzC76FwVNPH7yPOL0kN/zgwDVZxWRgUZYUZTwZZGMBYffmKlC35F3yGK1bkQswO6xZf3/5weK48/xX2XrHG0P/LhTi6ibW7i3tX0oEobcPeCUfLfUZoacQIjyCLLJZNyxVHE5oaI7TbYqYygoNGXddO8Xu9vJYMaqp8qR7+iXzk4of39284iVzYbO4w5xfz2cXpoPjj9xtrvPK50jKouqt/IrA4NEaO8OZx90sfxLHRGTLy1lk8XSqyjSTWZO1m4j6f5u5Y4es+Pk+iWH8UAW+RZ6B8NhnJLRBW6qXZ6o4nkIp0pzVNORHTOF1MHoFSO23tgGbYZZapgsteF2govJBG5/vpCu96NZUIj91StVEUvUP/kybxev1AuFDxFopkUYHVTisrWu3kQuybXI1VshV25NfNSnn+2CDv1+396ia2pK92iCmQGmPGf13S7bCkwlzvTwKUQnCgPu7OcavvnCYPYGVHWKwk1wGw2kLXi0dEyMwHI4puJN14I51GMrtZpz/KUO5tIBgrYBjgsE0hhytfoOaBJKwzXM1xk97wmDQ/Kur7/nZRCiLsSq2C67g/bfUykNaVVYOeQ98EWZV5jo98p8EzF3TLL++4XsENje44KxY2lgMqn5OcT96Kyxxn/p3W4ZJX81v2aRWMk3smTXiVt38uyzd/szDBwR8hm657enRYrBPYcW0GuwV25A4hAECBtPxHjhPJIv9ZFHD9HRGV/IMeOYLzaCEuxgV8dyg6KNhwvd72kTkrZmJGPT+lSLWh7b0N+79r/CddNFDXR+aWZhr5xpzPM/82zFMuUNNVpJ/16fC8zyCsC1N6nFDNCGStB0acaAOz622sROPUAJkwZL4UoIgE6/TF/FAsVqm29oB4PD8yDOm4ur+ CZUlrm6c aWPkTGUVsdM1s55FrhOpH5z9or8Osy7H1Q5uCLQ9cIO1d6i7OsiESXyu04IbEBEn030nSGUAu2MqnN1J534nqDLpR0P6c1ncOezP0jbdt2A9UE34kIpvQPUDXUMMQ+ZfkSVxegUerttn7w0lQeUMQLygcYCOkMu/k6rH3xpDr08IocuqrVVSI9WHQJJQMKnYmeHYqLpZhkjWB2byIfYEpPEgab2DtAOI6hZ72MU/rnGBx/x0LeV17Jef1oodCgsBQCD4wayD1PY6Hp3m4dLhQw7CvXtInH4Jrrf20ZFjPuKwNipD1Y4e2uls12B8FQnjOMqplOdCbag+IAOrH8HiN85xUzT5KjDm02OsM76owsHjoyPKduxDaGnHkBRyPK+f7ns6S6TUoaRv5cReYTqs/ILlj8t2PYlMOBFJKjtXJ5KmZNsog3WXXLLJ/GWJXQsZSkc4Sooqz4HTOKwJ7qdfbLZTfW699QBk1jSqkrBnRq05yTIl2JFg6J1ScYg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 2/8/24 23:05, Alexei Starovoitov wrote: > The work on bpf_arena was inspired by Barret's work: > https://github.com/google/ghost-userspace/blob/main/lib/queue.bpf.h > that implements queues, lists and AVL trees completely as bpf programs > using giant bpf array map and integer indices instead of pointers. > bpf_arena is a sparse array that allows to use normal C pointers to > build such data structures. Last few patches implement page_frag > allocator, link list and hash table as bpf programs. thanks for the shout-out. FWIW, i'm really looking forward to the BPF arena. it'll be a little work to switch from array maps to the arena, but in the long run, it'll vastly simplify our scheduler code. additionally, the ability to map in pages on demand, instead of preallocating a potentially large array map, will both save memory as well as allow me to remove some artificial limitations on what our scheduler can handle. (e.g. don't limit ourselves to 64k threads). thanks, barret