From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2660EECAAD1 for ; Wed, 31 Aug 2022 22:19:31 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8680A6B0073; Wed, 31 Aug 2022 18:19:30 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 8171D6B0074; Wed, 31 Aug 2022 18:19:30 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6B8E66B0075; Wed, 31 Aug 2022 18:19:30 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 5DCA06B0073 for ; Wed, 31 Aug 2022 18:19:30 -0400 (EDT) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 36B8540191 for ; Wed, 31 Aug 2022 22:19:30 +0000 (UTC) X-FDA: 79861305300.07.EE8C1F7 Received: from mail-vs1-f50.google.com (mail-vs1-f50.google.com [209.85.217.50]) by imf14.hostedemail.com (Postfix) with ESMTP id DBE83100030 for ; Wed, 31 Aug 2022 22:19:29 +0000 (UTC) Received: by mail-vs1-f50.google.com with SMTP id i1so5796284vsc.9 for ; Wed, 31 Aug 2022 15:19:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc; bh=AWZYQnfan1bJ9GVCNBmyZROKJBcbdAllrd1bujLULUY=; b=dIvdefwaZbVNNqxh58j/aN2+eJRZ99cdEUmZC1J0cvPnn8cQuWt1+PInXHWHuD86Ro kUUwpAt8eLCA1sOqsb23HOTSSSoFU8FV9mURgEs1ycFph/6ImAZMOpyQGA2HHzU/WQj6 qbvtJIAFvKWzXCkus1+g/Ks1t9ag0iaV+KhvBBU/KEtVQ1oxAITPF8No6eMViA8oktNL fj+WxeXrs49XTdF0UWkU474Bg5OYUt/4xAyqLxWNwsHFVm9wECowDjpI1a6GFj+otplu VlhUILHGh6hu65+zZSjlpg2G2QL32OR+YKzids3xS0QPdZFGBnezavGjEnHtulocVp+C BmeA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc; bh=AWZYQnfan1bJ9GVCNBmyZROKJBcbdAllrd1bujLULUY=; b=4zJMx8n8FmSS8uOotBc0FN/2uihz0CMG+GjUZNE8jr9fTjDXPo2GkFu6g3LwOkTGOT FI+C+GwRDmnqoRZQ8PKqKD6m55dyT9pwMs18Us5DOP1KvxaZr0GzIdeHkhzTOUBHsnot VkSSr6Xb488oC3lTewawfkpPg1x5tBDoogSe26kkN7oHr1KukOpzDr4BVlwJBUT5Cs+K UuRY7zr/HtYW3huPhmWGeZ8qA4fY7SemLc8oFdqAUwXdS9nxmgxsJDIU4SSYOtGb/vQg saMWuyx/OzqPXP9IVHnsYzMA3Q0SpNRkn87bn6+YterTP7C5fdu6raYVm8xJu6T85dAr xPmg== X-Gm-Message-State: ACgBeo2mRUsKPDnqLDMNM9jIwAU/hYX30gapeJc2IEWpbPk+iHux8Zph e8ZXu31uZLpjP80E0PNpEilL1fCXPXyHJR8hjrAPoQ== X-Google-Smtp-Source: AA6agR6qB/hK2H0DqIQnLfQXxQ5YBcusYTQ4Uhij460P3WvW0T5tBjs9Eu81k8/3Y7BrMETRjUoukeCZSc+ZR44TKS0= X-Received: by 2002:a67:f909:0:b0:390:e960:7f5a with SMTP id t9-20020a67f909000000b00390e9607f5amr4984075vsq.50.1661984369049; Wed, 31 Aug 2022 15:19:29 -0700 (PDT) MIME-Version: 1.0 References: <20220815071332.627393-1-yuzhao@google.com> <20220831041731.3836322-1-yuzhao@google.com> In-Reply-To: <20220831041731.3836322-1-yuzhao@google.com> From: Yu Zhao Date: Wed, 31 Aug 2022 16:18:50 -0600 Message-ID: Subject: Re: OpenWrt / MIPS benchmark with MGLRU To: Arnd Bergmann , Dave Hansen Cc: Linux-MM , Andrew Morton , Andi Kleen , Aneesh Kumar , Catalin Marinas , Dave Hansen , Hillf Danton , Jens Axboe , Johannes Weiner , Jonathan Corbet , Linus Torvalds , Matthew Wilcox , Mel Gorman , Michael Larabel , Michal Hocko , Mike Rapoport , Peter Zijlstra , Tejun Heo , Vlastimil Babka , Will Deacon , Linux ARM , "open list:DOCUMENTATION" , linux-kernel , "the arch/x86 maintainers" , Kernel Page Reclaim v2 Content-Type: text/plain; charset="UTF-8" ARC-Authentication-Results: i=1; imf14.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=dIvdefwa; spf=pass (imf14.hostedemail.com: domain of yuzhao@google.com designates 209.85.217.50 as permitted sender) smtp.mailfrom=yuzhao@google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1661984369; a=rsa-sha256; cv=none; b=XGETmSaKTD9XMBWGndHPvyrgKjcRPAUHM4PxENoPkhvWbp+QiTsuKSZX3NpDRxu2SV2kTE cDVvDc1DPh45s15ohWw01rbWIdiG9PHrXJB4KjO/yFnuNtYzhkYw2YdgkuKddFhQ0VSzrm sZ8JcXtyNDK5OJ9xqA7Bhcsks7gQ+1c= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1661984369; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=AWZYQnfan1bJ9GVCNBmyZROKJBcbdAllrd1bujLULUY=; b=bUeZ2kVEGEiknXcaPn/6701odztc07rFNmnTe+ot+UjxZXbsG+inIPWNMrHJeR9A7pUk+Y f6VB4dCJ5TjBaQNLC4IE70YeT9Lg/T6SPH+EM01vgafbgR5X01og83GfBt2Z42vsHCLQ3H F3DT76Fur7vfK7OZ/fHspEVqTWkZMJw= X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: DBE83100030 X-Rspam-User: Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=dIvdefwa; spf=pass (imf14.hostedemail.com: domain of yuzhao@google.com designates 209.85.217.50 as permitted sender) smtp.mailfrom=yuzhao@google.com; dmarc=pass (policy=reject) header.from=google.com X-Stat-Signature: chmp9ea1syuwo3nbgjs9kj49jn1i5ju6 X-HE-Tag: 1661984369-279685 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue, Aug 30, 2022 at 10:17 PM Yu Zhao wrote: > > TLDR > ==== > RAM utilization Throughput (95% CI) P99 Latency (95% CI) > ---------------------------------------------------------- > ~90% NS NS > ~110% +[12, 16]% -[20, 22]% > > Abbreviations > ============= > CI: confidence interval > NS: no statistically significant difference > DUT: device under test > ATE: automatic test equipment > > Rational > ======== > 1. OpenWrt is the most popular distro for WiFi routers; many of its > targets use big endianness [1]. > 2. 4 out of the top 5 bestselling WiFi routers in the US use MIPS [2]; > MIPS uses software-managed TLB. > 3. Memcached is the best available memory benchmark on OpenWrt; > admittedly such a use case is very limited in the real world. Thanks. My goal is to encourage MM people to extend their test coverage to some commonly used but less tested configurations. I carefully constructed this benchmark with the balance between its representativeness and the effort to reproduce. When I wear my MM hat, I see ER-8 as the ideal choice because it comes with a serial port, a replaceable memory DIMM and one of the two cores that can be disabled. The same SoC is also what the Debian MIPS port mainly uses for their testing [1]. So if I need help, I might be able to get it from them. >From OpenWrt's / MIPS OEMs' POVs, I do see ER-8 as an uninteresting platform. Currently the best selling WiFi router on Amazon US is Archer A7, a knockoff of Archer C7. The latter comes with not only the serial port header but also the JTAG header, and that's what I use. But I seriously doubt showing how I work on C7 would encourage MM people to try it. I snapped a pictures of it during lunch: https://drive.google.com/file/d/1rYBwLOyMqBSr6WKUZd7Gbf9RfwA641X5/ And other boards I routinely test the MM performance on: https://drive.google.com/file/d/1yBMx9OPWw-5czvz3maNUy6WBFwPvAqG5/ All the way dates back to this vintage: https://drive.google.com/file/d/12N21qiWSoyJgZwVkwAhY8_5Fj4dKftqD/ [1] https://wiki.debian.org/MIPSPort