From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 48109C3DA60 for ; Thu, 18 Jul 2024 09:15:11 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B2BA26B0085; Thu, 18 Jul 2024 05:15:10 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id ADBF96B0088; Thu, 18 Jul 2024 05:15:10 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 97C2E6B0089; Thu, 18 Jul 2024 05:15:10 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 7A3766B0085 for ; Thu, 18 Jul 2024 05:15:10 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 1D59F14199D for ; Thu, 18 Jul 2024 09:15:10 +0000 (UTC) X-FDA: 82352314380.19.D331EDF Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) by imf30.hostedemail.com (Postfix) with ESMTP id C7E0F80030 for ; Thu, 18 Jul 2024 09:15:07 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf30.hostedemail.com: domain of shiju.jose@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=shiju.jose@huawei.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1721294075; a=rsa-sha256; cv=none; b=tksMphQ9f2sh2gtAhf3J2XJxXzQzeB3MTgtBYjy39HQXQ87v3BSPAanvo13s+ffv390059 ZY0BkUPXJuA3oLO+/d6BiDEX4mNs47wTSYMktu33hkqAvgNS6lwlg99PWxV8pygUspx/N9 gmxqlOUhcb5dIMBokNoCJnmBN3sFnHU= ARC-Authentication-Results: i=1; imf30.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf30.hostedemail.com: domain of shiju.jose@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=shiju.jose@huawei.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1721294075; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v9s6mfMxpIj87O89hiFNln1Um0ChrJ5CQkWMBhDKIf8=; b=jS0TB64ZeWrLA0Y2+YvK13CtTVMAf/cWbOXFHHB4bEctJvOduP99siD3DaeCSZQcwqbhCz nPzrjIoCl+S5+kBLoiIdpdaWJP3+4UEnOLATGBSFnzAytsvhDzavp9KKymJFZt09I3cx7S VU+VWdJ0CeTRWH/9t4mc6p5+I3eGTdc= Received: from mail.maildlp.com (unknown [172.18.186.31]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4WPnC50ZDwz6K93k; Thu, 18 Jul 2024 17:12:49 +0800 (CST) Received: from lhrpeml500001.china.huawei.com (unknown [7.191.163.213]) by mail.maildlp.com (Postfix) with ESMTPS id 88A7A140594; Thu, 18 Jul 2024 17:15:04 +0800 (CST) Received: from lhrpeml500006.china.huawei.com (7.191.161.198) by lhrpeml500001.china.huawei.com (7.191.163.213) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Thu, 18 Jul 2024 10:15:04 +0100 Received: from lhrpeml500006.china.huawei.com ([7.191.161.198]) by lhrpeml500006.china.huawei.com ([7.191.161.198]) with mapi id 15.01.2507.039; Thu, 18 Jul 2024 10:15:04 +0100 From: Shiju Jose To: "nifan.cxl@gmail.com" CC: "linux-edac@vger.kernel.org" , "linux-cxl@vger.kernel.org" , "linux-acpi@vger.kernel.org" , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , "bp@alien8.de" , "tony.luck@intel.com" , "rafael@kernel.org" , "lenb@kernel.org" , "mchehab@kernel.org" , "dan.j.williams@intel.com" , "dave@stgolabs.net" , "Jonathan Cameron" , "dave.jiang@intel.com" , "alison.schofield@intel.com" , "vishal.l.verma@intel.com" , "ira.weiny@intel.com" , "david@redhat.com" , "Vilas.Sridharan@amd.com" , "leo.duran@amd.com" , "Yazen.Ghannam@amd.com" , "rientjes@google.com" , "jiaqiyan@google.com" , "Jon.Grimm@amd.com" , "dave.hansen@linux.intel.com" , "naoya.horiguchi@nec.com" , "james.morse@arm.com" , "jthoughton@google.com" , "somasundaram.a@hpe.com" , "erdemaktas@google.com" , "pgonda@google.com" , "duenwen@google.com" , "mike.malvestuto@intel.com" , "gthelen@google.com" , "wschwartz@amperecomputing.com" , "dferguson@amperecomputing.com" , "wbs@os.amperecomputing.com" , tanxiaofei , "Zengtao (B)" , "Roberto Sassu" , "kangkang.shen@futurewei.com" , wanghuiqiang , Linuxarm Subject: RE: [RFC PATCH v9 06/11] cxl/mbox: Add SET_FEATURE mailbox command Thread-Topic: [RFC PATCH v9 06/11] cxl/mbox: Add SET_FEATURE mailbox command Thread-Index: AQHa15F5gzHvz4/u302D5kaH2VCdSrH7S7MAgADqw7A= Date: Thu, 18 Jul 2024 09:15:04 +0000 Message-ID: <6b2235ab7d35400c88f1d0110222c56c@huawei.com> References: <20240716150336.2042-1-shiju.jose@huawei.com> <20240716150336.2042-7-shiju.jose@huawei.com> <66982618.050a0220.e9611.19eb@mx.google.com> In-Reply-To: <66982618.050a0220.e9611.19eb@mx.google.com> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.126.174.201] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: C7E0F80030 X-Stat-Signature: ohwkj51j8mkgd9548msc4j96nircy3qz X-Rspam-User: X-HE-Tag: 1721294107-887148 X-HE-Meta: U2FsdGVkX1/MuIAXpqYQ8H6YT82Obs2Ml1Ah6QOPspaCeCWSzFhcu5JDhfmLbBhrnCZ7UUXS7fq52rkq7K7z8jPVaVAWLmzECeO/eOedBcgRcxVxZQpncoJUijLg/pkwcwyxFllEIATDtgvnccALBFoSyicy47/w+Qn9vbGLXtFAoZRYaQFake6GqwLJLekndTmrz6ZPy2h05AVK8xOmAjeMGTR2Aeta1+nWPkUgSfEaXIIGxQbHkwKu8/PNVymN7DVfxOeJh+/NHyeAA/2C22Sbt1I9DHQUkg1pfUJIOeKmJxcU+yNpGdmCtbO/Kza8B/baZe2FW6ZTBTso49RMIbqVl3eqdtAhMZjrWexIyqQVM1VXEBjhZzSGGO/8s/V470nGEZFCIA9ci/Af+hgHn9CvTsMD1XHHFcl52zbJfjP3FhCKz8ybj8ufPsjfuoDEHuoBQTLMQ7FrS28WYIHffJFdtOu1cbQnpcZNcntvAKJ7LyQwhJXJQ2lqFx19S2Nu6VdDF+6/IrN1FIAWjXNCL1cJoBbJTc/JL8goMYEjxOdxYqZi78evFIyc0FsIeqiX7u9XdCqAWUoBplHC4vq+UvZ0Etzxm6+WRIPo8nIysgPow4xJcVV7SWUFpv1vrb4mBD6BJ1NzDRHjFfg11X8VGp6J3fQdjdVREHtT3Mer2hhCzklUyrS1UjmyK52uR9nXI5v7tATV5e27WH6TRJ0jpMmLNdFlfsc1iV+rQlsWn14C034W4gZQ0WsvXdl2qacXFk3YKJ3IVTypwWFtl1M7+IhEuBQAa7HyTCg0jaVmyqRW+8p+HIf+H1Z6RlCkRN0qoeY6i6VWb2kHv8IGmtMuzU9drbj/5atvIj+25YfC9P/DqIa9TpxsEI2EQNeNNcK4Ol5/XHmvRLkf0vLH2XGXcocUzlGEdBt7dIJIJQQQ2smq2bPjmGacaPr4BaYbVBg222lQRRqdgtc8VST5lvQ UCTG/Dm3 vBVSeTwkBNlMyl+wXtPvIWHor7FqPO8z+Ej1x2DujtDjla9u989L0FbiRsZlC9U+ng3FaYXV7ncjcKQD77oFeFB8+dosBpROWZ9lUQgLh8bI34M4Q+bCgvJlC0dIx2+Dses7LyfERmMyqOXuvs7ccatqi6w76jjZd5/uwF/0n4ZzF8gEKwg7U2CVXvRfiAPxsCF90JJwJhz5NHBMqlOWrxKMPrIXvQSB5fZrVDhnSkiaSayoLuUcAXPrJkSlZWALnZ8Na/3l3lfZGmDAI9Qp0wrrhmPPH3FxdGqZ47XY91H5w6cTwGKlU4A9qHm4N2j0l588hk7pynDLTXQS1rl6g3G9wYO5mRcUVIoIU3tdXTobPCVFCc1EbfmA94hgW6O3tR4KZOzkJYuR/dOzJ/XxYBUNseiLGUhNwPq1Bjhj3Lj2qlyHApCLsWtj+cmar7Cv0lGEuf1klqdjh39rvCklW4kkpMdIU6Ij6Ug0eBjt55097kPdprRm41f0+v6bG/zNYsoEC+/GFxTiyMYqo2nTAijveuy1JfoyQupfcCJ43GvSHWwGwzF1vkmxPtYfS7CAMB2BzdZEaGWkkz59k6/kRJdRxSSVG/vu+yXo2ykw6lN9fXUdqMvnYLS2fGUiestTV4KwNG/k95QKlgrBh9OU+mUHM7mdjIKNI4Yw1MdWdz2pEEe3tjZJoCrUkkwvRSxtD0H1hbVdS9FnVTWnzT7Z3X5sTr7rmnmjj6f0zatCXrE/pes7zCsA3dB9MzEW71lxVI0rBVkmb1aOWQva1QO09ca/8GvnX2fsufChnXfpbhCZgCsjNu5Z0figg+iP+YJsNSbf+hlBHjfQ/huslblEzCGYhlKRTfh7EtTcLm4KH36AEEcjhhAhIMQPGL81lIUm0LB6f+EUMRjPIb+7+PIOgq2j4ch5BTCOzaKBpmq0zHU/hGC9atSFRcKLzGR6rJDidaa4RTFw1ag2Ccxw= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: >-----Original Message----- >From: nifan.cxl@gmail.com >Sent: 17 July 2024 21:14 >To: Shiju Jose >Cc: linux-edac@vger.kernel.org; linux-cxl@vger.kernel.org; linux- >acpi@vger.kernel.org; linux-mm@kvack.org; linux-kernel@vger.kernel.org; >bp@alien8.de; tony.luck@intel.com; rafael@kernel.org; lenb@kernel.org; >mchehab@kernel.org; dan.j.williams@intel.com; dave@stgolabs.net; Jonathan >Cameron ; dave.jiang@intel.com; >alison.schofield@intel.com; vishal.l.verma@intel.com; ira.weiny@intel.com; >david@redhat.com; Vilas.Sridharan@amd.com; leo.duran@amd.com; >Yazen.Ghannam@amd.com; rientjes@google.com; jiaqiyan@google.com; >Jon.Grimm@amd.com; dave.hansen@linux.intel.com; >naoya.horiguchi@nec.com; james.morse@arm.com; jthoughton@google.com; >somasundaram.a@hpe.com; erdemaktas@google.com; pgonda@google.com; >duenwen@google.com; mike.malvestuto@intel.com; gthelen@google.com; >wschwartz@amperecomputing.com; dferguson@amperecomputing.com; >wbs@os.amperecomputing.com; nifan.cxl@gmail.com; tanxiaofei >; Zengtao (B) ; Roberto >Sassu ; kangkang.shen@futurewei.com; >wanghuiqiang ; Linuxarm > >Subject: Re: [RFC PATCH v9 06/11] cxl/mbox: Add SET_FEATURE mailbox >command > >On Tue, Jul 16, 2024 at 04:03:30PM +0100, shiju.jose@huawei.com wrote: >> From: Shiju Jose >> >> Add support for SET_FEATURE mailbox command. >> >> CXL spec 3.1 section 8.2.9.6 describes optional device specific features= . >> CXL devices supports features with changeable attributes. >> The settings of a feature can be optionally modified using Set Feature >> command. > >Add more specific spec reference to the command here: 8.2.9.6.3. >The same suggestions for get supported features and get feature commands. Will do. > >> >> Signed-off-by: Shiju Jose >> --- >> drivers/cxl/core/mbox.c | 71 >+++++++++++++++++++++++++++++++++++++++++ >> drivers/cxl/cxlmem.h | 33 +++++++++++++++++++ >> 2 files changed, 104 insertions(+) >> >> diff --git a/drivers/cxl/core/mbox.c b/drivers/cxl/core/mbox.c index >> b1eeed508459..50ecd2bd7372 100644 >> --- a/drivers/cxl/core/mbox.c >> +++ b/drivers/cxl/core/mbox.c >> @@ -1388,6 +1388,77 @@ size_t cxl_get_feature(struct cxl_memdev_state >> *mds, } EXPORT_SYMBOL_NS_GPL(cxl_get_feature, CXL); >> >> +/* >> + * FEAT_DATA_MIN_PAYLOAD_SIZE - min extra number of bytes should be >> + * available in the mailbox for storing the actual feature data so >> +that >> + * the feature data transfer would work as expected. >> + */ >> +#define FEAT_DATA_MIN_PAYLOAD_SIZE 10 int cxl_set_feature(struct >> +cxl_memdev_state *mds, >> + const uuid_t feat_uuid, u8 feat_version, >> + void *feat_data, size_t feat_data_size, >> + u8 feat_flag) >> +{ >> + struct cxl_memdev_set_feat_pi { >> + struct cxl_mbox_set_feat_hdr hdr; >> + u8 feat_data[]; >> + } __packed; >> + size_t data_in_size, data_sent_size =3D 0; >> + struct cxl_mbox_cmd mbox_cmd; >> + size_t hdr_size; >> + int rc =3D 0; >> + >> + struct cxl_memdev_set_feat_pi *pi __free(kfree) =3D >> + kmalloc(mds->payload_size, >GFP_KERNEL); >> + pi->hdr.uuid =3D feat_uuid; >> + pi->hdr.version =3D feat_version; >> + feat_flag &=3D ~CXL_SET_FEAT_FLAG_DATA_TRANSFER_MASK; > >Although we may not support it yet, should we set bit[3] (saved across res= et) >since we already defined CXL_SET_FEAT_FLAG_DATA_SAVED_ACROSS_RESET >and it is not used? Will do. > >Fan >> + hdr_size =3D sizeof(pi->hdr); >> + /* >> + * Check minimum mbox payload size is available for >> + * the feature data transfer. >> + */ >> + if (hdr_size + FEAT_DATA_MIN_PAYLOAD_SIZE > mds->payload_size) >> + return -ENOMEM; >> + >> + if ((hdr_size + feat_data_size) <=3D mds->payload_size) { >> + pi->hdr.flags =3D cpu_to_le32(feat_flag | >> + >CXL_SET_FEAT_FLAG_FULL_DATA_TRANSFER); >> + data_in_size =3D feat_data_size; >> + } else { >> + pi->hdr.flags =3D cpu_to_le32(feat_flag | >> + >CXL_SET_FEAT_FLAG_INITIATE_DATA_TRANSFER); >> + data_in_size =3D mds->payload_size - hdr_size; >> + } >> + >> + do { >> + pi->hdr.offset =3D cpu_to_le16(data_sent_size); >> + memcpy(pi->feat_data, feat_data + data_sent_size, >data_in_size); >> + mbox_cmd =3D (struct cxl_mbox_cmd) { >> + .opcode =3D CXL_MBOX_OP_SET_FEATURE, >> + .size_in =3D hdr_size + data_in_size, >> + .payload_in =3D pi, >> + }; >> + rc =3D cxl_internal_send_cmd(mds, &mbox_cmd); >> + if (rc < 0) >> + return rc; >> + >> + data_sent_size +=3D data_in_size; >> + if (data_sent_size >=3D feat_data_size) >> + return 0; >> + >> + if ((feat_data_size - data_sent_size) <=3D (mds->payload_size - >hdr_size)) { >> + data_in_size =3D feat_data_size - data_sent_size; >> + pi->hdr.flags =3D cpu_to_le32(feat_flag | >> + >CXL_SET_FEAT_FLAG_FINISH_DATA_TRANSFER); >> + } else { >> + pi->hdr.flags =3D cpu_to_le32(feat_flag | >> + >CXL_SET_FEAT_FLAG_CONTINUE_DATA_TRANSFER); >> + } >> + } while (true); >> +} >> +EXPORT_SYMBOL_NS_GPL(cxl_set_feature, CXL); >> + >> int cxl_mem_get_poison(struct cxl_memdev *cxlmd, u64 offset, u64 len, >> struct cxl_region *cxlr) >> { >> diff --git a/drivers/cxl/cxlmem.h b/drivers/cxl/cxlmem.h index >> 25698a6fbe66..c3cb8e2736b5 100644 >> --- a/drivers/cxl/cxlmem.h >> +++ b/drivers/cxl/cxlmem.h >> @@ -532,6 +532,7 @@ enum cxl_opcode { >> CXL_MBOX_OP_GET_SUP_LOG_SUBLIST =3D 0x0405, >> CXL_MBOX_OP_GET_SUPPORTED_FEATURES =3D 0x0500, >> CXL_MBOX_OP_GET_FEATURE =3D 0x0501, >> + CXL_MBOX_OP_SET_FEATURE =3D 0x0502, >> CXL_MBOX_OP_IDENTIFY =3D 0x4000, >> CXL_MBOX_OP_GET_PARTITION_INFO =3D 0x4100, >> CXL_MBOX_OP_SET_PARTITION_INFO =3D 0x4101, >> @@ -780,6 +781,34 @@ struct cxl_mbox_get_feat_in { >> u8 selection; >> } __packed; >> >> +/* >> + * Set Feature CXL 3.1 Spec 8.2.9.6.3 */ >> + >> +/* >> + * Set Feature input payload >> + * CXL rev 3.1 section 8.2.9.6.3 Table 8-101 */ >> +/* Set Feature : Payload in flags */ >> +#define CXL_SET_FEAT_FLAG_DATA_TRANSFER_MASK GENMASK(2, 0) >> +enum cxl_set_feat_flag_data_transfer { >> + CXL_SET_FEAT_FLAG_FULL_DATA_TRANSFER, >> + CXL_SET_FEAT_FLAG_INITIATE_DATA_TRANSFER, >> + CXL_SET_FEAT_FLAG_CONTINUE_DATA_TRANSFER, >> + CXL_SET_FEAT_FLAG_FINISH_DATA_TRANSFER, >> + CXL_SET_FEAT_FLAG_ABORT_DATA_TRANSFER, >> + CXL_SET_FEAT_FLAG_DATA_TRANSFER_MAX >> +}; >> +#define CXL_SET_FEAT_FLAG_DATA_SAVED_ACROSS_RESET BIT(3) >> + >> +struct cxl_mbox_set_feat_hdr { >> + uuid_t uuid; >> + __le32 flags; >> + __le16 offset; >> + u8 version; >> + u8 rsvd[9]; >> +} __packed; >> + >> /* Get Poison List CXL 3.0 Spec 8.2.9.8.4.1 */ struct >> cxl_mbox_poison_in { >> __le64 offset; >> @@ -918,6 +947,10 @@ size_t cxl_get_feature(struct cxl_memdev_state >*mds, >> const uuid_t feat_uuid, void *feat_out, >> size_t feat_out_size, >> enum cxl_get_feat_selection selection); >> +int cxl_set_feature(struct cxl_memdev_state *mds, >> + const uuid_t feat_uuid, u8 feat_version, >> + void *feat_data, size_t feat_data_size, >> + u8 feat_flag); >> int cxl_poison_state_init(struct cxl_memdev_state *mds); int >> cxl_mem_get_poison(struct cxl_memdev *cxlmd, u64 offset, u64 len, >> struct cxl_region *cxlr); >> -- >> 2.34.1 >> Thanks, Shiju