From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D63EFC6FD18 for ; Wed, 19 Apr 2023 22:18:37 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6AE21900018; Wed, 19 Apr 2023 18:18:23 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 65E17900003; Wed, 19 Apr 2023 18:18:23 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3C622900018; Wed, 19 Apr 2023 18:18:23 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 2EDE6900003 for ; Wed, 19 Apr 2023 18:18:23 -0400 (EDT) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id E742E1C61FC for ; Wed, 19 Apr 2023 22:18:22 +0000 (UTC) X-FDA: 80699555244.26.AE27949 Received: from mail-pl1-f173.google.com (mail-pl1-f173.google.com [209.85.214.173]) by imf22.hostedemail.com (Postfix) with ESMTP id 2F731C0011 for ; Wed, 19 Apr 2023 22:18:20 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=rivosinc-com.20221208.gappssmtp.com header.s=20221208 header.b=jzzLlLFe; spf=pass (imf22.hostedemail.com: domain of atishp@rivosinc.com designates 209.85.214.173 as permitted sender) smtp.mailfrom=atishp@rivosinc.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681942701; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Nt9qr+Ng8JBl/RErKCxn2q3deom0MBnPuCU/gT00P20=; b=rY6BnBmiS+JZcwNQEvJVT15GKvVOfFTBd1hXcVPHqnJv76DwVsr3ada4hn/WRNkNriGBnk gbQbPJAvS0UFhyTkaoXWfWb99M8FhsL1PGCRzB6eyNJjlSMztueNdOhLEmMlrIQXIASEOt A1pMphPfYTtcOKhE8/vCByt5acwArbk= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=rivosinc-com.20221208.gappssmtp.com header.s=20221208 header.b=jzzLlLFe; spf=pass (imf22.hostedemail.com: domain of atishp@rivosinc.com designates 209.85.214.173 as permitted sender) smtp.mailfrom=atishp@rivosinc.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681942701; a=rsa-sha256; cv=none; b=GLpTERDxlspmev+ERsn7h4zASg1HH2iv0muySv5dINVcYT8KeVgoetf2Z5kJ8ZokqFWxr3 dA/ghKEmIjTP+li+0pCLiX2loMIBvK0a5pNadxOfo/TN59LP0qMNO2rjBFniDJ45BcARqU 4t6ZoPEiTICLc7JAqCneVZfAJSg5C1w= Received: by mail-pl1-f173.google.com with SMTP id d9443c01a7336-1a66911f5faso4695685ad.0 for ; Wed, 19 Apr 2023 15:18:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivosinc-com.20221208.gappssmtp.com; s=20221208; t=1681942700; x=1684534700; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=Nt9qr+Ng8JBl/RErKCxn2q3deom0MBnPuCU/gT00P20=; b=jzzLlLFeiMsuZ9XUDLcOQDkvHl7c/vkCVuAH/Y4TphDSd5Mc9u3gD9w9H9CFYzB5dB VNJgXnI5oLZMEQ3VG1XPXo2sPYkG3mVd4jlqIeNIyytoZFK4U8o75fSdl6rlgSdH8yDf 9+C6A4ccVfr/Y6QMC1xbEc1A2Zj6A2nip5LOQdKpRlwCaJZa6zrc37kKkf6MblV8d0h+ SCrca1krwloO92QhHfZeNzDRzfTX4CH3FwSkQPPGyJ+li1uF4S8MDV8rlQs97XcIZPKM ki/SaLm60kl0sQ2WGkbdIBtaAJDxWkY52gy3+Wk0TvSwU5O4fxtQHmdRQz9B0d/5bKvD GE7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681942700; x=1684534700; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Nt9qr+Ng8JBl/RErKCxn2q3deom0MBnPuCU/gT00P20=; b=FpDHJg4HbEI9v1HMDtBf3aBh+kMRaXhLGh9qu3ONtjTo4o2NAKfs3v0o1dOMYRJvEs rF6f/y91TeEJQ3oV9rxGzqQWfwQu/PaDy3hSIfAwbsjnJ3VEk+nwmmwhu0FZRPhSRSA1 hiBR1577O6BVWf/gx+RdA5AOqL5PuAzUutbDprSbc4GQ10+9xty7NVMzuXXDdPFuzhy1 QI7dHQBEYCnwQIcTHf4t/tRRI2lrGav9Ev87blJohVjoVqRhFbPMurP2UkfIXX/JIhAe d139nlgPsj90XaMZkiFaVnoZhp/iroNmfIGDHQgSXzHqAIRQmPnRB4H5FUwXeRJ/9aNO YspA== X-Gm-Message-State: AAQBX9fAiSHIPIe+3Fv4k6Z983TfRKAmmpv6PrDKzzCt68oYIvId/XTH OqT3/CGQRmw2BtEXGESc9aoEgg== X-Google-Smtp-Source: AKy350bclXeDaJm5NGd+baLQjNm1etLX+lLDzeTXzfOcBiZB99+UVCqjhPXny+Rg6qaFMwVObWbhvw== X-Received: by 2002:a17:903:110e:b0:1a6:6fe3:df91 with SMTP id n14-20020a170903110e00b001a66fe3df91mr7814057plh.50.1681942700098; Wed, 19 Apr 2023 15:18:20 -0700 (PDT) Received: from atishp.ba.rivosinc.com ([66.220.2.162]) by smtp.gmail.com with ESMTPSA id jn11-20020a170903050b00b00196807b5189sm11619190plb.292.2023.04.19.15.18.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 19 Apr 2023 15:18:19 -0700 (PDT) From: Atish Patra To: linux-kernel@vger.kernel.org Cc: Atish Patra , Alexandre Ghiti , Andrew Jones , Andrew Morton , Anup Patel , Atish Patra , =?UTF-8?q?Bj=C3=B6rn=20T=C3=B6pel?= , Suzuki K Poulose , Will Deacon , Marc Zyngier , Sean Christopherson , linux-coco@lists.linux.dev, Dylan Reid , abrestic@rivosinc.com, Samuel Ortiz , Christoph Hellwig , Conor Dooley , Greg Kroah-Hartman , Guo Ren , Heiko Stuebner , Jiri Slaby , kvm-riscv@lists.infradead.org, kvm@vger.kernel.org, linux-mm@kvack.org, linux-riscv@lists.infradead.org, Mayuresh Chitale , Palmer Dabbelt , Paolo Bonzini , Paul Walmsley , Rajnesh Kanwal , Uladzislau Rezki Subject: [RFC 23/48] RISC-V: KVM: Wireup TVM world switch Date: Wed, 19 Apr 2023 15:16:51 -0700 Message-Id: <20230419221716.3603068-24-atishp@rivosinc.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230419221716.3603068-1-atishp@rivosinc.com> References: <20230419221716.3603068-1-atishp@rivosinc.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 2F731C0011 X-Stat-Signature: trour8zuxhiahoqydkfie1ukccjaf1h1 X-HE-Tag: 1681942700-147959 X-HE-Meta: U2FsdGVkX18LiuNrQ5nGuWXx/dSOaOp1JNip7Yxvvhzmy5RkYpbBbhIpDAsQoDzG1nPMpjSx1YUHZ3FdzIDqWzJ/rLtonZZZs0e+LHvLSziuw09DIG0ZNyXG1lih9LYWezUbyP2MAY+H8sfK31aLDVttzqYhkqafVlTwzEVZQRiiZ4wuV6WBNX/l4sHpQln8+pS96VuQRkL9H/d8KMTn0Tljc/u7Gii2Ms7HCprsVlifkneK1RhaoI1RzSgNsDsGGrLkvHsatMB1PUEyJACGVS/PK5d1CVd6qV9rLmT7lPhZOF5uMDOrgAh8EsF5HbJc4/kB/zDe/6gi+qqZuqsZQEC9tYnU1DhCsGf55IGIdvqgMjS+YfjoJh4JaLBng5j4PuY5nFBvj6Kj6DquV2NmTjV8wp4bplRTUcZc9qSiNkS/M1+3Mv3XWXahBdg0k7M4vPzowoMQST8Ws7MMA/dxSYfDe7gMowe2SLVcIMSYB3nxoEl8zkqrblJ5ILOzNgyyKsd6iae17CSb/bGXX3FOgRtNyjrTLIqoD9BCVW1zHCzpaAadOt+Jqem4ggHrrTbKz3qb/A3UDRlrIoJJJ5OD9FJ5txcLSUUEHsj1XyJMl8xBWdCqMpfI7MfbR3sE16AhyGmE+JBhkJywJIT+Fgm4l8oSQaJJEW43XJM8dSOQA8c11byQ1AZUfcYaAkvmTqSoI0a2D41PBJgXrNj0lTLIqjB3WF3J21mTSRqfSvXHMBZA4GLyM6vEn1We4zc2z++pd28nTIjBHZLgrz1zYFwKgfV4Yx5wxrcI5nk7P0nGgRrWG/ncHcebLEZRy4MDW0G+65/IEWnV+WrcsMKKWvRom7Wawet/J9FubVZ9grMZ/sc6NJqM7O5q9++gnZfllTM9YkuBnlOOVquCXM0JGNRUuYzvYcMuYyPlOGETztuvhoE7dEzA3qaK2uxX4BNZvbIox1MNMnwj1Ss8xyhfnSh i2wuVuh9 6OwGSqkZ9ODqVM2Fo5Ue1atMawyaBEKNHH7ULS/1ns+Am1l2kvTTZxZZ1sC20WAwTUh16ZauEaspGUa3tUVs1FxnYHgpg0NScDfeJYdgGbMk2RCGK72kMwQjKcPFmVzOAxi4Uo62RlbQwK4d2PeQBHk0ESUQ+muH7YHC/Aasjmsnp2K7ESd7szPkoBydIfH6Sp05Uw2nYWbk4RRf3ohBTdU77QKNDc4zbqPaQ5qZbnOJAwIFifQ/gUUYzKv3cER2R3ucwuQKrdaPMTzbWSAIEE71ucia/rbmtn0jBtBOv1IAJOkWTqdYzpNeJX2yUACXrxxfj5MYJfPk2e+PpXed/gDv/eTvRYyE+/4JmtXpXGGFntW8lGzVWzJ/KEFz5Rsadt6o9Kg1KuLMHXPr8+/Y2vku4sK1YBoO7j1UEMNBi4d23LKdwiv11b0dds4LTSK0gE1n0KlALA65JBTDb0P6JhQasC9e5ZIdJ+VZCEtMeIxporpYSp87gjjZT4rEsq5c0BhoU X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: TVM worlds switch takes a different path from regular VM world switch as it needs to make an ecall to TSM and TSM actually does the world switch. The host doesn't need to save/restore any context as TSM is expected to do that on behalf of the host. The TSM updatess the trap information in the shared memory which host uses to figure out the cause of the guest exit. Signed-off-by: Atish Patra --- arch/riscv/kvm/cove.c | 31 +++++++++++++++++++++++++++++-- arch/riscv/kvm/vcpu.c | 11 +++++++++++ arch/riscv/kvm/vcpu_exit.c | 10 ++++++++++ 3 files changed, 50 insertions(+), 2 deletions(-) diff --git a/arch/riscv/kvm/cove.c b/arch/riscv/kvm/cove.c index c93de9b..c11db7a 100644 --- a/arch/riscv/kvm/cove.c +++ b/arch/riscv/kvm/cove.c @@ -275,9 +275,36 @@ int kvm_riscv_cove_gstage_map(struct kvm_vcpu *vcpu, gpa_t gpa, unsigned long hv return rc; } -void kvm_riscv_cove_vcpu_switchto(struct kvm_vcpu *vcpu, struct kvm_cpu_trap *trap) +void noinstr kvm_riscv_cove_vcpu_switchto(struct kvm_vcpu *vcpu, struct kvm_cpu_trap *trap) { - /* TODO */ + int rc; + struct kvm *kvm = vcpu->kvm; + struct kvm_cove_tvm_context *tvmc; + struct kvm_cpu_context *cntx = &vcpu->arch.guest_context; + void *nshmem; + + if (!kvm->arch.tvmc) + return; + + tvmc = kvm->arch.tvmc; + + nshmem = nacl_shmem(); + /* Invoke finalize to mark TVM is ready run for the first time */ + if (unlikely(!tvmc->finalized_done)) { + + rc = sbi_covh_tsm_finalize_tvm(tvmc->tvm_guest_id, cntx->sepc, cntx->a1); + if (rc) { + kvm_err("TVM Finalized failed with %d\n", rc); + return; + } + tvmc->finalized_done = true; + } + + rc = sbi_covh_run_tvm_vcpu(tvmc->tvm_guest_id, vcpu->vcpu_idx); + if (rc) { + trap->scause = EXC_CUSTOM_KVM_COVE_RUN_FAIL; + return; + } } void kvm_riscv_cove_vcpu_destroy(struct kvm_vcpu *vcpu) diff --git a/arch/riscv/kvm/vcpu.c b/arch/riscv/kvm/vcpu.c index 3e04b78..43a0b8c 100644 --- a/arch/riscv/kvm/vcpu.c +++ b/arch/riscv/kvm/vcpu.c @@ -1042,6 +1042,11 @@ void kvm_arch_vcpu_put(struct kvm_vcpu *vcpu) kvm_riscv_vcpu_timer_save(vcpu); if (kvm_riscv_nacl_available()) { + /** + * For TVMs, we don't need a separate case as TSM only updates + * the required CSRs during the world switch. All other CSR + * value should be zeroed out by TSM anyways. + */ nshmem = nacl_shmem(); csr->vsstatus = nacl_shmem_csr_read(nshmem, CSR_VSSTATUS); csr->vsie = nacl_shmem_csr_read(nshmem, CSR_VSIE); @@ -1191,6 +1196,12 @@ static void noinstr kvm_riscv_vcpu_enter_exit(struct kvm_vcpu *vcpu, gcntx->hstatus = csr_swap(CSR_HSTATUS, hcntx->hstatus); } + trap->htval = nacl_shmem_csr_read(nshmem, CSR_HTVAL); + trap->htinst = nacl_shmem_csr_read(nshmem, CSR_HTINST); + } else if (is_cove_vcpu(vcpu)) { + nshmem = nacl_shmem(); + kvm_riscv_cove_vcpu_switchto(vcpu, trap); + trap->htval = nacl_shmem_csr_read(nshmem, CSR_HTVAL); trap->htinst = nacl_shmem_csr_read(nshmem, CSR_HTINST); } else { diff --git a/arch/riscv/kvm/vcpu_exit.c b/arch/riscv/kvm/vcpu_exit.c index 8944e29..c46e7f2 100644 --- a/arch/riscv/kvm/vcpu_exit.c +++ b/arch/riscv/kvm/vcpu_exit.c @@ -218,6 +218,15 @@ int kvm_riscv_vcpu_exit(struct kvm_vcpu *vcpu, struct kvm_run *run, else if (vcpu->arch.guest_context.hstatus & HSTATUS_SPV) ret = kvm_riscv_vcpu_sbi_ecall(vcpu, run); break; + case EXC_CUSTOM_KVM_COVE_RUN_FAIL: + if (likely(is_cove_vcpu(vcpu))) { + ret = -EACCES; + run->fail_entry.hardware_entry_failure_reason = + KVM_EXIT_FAIL_ENTRY_COVE_RUN_VCPU; + run->fail_entry.cpu = vcpu->cpu; + run->exit_reason = KVM_EXIT_FAIL_ENTRY; + } + break; default: break; } @@ -225,6 +234,7 @@ int kvm_riscv_vcpu_exit(struct kvm_vcpu *vcpu, struct kvm_run *run, /* Print details in-case of error */ if (ret < 0) { kvm_err("VCPU exit error %d\n", ret); + //TODO: These values are bogus/stale for a TVM. Improve it kvm_err("SEPC=0x%lx SSTATUS=0x%lx HSTATUS=0x%lx\n", vcpu->arch.guest_context.sepc, vcpu->arch.guest_context.sstatus, -- 2.25.1