From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3EE19C433F5 for ; Tue, 8 Mar 2022 14:26:44 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A6F898D0002; Tue, 8 Mar 2022 09:26:43 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 9F44F8D0003; Tue, 8 Mar 2022 09:26:43 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7AA6A8D0002; Tue, 8 Mar 2022 09:26:43 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (relay.hostedemail.com [64.99.140.28]) by kanga.kvack.org (Postfix) with ESMTP id 67F748D0001 for ; Tue, 8 Mar 2022 09:26:43 -0500 (EST) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 386252198C for ; Tue, 8 Mar 2022 14:26:43 +0000 (UTC) X-FDA: 79221445086.14.74E61EA Received: from mail-qt1-f177.google.com (mail-qt1-f177.google.com [209.85.160.177]) by imf28.hostedemail.com (Postfix) with ESMTP id 94579C000C for ; Tue, 8 Mar 2022 14:26:42 +0000 (UTC) Received: by mail-qt1-f177.google.com with SMTP id v3so16180594qta.11 for ; Tue, 08 Mar 2022 06:26:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=O5s1Kk/lxO3O1i26XInZyMyYmKkC+n7Z3tXbuJ1ASrM=; b=mm/r7zUmLX9Fupb/dwqtEMhJd1SI+FV5FFU4sRaiUkeshq56fdYlhZVWrjCH3IM5+G kZNj2p9d3dmO0J84BLnl7ANrELRSvQL20GInOqIw5GKRd9niTi837JPUDhQz7jf/XPJM u3RByecFyCrw4ifMdi8KUhDZDROI/UQf1I/XB2R605p7mIk6RPXkzCKuOfHovvbKo5zD Y4FhQV9TfFplT7A8A3ehZXClyW+7i5pQK37wQmQZtNPZFl9MliCSmtMkvvHvpYydNMzh c0i7sJveeR7c6j+x36JvsQkj1tr5+obgWJ0Pxt0Zk8UD9gg+jftnM6eANDqaFhexaSP0 7gqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=O5s1Kk/lxO3O1i26XInZyMyYmKkC+n7Z3tXbuJ1ASrM=; b=prtczJ+CsaCQEiRv/du0DHthbBvCzW3xEPt4fq6FbI2StNjDNslcnfhf33ml9rx6XI dUtUr79NEh6wiK2JwD380Nh5p82b+eNP7JhCloKWQieiTQkQvVl3aZ1MAn50OkNGvdtT s/DgolgcEVsFmcViQPLqAz8/9qTgF0Fd6nWgqDCgpFFdiDYPOfsdwotT7VLqBCD/smfF iL9CldWwfiOftBU3DVybvzFcSmgvJ7nYr+BhiGKKvY8MiC4zkI5SoLpEYXK+69lSHmbo ZR0Jy1VkVbgsF5kvE/ivsqUuUa+v+7F+20E9KVdLWs1HPKdicmYsseCaVaCWklNuxe5n Xmvw== X-Gm-Message-State: AOAM530/geot2+T6S6Ey2ZJX66hCjUZhGjaqWmHW8e0+joegTtEoRcNK J6OS1y1Zz1SfJPwb94ZK5l0TjV50AXFIuaRP5KSk4Q== X-Google-Smtp-Source: ABdhPJwLwBZCEZKJHP7xui2D5ADTSbMRiFjgIAtMomXg/L89dotKu/25ERSEpZlTlmLeuuaLX8nQq8fsWvcifRS6BF4= X-Received: by 2002:a05:622a:18a6:b0:2dd:2c5b:ca00 with SMTP id v38-20020a05622a18a600b002dd2c5bca00mr13533464qtc.549.1646749601587; Tue, 08 Mar 2022 06:26:41 -0800 (PST) MIME-Version: 1.0 References: <20220308141415.3168078-1-elver@google.com> In-Reply-To: <20220308141415.3168078-1-elver@google.com> From: Alexander Potapenko Date: Tue, 8 Mar 2022 15:26:05 +0100 Message-ID: Subject: Re: [PATCH v2] kfence: allow use of a deferrable timer To: Marco Elver Cc: Andrew Morton , Dmitry Vyukov , kasan-dev , "open list:DOCUMENTATION" , LKML , Linux Memory Management List Content-Type: multipart/alternative; boundary="00000000000009cd1405d9b5c5ce" X-Rspam-User: X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 94579C000C X-Stat-Signature: 19c4foiqspiooiw595kcjs4nqbixpzso Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b="mm/r7zUm"; spf=pass (imf28.hostedemail.com: domain of glider@google.com designates 209.85.160.177 as permitted sender) smtp.mailfrom=glider@google.com; dmarc=pass (policy=reject) header.from=google.com X-HE-Tag: 1646749602-696437 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: --00000000000009cd1405d9b5c5ce Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Mar 8, 2022 at 3:14 PM Marco Elver wrote: > Allow the use of a deferrable timer, which does not force CPU wake-ups > when the system is idle. A consequence is that the sample interval > becomes very unpredictable, to the point that it is not guaranteed that > the KFENCE KUnit test still passes. > > Nevertheless, on power-constrained systems this may be preferable, so > let's give the user the option should they accept the above trade-off. > > Signed-off-by: Marco Elver > Reviewed-by: Alexander Potapenko > --- > v2: > * Add more documentation. > * Remove 'if EXPERT' from Kconfig option since it's configurable via > kernel boot param anyway. > --- > Documentation/dev-tools/kfence.rst | 12 ++++++++++++ > lib/Kconfig.kfence | 12 ++++++++++++ > mm/kfence/core.c | 15 +++++++++++++-- > 3 files changed, 37 insertions(+), 2 deletions(-) > > diff --git a/Documentation/dev-tools/kfence.rst > b/Documentation/dev-tools/kfence.rst > index ac6b89d1a8c3..936f6aaa75c8 100644 > --- a/Documentation/dev-tools/kfence.rst > +++ b/Documentation/dev-tools/kfence.rst > @@ -41,6 +41,18 @@ guarded by KFENCE. The default is configurable via the > Kconfig option > ``CONFIG_KFENCE_SAMPLE_INTERVAL``. Setting ``kfence.sample_interval=3D0`= ` > disables KFENCE. > > +The sample interval controls a timer that sets up KFENCE allocations. By > +default, to keep the real sample interval predictable, the normal timer > also > +causes CPU wake-ups when the system is completely idle. This may be > undesirable > +on power-constrained systems. The boot parameter ``kfence.deferrable=3D1= `` > +instead switches to a "deferrable" timer which does not force CPU > wake-ups on > +idle systems, at the risk of unpredictable sample intervals. The default > is > +configurable via the Kconfig option ``CONFIG_KFENCE_DEFERRABLE``. > + > +.. warning:: > + The KUnit test suite is very likely to fail when using a deferrable > timer > + since it currently causes very unpredictable sample intervals. > + > The KFENCE memory pool is of fixed size, and if the pool is exhausted, n= o > further KFENCE allocations occur. With ``CONFIG_KFENCE_NUM_OBJECTS`` > (default > 255), the number of available guarded objects can be controlled. Each > object > diff --git a/lib/Kconfig.kfence b/lib/Kconfig.kfence > index 912f252a41fc..459dda9ef619 100644 > --- a/lib/Kconfig.kfence > +++ b/lib/Kconfig.kfence > @@ -45,6 +45,18 @@ config KFENCE_NUM_OBJECTS > pages are required; with one containing the object and two > adjacent > ones used as guard pages. > > +config KFENCE_DEFERRABLE > + bool "Use a deferrable timer to trigger allocations" > + help > + Use a deferrable timer to trigger allocations. This avoids > forcing > + CPU wake-ups if the system is idle, at the risk of a less > predictable > + sample interval. > + > + Warning: The KUnit test suite fails with this option enabled - > due to > + the unpredictability of the sample interval! > + > + Say N if you are unsure. > + > config KFENCE_STATIC_KEYS > bool "Use static keys to set up allocations" if EXPERT > depends on JUMP_LABEL > diff --git a/mm/kfence/core.c b/mm/kfence/core.c > index f126b53b9b85..2f9fdfde1941 100644 > --- a/mm/kfence/core.c > +++ b/mm/kfence/core.c > @@ -95,6 +95,10 @@ module_param_cb(sample_interval, > &sample_interval_param_ops, &kfence_sample_inte > static unsigned long kfence_skip_covered_thresh __read_mostly =3D 75; > module_param_named(skip_covered_thresh, kfence_skip_covered_thresh, > ulong, 0644); > > +/* If true, use a deferrable timer. */ > +static bool kfence_deferrable __read_mostly =3D > IS_ENABLED(CONFIG_KFENCE_DEFERRABLE); > +module_param_named(deferrable, kfence_deferrable, bool, 0444); > + > /* The pool of pages used for guard pages and objects. */ > char *__kfence_pool __read_mostly; > EXPORT_SYMBOL(__kfence_pool); /* Export for test modules. */ > @@ -740,6 +744,8 @@ late_initcall(kfence_debugfs_init); > > /* =3D=3D=3D Allocation Gate Timer > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D */ > > +static struct delayed_work kfence_timer; > + > #ifdef CONFIG_KFENCE_STATIC_KEYS > /* Wait queue to wake up allocation-gate timer task. */ > static DECLARE_WAIT_QUEUE_HEAD(allocation_wait); > @@ -762,7 +768,6 @@ static DEFINE_IRQ_WORK(wake_up_kfence_timer_work, > wake_up_kfence_timer); > * avoids IPIs, at the cost of not immediately capturing allocations if > the > * instructions remain cached. > */ > -static struct delayed_work kfence_timer; > static void toggle_allocation_gate(struct work_struct *work) > { > if (!READ_ONCE(kfence_enabled)) > @@ -790,7 +795,6 @@ static void toggle_allocation_gate(struct work_struct > *work) > queue_delayed_work(system_unbound_wq, &kfence_timer, > msecs_to_jiffies(kfence_sample_interval)); > } > -static DECLARE_DELAYED_WORK(kfence_timer, toggle_allocation_gate); > > /* =3D=3D=3D Public interface > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D */ > > @@ -809,8 +813,15 @@ static void kfence_init_enable(void) > { > if (!IS_ENABLED(CONFIG_KFENCE_STATIC_KEYS)) > static_branch_enable(&kfence_allocation_key); > + > + if (kfence_deferrable) > + INIT_DEFERRABLE_WORK(&kfence_timer, > toggle_allocation_gate); > + else > + INIT_DELAYED_WORK(&kfence_timer, toggle_allocation_gate); > + > WRITE_ONCE(kfence_enabled, true); > queue_delayed_work(system_unbound_wq, &kfence_timer, 0); > + > pr_info("initialized - using %lu bytes for %d objects at > 0x%p-0x%p\n", KFENCE_POOL_SIZE, > CONFIG_KFENCE_NUM_OBJECTS, (void *)__kfence_pool, > (void *)(__kfence_pool + KFENCE_POOL_SIZE)); > -- > 2.35.1.616.g0bdcbb4464-goog > > --=20 Alexander Potapenko Software Engineer Google Germany GmbH Erika-Mann-Stra=C3=9Fe, 33 80636 M=C3=BCnchen Gesch=C3=A4ftsf=C3=BChrer: Paul Manicle, Liana Sebastian Registergericht und -nummer: Hamburg, HRB 86891 Sitz der Gesellschaft: Hamburg Diese E-Mail ist vertraulich. Falls Sie diese f=C3=A4lschlicherweise erhalt= en haben sollten, leiten Sie diese bitte nicht an jemand anderes weiter, l=C3=B6schen Sie alle Kopien und Anh=C3=A4nge davon und lassen Sie mich bit= te wissen, dass die E-Mail an die falsche Person gesendet wurde. This e-mail is confidential. If you received this communication by mistake, please don't forward it to anyone else, please erase all copies and attachments, and please let me know that it has gone to the wrong person. --00000000000009cd1405d9b5c5ce Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Tue, Mar 8, 2022 at 3:14 PM Marco = Elver <elver@google.com> wrot= e:
Allow the use= of a deferrable timer, which does not force CPU wake-ups
when the system is idle. A consequence is that the sample interval
becomes very unpredictable, to the point that it is not guaranteed that
the KFENCE KUnit test still passes.

Nevertheless, on power-constrained systems this may be preferable, so
let's give the user the option should they accept the above trade-off.<= br>
Signed-off-by: Marco Elver <elver@google.com>
Reviewed-by: Alex= ander Potapenko <glider@google.com<= /a>>=C2=A0
---
v2:
* Add more documentation.
* Remove 'if EXPERT' from Kconfig option since it's configurabl= e via
=C2=A0 kernel boot param anyway.
---
=C2=A0Documentation/dev-tools/kfence.rst | 12 ++++++++++++
=C2=A0lib/Kconfig.kfence=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0| 12 ++++++++++++
=C2=A0mm/kfence/core.c=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0| 15 +++++++++++++--
=C2=A03 files changed, 37 insertions(+), 2 deletions(-)

diff --git a/Documentation/dev-tools/kfence.rst b/Documentation/dev-tools/k= fence.rst
index ac6b89d1a8c3..936f6aaa75c8 100644
--- a/Documentation/dev-tools/kfence.rst
+++ b/Documentation/dev-tools/kfence.rst
@@ -41,6 +41,18 @@ guarded by KFENCE. The default is configurable via the K= config option
=C2=A0``CONFIG_KFENCE_SAMPLE_INTERVAL``. Setting ``kfence.sample_interval= =3D0``
=C2=A0disables KFENCE.

+The sample interval controls a timer that sets up KFENCE allocations. By +default, to keep the real sample interval predictable, the normal timer al= so
+causes CPU wake-ups when the system is completely idle. This may be undesi= rable
+on power-constrained systems. The boot parameter ``kfence.deferrable=3D1``=
+instead switches to a "deferrable" timer which does not force CP= U wake-ups on
+idle systems, at the risk of unpredictable sample intervals. The default i= s
+configurable via the Kconfig option ``CONFIG_KFENCE_DEFERRABLE``.
+
+.. warning::
+=C2=A0 =C2=A0The KUnit test suite is very likely to fail when using a defe= rrable timer
+=C2=A0 =C2=A0since it currently causes very unpredictable sample intervals= .
+
=C2=A0The KFENCE memory pool is of fixed size, and if the pool is exhausted= , no
=C2=A0further KFENCE allocations occur. With ``CONFIG_KFENCE_NUM_OBJECTS`` = (default
=C2=A0255), the number of available guarded objects can be controlled. Each= object
diff --git a/lib/Kconfig.kfence b/lib/Kconfig.kfence
index 912f252a41fc..459dda9ef619 100644
--- a/lib/Kconfig.kfence
+++ b/lib/Kconfig.kfence
@@ -45,6 +45,18 @@ config KFENCE_NUM_OBJECTS
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 pages are required; with one containing = the object and two adjacent
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ones used as guard pages.

+config KFENCE_DEFERRABLE
+=C2=A0 =C2=A0 =C2=A0 =C2=A0bool "Use a deferrable timer to trigger al= locations"
+=C2=A0 =C2=A0 =C2=A0 =C2=A0help
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Use a deferrable timer to trigger alloca= tions. This avoids forcing
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0CPU wake-ups if the system is idle, at t= he risk of a less predictable
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sample interval.
+
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Warning: The KUnit test suite fails with= this option enabled - due to
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0the unpredictability of the sample inter= val!
+
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Say N if you are unsure.
+
=C2=A0config KFENCE_STATIC_KEYS
=C2=A0 =C2=A0 =C2=A0 =C2=A0 bool "Use static keys to set up allocation= s" if EXPERT
=C2=A0 =C2=A0 =C2=A0 =C2=A0 depends on JUMP_LABEL
diff --git a/mm/kfence/core.c b/mm/kfence/core.c
index f126b53b9b85..2f9fdfde1941 100644
--- a/mm/kfence/core.c
+++ b/mm/kfence/core.c
@@ -95,6 +95,10 @@ module_param_cb(sample_interval, &sample_interval_pa= ram_ops, &kfence_sample_inte
=C2=A0static unsigned long kfence_skip_covered_thresh __read_mostly =3D 75;=
=C2=A0module_param_named(skip_covered_thresh, kfence_skip_covered_thresh, u= long, 0644);

+/* If true, use a deferrable timer. */
+static bool kfence_deferrable __read_mostly =3D IS_ENABLED(CONFIG_KFENCE_D= EFERRABLE);
+module_param_named(deferrable, kfence_deferrable, bool, 0444);
+
=C2=A0/* The pool of pages used for guard pages and objects. */
=C2=A0char *__kfence_pool __read_mostly;
=C2=A0EXPORT_SYMBOL(__kfence_pool); /* Export for test modules. */
@@ -740,6 +744,8 @@ late_initcall(kfence_debugfs_init);

=C2=A0/* =3D=3D=3D Allocation Gate Timer =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D */

+static struct delayed_work kfence_timer;
+
=C2=A0#ifdef CONFIG_KFENCE_STATIC_KEYS
=C2=A0/* Wait queue to wake up allocation-gate timer task. */
=C2=A0static DECLARE_WAIT_QUEUE_HEAD(allocation_wait);
@@ -762,7 +768,6 @@ static DEFINE_IRQ_WORK(wake_up_kfence_timer_work, wake_= up_kfence_timer);
=C2=A0 * avoids IPIs, at the cost of not immediately capturing allocations = if the
=C2=A0 * instructions remain cached.
=C2=A0 */
-static struct delayed_work kfence_timer;
=C2=A0static void toggle_allocation_gate(struct work_struct *work)
=C2=A0{
=C2=A0 =C2=A0 =C2=A0 =C2=A0 if (!READ_ONCE(kfence_enabled))
@@ -790,7 +795,6 @@ static void toggle_allocation_gate(struct work_struct *= work)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 queue_delayed_work(system_unbound_wq, &kfen= ce_timer,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0msecs_to_jiffies(kfence_sample_interval));
=C2=A0}
-static DECLARE_DELAYED_WORK(kfence_timer, toggle_allocation_gate);

=C2=A0/* =3D=3D=3D Public interface =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D */

@@ -809,8 +813,15 @@ static void kfence_init_enable(void)
=C2=A0{
=C2=A0 =C2=A0 =C2=A0 =C2=A0 if (!IS_ENABLED(CONFIG_KFENCE_STATIC_KEYS))
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 static_branch_enabl= e(&kfence_allocation_key);
+
+=C2=A0 =C2=A0 =C2=A0 =C2=A0if (kfence_deferrable)
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0INIT_DEFERRABLE_WOR= K(&kfence_timer, toggle_allocation_gate);
+=C2=A0 =C2=A0 =C2=A0 =C2=A0else
+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0INIT_DELAYED_WORK(&= amp;kfence_timer, toggle_allocation_gate);
+
=C2=A0 =C2=A0 =C2=A0 =C2=A0 WRITE_ONCE(kfence_enabled, true);
=C2=A0 =C2=A0 =C2=A0 =C2=A0 queue_delayed_work(system_unbound_wq, &kfen= ce_timer, 0);
+
=C2=A0 =C2=A0 =C2=A0 =C2=A0 pr_info("initialized - using %lu bytes for= %d objects at 0x%p-0x%p\n", KFENCE_POOL_SIZE,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 CONFIG_KFENCE_NUM_O= BJECTS, (void *)__kfence_pool,
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (void *)(__kfence_p= ool + KFENCE_POOL_SIZE));
--
2.35.1.616.g0bdcbb4464-goog



--
Alexander Potapenko
Software= Engineer

Google Germany GmbH
Erika-Mann-Stra=C3=9Fe, 33
80636= M=C3=BCnchen

Gesch=C3=A4ftsf=C3=BChrer: Paul Manicle, Liana Sebasti= an
Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellsch= aft: Hamburg

Diese E-Mail ist vertraulich. Falls Sie diese f=C3=A4ls= chlicherweise erhalten haben sollten, leiten Sie diese bitte nicht an jeman= d anderes weiter, l=C3=B6schen Sie alle Kopien und Anh=C3=A4nge davon und l= assen Sie mich bitte wissen, dass die E-Mail an die falsche Person gesendet= wurde.


This e-mail is confidential. If you received this commun= ication by mistake, please don't forward it to anyone else, please eras= e all copies and attachments, and please let me know that it has gone to th= e wrong person.
--00000000000009cd1405d9b5c5ce--