MESSAGE
| DATE | 2020-11-28 |
| FROM | jc_gargma via artix-general
|
| SUBJECT | Re: [Hangout - NYLXS] [artix-general] generating zstd compress
|
From hangout-bounces-at-nylxs.com Sun Nov 29 09:43:54 2020
Return-Path:
X-Original-To: archive-at-mrbrklyn.com
Delivered-To: archive-at-mrbrklyn.com
Received: from www2.mrbrklyn.com (www2.mrbrklyn.com [96.57.23.82])
by mrbrklyn.com (Postfix) with ESMTP id 6693C163FCF;
Sun, 29 Nov 2020 09:43:54 -0500 (EST)
X-Original-To: hangout-at-nylxs.com
Delivered-To: hangout-at-nylxs.com
Received: by mrbrklyn.com (Postfix, from userid 1000)
id 2F4DB163F5D; Sun, 29 Nov 2020 09:43:26 -0500 (EST)
Resent-From: Ruben Safir
Resent-Date: Sun, 29 Nov 2020 09:43:26 -0500
Resent-Message-ID: <20201129144326.GD4206-at-www2.mrbrklyn.com>
Resent-To: hangout-at-nylxs.com
X-Original-To: ruben-at-mrbrklyn.com
Delivered-To: ruben-at-mrbrklyn.com
Received: from mail.artixlinux.org (mail.artixlinux.org [144.91.88.22])
by mrbrklyn.com (Postfix) with ESMTP id 53942163F55
for ; Sat, 28 Nov 2020 21:04:42 -0500 (EST)
Received: from localhost.localdomain (localhost [127.0.0.1])
by mail.artixlinux.org (Postfix) with ESMTP id 528B4A206F7;
Sun, 29 Nov 2020 03:04:36 +0100 (CET)
X-Original-To: artix-general-at-artixlinux.org
Delivered-To: artix-general-at-localhost
X-Greylist: delayed 585 seconds by postgrey-1.37 at endymion;
Sun, 29 Nov 2020 03:04:34 CET
Received: from mx.kolabnow.com (mx.kolabnow.com [95.128.36.40])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by mail.artixlinux.org (Postfix) with ESMTPS id AD8B9A2021C
for ; Sun, 29 Nov 2020 03:04:34 +0100 (CET)
Received: from localhost (unknown [127.0.0.1])
by ext-mx-out002.mykolab.com (Postfix) with ESMTP id 771B7BCE
for ; Sun, 29 Nov 2020 02:54:48 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kolabnow.com; h=
content-type:content-type:mime-version:references:in-reply-to
:message-id:date:date:subject:subject:from:from:received
:received:received; s=dkim20160331; t=1606614888; x=1608429289;
bh=PwKEWdEX7RNBG5Uva8/9tuxDiSo66QuhbdT8rPI4Q58=; b=cl3/y1I6a5Qw
DHf/nI1F/c25MICbctEWY5Nuek6bVQSV80H/OHZVW5wQzo16vrKHk4wvTX0C3bUs
oPuhfbv13J/gh0rfTWhDEvtQOxiT5ePjvx0t3v7apntapMenEIh8SU6Vj5LPJkt/
D5OkXE+f8zq0RT9MZ5K92MdvfVFn8CTMUzkT0cUxntbWIoiQQsa1GheFdMjFdyZs
wlnkHMpfH9qBJbWThEVa5iLy6w+6yet2EMD767L+FsIm4MwP9PYS+nyLrfiFjPzG
/03VwxtKWGFtqBlGNzYwEMSjHk3VKWVo1GP+uYOJrJJDMYu/aio1TyOY+d0DhqGw
NcahiJim4vNXedyTef7dUKQ8mRqxW8i0o20RfE1lt2wseo/ukg/Q0p+7DMLYqgz6
LyERfpprhWLsnUBwDk/TQLl5bbpRRp5FGHKbtXM4/RkfWEaqx79nWEYoiO1Prp7t
CpulJXxGX8iIahPucTYkRXvmPcEk+I35gM0wxD2/6E2velscc1140/ALGii2ZnSN
OH97xT3pYPclT2h7LxNZJh8gI9Cqjw/G5r0RkGySmDLa7RGVlm8UQ4WRFvTYwHJr
unMTdvovMKszi22iEcKFdtp36YbAiF2HqQQUHjYfjwXqJRoyZpX86cLVRZSZ4kDi
pCmf9Y9pLJrvs31mBpAR7U7685BqWx8=
X-Virus-Scanned: amavisd-new at mykolab.com
X-Spam-Flag: NO
X-Spam-Score: -1.9
X-Spam-Level:
X-Spam-Status: No, score=-1.9 tagged_above=-10 required=5
tests=[BAYES_00=-1.9] autolearn=ham autolearn_force=no
Received: from mx.kolabnow.com ([127.0.0.1])
by localhost (ext-mx-out002.mykolab.com [127.0.0.1]) (amavisd-new, port 10024)
with ESMTP id r0Uuw9r1kKfQ for ;
Sun, 29 Nov 2020 02:54:48 +0100 (CET)
Received: from int-mx003.mykolab.com (unknown [10.9.13.3])
by ext-mx-out002.mykolab.com (Postfix) with ESMTPS id E8C67A56
for ; Sun, 29 Nov 2020 02:54:47 +0100 (CET)
Received: from ext-subm003.mykolab.com (unknown [10.9.6.3])
by int-mx003.mykolab.com (Postfix) with ESMTPS id A5B7F2464
for ; Sun, 29 Nov 2020 02:54:47 +0100 (CET)
To: artix-general-at-artixlinux.org
Date: Sat, 28 Nov 2020 17:54:11 -0800
Message-ID: <5446106.sXtsSlJIb2-at-iserlohn-fortress.net>
In-Reply-To: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
References: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
MIME-Version: 1.0
X-BeenThere: artix-general-at-artixlinux.org
X-Mailman-Version: 2.1.34
Precedence: list
From: jc_gargma via artix-general
Content-Type: multipart/mixed; boundary="===============7506541416352776050=="
Subject: Re: [Hangout - NYLXS] [artix-general] generating zstd compress
initrd images
X-BeenThere: hangout-at-nylxs.com
List-Id: NYLXS Tech Talk and Politics
List-Unsubscribe: ,
List-Archive:
List-Post:
List-Help:
List-Subscribe: ,
Reply-To: jc_gargma
Errors-To: hangout-bounces-at-nylxs.com
Sender: "Hangout"
--===============7506541416352776050==
Content-Type: multipart/signed; boundary="nextPart8233643.vhVb01CZo6"; micalg="pgp-sha512"; protocol="application/pgp-signature"
--nextPart8233643.vhVb01CZo6
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="UTF-8"; protected-headers="v1"
From: jc_gargma
To: artix-general-at-artixlinux.org
Subject: Re: [artix-general] generating zstd compress initrd images
Date: Sat, 28 Nov 2020 17:54:11 -0800
Message-ID: <5446106.sXtsSlJIb2-at-iserlohn-fortress.net>
In-Reply-To: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
References: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
> As you can see, I'm trying to also take advantage of multi-threading for
> zstd compression. However what I've experienced is a pretty slow initrd
> image generation. I'm not sure if I'm having something misconfigured. Has
> any one tried using zstd and specified number of threads to use for it?
>
> Thanks !
I tested generating initramfs using various zstd thread and compression
settings options in mkinitpcio.conf while watching ram and cpu core usage, as
well as output image sizes.
My testing indicates that all zstd options are ignored, with the sole
exception of --single-thread, which correctly forces the use of only a single
thread that also utilizes less ram.
When used without --single-thread, zstd assumes -T0 and will use additional
cores based on the total size of the files in need of compression, just as xz
does with any value of -T n. Typically this means only one or two cores,
regardless of the system core count.
-jc
--nextPart8233643.vhVb01CZo6
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part.
Content-Transfer-Encoding: 7Bit
-----BEGIN PGP SIGNATURE-----
iHUEABYKAB0WIQTUQvHi+WpQBnAYf9XIyeGe2Ka2kgUCX8L/QwAKCRDIyeGe2Ka2
kjxJAP0edpIvg7PGEKvE/gPNiaPcSPlFbGF+sAeYy5lWVNPGaAD+IOVDQ3pSyqPG
No+R1KU6S+Lea7S3tglKnOojutJFqgc=
=S+0q
-----END PGP SIGNATURE-----
--nextPart8233643.vhVb01CZo6--
--===============7506541416352776050==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
--
artix-general mailing list
artix-general-at-artixlinux.org
https://lists.artixlinux.org/listinfo/artix-general
--===============7506541416352776050==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Hangout mailing list
Hangout-at-nylxs.com
http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============7506541416352776050==--
--===============7506541416352776050==
Content-Type: multipart/signed; boundary="nextPart8233643.vhVb01CZo6"; micalg="pgp-sha512"; protocol="application/pgp-signature"
--nextPart8233643.vhVb01CZo6
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="UTF-8"; protected-headers="v1"
From: jc_gargma
To: artix-general-at-artixlinux.org
Subject: Re: [artix-general] generating zstd compress initrd images
Date: Sat, 28 Nov 2020 17:54:11 -0800
Message-ID: <5446106.sXtsSlJIb2-at-iserlohn-fortress.net>
In-Reply-To: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
References: <7633beb1-7faa-b164-ebbf-40885c8b8f90-at-e.email>
> As you can see, I'm trying to also take advantage of multi-threading for
> zstd compression. However what I've experienced is a pretty slow initrd
> image generation. I'm not sure if I'm having something misconfigured. Has
> any one tried using zstd and specified number of threads to use for it?
>
> Thanks !
I tested generating initramfs using various zstd thread and compression
settings options in mkinitpcio.conf while watching ram and cpu core usage, as
well as output image sizes.
My testing indicates that all zstd options are ignored, with the sole
exception of --single-thread, which correctly forces the use of only a single
thread that also utilizes less ram.
When used without --single-thread, zstd assumes -T0 and will use additional
cores based on the total size of the files in need of compression, just as xz
does with any value of -T n. Typically this means only one or two cores,
regardless of the system core count.
-jc
--nextPart8233643.vhVb01CZo6
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part.
Content-Transfer-Encoding: 7Bit
-----BEGIN PGP SIGNATURE-----
iHUEABYKAB0WIQTUQvHi+WpQBnAYf9XIyeGe2Ka2kgUCX8L/QwAKCRDIyeGe2Ka2
kjxJAP0edpIvg7PGEKvE/gPNiaPcSPlFbGF+sAeYy5lWVNPGaAD+IOVDQ3pSyqPG
No+R1KU6S+Lea7S3tglKnOojutJFqgc=
=S+0q
-----END PGP SIGNATURE-----
--nextPart8233643.vhVb01CZo6--
--===============7506541416352776050==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
--
artix-general mailing list
artix-general-at-artixlinux.org
https://lists.artixlinux.org/listinfo/artix-general
--===============7506541416352776050==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Hangout mailing list
Hangout-at-nylxs.com
http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============7506541416352776050==--
|
|
