MESSAGE
DATE | 2020-12-23 |
FROM | Matthias Peng
|
SUBJECT | Re: [Hangout - NYLXS] Confused about two development utils [EXT]
|
From hangout-bounces-at-nylxs.com Fri Jan 1 11:09:43 2021 Return-Path: X-Original-To: archive-at-mrbrklyn.com Delivered-To: archive-at-mrbrklyn.com Received: from www2.mrbrklyn.com (www2.mrbrklyn.com [96.57.23.82]) by mrbrklyn.com (Postfix) with ESMTP id B178B164034; Fri, 1 Jan 2021 11:09:42 -0500 (EST) X-Original-To: hangout-at-www2.mrbrklyn.com Delivered-To: hangout-at-www2.mrbrklyn.com Received: by mrbrklyn.com (Postfix, from userid 1000) id 4AFD616403F; Fri, 1 Jan 2021 11:08:55 -0500 (EST) Resent-From: Ruben Safir Resent-Date: Fri, 1 Jan 2021 11:08:55 -0500 Resent-Message-ID: <20210101160855.GU15013-at-www2.mrbrklyn.com> Resent-To: hangout-at-mrbrklyn.com X-Original-To: ruben-at-mrbrklyn.com Delivered-To: ruben-at-mrbrklyn.com Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mrbrklyn.com (Postfix) with ESMTP id 92792163FCE for ; Wed, 23 Dec 2020 07:01:53 -0500 (EST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id A460147851 for ; Wed, 23 Dec 2020 12:01:52 +0000 (UTC) Received: (qmail 94302 invoked by uid 500); 23 Dec 2020 12:01:52 -0000 Mailing-List: contact modperl-help-at-perl.apache.org; run by ezmlm Precedence: bulk Delivered-To: mailing list modperl-at-perl.apache.org Received: (qmail 94291 invoked by uid 99); 23 Dec 2020 12:01:52 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Dec 2020 12:01:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 590861FF3A1 for ; Wed, 23 Dec 2020 12:01:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: 1 X-Spam-Level: * X-Spam-Status: No, score=1 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, HTML_OBFUSCATE_05_10=0.001, SCC_5_SHORT_WORD_LINES=1, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id wLfKx6RjGn53 for ; Wed, 23 Dec 2020 12:01:50 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::244; helo=mail-oi1-x244.google.com; envelope-from=pengmatthias-at-gmail.com; receiver= Received: from mail-oi1-x244.google.com (mail-oi1-x244.google.com [IPv6:2607:f8b0:4864:20::244]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 6133C7F9E1 for ; Wed, 23 Dec 2020 12:01:50 +0000 (UTC) Received: by mail-oi1-x244.google.com with SMTP id l207so18024746oib.4 for ; Wed, 23 Dec 2020 04:01:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=uFufox+GYY/LaR1mZdASTQYIXTqLSK8Sg1Fi7QoyRdA=; b=rIU+eoJOUjWUJQMuoXgmxHJ+u6Po0hK7JYCR2dWj3bnpLgvfh36QiFUgWTEhfi7mqc +POisWu6yBkgCNzVl0VWA4uBGpj2kEeewbCvUTqQR7MT6MNQYQwuO0M5cOJNviLwRdgs OL4tTsQTrmym6qFeDHyrK+HA+tFmbzCCz623ZheoKA5vlZ/UeRgA8RPgH+feuAqE8wTz aP87j1UQpKSvAmFdF5CI1Kq3z8I6BWZU/y6cJ+rH2exea4Qla9CJNvh6J/n++hfnCIim UUN4bkPbRtvXCUiiLVa4ASeQcAc0z9wGGtdUeZTNVFfaBM4ZLJ5M4qMUZ83TQxHK+1Y7 JVoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=uFufox+GYY/LaR1mZdASTQYIXTqLSK8Sg1Fi7QoyRdA=; b=rlzHee70d7HBrEtQ405p8kcMq7CZ/DNan44qm5v5iYwhiJjS48fgGF4CqRmFgdc0nH 5/jw1w9zqdFEHlEbV4TkpI5K1mItiUuXb5m9ewW1Mx6J9RqgkHQvvlzAY8EQCzdPR7TU FeqjpN9JG4lBZj+t77XCN2pA7Ox17T4fhnQjm/Mo7/B+g8z1816wjweP+nIyx96kV1/C 35nJsYFgul3RGPOJ+SpxWo4wH2tHW37469c9lSamDy9+/G9A9y2BFcppC0nJe9H7ZVsk XY8sl1MasgOXkf1Id7V2NYF3+5S1NCfkD4lvVR1EcZ6PI7QX1jBBiw9Jjgtyl8QkIAFR fLZA== X-Gm-Message-State: AOAM533FtgT922wFsXqsZF9wdKnzzXFGb7QerGP4qpSvKVFQ4SnGrG2b hYKrIqhTNT14Kqy9vDWuprftGFfzEH9CIOmIulDJnWpLz/w= X-Google-Smtp-Source: ABdhPJykJutkmcpvC+0gdsmdiQkkpcCYJnH/7Xwv8YIapQcuxYU8b8zZgf5nC/IdXFi8ozrVSKU1hFTXEpR13j74jGA= X-Received: by 2002:aca:5253:: with SMTP id g80mr17283170oib.98.1608724903177; Wed, 23 Dec 2020 04:01:43 -0800 (PST) MIME-Version: 1.0 References: <971cc41d-b30e-7fc1-25a2-4a63f028321d-at-ice-sa.com> <90ae0836-d487-926c-89e4-696a46fae57d-at-ice-sa.com> <335e0e3cca2e4dd3aeb5f91d83ea08c0-at-sanger.ac.uk> In-Reply-To: From: Matthias Peng Date: Wed, 23 Dec 2020 20:01:31 +0800 Message-ID: To: mod_perl list Subject: Re: [Hangout - NYLXS] Confused about two development utils [EXT] X-BeenThere: hangout-at-nylxs.com X-Mailman-Version: 2.1.30rc1 List-Id: NYLXS Tech Talk and Politics List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0406647842==" Errors-To: hangout-bounces-at-nylxs.com Sender: "Hangout"
--===============0406647842== Content-Type: multipart/alternative; boundary="000000000000652fed05b720747b"
--000000000000652fed05b720747b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Today memory is not serious problem, each of our server has 64GB memory.
> Forgot to add - so our FCGI servers need a lot (and I mean a lot) more > memory than the mod_perl servers to serve the same level of content (just > in case memory blows up with FCGI backends) > > -----Original Message----- > From: James Smith > Sent: 23 December 2020 11:34 > To: Andr=C3=A9 Warnier (tomcat/perl) ; modperl-at-perl.apache= .org > Subject: RE: Confused about two development utils [EXT] > > > > This costs memory, and all the more since many perl modules are not > thread-safe, so if you use them in your code, at this moment the only saf= e > way to do it is to use the Apache httpd prefork model. This means that ea= ch > Apache httpd child process has its own copy of the perl interpreter, whic= h > means that the memory used by this embedded perl interpreter has to be > counted n times (as many times as there are Apache httpd child processes > running at any one time). > > This isn=E2=80=99t quite true - if you load modules before the process fo= rks then > they can cleverly share the same parts of memory. It is useful to be able > to "pre-load" core functionality which is used across all functions {this > is the case in Linux anyway}. It also speeds up child process generation = as > the modules are already in memory and converted to byte code. > > One of the great advantages of mod_perl is Apache2::SizeLimit which can > blow away large child process - and then if needed create new ones. This = is > not the case with some of the FCGI solutions as the individual processes > can grow if there is a memory leak or a request that retrieves a large > amount of content (even if not served), but perl can't give the memory > back. So FCGI processes only get bigger and bigger and eventually blow up > memory (or hit swap first) > > > > > > -- > The Wellcome Sanger Institute is operated by Genome Research Limited, a > charity registered in England with number 1021457 and a company register= ed > in England with number 2742969, whose registered office is 215 Euston > Road, London, NW1 2 > y=3Dgmail&source=3Dg> > BE. > > > > -- > The Wellcome Sanger Institute is operated by Genome Research > Limited, a charity registered in England with number 1021457 and a > company registered in England with number 2742969, whose registered > office is 215 Euston Road, London, NW1 2 > y=3Dgmail&source=3Dg> > BE.
--000000000000652fed05b720747b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Today memory is not serious problem, each of our server h= as 64GB memory. =3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd= ing-left:1ex"> Forgot to add - so our FCGI servers need a lot (and I mea= n a lot) more memory than the mod_perl servers to serve the same level of c= ontent (just in case memory blows up with FCGI backends)
-----Original Message-----
From: James Smith <>js5-at-sanger.ac.uk>
Sent: 23 December 2020 11:34
To: Andr=C3=A9 Warnier (tomcat/perl) <arget=3D"_blank">aw-at-ice-sa.com>; he.org" target=3D"_blank">modperl-at-perl.apache.org
Subject: RE: Confused about two development utils [EXT]
> This costs memory, and all the more since many perl modules are not th= read-safe, so if you use them in your code, at this moment the only safe wa= y to do it is to use the Apache httpd prefork model. This means that each A= pache httpd child process has its own copy of the perl interpreter, which m= eans that the memory used by this embedded perl interpreter has to be count= ed n times (as many times as there are Apache httpd child processes running= at any one time).
This isn=E2=80=99t quite true - if you load modules before the process fork= s then they can cleverly share the same parts of memory. It is useful to be= able to "pre-load" core functionality which is used across all f= unctions {this is the case in Linux anyway}. It also speeds up child proces= s generation as the modules are already in memory and converted to byte cod= e.
One of the great advantages of mod_perl is Apache2::SizeLimit which can blo= w away large child process - and then if needed create new ones. This is no= t the case with some of the FCGI solutions as the individual processes can = grow if there is a memory leak or a request that retrieves a large amount o= f content (even if not served), but perl can't give the memory back. So= FCGI processes only get bigger and bigger and eventually blow up memory (o= r hit swap first)
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research=C2=A0 Li= mited, a charity registered in England with number 1021457 and a=C2=A0 comp= any registered in England with number 2742969, whose registered=C2=A0 offic= e i+NW1+2?entry=3Dgmail&source=3Dg">s 215 Euston Road, London, NW1 2BE= .
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research
=C2=A0Limited, a charity registered in England with number 1021457 and a r> =C2=A0company registered in England with number 2742969, whose registered <= br> =C2=A0office iad,+London,+NW1+2?entry=3Dgmail&source=3Dg">s 215 Euston Road, London, = NW1 2BE.
--000000000000652fed05b720747b--
--===============0406647842== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline
_______________________________________________ Hangout mailing list Hangout-at-nylxs.com http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============0406647842==--
--===============0406647842== Content-Type: multipart/alternative; boundary="000000000000652fed05b720747b"
--000000000000652fed05b720747b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Today memory is not serious problem, each of our server has 64GB memory.
> Forgot to add - so our FCGI servers need a lot (and I mean a lot) more > memory than the mod_perl servers to serve the same level of content (just > in case memory blows up with FCGI backends) > > -----Original Message----- > From: James Smith > Sent: 23 December 2020 11:34 > To: Andr=C3=A9 Warnier (tomcat/perl) ; modperl-at-perl.apache= .org > Subject: RE: Confused about two development utils [EXT] > > > > This costs memory, and all the more since many perl modules are not > thread-safe, so if you use them in your code, at this moment the only saf= e > way to do it is to use the Apache httpd prefork model. This means that ea= ch > Apache httpd child process has its own copy of the perl interpreter, whic= h > means that the memory used by this embedded perl interpreter has to be > counted n times (as many times as there are Apache httpd child processes > running at any one time). > > This isn=E2=80=99t quite true - if you load modules before the process fo= rks then > they can cleverly share the same parts of memory. It is useful to be able > to "pre-load" core functionality which is used across all functions {this > is the case in Linux anyway}. It also speeds up child process generation = as > the modules are already in memory and converted to byte code. > > One of the great advantages of mod_perl is Apache2::SizeLimit which can > blow away large child process - and then if needed create new ones. This = is > not the case with some of the FCGI solutions as the individual processes > can grow if there is a memory leak or a request that retrieves a large > amount of content (even if not served), but perl can't give the memory > back. So FCGI processes only get bigger and bigger and eventually blow up > memory (or hit swap first) > > > > > > -- > The Wellcome Sanger Institute is operated by Genome Research Limited, a > charity registered in England with number 1021457 and a company register= ed > in England with number 2742969, whose registered office is 215 Euston > Road, London, NW1 2 > y=3Dgmail&source=3Dg> > BE. > > > > -- > The Wellcome Sanger Institute is operated by Genome Research > Limited, a charity registered in England with number 1021457 and a > company registered in England with number 2742969, whose registered > office is 215 Euston Road, London, NW1 2 > y=3Dgmail&source=3Dg> > BE.
--000000000000652fed05b720747b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Today memory is not serious problem, each of our server h= as 64GB memory. =3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd= ing-left:1ex"> Forgot to add - so our FCGI servers need a lot (and I mea= n a lot) more memory than the mod_perl servers to serve the same level of c= ontent (just in case memory blows up with FCGI backends)
-----Original Message-----
From: James Smith <>js5-at-sanger.ac.uk>
Sent: 23 December 2020 11:34
To: Andr=C3=A9 Warnier (tomcat/perl) <arget=3D"_blank">aw-at-ice-sa.com>; he.org" target=3D"_blank">modperl-at-perl.apache.org
Subject: RE: Confused about two development utils [EXT]
> This costs memory, and all the more since many perl modules are not th= read-safe, so if you use them in your code, at this moment the only safe wa= y to do it is to use the Apache httpd prefork model. This means that each A= pache httpd child process has its own copy of the perl interpreter, which m= eans that the memory used by this embedded perl interpreter has to be count= ed n times (as many times as there are Apache httpd child processes running= at any one time).
This isn=E2=80=99t quite true - if you load modules before the process fork= s then they can cleverly share the same parts of memory. It is useful to be= able to "pre-load" core functionality which is used across all f= unctions {this is the case in Linux anyway}. It also speeds up child proces= s generation as the modules are already in memory and converted to byte cod= e.
One of the great advantages of mod_perl is Apache2::SizeLimit which can blo= w away large child process - and then if needed create new ones. This is no= t the case with some of the FCGI solutions as the individual processes can = grow if there is a memory leak or a request that retrieves a large amount o= f content (even if not served), but perl can't give the memory back. So= FCGI processes only get bigger and bigger and eventually blow up memory (o= r hit swap first)
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research=C2=A0 Li= mited, a charity registered in England with number 1021457 and a=C2=A0 comp= any registered in England with number 2742969, whose registered=C2=A0 offic= e i+NW1+2?entry=3Dgmail&source=3Dg">s 215 Euston Road, London, NW1 2BE= .
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research
=C2=A0Limited, a charity registered in England with number 1021457 and a r> =C2=A0company registered in England with number 2742969, whose registered <= br> =C2=A0office iad,+London,+NW1+2?entry=3Dgmail&source=3Dg">s 215 Euston Road, London, = NW1 2BE.
--000000000000652fed05b720747b--
--===============0406647842== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline
_______________________________________________ Hangout mailing list Hangout-at-nylxs.com http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============0406647842==--
|
|