MESSAGE
| DATE | 2021-02-07 |
| FROM | Mithun Bhattacharya
|
| SUBJECT | Re: [Hangout - NYLXS] Moving ExecCGI to mod_perl - performance and
|
From hangout-bounces-at-nylxs.com Tue Feb 9 17:08:04 2021
Return-Path:
X-Original-To: archive-at-mrbrklyn.com
Delivered-To: archive-at-mrbrklyn.com
Received: from www2.mrbrklyn.com (www2.mrbrklyn.com [96.57.23.82])
by mrbrklyn.com (Postfix) with ESMTP id 09CB016403B;
Tue, 9 Feb 2021 17:08:04 -0500 (EST)
X-Original-To: hangout-at-www2.mrbrklyn.com
Delivered-To: hangout-at-www2.mrbrklyn.com
Received: by mrbrklyn.com (Postfix, from userid 1000)
id D8B7D164045; Tue, 9 Feb 2021 17:05:47 -0500 (EST)
Resent-From: Ruben Safir
Resent-Date: Tue, 9 Feb 2021 17:05:47 -0500
Resent-Message-ID: <20210209220547.GT25519-at-www2.mrbrklyn.com>
Resent-To: hangout-at-mrbrklyn.com
X-Original-To: ruben-at-mrbrklyn.com
Delivered-To: ruben-at-mrbrklyn.com
Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org
[3.227.148.255]) by mrbrklyn.com (Postfix) with ESMTP id E4A04163FF9
for ; Sun, 7 Feb 2021 15:35:59 -0500 (EST)
Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153])
by mxout1-ec2-va.apache.org (ASF Mail Server at
mxout1-ec2-va.apache.org) with SMTP id 770EC42E62
for ; Sun, 7 Feb 2021 20:35:59 +0000 (UTC)
Received: (qmail 34399 invoked by uid 500); 7 Feb 2021 20:35:59 -0000
Mailing-List: contact modperl-help-at-perl.apache.org; run by ezmlm
Precedence: bulk
Delivered-To: mailing list modperl-at-perl.apache.org
Received: (qmail 34388 invoked by uid 99); 7 Feb 2021 20:35:58 -0000
Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org)
(95.217.134.168)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Feb 2021 20:35:58 +0000
Received: from localhost (localhost [127.0.0.1])
by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org)
with ESMTP id 07DE1C0116
for ; Sun, 7 Feb 2021 20:35:58 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org
X-Spam-Flag: NO
X-Spam-Score: 0
X-Spam-Level:
X-Spam-Status: No, score=0 tagged_above=-999 required=6.31
tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, LH_URI_DOM_IN_PATH=0.001,
RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
autolearn=disabled
Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new);
dkim=pass (2048-bit key) header.d=gmail.com
Received: from mx1-ec2-va.apache.org ([116.203.227.195])
by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new,
port 10024) with ESMTP id eDEKBJkeRPiC for ;
Sun, 7 Feb 2021 20:35:57 +0000 (UTC)
Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.217.52;
helo=mail-vs1-f52.google.com; envelope-from=mithnb-at-gmail.com;
receiver=
Received: from mail-vs1-f52.google.com (mail-vs1-f52.google.com
[209.85.217.52])
by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with
ESMTPS id AD03EBCC6B
for ; Sun, 7 Feb 2021 20:35:56 +0000 (UTC)
Received: by mail-vs1-f52.google.com with SMTP id t23so3409276vsk.2
for ; Sun, 07 Feb 2021 12:35:56 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
h=mime-version:references:in-reply-to:from:date:message-id:subject:to
:cc; bh=XerTQ+tZiihMofBmDuBXbq/eIelUdjR2WqvVyKq5+R0=;
b=PEzX93535eXeHRs8fM8nC+GjU4ud+m3gjFuAbIt7qmZ4Wm1gUneRmOcsYC+ings9ZO
5DnWmgYeRJXRLluuIX7Fgs6GtS4peLfOFJn0kY0lRlM8JPe3cdoBxP8VNRvf+upSxQSD
67H7InqFTetpijTpid1a6qmuti1CEAVbgOxbLIoXWfMVcZHPg8BvnCbitDOZjC8Cm9OI
RpkgdSNPv6gXlqMkkA+djMlqMUHM1k6hliJXi/Vh7mkJoAshcQbk+XP8nbNsb2t22i+l
LnsCIeKVBrqXWYcKmfBKP8pFFoabVvUodg74TX38iu4xH0ilNBMkmQk0E4LY/YxZBo7t
upbw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:references:in-reply-to:from:date
:message-id:subject:to:cc;
bh=XerTQ+tZiihMofBmDuBXbq/eIelUdjR2WqvVyKq5+R0=;
b=lWL2ezovR2fhNHttuMHP/HuyRVp4JeOQQt0DQQpYhO3bFwo7q7HyVd/VAZilLn0wjI
bFk9hxXyOhXWGM/Yn/XRWJ8T5vlDe+uDdCPs7YKQiOym+iE5gcxT/kDn1lTNUcceYXoU
7eF6zuGjxeH6GFbVkCBatuz1y2BmYP01HcZexqhGRs005hXs+uRqPaBvLVFXJo8ja2vJ
tFbRVt9eoTR1Wh8NraVIp+HgmoQL4oiV/VupcxJvO4kbNVXFAL2XHM7dUXduQkQMaR7e
1GFyq9lg8fuoPS5JSG5YtyMU81AIkX1r3IUn1JnQzJWqS6lBR1WmQQJpznYBljWByII5
wMmg==
X-Gm-Message-State: AOAM533n44iuW7aZCJK/4KI83JczUaDgkhz/otaV79LUzKQxb5DfG8Mt
73o8ZNjxl2rG1uG6yGUqs6m2bpK7gWrSAQH5vKI=
X-Google-Smtp-Source: ABdhPJw0V7X70QMvOHgM8nLLNCR7AmbmUKJSsopTtm/VByVtTyA4iEFQ/BEiTwhgg2imcPKR7odROyYkjLafX6dDz6M=
X-Received: by 2002:a05:6102:5c:: with SMTP id
k28mr8665861vsp.38.1612730150129;
Sun, 07 Feb 2021 12:35:50 -0800 (PST)
MIME-Version: 1.0
References:
<5DT5OQ.TMVDQL2ALCKH-at-crc.id.au>
<20210207200539.a916a6af80093eb8a56ab4dc-at-wanadoo.fr>
In-Reply-To:
From: Mithun Bhattacharya
Date: Sun, 7 Feb 2021 14:35:39 -0600
Message-ID:
To: James Smith
Cc: Vincent Veyron , Steven Haigh ,
"modperl-at-perl.apache.org"
Subject: Re: [Hangout - NYLXS] Moving ExecCGI to mod_perl - performance and
custom 'modules' [EXT]
X-BeenThere: hangout-at-nylxs.com
X-Mailman-Version: 2.1.30rc1
List-Id: NYLXS Tech Talk and Politics
List-Unsubscribe: ,
List-Archive:
List-Post:
List-Help:
List-Subscribe: ,
Content-Type: multipart/mixed; boundary="===============1865527230=="
Errors-To: hangout-bounces-at-nylxs.com
Sender: "Hangout"
--===============1865527230==
Content-Type: multipart/alternative; boundary="000000000000b791c905bac4ffe6"
--000000000000b791c905bac4ffe6
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
DBI sharing has it's own issues but in most use cases it does a pretty good
job and keeps the DBA's happy - that is very important ;)
On Sun, Feb 7, 2021 at 2:23 PM James Smith wrote:
> DBI sharing doesn't really gain you much - and can actually lead you into
> a whole world of pain. It isn't actually worth turning it on at all.
>
> We use dedicated DB caching in the cases where we benefit from it as and
> when you need it (low level caching database)...
>
> Although milage may vary - our problem was DB servers with 30 or 40
> databases on them being connected from a number of approximately 50-100
> child apaches, meant we ended up blowing up the connections to the databa=
se
> server really quickly...
>
>
> -----Original Message-----
> From: Vincent Veyron
> Sent: 07 February 2021 19:06
> To: Steven Haigh
> Cc: James Smith ; modperl-at-perl.apache.org
> Subject: Re: Moving ExecCGI to mod_perl - performance and custom 'modules=
'
> [EXT]
>
> On Sun, 07 Feb 2021 23:58:17 +1100
> Steven Haigh wrote:
> >
> > I haven't gotten into the preload or DBI sharing yet - as that'll end
> > up needing a bit of a rewrite of code to take advantage of. I'd be
> > open to suggestions here from those who have done it in the past to
> > save me going down some dead ends :D
>
> I use mod_perl handlers, so not sure how it mixes with PerlRegistry, but
> you probably want to have a look at connect_cached
>
>
> --
>
> Bien =C3=A0 vous, Vincent Veyron
>
>
> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__compta.libremen.co=
m&d=3DDwIFAw&c=3DD7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnqBo&r=3DoH2yp0ge1e=
cj4oDX0XM7vQ&m=3DC0OcuGbNbfxaSa8ASgV3uFXzejn7MpjIUH1aP1RbiyU&s=3DGPr8VuKQ3r=
ZCzCPwggyAHdCOojK6ZThmShKk0Jb3maI&e=3D
> Logiciel libre de comptabilit=C3=A9 g=C3=A9n=C3=A9rale en partie double
>
>
>
> --
> The Wellcome Sanger Institute is operated by Genome Research
> Limited, a charity registered in England with number 1021457 and a
> company registered in England with number 2742969, whose registered
> office is 215 Euston Road, London, NW1 2BE.
>
--000000000000b791c905bac4ffe6
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
DBI sharing has it's own issues but in most use cases =
it does a pretty good job and keeps the DBA's happy - that is very impo=
rtant ;)
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex">DBI sharing doesn't really gain you mu=
ch - and can actually lead you into a whole world of pain. It isn't act=
ually worth turning it on at all.
We use dedicated DB caching in the cases where we benefit from it as and wh=
en you need it (low level caching database)...
Although milage may vary - our problem was DB servers with 30 or 40 databas=
es on them being connected from a number of approximately 50-100 child apac=
hes, meant we ended up blowing up the connections to the database server re=
ally quickly...
-----Original Message-----
From: Vincent Veyron <blank">vv.lists-at-wanadoo.fr>
Sent: 07 February 2021 19:06
To: Steven Haigh <=
netwiz-at-crc.id.au>
Cc: James Smith <j=
s5-at-sanger.ac.uk>; =3D"_blank">modperl-at-perl.apache.org
Subject: Re: Moving ExecCGI to mod_perl - performance and custom 'modul=
es' [EXT]
On Sun, 07 Feb 2021 23:58:17 +1100
Steven Haigh <netw=
iz-at-crc.id.au> wrote:
>
> I haven't gotten into the preload or DBI sharing yet - as that'=
;ll end
> up needing a bit of a rewrite of code to take advantage of. I'd be=
> open to suggestions here from those who have done it in the past to r>
> save me going down some dead ends :D
I use mod_perl handlers, so not sure how it mixes with PerlRegistry, but yo=
u probably want to have a look at connect_cached
--
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Bien =C3=
=A0 vous, Vincent Veyron
bremen.com&d=3DDwIFAw&c=3DD7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnq=
Bo&r=3DoH2yp0ge1ecj4oDX0XM7vQ&m=3DC0OcuGbNbfxaSa8ASgV3uFXzejn7MpjIU=
H1aP1RbiyU&s=3DGPr8VuKQ3rZCzCPwggyAHdCOojK6ZThmShKk0Jb3maI&e=3D" re=
l=3D"noreferrer" target=3D"_blank">https://urldefense.proofpoint.com/v2/url=
?u=3Dhttps-3A__compta.libremen.com&d=3DDwIFAw&c=3DD7ByGjS34AllFgecY=
w0iC6Zq7qlm8uclZFI0SqQnqBo&r=3DoH2yp0ge1ecj4oDX0XM7vQ&m=3DC0OcuGbNb=
fxaSa8ASgV3uFXzejn7MpjIUH1aP1RbiyU&s=3DGPr8VuKQ3rZCzCPwggyAHdCOojK6ZThm=
ShKk0Jb3maI&e=3D
Logiciel libre de comptabilit=C3=A9 g=C3=A9n=C3=A9rale en partie double
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research
=C2=A0Limited, a charity registered in England with number 1021457 and a r>
=C2=A0company registered in England with number 2742969, whose registered <=
br>
=C2=A0office is 215 Euston Road, London, NW1 2BE.
--000000000000b791c905bac4ffe6--
--===============1865527230==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Hangout mailing list
Hangout-at-nylxs.com
http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============1865527230==--
--===============1865527230==
Content-Type: multipart/alternative; boundary="000000000000b791c905bac4ffe6"
--000000000000b791c905bac4ffe6
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
DBI sharing has it's own issues but in most use cases it does a pretty good
job and keeps the DBA's happy - that is very important ;)
On Sun, Feb 7, 2021 at 2:23 PM James Smith wrote:
> DBI sharing doesn't really gain you much - and can actually lead you into
> a whole world of pain. It isn't actually worth turning it on at all.
>
> We use dedicated DB caching in the cases where we benefit from it as and
> when you need it (low level caching database)...
>
> Although milage may vary - our problem was DB servers with 30 or 40
> databases on them being connected from a number of approximately 50-100
> child apaches, meant we ended up blowing up the connections to the databa=
se
> server really quickly...
>
>
> -----Original Message-----
> From: Vincent Veyron
> Sent: 07 February 2021 19:06
> To: Steven Haigh
> Cc: James Smith ; modperl-at-perl.apache.org
> Subject: Re: Moving ExecCGI to mod_perl - performance and custom 'modules=
'
> [EXT]
>
> On Sun, 07 Feb 2021 23:58:17 +1100
> Steven Haigh wrote:
> >
> > I haven't gotten into the preload or DBI sharing yet - as that'll end
> > up needing a bit of a rewrite of code to take advantage of. I'd be
> > open to suggestions here from those who have done it in the past to
> > save me going down some dead ends :D
>
> I use mod_perl handlers, so not sure how it mixes with PerlRegistry, but
> you probably want to have a look at connect_cached
>
>
> --
>
> Bien =C3=A0 vous, Vincent Veyron
>
>
> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__compta.libremen.co=
m&d=3DDwIFAw&c=3DD7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnqBo&r=3DoH2yp0ge1e=
cj4oDX0XM7vQ&m=3DC0OcuGbNbfxaSa8ASgV3uFXzejn7MpjIUH1aP1RbiyU&s=3DGPr8VuKQ3r=
ZCzCPwggyAHdCOojK6ZThmShKk0Jb3maI&e=3D
> Logiciel libre de comptabilit=C3=A9 g=C3=A9n=C3=A9rale en partie double
>
>
>
> --
> The Wellcome Sanger Institute is operated by Genome Research
> Limited, a charity registered in England with number 1021457 and a
> company registered in England with number 2742969, whose registered
> office is 215 Euston Road, London, NW1 2BE.
>
--000000000000b791c905bac4ffe6
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
DBI sharing has it's own issues but in most use cases =
it does a pretty good job and keeps the DBA's happy - that is very impo=
rtant ;)
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex">DBI sharing doesn't really gain you mu=
ch - and can actually lead you into a whole world of pain. It isn't act=
ually worth turning it on at all.
We use dedicated DB caching in the cases where we benefit from it as and wh=
en you need it (low level caching database)...
Although milage may vary - our problem was DB servers with 30 or 40 databas=
es on them being connected from a number of approximately 50-100 child apac=
hes, meant we ended up blowing up the connections to the database server re=
ally quickly...
-----Original Message-----
From: Vincent Veyron <blank">vv.lists-at-wanadoo.fr>
Sent: 07 February 2021 19:06
To: Steven Haigh <=
netwiz-at-crc.id.au>
Cc: James Smith <j=
s5-at-sanger.ac.uk>; =3D"_blank">modperl-at-perl.apache.org
Subject: Re: Moving ExecCGI to mod_perl - performance and custom 'modul=
es' [EXT]
On Sun, 07 Feb 2021 23:58:17 +1100
Steven Haigh <netw=
iz-at-crc.id.au> wrote:
>
> I haven't gotten into the preload or DBI sharing yet - as that'=
;ll end
> up needing a bit of a rewrite of code to take advantage of. I'd be=
> open to suggestions here from those who have done it in the past to r>
> save me going down some dead ends :D
I use mod_perl handlers, so not sure how it mixes with PerlRegistry, but yo=
u probably want to have a look at connect_cached
--
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Bien =C3=
=A0 vous, Vincent Veyron
bremen.com&d=3DDwIFAw&c=3DD7ByGjS34AllFgecYw0iC6Zq7qlm8uclZFI0SqQnq=
Bo&r=3DoH2yp0ge1ecj4oDX0XM7vQ&m=3DC0OcuGbNbfxaSa8ASgV3uFXzejn7MpjIU=
H1aP1RbiyU&s=3DGPr8VuKQ3rZCzCPwggyAHdCOojK6ZThmShKk0Jb3maI&e=3D" re=
l=3D"noreferrer" target=3D"_blank">https://urldefense.proofpoint.com/v2/url=
?u=3Dhttps-3A__compta.libremen.com&d=3DDwIFAw&c=3DD7ByGjS34AllFgecY=
w0iC6Zq7qlm8uclZFI0SqQnqBo&r=3DoH2yp0ge1ecj4oDX0XM7vQ&m=3DC0OcuGbNb=
fxaSa8ASgV3uFXzejn7MpjIUH1aP1RbiyU&s=3DGPr8VuKQ3rZCzCPwggyAHdCOojK6ZThm=
ShKk0Jb3maI&e=3D
Logiciel libre de comptabilit=C3=A9 g=C3=A9n=C3=A9rale en partie double
--
=C2=A0The Wellcome Sanger Institute is operated by Genome Research
=C2=A0Limited, a charity registered in England with number 1021457 and a r>
=C2=A0company registered in England with number 2742969, whose registered <=
br>
=C2=A0office is 215 Euston Road, London, NW1 2BE.
--000000000000b791c905bac4ffe6--
--===============1865527230==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Hangout mailing list
Hangout-at-nylxs.com
http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============1865527230==--
|
|
