MESSAGE
DATE | 2020-08-04 |
FROM | Mithun Bhattacharya
|
SUBJECT | Re: [Hangout - NYLXS] Question about deployment of math computing
|
From hangout-bounces-at-nylxs.com Thu Aug 6 22:02:30 2020 Return-Path: X-Original-To: archive-at-mrbrklyn.com Delivered-To: archive-at-mrbrklyn.com Received: from www2.mrbrklyn.com (www2.mrbrklyn.com [96.57.23.82]) by mrbrklyn.com (Postfix) with ESMTP id 0548A163FFC; Thu, 6 Aug 2020 22:02:29 -0400 (EDT) X-Original-To: hangout-at-www2.mrbrklyn.com Delivered-To: hangout-at-www2.mrbrklyn.com Received: by mrbrklyn.com (Postfix, from userid 1000) id 6BFF5163FEE; Thu, 6 Aug 2020 22:01:29 -0400 (EDT) Resent-From: Ruben Safir Resent-Date: Thu, 6 Aug 2020 22:01:29 -0400 Resent-Message-ID: <20200807020129.GN24245-at-www2.mrbrklyn.com> Resent-To: hangout-at-mrbrklyn.com X-Original-To: ruben-at-mrbrklyn.com Delivered-To: ruben-at-mrbrklyn.com Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mrbrklyn.com (Postfix) with ESMTP id D6AE1163F91 for ; Tue, 4 Aug 2020 21:36:56 -0400 (EDT) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id F123212551E for ; Wed, 5 Aug 2020 01:36:54 +0000 (UTC) Received: (qmail 44454 invoked by uid 500); 5 Aug 2020 01:36:54 -0000 Mailing-List: contact modperl-help-at-perl.apache.org; run by ezmlm Precedence: bulk Delivered-To: mailing list modperl-at-perl.apache.org Received: (qmail 44439 invoked by uid 99); 5 Aug 2020 01:36:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2020 01:36:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 835251A4186 for ; Wed, 5 Aug 2020 01:36:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id GTRB6gU2Ay65 for ; Wed, 5 Aug 2020 01:36:52 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.217.50; helo=mail-vs1-f50.google.com; envelope-from=mithnb-at-gmail.com; receiver= Received: from mail-vs1-f50.google.com (mail-vs1-f50.google.com [209.85.217.50]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 10C18BB941 for ; Wed, 5 Aug 2020 01:36:52 +0000 (UTC) Received: by mail-vs1-f50.google.com with SMTP id n4so1506962vsl.10 for ; Tue, 04 Aug 2020 18:36:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Je4VxNlC6GmC+gBoCkn38Ghv3nOLu7GWCaiE4bvG8yw=; b=ia3LfCkbrIfOh7mwF3SdrNBwGlyJ/uQ8dbmqeMc0EfYx4nYoqkHaBSG5mdhKzld7HE uxFbN/ov7m2xfiP156arT5c4mhbelgTVtitQLg9murSJhaciJMznlk3nTJtAGBeVOPOx wEI+sWlZ35F0WQtv/Oxyvc2IeP6tlBxR21lVaS9rRWTgLWm97c7IuST5Qj8zXewtccoN 3r9/Z2b51/S9cN4CQYi9wqqdyWEKYz8S4YzOBuxx3+73HwLK/oWYxUIE6PenPQDfP7Vy iV/0Uj11YoPLwp1kVGOiD9OzTSzIbBafLSVwXy6K84DdtT1Vd2AiXIUeqocsyGH8/v+3 BKlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Je4VxNlC6GmC+gBoCkn38Ghv3nOLu7GWCaiE4bvG8yw=; b=PbvtI68MBKB9+FyDMn4Iz6yFMZo+WfnGmz4QeSTlTyaLS0O4a+FNb7OKnqkSlSD/i3 24zul725IrDEL9HoC+p0WdmT3jXAaDhurVfk9gQ7/bYagmeMYTbHXCE6X33CiGhSqEBW vhbZywjg6chSBoZjIW15P28NIovqu9S4w1K99Bf7zrs2hOtTQOAFeTgcjUAU/quOj1gK ic1uXowgqFOLPsWGNDppfAaKK5BccM7k8vVrkG+2DWppR92qn6uQHizNsGyFxd59NAtB i0iEkePvk8hyOOSUsyDnxdcZWXovYOrYPfJWN/Do7Zrwp61n8Yq5epreZ4DFLsZz49uN vuDg== X-Gm-Message-State: AOAM530Z4cKBGBjeTLGM4SmZ7K6BctsT8h4YcWZpAcfsp2/s2UHJc7Ie /3h25LD5P+I967/ngThImPtW24PNeIL5l/3Tv10Fx1lskrA= X-Google-Smtp-Source: ABdhPJzWZNsppGnZTAI+BmkPfq0pmtC8o5pyR9GnFiFsS+JFvInOPXG9U+F78P+bGzZBZCM6uNZB327+fwD+FIm7NN8= X-Received: by 2002:a67:1942:: with SMTP id 63mr372678vsz.125.1596591405427; Tue, 04 Aug 2020 18:36:45 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Mithun Bhattacharya Date: Tue, 4 Aug 2020 20:36:34 -0500 Message-ID: To: Wesley Peng Cc: mod_perl list Subject: Re: [Hangout - NYLXS] Question about deployment of math computing X-BeenThere: hangout-at-nylxs.com X-Mailman-Version: 2.1.30rc1 List-Id: NYLXS Tech Talk and Politics List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0802041030==" Errors-To: hangout-bounces-at-nylxs.com Sender: "Hangout"
--===============0802041030== Content-Type: multipart/alternative; boundary="00000000000092759b05ac1767dd"
--00000000000092759b05ac1767dd Content-Type: text/plain; charset="UTF-8"
Do you really need a webserver which is providing a blocking service ?
Assuming you are doing some sort of map reduce you would be better of creating a job queue and placing requests into it. You would have a separate consumer of the queue which could scale up or down depending upon how long the job queue is.
On Tue, Aug 4, 2020 at 8:23 PM Wesley Peng wrote:
> Hi > > We do math programming (so called machine learning today) in webserver. > The response would be slow, generally it will take 100ms~500ms to finish > a request. > For this use case, shall we deploy the code within preforked modperl ,or > event-driven server like dancer/starman? > (we don't use DB like mysql or other slow IO storage server, all > arguments were passed to webserver by HTTP POST from client). > > Thank you. >
--00000000000092759b05ac1767dd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Do you really need a webserver which=C2=A0is providing a b= locking service ?
Assuming you are doing some sort of ma= p reduce you would be better of creating a job queue and placing requests i= nto it. You would have a separate consumer of the queue which could scale u= p or down depending upon how long the job queue is.
ss=3D"gmail_quote"> n:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex= ">Hi
We do math programming (so called machine learning today) in webserver.
The response would be slow, generally it will take 100ms~500ms to finish r> a request.
For this use case, shall we deploy the code within preforked modperl ,or r> event-driven server like dancer/starman?
(we don't use DB like mysql or other slow IO storage server, all
arguments were passed to webserver by HTTP POST from client).
Thank you.
--00000000000092759b05ac1767dd--
--===============0802041030== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline
_______________________________________________ Hangout mailing list Hangout-at-nylxs.com http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============0802041030==--
--===============0802041030== Content-Type: multipart/alternative; boundary="00000000000092759b05ac1767dd"
--00000000000092759b05ac1767dd Content-Type: text/plain; charset="UTF-8"
Do you really need a webserver which is providing a blocking service ?
Assuming you are doing some sort of map reduce you would be better of creating a job queue and placing requests into it. You would have a separate consumer of the queue which could scale up or down depending upon how long the job queue is.
On Tue, Aug 4, 2020 at 8:23 PM Wesley Peng wrote:
> Hi > > We do math programming (so called machine learning today) in webserver. > The response would be slow, generally it will take 100ms~500ms to finish > a request. > For this use case, shall we deploy the code within preforked modperl ,or > event-driven server like dancer/starman? > (we don't use DB like mysql or other slow IO storage server, all > arguments were passed to webserver by HTTP POST from client). > > Thank you. >
--00000000000092759b05ac1767dd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Do you really need a webserver which=C2=A0is providing a b= locking service ?
Assuming you are doing some sort of ma= p reduce you would be better of creating a job queue and placing requests i= nto it. You would have a separate consumer of the queue which could scale u= p or down depending upon how long the job queue is.
ss=3D"gmail_quote"> n:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex= ">Hi
We do math programming (so called machine learning today) in webserver.
The response would be slow, generally it will take 100ms~500ms to finish r> a request.
For this use case, shall we deploy the code within preforked modperl ,or r> event-driven server like dancer/starman?
(we don't use DB like mysql or other slow IO storage server, all
arguments were passed to webserver by HTTP POST from client).
Thank you.
--00000000000092759b05ac1767dd--
--===============0802041030== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline
_______________________________________________ Hangout mailing list Hangout-at-nylxs.com http://lists.mrbrklyn.com/mailman/listinfo/hangout
--===============0802041030==--
|
|