Squid slower compared to Linux how to boost it?

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Squid slower compared to Linux how to boost it?

slackwaree
Hello,

I'm migrating from an old Debian Wheezy 7.11 to OpenBSD 6.3.
Although some of the bench numbers in favor of Obsd when I start using the proxy in general I feel more sluggishness (sometimes pages load slower) also elements might not load.

BENCHMARK THROUGH WHEEZY PROXY
==============================

ab -n 1000 -c 50 -X <proxyip>:<port> http://wiki.asterisk.org/

This is ApacheBench, Version 2.3 <$Revision: 1757674 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests

Server Software:        Apache/2.2.22
Server Hostname:        wiki.asterisk.org
Server Port:            80

Document Path:          /
Document Length:        317 bytes

Concurrency Level:      50
Time taken for tests:   34.569 seconds
Complete requests:      1000
Failed requests:        0
Non-2xx responses:      1000
Total transferred:      639000 bytes
HTML transferred:       317000 bytes
Requests per second:    28.93 [#/sec] (mean)
Time per request:       1728.457 [ms] (mean)
Time per request:       34.569 [ms] (mean, across all concurrent requests)
Transfer rate:          18.05 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       26   28   2.2     27      46
Processing:   533 1662 157.6   1698    2050
Waiting:      532 1662 157.6   1698    2049
Total:        563 1690 157.1   1726    2077

Percentage of the requests served within a certain time (ms)
  50%   1726
  66%   1734
  75%   1747
  80%   1755
  90%   1783
  95%   1819
  98%   1831
  99%   1869
100%   2077 (longest request)

BENCHMARK THROUGH OBSD PROXY
==============================

Server Software:        Apache/2.2.22
Server Hostname:        wiki.asterisk.org
Server Port:            80

Document Path:          /
Document Length:        317 bytes

Concurrency Level:      50
Time taken for tests:   13.697 seconds
Complete requests:      1000
Failed requests:        0
Non-2xx responses:      1000
Total transferred:      596000 bytes
HTML transferred:       317000 bytes
Requests per second:    73.01 [#/sec] (mean)
Time per request:       684.852 [ms] (mean)
Time per request:       13.697 [ms] (mean, across all concurrent requests)
Transfer rate:          42.49 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       26   71 185.2     34    1068
Processing:   166  550 700.5    312    3840
Waiting:      165  320 151.1    301    3296
Total:        194  621 713.5    346    3881

Percentage of the requests served within a certain time (ms)
  50%    346
  66%    358
  75%    375
  80%    392
  90%   1855
  95%   2326
  98%   3382
  99%   3871
100%   3881 (longest request)

I use the proxy as proxy only without caching (cache dir is disabled) so that cannot impact performace, it is the same config but different versions:

ii  squid-langpack                     20120616-1                    all          Localized error pages for Squid
ii  squid3                             3.1.20-2.2+deb7u3             amd64        Full featured Web Proxy cache (HTTP proxy)
ii  squid3-common                      3.1.20-2.2+deb7u3             all          Full featured Web Proxy cache (HTTP proxy) - common files
ii  squidguard                         1.5-1                         amd64        filter and redirector plugin for Squid

VS

[squid-3.5.27p1.tgz](https://ftp.openbsd.org/pub/OpenBSD/6.3/packages/amd64/squid-3.5.27p1.tgz)

There is no firewall in either cases, the machines are VMs with the same specs:

KVM 1x2.40GHz CPU + 1 GB ram.

The cpu usage don't go higher even during the tests than 20-30%.

As I said caching is turned off so file IO cannot be a bottleneck.

Are there any tricks to boost my proxy performance on OpenBSD even more?
Reply | Threaded
Open this post in threaded view
|

Re: Squid slower compared to Linux how to boost it?

Juan Francisco Cantero Hurtado
On Tue, Jan 22, 2019 at 07:49:06AM +0000, slackwaree wrote:
> Hello,
>
> I'm migrating from an old Debian Wheezy 7.11 to OpenBSD 6.3.

If you're migrating to OpenBSD, then try with -current and update to 6.5
when we release it.

> Although some of the bench numbers in favor of Obsd when I start using the proxy in general I feel more sluggishness (sometimes pages load slower) also elements might not load.
>
> BENCHMARK THROUGH WHEEZY PROXY
> ==============================
>
> ab -n 1000 -c 50 -X <proxyip>:<port> http://wiki.asterisk.org/
>
> This is ApacheBench, Version 2.3 <$Revision: 1757674 $>
> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
> Licensed to The Apache Software Foundation, http://www.apache.org/
>
> Completed 100 requests
> Completed 200 requests
> Completed 300 requests
> Completed 400 requests
> Completed 500 requests
> Completed 600 requests
> Completed 700 requests
> Completed 800 requests
> Completed 900 requests
> Completed 1000 requests
> Finished 1000 requests
>
> Server Software:        Apache/2.2.22
> Server Hostname:        wiki.asterisk.org
> Server Port:            80
>
> Document Path:          /
> Document Length:        317 bytes
>
> Concurrency Level:      50
> Time taken for tests:   34.569 seconds
> Complete requests:      1000
> Failed requests:        0
> Non-2xx responses:      1000
> Total transferred:      639000 bytes
> HTML transferred:       317000 bytes
> Requests per second:    28.93 [#/sec] (mean)
> Time per request:       1728.457 [ms] (mean)
> Time per request:       34.569 [ms] (mean, across all concurrent requests)
> Transfer rate:          18.05 [Kbytes/sec] received
>
> Connection Times (ms)
>               min  mean[+/-sd] median   max
> Connect:       26   28   2.2     27      46
> Processing:   533 1662 157.6   1698    2050
> Waiting:      532 1662 157.6   1698    2049
> Total:        563 1690 157.1   1726    2077
>
> Percentage of the requests served within a certain time (ms)
>   50%   1726
>   66%   1734
>   75%   1747
>   80%   1755
>   90%   1783
>   95%   1819
>   98%   1831
>   99%   1869
> 100%   2077 (longest request)
>
> BENCHMARK THROUGH OBSD PROXY
> ==============================
>
> Server Software:        Apache/2.2.22
> Server Hostname:        wiki.asterisk.org
> Server Port:            80
>
> Document Path:          /
> Document Length:        317 bytes
>
> Concurrency Level:      50
> Time taken for tests:   13.697 seconds
> Complete requests:      1000
> Failed requests:        0
> Non-2xx responses:      1000
> Total transferred:      596000 bytes
> HTML transferred:       317000 bytes
> Requests per second:    73.01 [#/sec] (mean)
> Time per request:       684.852 [ms] (mean)
> Time per request:       13.697 [ms] (mean, across all concurrent requests)
> Transfer rate:          42.49 [Kbytes/sec] received
>
> Connection Times (ms)
>               min  mean[+/-sd] median   max
> Connect:       26   71 185.2     34    1068
> Processing:   166  550 700.5    312    3840
> Waiting:      165  320 151.1    301    3296
> Total:        194  621 713.5    346    3881
>
> Percentage of the requests served within a certain time (ms)
>   50%    346
>   66%    358
>   75%    375
>   80%    392
>   90%   1855
>   95%   2326
>   98%   3382
>   99%   3871
> 100%   3881 (longest request)
>
> I use the proxy as proxy only without caching (cache dir is disabled) so that cannot impact performace, it is the same config but different versions:
>
> ii  squid-langpack                     20120616-1                    all          Localized error pages for Squid
> ii  squid3                             3.1.20-2.2+deb7u3             amd64        Full featured Web Proxy cache (HTTP proxy)
> ii  squid3-common                      3.1.20-2.2+deb7u3             all          Full featured Web Proxy cache (HTTP proxy) - common files
> ii  squidguard                         1.5-1                         amd64        filter and redirector plugin for Squid
>
> VS
>
> [squid-3.5.27p1.tgz](https://ftp.openbsd.org/pub/OpenBSD/6.3/packages/amd64/squid-3.5.27p1.tgz)
>
> There is no firewall in either cases, the machines are VMs with the same specs:
>
> KVM 1x2.40GHz CPU + 1 GB ram.
>
> The cpu usage don't go higher even during the tests than 20-30%.
>
> As I said caching is turned off so file IO cannot be a bottleneck.
>
> Are there any tricks to boost my proxy performance on OpenBSD even more?

--
Juan Francisco Cantero Hurtado http://juanfra.info

Reply | Threaded
Open this post in threaded view
|

Re: Squid slower compared to Linux how to boost it?

Steven Shockley
On 1/22/2019 11:51 AM, Juan Francisco Cantero Hurtado wrote:
> On Tue, Jan 22, 2019 at 07:49:06AM +0000, slackwaree wrote:
>> Hello,
>>
>> I'm migrating from an old Debian Wheezy 7.11 to OpenBSD 6.3.
>
> If you're migrating to OpenBSD, then try with -current and update to 6.5
> when we release it.

Was there a specific change that might make a difference?  Thanks.

Reply | Threaded
Open this post in threaded view
|

Re: Squid slower compared to Linux how to boost it?

Juan Francisco Cantero Hurtado
On Tue, Jan 22, 2019 at 07:56:30PM -0500, Steven Shockley wrote:

> On 1/22/2019 11:51 AM, Juan Francisco Cantero Hurtado wrote:
> > On Tue, Jan 22, 2019 at 07:49:06AM +0000, slackwaree wrote:
> >> Hello,
> >>
> >> I'm migrating from an old Debian Wheezy 7.11 to OpenBSD 6.3.
> >
> > If you're migrating to OpenBSD, then try with -current and update to 6.5
> > when we release it.
>
> Was there a specific change that might make a difference?  Thanks.

Yes, a full year of work.

Anyway, my point is that you're installing a version which will be EOL
in a few months and the security patches for ports goes only to the
-stable branch (6.4). I think that testing your setup with -current
before of migrate everything is easier for you, instead of install 6.3
now and then update to 6.4 and finally update to 6.5 (we don't support
updates of non-consecutive version, i.e. 6.3 -> 6.5).


--
Juan Francisco Cantero Hurtado http://juanfra.info