dpb freezes on ruby-1.8.7 and 1-9.3

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

dpb freezes on ruby-1.8.7 and 1-9.3

Predrag Punosevac-2
Dear All,

I was trying to build last night all packages for amd64 as I promised
two weeks ago to Mark Espie on that Supermicro server with 64 cores and
256 GB of RAM. I was using the snapshot from yesterday and the latest
port. dmesg has been sent to dmesg@ I just run
./dpb -a

As I came this morning to my office I noticed that about
3GB of packages has been build and that the built is hanging with the
message
<ruby-1.8.7-p374.tar.tz(#1) [9001] frozen for 5 HOURS!
<ruby-1.9.3-p448.tar.tz(#1) [17065] frozen for 5 HOURS!

I uploaded all log files found in /usr/ports/log

http://www.devio.us/~ppunosevac/logs.tgz

This server is interesting as it has only one 600 GB Solid State HDD

Intel DC S3500 Series MCL (6Gb/s)

supposedly for better read and write times.  

I did couple of tests and executing mv command on the 500 MB directory
took 5 minutes. It took almost a minute to rm -rf that same directory.

What am I doing wrong?


Best,
Predrag

P.S. I apologize to Mark for this long delay. The good news is that I
have so much other stuff to do that I could probably hang on to this
server for another 4-5 days before putting it into production so please
feel free to teach me something and use this machine for something
OpenBSD related.

Reply | Threaded
Open this post in threaded view
|

Re: dpb freezes on ruby-1.8.7 and 1-9.3

Nigel Taylor-3
On 10/30/13 17:39, Predrag Punosevac wrote:

> Dear All,
>
> I was trying to build last night all packages for amd64 as I promised
> two weeks ago to Mark Espie on that Supermicro server with 64 cores and
> 256 GB of RAM. I was using the snapshot from yesterday and the latest
> port. dmesg has been sent to dmesg@ I just run
> ./dpb -a
>
> As I came this morning to my office I noticed that about
> 3GB of packages has been build and that the built is hanging with the
> message
> <ruby-1.8.7-p374.tar.tz(#1) [9001] frozen for 5 HOURS!
> <ruby-1.9.3-p448.tar.tz(#1) [17065] frozen for 5 HOURS!
>
> I uploaded all log files found in /usr/ports/log
>
> http://www.devio.us/~ppunosevac/logs.tgz
>
> This server is interesting as it has only one 600 GB Solid State HDD
>
> Intel DC S3500 Series MCL (6Gb/s)
>
> supposedly for better read and write times.  
>
> I did couple of tests and executing mv command on the 500 MB directory
> took 5 minutes. It took almost a minute to rm -rf that same directory.
>
> What am I doing wrong?
>
>
> Best,
> Predrag
>
> P.S. I apologize to Mark for this long delay. The good news is that I
> have so much other stuff to do that I could probably hang on to this
> server for another 4-5 days before putting it into production so please
> feel free to teach me something and use this machine for something
> OpenBSD related.
>
>
That's downloading, most likely hung on ftp transfers.

Myself I change the MASTER_SITES like so... http works better,
if there is an http site available to download from.

$ cvs -R -q diff -uNp
Index: Makefile.inc
===================================================================
RCS file: /home/cvs/ports/lang/ruby/Makefile.inc,v
retrieving revision 1.6
diff -u -p -r1.6 Makefile.inc
--- Makefile.inc        11 Mar 2013 11:20:28 -0000      1.6
+++ Makefile.inc        11 Mar 2013 17:22:56 -0000
@@ -15,7 +15,8 @@ PERMIT_PACKAGE_CDROM ?= Yes
 PERMIT_PACKAGE_FTP ?= Yes
 PERMIT_DISTFILES_FTP ?= Yes
 
-MASTER_SITES ?=        ftp://www.ruby-lang.org/pub/ruby/${VERSION:R}/ \
+MASTER_SITES ?=        http://ftp.ruby-lang.org/pub/ruby/${VERSION:R}/ \
+               ftp://www.ruby-lang.org/pub/ruby/${VERSION:R}/ \
                ftp://mirror.nucba.ac.jp/pub/ruby/${VERSION:R}/ \
                ftp://ftp.kr.freebsd.org/pub/ruby/${VERSION:R}/

Then I don't normally use dpb for fetching files either, but use make fetch.

When I do the cvs update I generate a list to be fetched.

Some sites don't like multiple download requests at the same time, using
make fetch avoids that.

If the ftp hangs kill the process and let it try the next site. Using a
list allow me to do that then start dpb knowning it less likely to
get stuck on a download.

Reply | Threaded
Open this post in threaded view
|

Re: dpb freezes on ruby-1.8.7 and 1-9.3

Brett Mahar-2


|
| Then I don't normally use dpb for fetching files either, but use make fetch.
|
| When I do the cvs update I generate a list to be fetched.
|
| Some sites don't like multiple download requests at the same time, using
| make fetch avoids that.
|
| If the ftp hangs kill the process and let it try the next site. Using a
| list allow me to do that then start dpb knowning it less likely to
| get stuck on a download.
|

Or you can use dpb to download everything one at a time, prior to building:

#!/bin/ksh

/usr/ports/infrastructure/bin/dpb -F 1 dpb_ports_list &&
/usr/ports/infrastructure/bin/dpb -I dpb_ports_list

Reply | Threaded
Open this post in threaded view
|

Re: dpb freezes on ruby-1.8.7 and 1-9.3

Marc Espie-2

There is a knob for stuck downloads too (FETCH_TIMEOUT)