Upgrading from 0.7.3 to trunk sort of works

Added by Aaron Parks over 11 years ago

We recently decided we love redmine enough (.7.3) to spend an afternoon upgrading to the latest version trunk (3733). We had some library/versioning issues and finally got to the point that we could see the front page of the site. Much excitement ensued!

Alas, only a few of pages worked. You could see the projects list and a projects top level page. Clicking on a user will sometimes bring up their home page, then clicking on issues assigned to them seems to work.

Clicking on any link in the menubar, the login button, or a project page returned a 500 error and our apache log is filled with messages like these:

[Wed May 05 14:58:33 2010] [error] [client 10.xxx.xx.82] Premature end of script headers: login, referer: http://redmine.somewhere.org/
[ pid=4628 file=ext/apache2/Hooks.cpp:684 time=2010-05-05 14:58:33.50 ]:
The backend application (process 4685) did not send a valid HTTP response; instead, it sent nothing at all. It is possible that it has crashed; please check whether there are crashing bugs in this application.

*IP/http modified to protect the guilty.

We are at a loss as to what to try next and were hoping somebody might have an idea.

Relevant versions:
Redmine we are upgrading (worked great): 0.7.3
Database: Postgres 8.1.18
Postgres connector: 0.7.9.2008.01.28
New Redmine Version -- trunk (3733)
rack 1.0.1
rails 2.3.5
rake 0.8.7
rubygems 1.3.6
passenger 2.2.11

Aaron Parks

Replies (5)

RE: Upgrading from 0.7.3 to trunk sort of works - Added by Aaron Parks over 11 years ago

After playing with this some more I got to where it won't work at all and errors out at passenger:

The application spawner server exited unexpectedly: Unexpected end-of-file detected.

Exception class:
PhusionPassenger::Railz::ApplicationSpawner::Error

But the interesting bit is in the Apache log:

/var/www/redmine-trunk/vendor/plugins/engines/lib/engines/rails_extensions/dependencies.rb:111: [BUG] Segmentation fault
ruby 1.8.6 (2008-06-20) [i686-linux]

AP

RE: Upgrading from 0.7.3 to trunk sort of works - Added by Aaron Parks over 11 years ago

Replying to myself yet again, when I run:

RAILS_ENV=production script/about

I get a stack trace rather than Output:

/usr/local/lib/ruby/gems/1.8/gems/rails-2.3.5/lib/rails/gem_dependency.rb:119:Warning: Gem::Dependency#version_requirements is deprecated and will be removed on or after August 2010. Use #requirement
  • glibc detected * ruby: corrupted double-linked list: 0x0959ff28 * ======= Backtrace: =========
    /lib/libc.so.6[0x553559]
    /lib/libc.so.6(__libc_malloc+0x67)[0x554d87]
    ruby(ruby_xmalloc+0x4b)[0x807079b]
    ruby(ruby_re_compile_pattern+0x4568)[0x80aea98]
    ruby[0x80a4195]
    ruby(rb_reg_new+0x29)[0x80a4409]
    ruby[0x805cd9d]
    ruby[0x805b3cb]
    ruby[0x805cc15]
    ruby[0x8059fb8]
    ruby(rb_yield+0x21)[0x805a841]
    ruby(rb_ary_each+0x25)[0x80c91c5]
    ruby[0x805e1f2]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805daff]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c95b]
    ruby[0x805d25b]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c95b]
    ruby[0x8059fb8]
    ruby(rb_yield+0x21)[0x805a841]
    ruby(rb_ary_each+0x25)[0x80c91c5]
    ruby[0x805e1f2]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805daff]
    ruby[0x8059fb8]
    ruby(rb_yield+0x21)[0x805a841]
    ruby(rb_ary_each+0x25)[0x80c91c5]
    ruby[0x805e1f2]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805daff]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c5aa]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x8066fff]
    ruby[0x8055996]
    ruby[0x805e1f2]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c854]
    ruby[0x805daff]
    ruby(rb_load+0x46d)[0x806846d]
    ruby(rb_require_safe+0x347)[0x8068897]
    ruby[0x805e1f2]
    ruby[0x805ede1]
    ruby[0x805c95b]
    ruby[0x805d25b]
    ruby[0x805e9df]
    ruby[0x805ede1]
    ruby[0x805c95b] ======= Memory map: ========
    00110000-00113000 r-xp 00000000 fd:00 14131520 /usr/local/lib/ruby/1.8/i686-linux/thread.so
    00113000-00114000 rwxp 00002000 fd:00 14131520 /usr/local/lib/ruby/1.8/i686-linux/thread.so
    00114000-00118000 r-xp 00000000 fd:00 14131502 /usr/local/lib/ruby/1.8/i686-linux/stringio.so
    00118000-00119000 rwxp 00003000 fd:00 14131502 /usr/local/lib/ruby/1.8/i686-linux/stringio.so
    00119000-0011b000 r-xp 00000000 fd:00 14131504 /usr/local/lib/ruby/1.8/i686-linux/enumerator.so
    0011b000-0011c000 rwxp 00001000 fd:00 14131504 /usr/local/lib/ruby/1.8/i686-linux/enumerator.so
    0011c000-00153000 r-xp 00000000 fd:00 14131508 /usr/local/lib/ruby/1.8/i686-linux/nkf.so
    00153000-00156000 rwxp 00036000 fd:00 14131508 /usr/local/lib/ruby/1.8/i686-linux/nkf.so
    00156000-00157000 rwxp 00156000 00:00 0
    00157000-0015b000 r-xp 00000000 fd:00 14131497 /usr/local/lib/ruby/1.8/i686-linux/strscan.so
    0015b000-0015c000 rwxp 00003000 fd:00 14131497 /usr/local/lib/ruby/1.8/i686-linux/strscan.so
    0015c000-00190000 r-xp 00000000 fd:00 14131505 /usr/local/lib/ruby/1.8/i686-linux/openssl.so
    00190000-00192000 rwxp 00034000 fd:00 14131505 /usr/local/lib/ruby/1.8/i686-linux/openssl.so
    00192000-001d5000 r-xp 00000000 fd:00 7112993 /lib/libssl.so.0.9.8e
    001d5000-001d9000 rwxp 00042000 fd:00 7112993 /lib/libssl.so.0.9.8e
    001d9000-001fe000 r-xp 00000000 fd:00 13668509 /usr/lib/libk5crypto.so.3.1
    001fe000-001ff000 rwxp 00025000 fd:00 13668509 /usr/lib/libk5crypto.so.3.1
    001ff000-00207000 r-xp 00000000 fd:00 14850761 /usr/local/lib/ruby/gems/1.8/gems/postgres-0.7.9.2008.01.28/lib/postgres.so
    00207000-00208000 rwxp 00007000 fd:00 14850761 /usr/local/lib/ruby/gems/1.8/gems/postgres-0.7.9.2008.01.28/lib/postgres.so
    00208000-0020f000 r-xp 00000000 fd:00 14131506 /usr/local/lib/ruby/1.8/i686-linux/zlib.so
    0020f000-00210000 rwxp 00007000 fd:00 14131506 /usr/local/lib/ruby/1.8/i686-linux/zlib.so
    00210000-00211000 r-xp 00000000 fd:00 14582071 /usr/local/lib/ruby/1.8/i686-linux/digest/sha1.so
    00211000-00212000 rwxp 00000000 fd:00 14582071 /usr/local/lib/ruby/1.8/i686-linux/digest/sha1.so
    00212000-0021b000 r-xp 00000000 fd:00 7111585 /lib/libnss_files-2.5.so
    0021b000-0021c000 r-xp 00008000 fd:00 7111585 /lib/libnss_files-2.5.so
    0021c000-0021d000 rwxp 00009000 fd:00 7111585 /lib/libnss_files-2.5.so
    00222000-0022b000 r-xp 00000000 fd:00 14131501 /usr/local/lib/ruby/1.8/i686-linux/socket.so
    0022b000-0022c000 rwxp 00008000 fd:00 14131501 /usr/local/lib/ruby/1.8/i686-linux/socket.so
    0022c000-00237000 r-xp 00000000 fd:00 7110895 /lib/libgcc_s-4.1.2-20080825.so.1
    00237000-00238000 rwxp 0000a000 fd:00 7110895 /lib/libgcc_s-4.1.2-20080825.so.1
    0028f000-00293000 r-xp 00000000 fd:00 7110693 /lib/libnss_dns-2.5.so
    00293000-00294000 r-xp 00003000 fd:00 7110693 /lib/libnss_dns-2.5.so
    00294000-00295000 rwxp 00004000 fd:00 7110693 /lib/libnss_dns-2.5.so
    00439000-0043c000 r-xp 00000000 fd:00 14131498 /usr/local/lib/ruby/1.8/i686-linux/iconv.so
    0043c000-0043d000 rwxp 00002000 fd:00 14131498 /usr/local/lib/ruby/1.8/i686-linux/iconv.so
    00454000-0045d000 r-xp 00000000 fd:00 7110704 /lib/libcrypt-2.5.so
    0045d000-0045e000 r-xp 00008000 fd:00 7110704 /lib/libcrypt-2.5.so
    0045e000-0045f000 rwxp 00009000 fd:00 7110704 /lib/libcrypt-2.5.so
    0045f000-00486000 rwxp 0045f000 00:00 0
    004c6000-004e0000 r-xp 00000000 fd:00 7110708 /lib/ld-2.5.so
    004e0000-004e1000 r-xp 00019000 fd:00 7110708 /lib/ld-2.5.so
    004e1000-004e2000 rwxp 0001a000 fd:00 7110708 /lib/ld-2.5.so
    004e9000-00628000 r-xp 00000000 fd:00 7110881 /lib/libc-2.5.so
    00628000-0062a000 r-xp 0013f000 fd:00 7110881 /lib/libc-2.5.so
    0062a000-0062b000 rwxp 00141000 fd:00 7110881 /lib/libc-2.5.so
    0062b000-0062e000 rwxp 0062b000 00:00 0
    00630000-00632000 r-xp 00000000 fd:00 7110915 /lib/libdl-2.5.so
    00632000-00633000 r-xp 00001000 fd:00 7110915 /lib/libdl-2.5.so
    00633000-00634000 rwxp 00002000 fd:00 7110915 /lib/libdl-2.5.so
    00636000-0065b000 r-xp 00000000 fd:00 7110893 /lib/libm-2.5.so
    0065b000-0065c000 r-xp 00024000 fd:00 7110893 /lib/libm-2.5.so
    0065c000-0065d000 rwxp 00025000 fd:00 7110893 /lib/libm-2.5.so
    0065f000-00672000 r-xp 00000000 fd:00 7110905 /lib/libpthread-2.5.so
    00672000-00673000 r-xp 00013000 fd:00 7110905 /lib/libpthread-2.5.so
    00673000-00674000 rwxp 00014000 fd:00 7110905 /lib/libpthread-2.5.so
    00674000-00676000 rwxp 00674000 00:00 0
    00678000-0068a000 r-xp 00000000 fd:00 13666573 /usr/lib/libz.so.1.2.3
    0068a000-0068b000 rwxp 00011000 fd:00 13666573 /usr/lib/libz.so.1.2.3
    00698000-006d3000 r-xp 00000000 fd:00 7110941 /lib/libsepol.so.1
    006d3000-006d4000 rwxp 0003b000 fd:00 7110941 /lib/libsepol.so.1
    006d4000-006de000 rwxp 006d4000 00:00 0
    006e0000-006f6000 r-xp 00000000 fd:00 7110942 /lib/libselinux.so.1
    006f6000-006f8000 rwxp 00015000 fd:00 7110942 /lib/libselinux.so.1
    006fa000-00719000 r-xp 00000000 fd:00 13670435 /usr/lib/libpq.so.4.1
    00719000-0071a000 rwxp 0001f000 fd:00 13670435 /usr/lib/libpq.so.4.1
    00749000-0074c000 r-xp 00000000 fd:00 14582078 /usr/local/lib/ruby/1.8/i686-linux/racc/cparse.so
    0074c000-0074d000 rwxp 00002000 fd:00 14582078 /usr/local/lib/ruby/1.8/i686-linux/racc/cparse.so
    0079a000-007ad000 r-xp 00000000 fd:00 7110910 /lib/libnsl-2.5.so
    007ad000-007ae000 r-xp 00012000 fd:00 7110910 /lib/libnsl-2.5.so
    007ae000-007af000 rwxp 00013000 fd:00 7110910 /lib/libnsl-2.5.so
    007af000-007b1000 rwxp 007af000 00:00 0
    00849000-00862000 r-xp 00000000 fd:00 14131514 /usr/local/lib/ruby/1.8/i686-linux/syck.so
    00862000-00863000 rwxp 00019000 fd:00 14131514 /usr/local/lib/ruby/1.8/i686-linux/syck.so
    00913000-00915000 r-xp 00000000 fd:00 7111562 /lib/libcom_err.so.2.1
    00915000-00916000 rwxp 00001000 fd:00 7111562 /lib/libcom_err.so.2.1
    00918000-0091a000 r-xp 00000000 fd:00 7111555 /lib/libkeyutils-1.2.so
    0091a000-0091b000 rwxp 00001000 fd:00 7111555 /lib/libkeyutils-1.2.so
    0091d000-0092c000 r-xp 00000000 fd:00 7111559 /lib/libresolv-2.5.so
    0092c000-0092d000 r-xp 0000e000 fd:00 7111559 /lib/libresolv-2.5.so
    0092d000-0092e000 rwxp 0000f000 fd:00 7111559 /lib/libresolv-2.5.so
    0092e000-00930000 rwxp 0092e000 00:00 0
    00937000-00964000 r-xp 00000000 fd:00 13668512 /usr/lib/libgssapi_krb5.so.2.2
    00964000-00965000 rwxp 0002d000 fd:00 13668512 /usr/lib/libgssapi_krb5.so.2.2
    00967000-00a91000 r-xp 00000000 fd:00 7111630 /lib/libcrypto.so.0.9.8e
    00a91000-00aa4000 rwxp 00129000 fd:00 7111630 /lib/libcrypto.so.0.9.8e
    00aa4000-00aa8000 rwxp 00aa4000 00:00 0
    00b69000-00b72000 r-xp 00000000 fd:00 14131513 /usr/local/lib/ruby/1.8/i686-linux/bigdecimal.so
    00b72000-00b73000 rwxp 00008000 fd:00 14131513 /usr/local/lib/ruby/1.8/i686-linux/bigdecimal.so
    00b95000-00c28000 r-xp 00000000 fd:00 13668511 /usr/lib/libkrb5.so.3.3
    00c28000-00c2b000 rwxp 00092000 fd:00 13668511 /usr/lib/libkrb5.so.3.3
    00c50000-00c58000 r-xp 00000000 fd:00 13668508 /usr/lib/libkrb5support.so.0.1
    00c58000-00c59000 rwxp 00007000 fd:00 13668508 /usr/lib/libkrb5support.so.0.1
    00c82000-00c83000 r-xp 00c82000 00:00 0 [vdso]
    00cc0000-00cc2000 r-xp 00000000 fd:00 14131509 /usr/local/lib/ruby/1.8/i686-linux/etc.so
    00cc2000-00cc3000 rwxp 00001000 fd:00 14131509 /usr/local/lib/ruby/1.8/i686-linux/etc.so
    00cc3000-00cc6000 r-xp 00000000 fd:00 14131503 /usr/local/lib/ruby/1.8/i686-linux/digest.so
    00cc6000-00cc7000 rwxp 00002000 fd:00 14131503 /usr/local/lib/ruby/1.8/i686-linux/digest.so
    00d2d000-00d2e000 r-xp 00000000 fd:00 14582073 /usr/local/lib/ruby/1.8/i686-linux/digest/md5.so
    00d2e000-00d2f000 rwxp 00000000 fd:00 14582073 /usr/local/lib/ruby/1.8/i686-linux/digest/md5.so
    00d74000-00d75000 r-xp 00000000 fd:00 14131521 /usr/local/lib/ruby/1.8/i686-linux/fcntl.so
    00d75000-00d76000 rwxp 00000000 fd:00 14131521 /usr/local/lib/ruby/1.8/i686-linux/fcntl.so
    08048000-080f3000 r-xp 00000000 fd:00 13682407 /usr/local/bin/ruby
    080f3000-080f4000 rw-p 000ab000 fd:00 13682407 /usr/local/bin/ruby
    080f4000-08104000 rw-p 080f4000 00:00 0
    0883d000-0a569000 rw-p 0883d000 00:00 0
    b7000000-b7021000 rw-p b7000000 00:00 0
    b7021000-b7100000 ---p b7021000 00:00 0
    b715b000-b7fbb000 rw-p b715b000 00:00 0
    b7fc0000-b7fc1000 rw-p b7fc0000 00:00 0
    b7fc1000-b7fc8000 r--s 00000000 fd:00 13762818 /usr/lib/gconv/gconv-modules.cache
    bf9c1000-bf9f1000 rw-p bf9c1000 00:00 0 [stack]
    Aborted

RE: Upgrading from 0.7.3 to trunk sort of works - Added by Aaron Parks over 11 years ago

Fixed the about tool not working by following the .7+ migration directions for plugins:

Ruby version 1.8.6 (i686-linux)
RubyGems version 1.3.6
Rack version 1.0
Rails version 2.3.5
Active Record version 2.3.5
Active Resource version 2.3.5
Action Mailer version 2.3.5
Active Support version 2.3.5
Application root /var/www/redmine-trunk
Environment production
Database adapter postgresql
Database schema version 20100313171051

AP

RE: Upgrading from 0.7.3 to trunk sort of works - Added by Aaron Parks over 11 years ago

Upon further investigation it seems that when I click a link that doesn't work (some do) a process is being created that immediately dies and makes Apache Angry and gives the error:

[Thu May 06 10:18:04 2010] [error] [client 10.xx.xx.82] Premature end of script headers: projects, referer: http://redmine.somewhere.org/
[ pid=9727 file=ext/apache2/Hooks.cpp:684 time=2010-05-06 10:18:04.975 ]:
The backend application (process 9806) did not send a valid HTTP response; instead, it sent nothing at all. It is possible that it has crashed; please check whether there are crashing bugs in this application.

However my linux skills aren't enough to figure out what that process is. I have found that the PID does not exist before the link is pressed.

Further for the links that do work the log in logs/production.log looks great, but no mention is ever made of the bad links, leading me to believe the system isn't making it that far.

AP

RE: Upgrading from 0.7.3 to trunk sort of works - Added by Aaron Parks over 11 years ago

After all that it turns out I had an old version of Enterprise ruby that just flat out didn't work. Upgraded to the latest version it fixed all the problems.

AP

(1-5/5)