Setup issues with 0.0.4.5.2

[Kurt Albershardt]

Just ran sipxecs-setup on a fresh install of 0.0.4.5.2 and answered the basic questions. As expected, got:

Configuring system, this may take a few minutes...

After ~15 minutes, the java process owned by user sipx is _still_ using ~130% CPU. Wait for awhile, then see:

error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
done.
[***@sipx ~]#

in the original window.

Suggestions?

--thanks

[Kurt Albershardt]

Is there a dependency on mysql that's not being met by 'yum groupinstall sipxecs' ?

The only mysql package I show is:

mysql-libs-5.1.61-1.el6_2.1.x86_64

Post by Kurt Albershardt
Configuring system, this may take a few minutes...
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
done.
in the original window.
Suggestions?
--thanks

[Tony Graziano]

I think its fixed in the 4.6 in the staging area but 4.6 needs some cleanup
still...

Post by Kurt Albershardt
Is there a dependency on mysql that's not being met by 'yum groupinstall sipxecs' ?
mysql-libs-5.1.61-1.el6_2.1.x86_64

Post by Kurt Albershardt
Just ran sipxecs-setup on a fresh install of 0.0.4.5.2 and answered the
Configuring system, this may take a few minutes...
After ~15 minutes, the java process owned by user sipx is _still_ using
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
done.
in the original window.
Suggestions?
--thanks

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Douglas Hubler]

Here are the instructions for installing 4.6.0 (non-production release)
http://wiki.sipfoundry.org/display/sipXecs/Installing+4.6.0

I should delete the 0.0.4.5.2 binaries just to remove confusion

On Sat, Jul 7, 2012 at 8:52 PM, Tony Graziano

Post by Tony Graziano
I think its fixed in the 4.6 in the staging area but 4.6 needs some cleanup
still...

Post by Kurt Albershardt
Is there a dependency on mysql that's not being met by 'yum groupinstall sipxecs' ?
mysql-libs-5.1.61-1.el6_2.1.x86_64

Post by Kurt Albershardt
Just ran sipxecs-setup on a fresh install of 0.0.4.5.2 and answered the
Configuring system, this may take a few minutes...
After ~15 minutes, the java process owned by user sipx is _still_ using
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
done.
in the original window.
Suggestions?
--thanks

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

Telephone: [phone]
Helpdesk Customers: http://myhelp.myitdepartment.net
Blog: http://blog.myitdepartment.net
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Kurt Albershardt]

Thanks - I'll wipe it and start over!

Post by Douglas Hubler
Here are the instructions for installing 4.6.0 (non-production release)
http://wiki.sipfoundry.org/display/sipXecs/Installing+4.6.0
I should delete the 0.0.4.5.2 binaries just to remove confusion
On Sat, Jul 7, 2012 at 8:52 PM, Tony Graziano

Post by Tony Graziano
I think its fixed in the 4.6 in the staging area but 4.6 needs some cleanup
still...

Post by Kurt Albershardt
Is there a dependency on mysql that's not being met by 'yum groupinstall sipxecs' ?
mysql-libs-5.1.61-1.el6_2.1.x86_64

Post by Kurt Albershardt
Just ran sipxecs-setup on a fresh install of 0.0.4.5.2 and answered the
Configuring system, this may take a few minutes...
After ~15 minutes, the java process owned by user sipx is _still_ using
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
error reading information on service mysqld: No such file or directory
done.
in the original window.
Suggestions?
--thanks

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

Telephone: [phone]
Helpdesk Customers: http://myhelp.myitdepartment.net
Blog: http://blog.myitdepartment.net
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Kurt Albershardt]

After groupremoving sipxecs, individually removing a few sipx* packages that didn't leave with it, and clearing the 0.0.4.5.2 repo, I followed the wiki recipe and saw only one item of concern:


Installing : sipxfreeswitch-4.6.0-5.gf9087.x86_64 107/117
/var/tmp/rpm-tmp.G7yNnR: line 1: freeswitch.sh: command not found

Post by Douglas Hubler
Here are the instructions for installing 4.6.0 (non-production release)
http://wiki.sipfoundry.org/display/sipXecs/Installing+4.6.0
I should delete the 0.0.4.5.2 binaries just to remove confusion
On Sat, Jul 7, 2012 at 8:52 PM, Tony Graziano

Post by Tony Graziano
I think its fixed in the 4.6 in the staging area but 4.6 needs some cleanup
still...

Post by Kurt Albershardt
Is there a dependency on mysql that's not being met by 'yum groupinstall sipxecs' ?
mysql-libs-5.1.61-1.el6_2.1.x86_64

[Kurt Albershardt]

Ran sipxecs-setup --reset, things appeared OK - though no prompt to point my browser at the HTTP admin page as there used to be.

BUT

24 minutes later, the java process owned by sipx is still sucking 99% of both CPUs.

Post by Kurt Albershardt
Installing : sipxfreeswitch-4.6.0-5.gf9087.x86_64 107/117
/var/tmp/rpm-tmp.G7yNnR: line 1: freeswitch.sh: command not found

Post by Douglas Hubler
Here are the instructions for installing 4.6.0 (non-production release)
http://wiki.sipfoundry.org/display/sipXecs/Installing+4.6.0
I should delete the 0.0.4.5.2 binaries just to remove confusion

[Douglas Hubler]

Post by Kurt Albershardt
Ran sipxecs-setup --reset, things appeared OK - though no prompt to point my browser at the HTTP admin page as there used to be.

developers: I think "--reset-all" should drop the database or clear
files in /var/sipxdata/cfdata. It would need confirmation that all
data will be erased. Any votes? There's a chance that Kurt has legacy
data in database from 4.5.2.

Post by Kurt Albershardt
BUT
24 minutes later, the java process owned by sipx is still sucking 99% of both CPUs.

Anything interesting in
/var/log/sipxpbx/sipxconfig.log

[George Niculae]

Post by Douglas Hubler

Post by Kurt Albershardt
Ran sipxecs-setup --reset, things appeared OK - though no prompt to point my browser at the HTTP admin page as there used to be.

developers: I think "--reset-all" should drop the database or clear
files in /var/sipxdata/cfdata. It would need confirmation that all
data will be erased. Any votes? There's a chance that Kurt has legacy
data in database from 4.5.2.

+1

IMHO no need for confirmation as it's "reset-all" afterwards

Post by Douglas Hubler

Post by Kurt Albershardt
BUT
24 minutes later, the java process owned by sipx is still sucking 99% of both CPUs.

Anything interesting in
/var/log/sipxpbx/sipxconfig.log
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Philippe Laurent]

+1

Post by George Niculae

Post by Douglas Hubler

Post by Kurt Albershardt
Ran sipxecs-setup --reset, things appeared OK - though no prompt to point my browser at the HTTP admin page as there used to be.

developers: I think "--reset-all" should drop the database or clear
files in /var/sipxdata/cfdata. It would need confirmation that all
data will be erased. Any votes? There's a chance that Kurt has legacy
data in database from 4.5.2.

+1
IMHO no need for confirmation as it's "reset-all" afterwards

Post by Douglas Hubler

Post by Kurt Albershardt
BUT
24 minutes later, the java process owned by sipx is still sucking 99% of both CPUs.

Anything interesting in
/var/log/sipxpbx/sipxconfig.log
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Kurt Albershardt]

Post by Douglas Hubler

Post by Kurt Albershardt
24 minutes later, the java process owned by sipx is still sucking 99% of both CPUs.

Anything interesting in
/var/log/sipxpbx/sipxconfig.log

Not being familiar with that logfile, I'm not sure what qualifies as interesting. Here's the tail:

"2012-07-08T18:48:03.439000Z":3:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"0 setup listeners will be called again"
"2012-07-08T18:48:03.440000Z":4:JAVA:INFO:sipx.murray-hotel.com:main:00000000:ConfigManagerImpl:"Configuration work to do. Notifying providers."
"2012-07-08T18:58:53.625000Z":8:JAVA:INFO:sipx.murray-hotel.com:Shutdown:00000000:DynamicSessionFactoryBean:"Closing Hibernate SessionFactory"
"2012-07-08T22:04:21.377000Z":1:JAVA:INFO:sipx.murray-hotel.com:main:00000000:DynamicSessionFactoryBean:"Building new Hibernate SessionFactory"
"2012-07-08T22:04:27.946000Z":2:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"1 setup listeners will be called again"
"2012-07-08T22:04:27.947000Z":3:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"0 setup listeners will be called again"
"2012-07-08T22:04:44.626000Z":4:JAVA:INFO:sipx.murray-hotel.com:Replication worker thread:00000000:ConfigManagerImpl:"Configuration work to do. Notifying providers."
"2012-07-08T22:04:46.478000Z":5:JAVA:INFO:sipx.murray-hotel.com:Replication worker thread:00000000:AgentRunner:"Starting agent run /usr/bin/sipxagent --host 127.0.0.1 "
[***@sipx sipxpbx]#


Oh, and after a restart Java is munching ~95-99% of all available CPUs again.

Is there some postinstall task that uses a lot of Java? I haven't even begun any web config yet.

[Kurt Albershardt]

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2 CPUs) to 231% (3 CPUs.)

[Tony Graziano]

How much ram did you allot?

Post by Kurt Albershardt

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2
CPUs) to 231% (3 CPUs.)
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Kurt Albershardt]

Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of memory yesterday. Left it running all night and it's at 40% according to Proxmox.

Top is still looking about the same:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java

Post by Tony Graziano
How much ram did you allot?

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2 CPUs) to 231% (3 CPUs.)

[Michael Picher]

try giving the box 4 GB of RAM...

Post by Kurt Albershardt
Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of
memory yesterday. Left it running all night and it's at 40% according to
Proxmox.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java
How much ram did you allot?

Post by Kurt Albershardt

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2
CPUs) to 231% (3 CPUs.)

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

--
Michael Picher, Director of Technical Services
eZuce, Inc.

300 Brickstone Square****

Suite 201****

Andover, MA. 01810
O.978-296-1005 X2015
M.207-956-0262
@mpicher <http://twitter.com/mpicher>
linkedin <http://www.linkedin.com/profile/view?id=35504760&trk=tab_pro>
www.ezuce.com

------------------------------------------------------------------------------------------------------------
There are 10 kinds of people in the world, those who understand binary and
those who don't.

[Kurt Albershardt]

Did that, RAM usage stays the same -- just represents a lower percentage of the system:

1666 sipx 20 0 2505m 611m 13m S 225.7 14.9 2581:37 java

Post by Michael Picher
try giving the box 4 GB of RAM...
Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of memory yesterday. Left it running all night and it's at 40% according to Proxmox.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java

[Douglas Hubler]

Post by Kurt Albershardt
Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of
memory yesterday. Left it running all night and it's at 40% according to
Proxmox.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java

Can you find out what application 1666 is?

ps aux -ww | grep 1666

[Kurt Albershardt]

Post by Douglas Hubler

Post by Kurt Albershardt
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java

Can you find out what application 1666 is?
ps aux -ww | grep 1666

[***@sipx ~]# ps aux -ww | grep 1666
sipx 1666 212 29.8 2566044 626408 ? Ssl Jul08 2576:06 /usr/bin/java -Dcom.ibm.tools.attach.enable=no -Dprocname=sipxconfig -XX:MaxPermSize=128M -Xmx1024m -Djava.io.tmpdir=/var/sipxdata/tmp -Djetty.lib.dir=/usr/share/java/sipXecs/sipXconfig -Djetty.conf.dir=/etc/sipxpbx -Djetty.log.dir=/var/log/sipxpbx -Dorg.apache.lucene.lockdir=/var/sipxdata/tmp/index -Dorg.apache.commons.loging.Log=org.apache.commons.logging.impl.Log4JLogger -Djava.awt.headless=true org.mortbay.jetty.Server /etc/sipxpbx/sipxconfig-jetty.xml
root 16294 0.0 0.0 103228 844 pts/0 R+ 12:15 0:00 grep 1666

[Douglas Hubler]

Please run
tail -f /var/log/sipxpbx/sipxconfig.log

If the log keep growing and growing, then sipxconfig is stuck in an
infinite loop configuring itself:

start up, configure, detect change, restart, configure, detect change...

Workaround,
edit /usr/share/share/sipxecs/cfinputs/plugin.d/sipxconfig.cf

Change line that starts with
primary.sipxconfig_running.restart_sipxconfig...

To
noway.primary.sipxconfig_running.restart_sipxconfig...



If sipxconfig stops restarting, if possible, I would like a backup of
configuration and a snapshot of system (see wiki if not sure how to do
that)

Post by Kurt Albershardt

Post by Douglas Hubler

Post by Kurt Albershardt
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java

Can you find out what application 1666 is?
ps aux -ww | grep 1666

sipx 1666 212 29.8 2566044 626408 ? Ssl Jul08 2576:06 /usr/bin/java -Dcom.ibm.tools.attach.enable=no -Dprocname=sipxconfig -XX:MaxPermSize=128M -Xmx1024m -Djava.io.tmpdir=/var/sipxdata/tmp -Djetty.lib.dir=/usr/share/java/sipXecs/sipXconfig -Djetty.conf.dir=/etc/sipxpbx -Djetty.log.dir=/var/log/sipxpbx -Dorg.apache.lucene.lockdir=/var/sipxdata/tmp/index -Dorg.apache.commons.loging.Log=org.apache.commons.logging.impl.Log4JLogger -Djava.awt.headless=true org.mortbay.jetty.Server /etc/sipxpbx/sipxconfig-jetty.xml
root 16294 0.0 0.0 103228 844 pts/0 R+ 12:15 0:00 grep 1666
_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

[Kurt Albershardt]

Post by Douglas Hubler
Please run
tail -f /var/log/sipxpbx/sipxconfig.log
If the log keep growing and growing

Nothing has been appended to that file since yesterday - output matches what I sent then:

[***@sipx ~]# tail -f /var/log/sipxpbx/sipxconfig.log
"2012-07-08T18:47:53.996000Z":1:JAVA:INFO:sipx.murray-hotel.com:main:00000000:DynamicSessionFactoryBean:"Building new Hibernate SessionFactory"
"2012-07-08T18:48:03.429000Z":2:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"1 setup listeners will be called again"
"2012-07-08T18:48:03.439000Z":3:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"0 setup listeners will be called again"
"2012-07-08T18:48:03.440000Z":4:JAVA:INFO:sipx.murray-hotel.com:main:00000000:ConfigManagerImpl:"Configuration work to do. Notifying providers."
"2012-07-08T18:58:53.625000Z":8:JAVA:INFO:sipx.murray-hotel.com:Shutdown:00000000:DynamicSessionFactoryBean:"Closing Hibernate SessionFactory"
"2012-07-08T22:04:21.377000Z":1:JAVA:INFO:sipx.murray-hotel.com:main:00000000:DynamicSessionFactoryBean:"Building new Hibernate SessionFactory"
"2012-07-08T22:04:27.946000Z":2:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"1 setup listeners will be called again"
"2012-07-08T22:04:27.947000Z":3:JAVA:INFO:sipx.murray-hotel.com:main:00000000:SetupManagerImpl:"0 setup listeners will be called again"
"2012-07-08T22:04:44.626000Z":4:JAVA:INFO:sipx.murray-hotel.com:Replication worker thread:00000000:ConfigManagerImpl:"Configuration work to do. Notifying providers."
"2012-07-08T22:04:46.478000Z":5:JAVA:INFO:sipx.murray-hotel.com:Replication worker thread:00000000:AgentRunner:"Starting agent run /usr/bin/sipxagent --host 127.0.0.1 "

[Tony Graziano]

realize with RAM, once you start using swap performance degrades quite
a bit. So SWAP might be affecting the CPU issue in an adverse way. Are
you using any swap? Ideally you should have enough ram to prevent
using swap.

Post by Kurt Albershardt
Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of
memory yesterday. Left it running all night and it's at 40% according to
Proxmox.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java
How much ram did you allot?

Post by Kurt Albershardt

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2
CPUs) to 231% (3 CPUs.)

_______________________________________________
sipx-users mailing list
List Archive: http://list.sipfoundry.org/archive/sipx-users/

--
~~~~~~~~~~~~~~~~~~
Tony Graziano, Manager
Telephone: [phone]
sip: ***@voice.myitdepartment.net
Fax: [phone]
~~~~~~~~~~~~~~~~~~
Linked-In Profile:
http://www.linkedin.com/pub/tony-graziano/14/4a6/7a4
Ask about our Internet Fax services!
~~~~~~~~~~~~~~~~~~

Using or developing for sipXecs from SIPFoundry? Ask me about sipX-CoLab 2013!

[Kurt Albershardt]

No swap in use at all -- not much RAM either, just CPU.

Post by Tony Graziano
realize with RAM, once you start using swap performance degrades quite
a bit. So SWAP might be affecting the CPU issue in an adverse way. Are
you using any swap? Ideally you should have enough ram to prevent
using swap.

Post by Kurt Albershardt
Allocated 2 gbytes RAM and 4 gbytes of swap to the VM. Was using 32% of
memory yesterday. Left it running all night and it's at 40% according to
Proxmox.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1666 sipx 20 0 2505m 611m 13m S 230.4 29.9 2184:51 java
How much ram did you allot?

Post by Kurt Albershardt

Post by Kurt Albershardt
after a restart Java is munching ~95-99% of all available CPUs again.

FYI -- I allocated another proc to the VM, and CPU jumped from 197% (2
CPUs) to 231% (3 CPUs.)