libpri error??

Report
Question
Hello list, I have a client who's taking intermittent errors on their PRI. The server is
configured with one PRI from the TELCO, and two PRI connecting to their Iwatsu
ADIX legacy system. The odd thing is, the system can run for days, weeks or
months without a reported error and then just bomb. The only thing that fixes
it is stopping and starting the services. It then runs well for a random time
period. I've upgraded and downgraded software, even tried new hardware and
CentOS 5.x. none of these changes have made a difference. Now here's the crazy thing, this system ran fine for a couple years BEFORE a
change in the local provider(from Level 3 to CenturyLink). CL claims that they
do nothing different from Level 3 but we noticed right away that we had to
adjust the pridialplan to get outbound to work. So much for that. I figured
there was a problem with the circuit. So we worked with Sangoma and the Telco
to troubleshoot the problem. After a lot of ordeal, Sangoma cleared the Telco
and said "the problem is most likely in libpri". I upgraded libpri to SVN release 2279 and that seemed to be the fix we needed.
We had a couple errors but figured they were in the dialplan, made some
adjustments and it ran clean. We noticed a few errors on the Telco PRI so I
upgraded to libpri 2283. This time everything ran so clean, we thought our problems were behind us.
Unfortunately for us, this morning everything went haywire. The Iwatsu could
not make internal or outbound calls via the PRI. SIP users on the asterisk
server could not call out and I could not call in. The message was "All
circuits busy". A quick restart and everything is back. The TELCO swears it's not their problem and upgrading libpri to SVN have
seemed to help. I'm hoping someone here can provide some insight. I have an IDSN pcap from this morning and the relevant log file located here: http://www.sayso.net/031412/8841.pcap
http://www.sayso.net/031412/asterisk.log I just realized that debugging was not set in asterisk so this is probably not
enough information to get started. What should I set debug level to next time?
I will do that and turn on debugging on span 1. Anyway, if there's anything
that can be done now.... Here's my /etc/dahdi/system.conf
==================================================================
#autogenerated by /usr/sbin/wancfg_dahdi do not hand edit
#autogenrated on 2012-02-29
#Dahdi Channels Configurations
#For detailed Dahdi options, view /etc/dahdi/system.conf.bak
loadzone=us
defaultzone=us #Sangoma A104 port 1 [slot:4 bus:9 span:1]
span=1,1,0,esf,b8zs
bchan=1-23
echocanceller=HWEC,1-23
hardhdlc=24 #Sangoma A104 port 2 [slot:4 bus:9 span:2]
span=2,2,0,esf,b8zs
bchan=25-47
echocanceller=HWEC,25-47
hardhdlc=48 #Sangoma A104 port 3 [slot:4 bus:9 span:3]
span=3,3,0,esf,b8zs
bchan=49-71
echocanceller=HWEC,49-71
hardhdlc=72 #Sangoma A104 port 4 [slot:4 bus:9 span:4]
span=4,4,0,esf,b8zs
bchan=73-95
echocanceller=HWEC,73-95
hardhdlc=96
================================================================== /etc/asterisk/chan_dahdi.conf
==================================================================
;autogenerated by /usr/sbin/wancfg_dahdi do not hand edit
;autogenrated on 2012-02-29
;Dahdi Channels Configurations
;For detailed Dahdi options, view /etc/asterisk/chan_dahdi.conf.bak [trunkgroups] [channels]
context=default
usecallerid=yes
hidecallerid=no
callwaiting=yes
usecallingpres=yes
callwaitingcallerid=yes
threewaycalling=yes
transfer=yes
canpark=yes
cancallforward=yes
callreturn=yes
echocancel=yes
echocancelwhenbridged=yes
relaxdtmf=yes
rxgain=0.0
txgain=0.0
group=1
callgroup=1
pickupgroup=1
immediate=no ; Required for Embarq / CenturyTel
pridialplan=unknown
prilocaldialplan=local
priindication=outofband
priexclusive=no ;Sangoma A104 port 1 [slot:4 bus:9 span:1]
switchtype=national
context=from-pstn
group=0
echocancel=yes
signalling=pri_cpe
channel =>1-23 ;Sangoma A104 port 2 [slot:4 bus:9 span:2]
switchtype=national
context=from-internal
group=1
echocancel=yes
signalling=pri_net
channel =>25-47 ;Sangoma A104 port 3 [slot:4 bus:9 span:3]
switchtype=national
context=from-internal
group=2
echocancel=yes
signalling=pri_net
channel =>49-71 ;Sangoma A104 port 4 [slot:4 bus:9 span:4]
switchtype=national
context=from-internal
group=3
echocancel=yes
signalling=pri_net
channel =>73-95
================================================================== /etc/wanpipe/wanpipe1.conf
==================================================================
#================================================
# WANPIPE1 Configuration File
#================================================
#
# Date: Wed Dec 6 20:29:03 UTC 2006
#
# Note: This file was generated automatically
# by /usr/local/sbin/setup-sangoma program.
#
# If you want to edit this file, it is
# recommended that you use wancfg program
# to do so.
#================================================
# Sangoma Technologies Inc.
#================================================ [devices]
wanpipe1 = WAN_AFT_TE1, Comment [interfaces]
w1g1 = wanpipe1, , TDM_VOICE, Comment [wanpipe1]
CARD_TYPE = AFT
S514CPU = A
CommPort = PRI
AUTO_PCISLOT = NO
PCISLOT = 4
PCIBUS = 9
FE_MEDIA = T1
FE_LCODE = B8ZS
FE_FRAME = ESF
FE_LINE = 1
TE_CLOCK = NORMAL
TE_REF_CLOCK = 0 TE_HIGHIMPEDANCE = NO
TE_RX_SLEVEL = 360
HW_RJ45_PORT_MAP = DEFAULT
LBO = 0DB
FE_TXTRISTATE = NO
MTU = 1500
UDPPORT = 9000
TTL = 255
IGNORE_FRONT_END = NO
TDMV_SPAN = 1
TDMV_DCHAN = 24
TE_AIS_MAINTENANCE = NO #NO: defualt YES: Start port in AIS Blue
Alarm and keep line down
#wanpipemon -i w1g1 -c Ttx_ais_off to disable
AIS maintenance mode
#wanpipemon -i
w1g1 -c Ttx_ais_on to enable AIS maintenance mode
TDMV_HW_DTMF = NO # YES: receive dtmf events from hardware
TDMV_HW_FAX_DETECT = NO # YES: receive fax 1100hz
events from hardware
HWEC_OPERATION_MODE = OCT_NORMAL # OCT_NORMAL: echo cancelation enabled
with nlp (default) # OCT_SPEECH: improves software tone detection by disabling NLP (echo possible) # OCT_NO_ECHO:disables echo cancelation but allows VQE/tone functions.
HWEC_DTMF_REMOVAL = NO # NO: default YES: remove dtmf out of
incoming media (must have hwdtmf enabled)
HWEC_NOISE_REDUCTION = NO # NO: default YES: reduces noise on the line
- could break fax
HWEC_ACUSTIC_ECHO = NO # NO: default YES: enables acustic echo
cancelation
HWEC_NLP_DISABLE = NO # NO: default YES: guarantees software tone
detection (possible echo)
HWEC_TX_AUTO_GAIN = 0 # 0: disable -40-0: default tx audio level
to be maintained (-20 default)
HWEC_RX_AUTO_GAIN = 0 # 0: disable -40-0: default tx audio level
to be maintained (-20 default)
HWEC_TX_GAIN = 0 # 0: disable -24-24: db values to be
applied to tx signal
HWEC_RX_GAIN = 0 # 0: disable -24-24: db values to be
applied to tx signal [w1g1]
ACTIVE_CH = ALL
TDMV_HWEC = YES
MTU = 8
================================================================== Installed Software
==================================================================
asterisk-1.4.43-1.C4.SC
asterisk-addons-1.4.13-1.C4.LSE
asterisk-core-sounds-en-wav-1.4.21-1.C4.SC
asterisk-devel-1.4.43-1.C4.SC
asterisk-extra-sounds-en-gsm-1.4.11-2.C4.LSE
asterisk-libpri-2283-1svn.C4.SC
asterisk-perl-1.01-1.C4.LSE
dahdi-linux-2.6.0-2.6.9_103.plus.c4.LSE.1smp_3.C4.SC
dahdi-tools-2.6.0-2.C4.SC
iaxmodem-static-1.2.0-1.C4.SC
kernel-smp-2.6.9-103.plus.c4.LSE.1
kernel-utils-2.4-23.el4
wanpipe-3.5.25-1.SC
wanpipe-modules-3.5.25-kernel.2.6.9.103.plus.c4.LSE.1smp.dahdi.2.6.0_1.SC
==================================================================
Thank you,
Asterisk Users 3.4 years ago 2 Answers

Answers ( 2 )

    +1
    March 14, 2012 at 14:02 pm
    Reply


    Thanks, I'll give this a shot.
    Our Telco PRI is set inbound and asterisk set descending so we should be good
    there. I'll double check the Iwatsu PRI's. Thank you,

    +1
    March 30, 2012 at 12:05 pm
    Reply


    This has been working very well for us so far. At least on the TELCO trunk.
    Today we have a new problem. The Iwatsu legacy phone system connected on span
    2 and 3 is now unable to grab an outbound channel on span 3. Inbound calls are
    OK. Iwatsu is configured to dial descending, Asterisk dials ascending. [Mar 30 11:26:14] DEBUG[7643] chan_dahdi.c: Span 3: SETUP requested
    unavailable channel 0/23. Attempting to renegotiate. This channel, DAHDI/71-1, is not shown as in use. Here is the call debug log:
    ==========================================================================
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Protocol Discriminator: Q.931 (8)
    len=32
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < TEI=0 Call Ref: len= 2 (reference
    1/0x1) (Sent from originator)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Message Type: SETUP (5)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < [04 03 90 90 a2]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Bearer Capability (len= 5) [ Ext:
    1 Coding-Std: 0 Info transfer capability: 3.1kHz audio (16)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Ext:
    1 Trans mode/rate: 64kbps, circuit-mode (16)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: <
    User information layer 1: u-Law (34)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < [18 03 a9 83 97]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Channel ID (len= 5) [ Ext: 1
    IntID: Implicit Other(PRI) Spare: 0 Exclusive Dchan: 0
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < ChanSel: As
    indicated in following octets
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Ext: 1
    Coding: 0 Number Specified Channel Type: 3
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Ext: 1
    Channel: 23 Type: NET]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < [6c 05 00 80 33 39 39]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Calling Party Number (len= 7) [
    Ext: 0 TON: Unknown Number Type (0) NPI: Unknown Number Plan (0)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: <
    Presentation: Presentation permitted, user number not screened (0) 'XXX' ]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < [70 08 80 35 37 36 36 38 34 39]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: < Called Party Number (len=10) [
    Ext: 1 TON: Unknown Number Type (0) NPI: Unknown Number Plan (0) 'XXX6849' ]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Making new call for cref 1
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: Received message for call 0x8c925a8
    on link 0xb7dcf194 TEI/SAPI 0/0
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Processing Q.931 Call Setup
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Processing IE 4 (cs0, Bearer
    Capability)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Processing IE 24 (cs0, Channel ID)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Processing IE 108 (cs0, Calling
    Party Number)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: -- Processing IE 112 (cs0, Called
    Party Number)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:8515
    post_handle_q931_message: Call 1 enters state 6 (Call Present). Hold state: Idle
    [Mar 30 11:26:14] DEBUG[7643] chan_dahdi.c: Span 3: SETUP requested
    unavailable channel 0/23. Attempting to renegotiate.
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:7004 q931_hangup: Hangup
    other cref:1
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:6761 __q931_hangup: ourstate
    Call Present, peerstate Call Initiated, hold-state Idle
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:6252 q931_release_complete:
    Call 1 enters state 0 (Null). Hold state: Idle
    [Mar 30 11:26:14] VERBOSE[7643] logger.c:
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > DL-DATA request
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Protocol Discriminator: Q.931 (8)
    len=9
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > TEI=0 Call Ref: len= 2 (reference
    1/0x1) (Sent to originator)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Message Type: RELEASE COMPLETE (90)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: TEI=0 Transmitting N(S)=89, window
    is open V(A)=89 K=7
    [Mar 30 11:26:14] VERBOSE[7643] logger.c:
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Protocol Discriminator: Q.931 (8)
    len=9
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > TEI=0 Call Ref: len= 2 (reference
    1/0x1) (Sent to originator)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Message Type: RELEASE COMPLETE (90)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > [08 02 81 ac]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Cause (len= 4) [ Ext: 1 Coding:
    CCITT (ITU) standard (0) Spare: 0 Location: Private network serving the
    local user (1)
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: > Ext: 1 Cause:
    Requested channel not available (44), class = Network Congestion (resource
    unavailable) (2) ]
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:7004 q931_hangup: Hangup
    other cref:1
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: q931.c:6761 __q931_hangup: ourstate
    Null, peerstate Null, hold-state Idle
    [Mar 30 11:26:14] VERBOSE[7643] logger.c: Destroying call 0x8c925a8, ourstate
    Null, peerstate Null, hold-state Idle
    =============================================================================== While I was writing this message, the onsite tech pulled the cable on span 3
    and outbound calls are going through now. Here is the log from the good call
    on span 2. It's not stuck on dialing out on 0/23... ===============================================================================
    < Protocol Discriminator: Q.931 (8) len=36
    < TEI=0 Call Ref: len= 2 (reference 6/0x6) (Sent from originator)
    < Message Type: SETUP (5)
    < [04 03 80 90 a2]
    < Bearer Capability (len= 5) [ Ext: 1 Coding-Std: 0 Info transfer
    capability: Speech (0)
    < Ext: 1 Trans mode/rate: 64kbps, circuit-mode (16)
    < User information layer 1: u-Law (34)
    < [18 03 a9 83 92]
    < Channel ID (len= 5) [ Ext: 1 IntID: Implicit Other(PRI) Spare: 0
    Exclusive Dchan: 0
    < ChanSel: As indicated in following octets
    < Ext: 1 Coding: 0 Number Specified Channel Type: 3
    < Ext: 1 Channel: 18 Type: NET]
    < [6c 05 00 80 32 37 30]
    < Calling Party Number (len= 7) [ Ext: 0 TON: Unknown Number Type (0) NPI:
    Unknown Number Plan (0)
    < Presentation: Presentation permitted, user
    number not screened (0) 'ZZZ' ]
    < [70 0c 80 31 38 30 30 34 36 37 34 34 34 38]
    < Called Party Number (len=14) [ Ext: 1 TON: Unknown Number Type (0) NPI:
    Unknown Number Plan (0) 'ZZZZZZZ4448' ]

 Prev question

Next question