Thursday, June 17, 2021

Cisco ASA5516 Input errors

ASA5516. Getting input errors about every 10-20sec. The device was up for about 100 days before we noticed that it killed the network speed. Rebooted the device and it cleared it up for now. Any advice for trying to figure out the cause of the errors?

 Hardware is Accelerator rev01, BW 1000 Mbps, DLY 10 usec Auto-Duplex(Full-duplex), Auto-Speed(1000 Mbps) Input flow control is unsupported, output flow control is off MAC address x, MTU 1500 IP address x, subnet mask 255.255.255.0 420104542 packets input, 429238268656 bytes, 0 no buffer Received 14509239 broadcasts, 0 runts, 0 giants 26821 input errors, 0 CRC, 26821 frame, 0 overrun, 0 ignored, 0 abort 0 pause input, 0 resume input 0 L2 decode drops 250519518 packets output, 177349647630 bytes, 0 underruns 0 pause output, 0 resume output 0 output errors, 0 collisions, 0 interface resets 0 late collisions, 0 deferred 0 input reset drops, 1124 output reset drops input queue (blocks free curr/low): hardware (1959/1820) output queue (blocks free curr/low): hardware (2047/886) 

show blocks SIZE MAX LOW CNT 0 1450 1435 1450 4 500 498 499 80 2249 2187 2249 256 6148 6113 6143 1550 8780 8669 8777 2048 4400 4399 4400 2560 2788 2788 2788 4096 100 100 100 8192 100 100 100 9344 100 100 100 16384 154 154 154 65536 16 16 16 

cpu-hog

Cisco Adaptive Security Appliance Software Version 9.13(1) ASLR enabled, text region 55f147c52000-55f14c62bd25 Process: CP Midpath Processing, PROC_PC_TOTAL: 2, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 10:56:24 CDT Jun 14 2021 PC: 0x000055f148e87b65 (suspend) Process: CERT API, PROC_PC_TOTAL: 2, MAXHOG: 3, LASTHOG: 3 LASTHOG At: 10:56:24 CDT Jun 14 2021 PC: 0x000055f14a1fae88 (suspend) Process: Unicorn Admin Handler, PROC_PC_TOTAL: 1, MAXHOG: 4, LASTHOG: 4 LASTHOG At: 10:57:49 CDT Jun 14 2021 PC: 0x000055f14a5c784d (suspend) Process: Unicorn Admin Handler, NUMHOG: 1, MAXHOG: 4, LASTHOG: 4 LASTHOG At: 10:57:49 CDT Jun 14 2021 PC: 0x000055f14a5c784d (suspend) Call stack: 0x000055f148888633 Process: CP Processing, PROC_PC_TOTAL: 1, MAXHOG: 19, LASTHOG: 19 LASTHOG At: 11:08:15 CDT Jun 14 2021 PC: 0x000055f148e87175 (suspend) Process: CP Midpath Processing, NUMHOG: 5, MAXHOG: 19, LASTHOG: 19 LASTHOG At: 11:08:15 CDT Jun 14 2021 PC: 0x000055f148e87b65 (suspend) Call stack: 0x000055f1488885fb Process: tmatch compile thread, PROC_PC_TOTAL: 3, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 12:49:49 CDT Jun 14 2021 PC: 0x000055f148cedd1c (suspend) Process: tmatch compile thread, NUMHOG: 3, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 12:49:49 CDT Jun 14 2021 PC: 0x000055f148cedd1c (suspend) Call stack: 0x000055f148cedd1c 0x000055f1488885fb Process: Unicorn Proxy Thread, PROC_PC_TOTAL: 1, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 13:59:43 CDT Jun 14 2021 PC: 0x000055f1491a8f7c (suspend) Process: Unicorn Proxy Thread, NUMHOG: 1, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 13:59:43 CDT Jun 14 2021 PC: 0x000055f1491a8f7c (suspend) Call stack: 0x000055f148889145 0x000055f1491a8f7c 0x000055f1489054ff 0x000055f14aa27a7b 0x000055f14aa2ae0b 0x000055f14883c47f 0x000055f1488a6a40 0x000055f1488aa090 0x000055f14889f610 0x000055f1488a0ddd 0x000055f1488a10ce 0x000055f14ad1c078 0x000055f14a7ab112 0x000055f14a7bc1fd Process: Unicorn Proxy Thread, PROC_PC_TOTAL: 2, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 23:45:56 CDT Jun 14 2021 PC: 0x000055f14a653b6f (suspend) Process: Unicorn Proxy Thread, NUMHOG: 2, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 23:45:56 CDT Jun 14 2021 PC: 0x000055f14a653b6f (suspend) Call stack: 0x000055f14a653b6f 0x000055f14a672b62 0x000055f14a675210 0x000055f14a7be9b3 0x000055f14a7bcf29 0x000055f14a7b0253 0x000055f14a7b177e 0x000055f14a7b2643 0x000055f14a7b3bde 0x000055f14a7b5536 0x000055f14a7b3d4f 0x000055f14a7b6013 0x000055f14a7aae85 0x000055f14a7aab0a Process: IKEv2 Daemon, PROC_PC_TOTAL: 5, MAXHOG: 3, LASTHOG: 3 LASTHOG At: 05:19:59 CDT Jun 15 2021 PC: 0x000055f1489d74d9 (suspend) Process: IKEv2 Daemon, NUMHOG: 5, MAXHOG: 3, LASTHOG: 3 LASTHOG At: 05:19:59 CDT Jun 15 2021 PC: 0x000055f1489d74d9 (suspend) Call stack: 0x000055f148abefd8 0x000055f1489e455f 0x000055f14928f5ed 0x000055f149304101 0x000055f1492fdbde 0x000055f14930159f 0x000055f1492e3615 0x000055f1492ecae0 0x000055f1492ecff5 0x000055f1492f71b6 0x000055f1492f7bb4 0x000055f149342d41 0x000055f1492cff30 0x000055f1488885fb Process: Unicorn Admin Handler, PROC_PC_TOTAL: 1, MAXHOG: 4, LASTHOG: 4 LASTHOG At: 13:12:02 CDT Jun 16 2021 PC: 0x000055f14903199b (suspend) Process: Unicorn Admin Handler, NUMHOG: 1, MAXHOG: 4, LASTHOG: 4 LASTHOG At: 13:12:02 CDT Jun 16 2021 PC: 0x000055f14903199b (suspend) Call stack: 0x000055f14903199b 0x000055f1490262b7 0x000055f149f6e5a8 0x000055f1490ea072 0x000055f1490d83a7 0x000055f1490da001 0x000055f1490daa6f 0x000055f1490e657e 0x000055f1488885fb Process: Unicorn Proxy Thread, PROC_PC_TOTAL: 14, MAXHOG: 3, LASTHOG: 1 LASTHOG At: 10:35:55 CDT Jun 17 2021 PC: 0x000055f14a680530 (suspend) Process: Unicorn Proxy Thread, NUMHOG: 14, MAXHOG: 3, LASTHOG: 1 LASTHOG At: 10:35:55 CDT Jun 17 2021 PC: 0x000055f14a680530 (suspend) Call stack: 0x000055f14a680530 0x000055f14a6532ca 0x000055f14a659b39 0x000055f14a659c38 0x000055f14bcd342a 0x00007fab59ea8658 0x00007fab595b4b00 0x00007fab595b5300 0x00007fab595b5400 0x00007fab595b5500 0x00007fab595b5600 0x00007fab595b5700 0x00007fab595b6b80 0x00007fab595b6c80 Process: rtcli async executor process, PROC_PC_TOTAL: 8, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 12:57:50 CDT Jun 17 2021 PC: 0x000055f14a652b6a (suspend) Process: rtcli async executor process, NUMHOG: 8, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 12:57:50 CDT Jun 17 2021 PC: 0x000055f14a652b6a (suspend) Call stack: 0x000055f14a652b6a 0x000055f14a659b39 0x000055f14a659c38 0x00007fab6ace29e0 Process: ssh_init, NUMHOG: 11, MAXHOG: 6, LASTHOG: 6 LASTHOG At: 13:08:22 CDT Jun 17 2021 PC: 0x000055f14a557b70 (suspend) Call stack: 0x000055f14a56dd52 0x000055f14a56cdea 0x000055f14a56af35 0x000055f14a56bca8 0x000055f14a561312 0x000055f1488885fb Process: ssh_init, PROC_PC_TOTAL: 77, MAXHOG: 6, LASTHOG: 2 LASTHOG At: 13:13:51 CDT Jun 17 2021 PC: 0x000055f14a557b70 (suspend) Process: ssh, NUMHOG: 66, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 13:13:51 CDT Jun 17 2021 PC: 0x000055f14a557b70 (suspend) Call stack: 0x000055f14a56dd52 0x000055f14a57010a 0x000055f14a55e8aa 0x000055f14a55f04d 0x000055f149f3702f 0x000055f14b17a13f 0x000055f148964915 0x000055f1489510ae 0x000055f148952257 0x000055f1488885fb Process: DATAPATH-0-1603, PROC_PC_TOTAL: 882, MAXHOG: 7, LASTHOG: 4 LASTHOG At: 13:20:50 CDT Jun 17 2021 PC: 0x0000000000000000 (suspend) Process: DATAPATH-0-1603, NUMHOG: 879, MAXHOG: 7, LASTHOG: 4 LASTHOG At: 13:20:50 CDT Jun 17 2021 PC: 0x0000000000000000 (suspend) Call stack: 0x000055f148d4fa8a 0x000055f14a27b187 0x000055f14a28a8ac 0x000055f14a29a5d8 0x00007fab8f9803d4 Process: DATAPATH-1-1604, PROC_PC_TOTAL: 854, MAXHOG: 26, LASTHOG: 2 LASTHOG At: 13:20:50 CDT Jun 17 2021 PC: 0x0000000000000000 (suspend) Process: DATAPATH-1-1604, NUMHOG: 851, MAXHOG: 26, LASTHOG: 2 LASTHOG At: 13:20:50 CDT Jun 17 2021 PC: 0x0000000000000000 (suspend) Call stack: 0x000055f148d4fa8a 0x000055f14a27b187 0x000055f14a28a8ac 0x000055f14a29a5d8 0x00007fab8f9803d4 CPU hog threshold (msec): 1.542 Last cleared: None 

block exhaustion snapshot

Snapshot created due to 0 blocks running out LOW, CNT columns indicate interface pool blocks GLB prefixed columns indicate global pool blocks TXQLEN column indicates number of blocks in transmit ring Interface TXQLEN Core local blocks information: CORE LIMIT ALLOC HIGH CNT FAILED 0 0 0 0 0 0 1 0 0 0 0 0 Histogram of 'ASP load balancer queue sizes' 64 buckets sampling from 1 to 65 (1 per bucket) 0 samples within range (average=0) <no data for 'ASP load balancer queue sizes' histogram> Data points: bucket[1-1] = 0 samples bucket[2-2] = 0 samples bucket[3-3] = 0 samples bucket[4-4] = 0 samples bucket[5-5] = 0 samples bucket[6-6] = 0 samples bucket[7-7] = 0 samples bucket[8-8] = 0 samples bucket[9-9] = 0 samples bucket[10-10] = 0 samples bucket[11-11] = 0 samples bucket[12-12] = 0 samples bucket[13-13] = 0 samples bucket[14-14] = 0 samples bucket[15-15] = 0 samples bucket[16-16] = 0 samples bucket[17-17] = 0 samples bucket[18-18] = 0 samples bucket[19-19] = 0 samples bucket[20-20] = 0 samples bucket[21-21] = 0 samples bucket[22-22] = 0 samples bucket[23-23] = 0 samples bucket[24-24] = 0 samples bucket[25-25] = 0 samples bucket[26-26] = 0 samples bucket[27-27] = 0 samples bucket[28-28] = 0 samples bucket[29-29] = 0 samples bucket[30-30] = 0 samples bucket[31-31] = 0 samples bucket[32-32] = 0 samples bucket[33-33] = 0 samples bucket[34-34] = 0 samples bucket[35-35] = 0 samples bucket[36-36] = 0 samples bucket[37-37] = 0 samples bucket[38-38] = 0 samples bucket[39-39] = 0 samples bucket[40-40] = 0 samples bucket[41-41] = 0 samples bucket[42-42] = 0 samples bucket[43-43] = 0 samples bucket[44-44] = 0 samples bucket[45-45] = 0 samples bucket[46-46] = 0 samples bucket[47-47] = 0 samples bucket[48-48] = 0 samples bucket[49-49] = 0 samples bucket[50-50] = 0 samples bucket[51-51] = 0 samples bucket[52-52] = 0 samples bucket[53-53] = 0 samples bucket[54-54] = 0 samples bucket[55-55] = 0 samples bucket[56-56] = 0 samples bucket[57-57] = 0 samples bucket[58-58] = 0 samples bucket[59-59] = 0 samples bucket[60-60] = 0 samples bucket[61-61] = 0 samples bucket[62-62] = 0 samples bucket[63-63] = 0 samples bucket[64-64] = 0 samples DP-CP EVENT QUEUE QUEUE-LEN HIGH-WATER Punt Event Queue 0 0 Routing Event Queue 0 0 Identity-Traffic Event Queue 0 0 PTP-Traffic Event Queue 0 0 General Event Queue 0 0 Syslog Event Queue 0 0 Non-Blocking Event Queue 0 0 Midpath High Event Queue 0 0 Midpath Norm Event Queue 0 0 Crypto Event Queue 0 0 HA Event Queue 0 0 Threat-Detection Event Queue 0 0 SCP Event Queue 0 0 ARP Event Queue 0 0 IDFW Event Queue 0 0 CXSC Event Queue 0 0 BFD Event Queue 0 0 SFR Event Queue 0 0 Cluster Event Queue 0 0 CP-DP EVENT QUEUE QUEUE-LEN HIGH-WATER Dispatch Global Work Queue 0 0 block snapshot count is 0 


No comments:

Post a Comment