ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
TimestampWhat CDN?
What have you identified the traffic to be?
What is the access network?
Where is the rate limiting done?
How is the rate limiting done?
What is doing the rate limiting?
What is the rate-limit set to?
Upstream of the rate-limiter, what are you seeing for inbound traffic levels?
One concurrent connection or many?
How does other traffic behave when exceeding the rate limit (outside of the problem situations)?
Where is NAT performed?
What is doing NAT (make\model)?
Shared NAT or isolated to that customer?
Have you done a packet capture before and after the rate limiter? The NAT device?
Would you be willing to send a filtered packet capture (only the frames that relate to this CDN) to the CDN if they want it?
Are there any bursting methods in use (customer can download at a rate above their normal plan for some time, dropping down to their plan speed when done)?
2
9/21/2016 9:32:55
Akamai, Microsoft
Windows Updates
Mikrotik Wireless, Ubiquiti Wireless
CPEPFIFO
MikroTik Simple Queues
1664k, 3200k or 5248k
50-80% above client limit
ManyNormalCPE, Border
CCR1036, CCR1072
Shared by multiple customers
NoYes
3
9/21/2016 9:46:21
Akamai, Level 3, Microsoft, LimeLight
Microsoft Windows 10 update and Apple ISO
Ubiquiti WirelessAt the towerSFQMikrotik Router768k-10mbs256k-1mbsOne
Internet seems to be down or really slow
CPEUbnt
Shared by multiple customers
NoYes
4
9/21/2016 9:48:30
Akamai, Microsoft
Windows 10 updates
Active Ethernet
In client CPE. Mikrotik RB1100ahx2
Policing
Mikrotik RB110ahx2
11Mb out of 20Mb
20MbManyTotally stalledCPE
Multiple downstream routers
Customers have own NAT routers
YesYesNo
5
9/21/2016 10:41:57AkamaiNetflix
DSL, Ubiquiti Wireless, 802.16e WiMax, TD-LTE, & Carrier Ethernet Fiber (10mbps and up),
WiMax: Vendor Access Service Network Gateway, LTE: Vendor Evolved Packet Core, ADSL: PPPoE LNS
Un-known or un-documented vendor implementation (LTE & WiMax)
Vendor Access Service Network Gateway or LTE Evolved Packet Core
Varies. Nothing higher than 10mbit/sec
800mbit/secOne
Drops owing to inbound saturation
CPE
Many. Top three: LTE: Huawei B2268H, LTE: CelaLink CL-10, WiMax: Alvarion/Telrad 3000/4000
Single customerNo
n/a, no saved captures available
6
9/21/2016 11:28:52
Microsoft, LimeLight
Windows updates
Cambium ePMP Wireless, Ubiquiti Wireless
NOC/network edge
SFQ
MikroTik (PPPoE)
Various - it seems to show up on sub-2Mbps connection most of the time
haven't checkedManyas expectedCPE
Ubiquiti airmax, cambium ePMP
Single customerNoYes
7
9/21/2016 15:07:05
Akamai, Microsoft
Micorsoft Windows Update
DSL, Active Ethernet, Ubiquiti Wireless
Access RouterSFQMikrotik
Customer speed tier +15% + a 25% burst
Customer total speed + 20-40%
Many
As expected - Latency raises but traffic normalizes to customers package
CPE
Comtrend Modem, Comtrend Router, Ubiquiti Radio
Single customerNoYes
8
9/21/2016 16:24:50Microsoft
Windows updates
Mikrotik Wireless
access list, which doesnt work but queues on edge routers do
Hardware\protocol limitations
access list in mikrotik
2mb
max of the connection
Many
I'm not sure what you mean the traffic kind of does whatever it wants even thou the radio is limited
Router
Mikrotik CCR1009 router
Shared by multiple customers
YesYes
9
9/21/2016 18:46:48
Akamai, Microsoft
Microsoft Updates
DSL, Active Ethernet
For ADSL/VDSL it is usually done within the last-mile by the ILEC.
Policing, Hardware\protocol limitations
Depends on the connectivity. For DSL customers the DSLAM and physical link rate are responsible, though in some cases we believe the ILEC polices to the guaranteed speed rather than limiting the physical sync.
I have observed these complaints on everything from 6mbps to 25mbps, and possibly on faster connections but the updates may clear quickly enough that we haven't seen many reports.
I have not measured this.
Many
I have not measured this.
Router, Half of customers provide their own NAT box. Other half (private WAN customers) are NAT'd by a central SRX cluster.
SRX Cluster
Shared by multiple customers, Single customer
NoYes
10
9/21/2016 19:41:13
Microsoft, LimeLight
Windows Update
Cambium PMP Wireless
PMP450 APPolicingPMP450 AP
Burst up to 15 Mbps, and sustained between 2-10 Mbps depending on plan.
Up to the burst bandwidth limit, but never higher.
Many
Other applications and services fall apart when most of their packets get discarded at the PMP450.
Router
NAT to the public IP is performed at our upstream edge (Mikrotik), but there are usually two more layers at the PMP450 CPE, and at the customer's router.
Shared by multiple customers, Shared by all customers, Single customer
NoNo
11
9/21/2016 19:54:24Microsoft
Microsoft Updates
Mikrotik Wireless
We are trying not to block or limit
N/AN/AN/A30 megsManyN/ACustomerCustomerSingle customerYesYesNo
12
9/21/2016 22:31:20
Akamai, Level 3, Microsoft, LimeLight, High Winds
Unknown for sure, but I suspect video and large downloads
Active Ethernet, Ubiquiti Wireless
varies - usually the ubnt cpe or the router the AP is attached to
PFIFO, SFQ, PCQ
Ubnt unit traffic shaping, egress only and/or mikrotik simple queues
varies - anywhere from 1.2mb/s to 6mb/s
Exceeds shaped limit 10-100%
One
Customers complain about super slow service
No NAT - Public IP's
N/ANo NAT involvedNoYes
13
9/22/2016 0:15:46Akamai
Windows Updates
Active Ethernet
QoS FAvour Voip, Policing instead of shape.
PolicingCisco 292120Mbps50-75MBpsMany
Kills connections / Overloaded Service
RouterCisco 2921Single customerNo
Maybe, if i see it again and have time to react
14
9/22/2016 11:38:16
Akamai, Microsoft
Windows update and other large file download
Active Ethernet
Through a MPLS TE Tunnel
RED
Mikrotik Through a TE Tunnel
100mbps200-250mbpsMany
All other traffic becomes completely unresponsive
Customer's Router
Cisco ASR1001Single customerNo
When I see it again I can
15
9/22/2016 20:28:30
Level 3, Microsoft
Windows 10 auto updates mostly
Ubiquiti Wireless
Ubiquiti CPEs and Mikrotik router
Policing, PFIFO
Ubiquiti CPEs and Mikrotik router
varies from 1mbps to 12mbps
?ManyfineCPE
ubiquity nanobridges
Single customerNoNo
16
10/1/2016 3:14:32Akamai
Windows 10 updates
DSLEntry routerPolicingNo effect10KB/s45Mb/s+Many
Internet becomes completely unusable
Router
ASUS RT-AC3200
Shared by multiple customers
YesNo
17
10/2/2016 15:11:00Microsoft
Windows 10 updates
Ubiquiti Wirelesscpe or routerPolicing
cpe traffic shapping
4, 6 or 8 Mbps down
Maxes out 4 Mbps constantly - Windows 10 updates
One
No traffic left for any other activities
Router
MikroTik RB2011UiAS
Shared by multiple customers
NoPossibly
18
10/3/2016 11:11:56Microsoft
Windows10 Updates
Cambium PMP Wireless, Cambium ePMP Wireless, Ubiquiti Wireless
Core RouterPCQMikrotik Router5mbps5mbpsManyDropsCPE, RouterMikrotik X86
Shared by multiple customers, Single customer
NoNoYes
19
10/5/2016 10:01:15Microsoft
Windows Update
Cambium PMP Wireless
CPE
PMP100 900mhz CPE
CPE1.5mbit5mbitOneThrottlesCustomer RouterLinksys routerSingle customerNoYesNo
20
10/19/2016 3:06:42Akamaitraffic
Mikrotik Wireless, Cambium ePMP Wireless
PPPOE serverPFIFO, PCQqueuemaximum ratetrafficOne
inside the main queue
CPE, Routerubiquity nsm5Single customerYesYesYes
21
10/20/2016 13:07:42AkamaiWindows updateActive EthernetEdgePCQsimple queues5M20MManystopsRouterMikrotik rbg450
Shared by multiple customers
NoYesYes
22
10/7/2017 5:53:31Akamai10000DSL100000Policing100001000010000One10000CPEnat
Shared by multiple customers
YesYesYes
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100