<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle" type="text/css">P {margin-top:0;margin-bottom:0;}</style>
</head>
<body ocsi="0" fpstyle="1">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">John,<br>
<br>
One "simple" patch for ASA 9 would be to (a) only recognize flow-update events and (b) create two unidirectional flows from each bidirectional flow -- swap the IP/port/ifIndex and include only the appropriate byte counter.<br>
<br>
Not only is it simple, but the resulting data would be fully compatible with existing scripts and tools that work on unidirectional flows.<br>
<br>
-Craig<br>
<br>
<br>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div style="direction: ltr;" id="divRpF25288"><font color="#000000" face="Tahoma" size="2"><b>From:</b> John Marrett [johnf@zioncluster.ca]<br>
<b>Sent:</b> Friday, February 21, 2014 5:17 AM<br>
<b>To:</b> Craig Weinhold<br>
<b>Cc:</b> netflow-tools@mindrot.org<br>
<b>Subject:</b> Re: [netflow-tools] Cisco ASA OS 9 flowd errors<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">
<div>
<div>I should have known that Craig would know the subject matter well, you're really throwing down with are you up to the challenge!<br>
<br>
Can't believe I didn't think to check the netflow docs as I did last time. You've linked us to some very interesting information.
<br>
<br>
My little patch for ASA 8 Netflow gives a very basic interpretation, it's enough to allow you to use flow-tools to perform very basic reporting, but doesn't provide any temporal information as there is only a single packet on close. As such it's unsuited to
use with the most powerful open source flow reporting system ( <a href="http://wvnetflow.sourceforge.net/" target="_blank">
http://wvnetflow.sourceforge.net/</a> ).<br>
<br>
</div>
ASA 9 seems much more interesting as a full implementation would allow an ASA to function as a full featured collector. It's unfortunate that none of the fields align with standard fields.<br>
<br>
My reading also seems to suggest that I would need to configure the collector in a specific fashion; this annotation in the NSEL documentation:<br>
<br>
"<img alt="" border="0" height="2" width="1">Different events in the life of a flow may be issued in separate NetFlow packets and may arrive out-of-order at the collector. For example, the packet containing a flow teardown event may reach the collector before
the packet containing a flow creation event. As a result, it is important that collector applications use the Event Time field to correlate events. " [1] and "a configurable CLI parameter is provided to delay sending of the flow-create event. If the timer
fires, the flow-create event is sent. However, if the flow is torn down before the timer expires,
<em class="">only</em> the flow-teardown event is sent; no flow-create event is sent. " [2]<br>
<br>
</div>
<div>As I read this it would probably be best to ensure that the refresh-interval is the same as, or one second less than the delay flow-create timer. [3]<br>
<br>
</div>
<div>I'm not certain how different this behaviour is from regular netflow as it's been several years since I went this deep into netflow packet collection and processing and my last visit was with much less ambitious goals. If you look at my patch [4] you'll
see that only fairly small changes were required to make things work; I wonder if they changed things in such a way that the "standard" netflow v9 field identifiers used on other platforms no longer match the ASA 9 ones, even though their field content is
the same. If this is the case then it could actually be pretty easy to address.<br>
<br>
</div>
<div>If anyone else is interested in this subject please feel free to contact me on or off list. I can provide all kinds of assistance captures and potentially even (remote) hardware access. I will probably start in on this to see how challenging it actually
is, if it's not as bad as I fear it is then I may be able to get something done fairly quickly. It's not entirely clear to me why the fields
<br>
</div>
<div><br>
All of this said, I think it's clear that I AM up to the challenge!<br>
<br>
Whether my availability and scheduling are is an open question however :(<br>
<br>
I've got a lot on my plate at home and work; in the environment where I have these ASAs running as collectors I now have new options (N7k Core Switches) which give me other substantially easier options to address the issue as well.<br>
<br>
[1] <a href="http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html#wp1029397" target="_blank">
http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html#wp1029397</a><br>
[2] <a href="http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html#wp1028239" target="_blank">
http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html#wp1028239</a><br>
[3] <a href="http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/configuration/general/asa_91_general_config/monitor_nsel.html#wp1301461" target="_blank">
http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/configuration/general/asa_91_general_config/monitor_nsel.html#wp1301461</a><br>
[4] <a href="http://zioncluster.ca/netflow/asa_patch_2.diff" target="_blank">http://zioncluster.ca/netflow/asa_patch_2.diff</a><br>
<br>
</div>
-JohnF<br>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Thu, Feb 20, 2014 at 11:17 PM, Craig Weinhold <span dir="ltr">
<<a href="mailto:Craig.Weinhold@cdw.com" target="_blank">Craig.Weinhold@cdw.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div>
<div style="direction:ltr; font-size:10pt; font-family:Tahoma">NSEL from ASA is quite different from traditional NetFlow, and it changed with ASA 9. Each flow is a bidirectional entity with separate byte/packet counters in each direction (previously there was
one total byte counter). There are also new event types -- flow alert and flow update.<br>
<br>
ASA 8.x <a href="http://www.cisco.com/c/en/us/td/docs/security/asa/asa82/netflow/netflow.html" target="_blank">
http://www.cisco.com/c/en/us/td/docs/security/asa/asa82/netflow/netflow.html</a><br>
<br>
ASA 9.x <a href="http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html" target="_blank">
http://www.cisco.com/c/en/us/td/docs/security/asa/asa91/system/netflow/netflow.html</a><br>
<br>
I'd love to see a complete implementation of NSEL in flowd, but that requires changing the output format. You up to the challenge?<br>
<br>
-Craig<br>
<br>
<br>
<div style="font-size:16px; font-family:Times New Roman">
<hr>
<div style="direction:ltr"><font color="#000000" face="Tahoma"><b>From:</b> netflow-tools [netflow-tools-bounces+craig.weinhold=<a href="mailto:cdw.com@mindrot.org" target="_blank">cdw.com@mindrot.org</a>] on behalf of John Marrett [<a href="mailto:johnf@zioncluster.ca" target="_blank">johnf@zioncluster.ca</a>]<br>
<b>Sent:</b> Thursday, February 20, 2014 8:29 PM<br>
<b>To:</b> <a href="mailto:netflow-tools@mindrot.org" target="_blank">netflow-tools@mindrot.org</a><br>
<b>Subject:</b> [netflow-tools] Cisco ASA OS 9 flowd errors<br>
</font><br>
</div>
<div>
<div class="h5">
<div></div>
<div>
<div dir="ltr">
<div>
<div>
<div>I'm running a version of flowd 0.9.1 with my ASA patches applied ( <a href="http://zioncluster.ca/netflow/asa_patch_2.diff" target="_blank">
http://zioncluster.ca/netflow/asa_patch_2.diff</a> ).<br>
<br>
</div>
I've recently realized that when running against flows from ASA running versions of 9.1(4) (and probably earlier releases in 9) I'm seeing error messages and no data is recorded to disk.<br>
<br>
</div>
When templates are received I see the following:<br>
<br>
NetFlow v.9 template set from <a href="http://1.1.1.1/0x0" target="_blank">1.1.1.1/0x0</a> with len 1368:<br>
Contains template 0x00000000/0x0100 with 21 records (offset 8):<br>
forced deletion of template 0x0100 from peer <a href="http://1.1.1.1/0x00000000" target="_blank">
1.1.1.1/0x00000000</a><br>
Contains template 0x00000000/0x0101 with 21 records (offset 96):<br>
forced deletion of template 0x0101 from peer <a href="http://1.1.1.1/0x00000000" target="_blank">
1.1.1.1/0x00000000</a><br>
Contains template 0x00000000/0x0102 with 21 records (offset 184):<br>
forced deletion of template 0x0102 from peer <a href="http://1.1.1.1/0x00000000" target="_blank">
1.1.1.1/0x00000000</a><br>
[...]<br>
<br>
Even after receipt of the template I see the following:<br>
<br>
netflow v.9 packet (len 1412) 17 recs, source 0x00000000<br>
netflow v.9 data flowset (len 104) source 0x00000000<br>
netflow v.9 data flowset without template <a href="http://1.1.1.1/0x00000000/0x0100" target="_blank">
1.1.1.1/0x00000000/0x0100</a><br>
netflow v.9 data flowset (len 68) source 0x00000000<br>
netflow v.9 data flowset without template <a href="http://1.1.1.1/0x00000000/0x0107" target="_blank">
1.1.1.1/0x00000000/0x0107</a><br>
netflow v.9 data flowset (len 104) source 0x00000000<br>
[...]<br>
<br>
</div>
<div>When I compare it with another host running an older version I see different log information.<br>
<br>
NetFlow v.9 template set from <a href="http://1.1.1.2/0x0" target="_blank">1.1.1.2/0x0</a> with len 992:<br>
Contains template 0x00000000/0x0100 with 21 records (offset 8):<br>
Contains template 0x00000000/0x0101 with 21 records (offset 96):<br>
Contains template 0x00000000/0x0102 with 17 records (offset 184):<br>
Contains template 0x00000000/0x0103 with 17 records (offset 256):<br>
Contains template 0x00000000/0x0104 with 18 records (offset 328):<br>
Contains template 0x00000000/0x0105 with 14 records (offset 404):<br>
Contains template 0x00000000/0x0106 with 14 records (offset 464):<br>
Contains template 0x00000000/0x0107 with 18 records (offset 524):<br>
Contains template 0x00000000/0x0108 with 14 records (offset 600):<br>
forced deletion of template 0x0108 from peer <a href="http://1.1.1.2/0x00000000" target="_blank">
1.1.1.2/0x00000000</a><br>
Contains template 0x00000000/0x0109 with 22 records (offset 660):<br>
forced deletion of template 0x0109 from peer <a href="http://1.1.1.2/0x00000000" target="_blank">
1.1.1.2/0x00000000</a><br>
Contains template 0x00000000/0x010a with 22 records (offset 752):<br>
forced deletion of template 0x010a from peer <a href="http://1.1.1.2/0x00000000" target="_blank">
1.1.1.2/0x00000000</a><br>
Contains template 0x00000000/0x010b with 18 records (offset 844):<br>
forced deletion of template 0x010b from peer <a href="http://1.1.1.2/0x00000000" target="_blank">
1.1.1.2/0x00000000</a><br>
Contains template 0x00000000/0x010c with 18 records (offset 920):<br>
<br>
</div>
<div>I note that with the newer release of the ASA code that none of the template records are accepted, with the older version only a few of them are force deleted.<br>
</div>
<div><br>
Does anyone have any idea what may be happening here?<br>
<br>
</div>
<div>I am ready to provide samples off list and perform any debugging requested. If it's possible to receive and parse the template and post it publicly so we can compare the two versions I'd be more than happy too.<br>
<br>
</div>
<div>I'm eager to solve the problem and ready to do whatever it takes to address it.<br>
</div>
<div><br>
</div>
<div>Thanks in advance,<br>
</div>
<div><br>
</div>
-JohnF<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>