Problems using faucet with Aruba 2930F

[d-patch]

Hi,

I am struggeling to correctly use faucet with my Aruba 2930F switches. It seems to work somehow sometimes, but not fully and not without problems. I'm hoping that you can help me find the issue with my setup.
I have followed the faucet documentation regarding the configuration of the Aruba 2930F switches.
Sometimes after changing the faucet config (adding vlans, interfaces or routers) and reloading or restarting faucet, there are suddenly lots of error messages like the ones below in the faucet.log. Also, it seems like the "openflow aggregate instance" doesn't have "full control" over the VLANs on the switch, as I can still use the switch CLI or GUI to configure VLANs.
Here is the output of the Aruba CLI concerning the openflow config:

Running configuration:

; JL254A Configuration Editor; Created on release #WC.16.11.0014
; Ver #14:67.6f.f8.1d.9b.3f.bf.bb.ef.7c.59.fc.6b.fb.9f.fc.ff.ff.37.ef:44
hostname "aruba-05"
module 1 type jl254a
logging 192.168.0.254
max-vlans 2048
timesync ntp
ntp unicast
ntp server 192.168.0.254 iburst
ntp enable
time daylight-time-rule western-europe
time timezone 60
ip ssh filetransfer
ip routing
snmp-server community "public" unrestricted
openflow
   controller-id 1 ip 192.168.0.240 port 6663 controller-interface vlan 2048
   instance aggregate
      controller-id 1
      version 1.3 only
      max-backoff-interval 10
      pipeline-model custom
      packet-in vlan-tagging input-form
      override-protocol all
      enable
      exit
   enable
   exit
vlan 1
   name "DEFAULT_VLAN"
   no untagged 1-52
   no ip address
   exit
vlan 2
   name "VLAN2"
   tagged 1-47,49-52
   no ip address
   exit
vlan 3
   name "VLAN3"
   tagged 1-47,49-52
   no ip address
   exit
[...]

aruba-05(config)# show openflow

 OpenFlow                     : Enabled
 Egress Only Ports Mode       : Disabled

 Instance Information

                                                 No. of     No. of     OpenFlow
  Instance Name                     Oper. Status H/W Flows  S/W Flows  Version
  --------------------------------- ------------ ---------- ---------- --------
  aggregate                         Up           259        0          1.3 only

aruba-05(config)# show openflow flow-table

 Flow Table Information

                                         Refresh
                                  Max.   Rate      Flow
 Table Name                       Usage  (seconds) Count
 -------------------------------- ------ --------- -----
 IP Control Table                 50%    12        0
 Policy Engine Table              50%    20        1818326388

          IP Control Table   Policy Engine Table
 Slot ID  Current Usage (%)  Current Usage (%)
 -------- -----------------  -------------------
 1         0.000000           1.67
 Note: Current usage is percentage of OpenFlow maximum usage

aruba-05(config)# show openflow instance aggregate

 Configured OF Version         : 1.3 only
 Negotiated OF Version         : 1.3
 Instance Name                 : aggregate
 Data-path Description         : aggregate
 Administrator Status          : Enabled
 Member List                   : VLAN 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36,
 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, [...] 1954, 1955, 1956, 1957, 1958, 1959, 1960, 1961, 1962, 1963, 1964, 1965, 1966, 1967, 1968, 1969, 1970, 1971, 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, 1981,
 1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009,
 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, 2023, 2024, 2025, 2026, 2027, 2028, 2029, 2030, 2031, 2032, 2033, 2034, 2035, 2036, 2037,
 2038, 2039, 2040, 2041, 2042, 2043, 2044, 2045, 2046, 2047
 Pipeline Model                : Custom
 Listen Port                   : None
 Operational Status            : Up
 Operational Status Reason     : NA
 Datapath ID                   : 0001883a30c88040
 Mode                          : Active
 Flow Location                 : Hardware Only
 No. of Hardware Flows         : 259
 No. of Software Flows         : 0
 Hardware Rate Limit           : 0 kbps
 Software Rate Limit           : 100 pps
 Conn. Interrupt Mode          : Fail-Secure
 Maximum Backoff Interval      : 10 seconds
 Probe Interval                : 10 seconds
 Hardware Table Miss Count     : NA
 No. of Software Flow Tables   : NA
 Egress Only Ports             : None
 Table Model                   : Custom Pipeline
 Source MAC Group Table        : Disabled
 Destination MAC Group Table   : Disabled
 Default Miss Action           : Drop
 Packet-In VLAN Tagging        : Input Form

 Controller Id Connection Status Connection State Secure Role
 ------------- ----------------- ---------------- ------ ------
 1             Connected         Active           No     Equal

aruba-05(config)# show openflow instance aggregate flow-table

 OpenFlow Instance Flow Table Information

 Table                       Flow     Miss
 ID    Table Name            Count    Count         Goto Table
 ----- --------------------- -------- ------------- -------------
 0     vlan                  8        1             1
 1     eth_src               53       0             2, 3, 4, 5
 2     ipv6_fib              65       0             3, 4, 5
 3     vip                   48       0             4, 5
 4     eth_dst               1        0             *
 5     flood                 84       0             *


 Table
 ID    Table Name            Available Free Flow Count
 ----- --------------------- ------------------------------
 0     vlan                   Ports 1-52          : 57

 1     eth_src                Ports 1-52          : 44

 2     ipv6_fib               Ports 1-52          : 0

 3     vip                    Ports 1-52          : 113

 4     eth_dst                Ports 1-52          : 153

 5     flood                  Ports 1-52          : 77


 * Denotes that the pipeline could end here.

And here is the faucet.log containing the error message:

Jan 22 21:21:34 faucet INFO     version 1.10.10
Jan 22 21:21:34 faucet INFO     Reloading configuration
Jan 22 21:21:34 faucet INFO     configuration /etc/faucet/faucet-aruba.yaml changed, analyzing differences
Jan 22 21:21:34 faucet INFO     Add new datapath DPID 431258484637760 (0x1883a30c88040)
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN mgmt-wan vid:20  with VIPs ['2001:0:db8:10:172:16:0:254/
64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotea01-wan vid:21  with VIPs ['2001:0:db8:11:172:16:1
:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotea02-wan vid:22  with VIPs ['2001:0:db8:12:172:16:2:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remoteb01-wan vid:23  with VIPs ['2001:0:db8:13:172:16:3:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remoteb02-wan vid:24  with VIPs ['2001:0:db8:14:172:16:4:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotec01-wan vid:25  with VIPs ['2001:0:db8:15:172:16:5:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotec02-wan vid:26  with VIPs ['2001:0:db8:16:172:16:6:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN rz01-wan vid:27  with VIPs ['2001:0:db8:17:172:17:7:254/64']
Jan 22 21:21:34 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN rz02-wan vid:28  with VIPs ['2001:0:db8:18:172:18:8:254/64']
Jan 22 21:21:35 faucet ERROR    <os_ken.controller.ofp_event.EventOFPSwitchFeatures object at 0x7f6ed930cdc0>: unknown datapath DPID 444618604606656 (0x19460d5fcf4c0)
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 port desc stats
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 delta in known ports: conf {49} dyn {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 50, 51, 52}
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 delta in up state: set() => {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 49, 4294967294}
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 1 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 2 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 3 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 4 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 5 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 6 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 7 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 8 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 9 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 10 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 11 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 12 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 13 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 14 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 15 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 16 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 fabricating ADD status True
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 status change: Port 49 up status True reason ADD state 0
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 (49) up
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-red-transfer vid:85 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-red-transfer vid:86 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-red-transfer vid:84 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-red-transfer vid:10 untagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-red-transfer vid:82 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-red-transfer vid:81 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-red-transfer vid:83 tagged: Port 49
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 send_flow_msgs: DP not up
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Cold start configuring DP
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 (49) configured
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-red-transfer vid:10 untagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-wan vid:20
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-wan vid:21
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-wan vid:22
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-wan vid:23
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-wan vid:24
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-wan vid:25
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-wan vid:26
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN rz01-wan vid:27
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN rz02-wan vid:28
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-red-transfer vid:81 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-red-transfer vid:82 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-red-transfer vid:83 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-red-transfer vid:84 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-red-transfer vid:85 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-red-transfer vid:86 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO     DPID 431258484637760 (0x1883a30c88040) aruba-05 table ID 0 table config match_types: (('eth_dst', True), ('eth_type', False), ('in_port', False), ('vlan_vid', False)) name: vlan next_tables: ['eth_src'] output: True set_fields: ('vlan_vid',) size: 64 vlan_port_scale: 3
table ID 1 table config match_types: (('eth_dst', True), ('eth_src', False), ('eth_type', False), ('in_port', False), ('vlan_vid', False)) miss_goto: eth_dst name: eth_src next_tables: ['ipv6_fib', 'vip', 'eth_dst', 'flood'] output: True set_fields: ('vlan_vid', 'eth_dst') size: 96 table_id: 1 vlan_port_scale: 4.1
table ID 2 table config dec_ttl: True match_types: (('eth_type', False), ('ipv6_dst', True), ('vlan_vid', False)) name: ipv6_fib next_tables: ['vip', 'eth_dst', 'flood'] output: True set_fields: ('eth_dst', 'eth_src', 'vlan_vid') size: 64 table_id: 2 vlan_port_scale: 3.1
table ID 3 table config match_types: (('arp_tpa', False), ('eth_dst', False), ('eth_type', False), ('icmpv6_type', False), ('ip_proto', False)) name: vip next_tables: ['eth_dst', 'flood'] output: True size: 160 table_id: 3 vlan_scale: 8
table ID 4 table config exact_match: True match_types: (('eth_dst', False), ('vlan_vid', False)) miss_goto: flood name: eth_dst output: True size: 96 table_id: 4 vlan_port_scale: 4.1
table ID 5 table config match_types: (('eth_dst', True), ('in_port', False), ('vlan_vid', False)) name: flood output: True size: 160 table_id: 5 vlan_port_scale: 8.0
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a714,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x14\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x17'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a715,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x15\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x19'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a716,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x16\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1a'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a717,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x17\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x16'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a718,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x18\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x14'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a719,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x19\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1b'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a71a,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x1a\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1c'),type=5)
Jan 22 21:21:35 faucet.valve ERROR    DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a71b,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x1b\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x18'),type=5)
[...]
There are a lot more of these error messages in the log. The "unknown datapath" message is from another switch, whose faucet config I erased, so you can ignore those.

And here is the corresponding faucet config:

---
vlans:
    mgmt-wan:
        vid: 20
        faucet_mac: "0e:00:00:22:10:00"
        faucet_vips:
            - '2001:0:db8:10:172:16:0:254/64'
    remotea01-wan:
        vid: 21
        faucet_mac: "0e:00:00:22:11:00"
        faucet_vips:
            - '2001:0:db8:11:172:16:1:254/64'
    remotea02-wan:
        vid: 22
        faucet_mac: "0e:00:00:22:12:00"
        faucet_vips:
            - '2001:0:db8:12:172:16:2:254/64'
    remoteb01-wan:
        vid: 23
        faucet_mac: "0e:00:00:22:13:00"
        faucet_vips:
            - '2001:0:db8:13:172:16:3:254/64'
    remoteb02-wan:
        vid: 24
        faucet_mac: "0e:00:00:22:14:00"
        faucet_vips:
            - '2001:0:db8:14:172:16:4:254/64'
    remotec01-wan:
        vid: 25
        faucet_mac: "0e:00:00:22:15:00"
        faucet_vips:
            - '2001:0:db8:15:172:16:5:254/64'
    remotec02-wan:
        vid: 26
        faucet_mac: "0e:00:00:22:16:00"
        faucet_vips:
            - '2001:0:db8:16:172:16:6:254/64'
    rz01-wan:
        vid: 27
        faucet_mac: "0e:00:00:22:17:00"
        faucet_vips:
            - '2001:0:db8:17:172:17:7:254/64'
    rz02-wan:
        vid: 28
        faucet_mac: "0e:00:00:22:18:00"
        faucet_vips:
            - '2001:0:db8:18:172:18:8:254/64'

    mgmt-red-transfer:
        vid: 10
        faucet_mac: "0e:00:00:22:20:00"
    remotea01-red-transfer:
        vid: 81
        faucet_mac: "0e:00:00:22:21:00"
    remotea02-red-transfer:
        vid: 82
        faucet_mac: "0e:00:00:22:22:00"
    remoteb01-red-transfer:
        vid: 83
        faucet_mac: "0e:00:00:22:23:00"
    remoteb02-red-transfer:
        vid: 84
        faucet_mac: "0e:00:00:22:24:00"
    remotec01-red-transfer:
        vid: 85
        faucet_mac: "0e:00:00:22:25:00"
    remotec02-red-transfer:
        vid: 86
        faucet_mac: "0e:00:00:22:26:00"

routers:
    router-wan:
        vlans: [mgmt-wan, remotea01-wan, remotea02-wan, remoteb01-wan, remoteb02-wan, remotec01-wan, remotec02-wan, rz01-wan, rz02-wan]

dps:
    aruba-05:
        dp_id: 0x0001883a30c88040
        hardware: "Aruba"
        interfaces:
            49:
                native_vlan: mgmt-red-transfer
                tagged_vlans: [remotea01-red-transfer, remotea02-red-transfer, remoteb01-red-transfer, remoteb02-red-transfer, remotec01-red-transfer, remotec02-red-transfer]

I have also tried to "play around" with the setting port_table_scale_factor but I didn't know which values are sensible and testing some values didn't seem to make any difference, as the errors still occured.

Thanks in advance for your help!

[gizmoguy]

The error seems to indicate one of your openflow tables is full on the switch, you can manually adjust the size of the tables with the folllowing configuration to see if you can clear the error:

dps:
    aruba-05:
        dp_id: 0x0001883a30c88040
        hardware: "Aruba"
        table_sizes:
            eth_dst: 1024
            eth_src: 1024
            flood: 512
            port_acl: 256
            vlan: 512

If that doesn't help you can enable debug mode on the aruba which will give you a better error message about why the error is occurring:

https://docs.faucet.nz/en/latest/vendors/hpe/README_Aruba.html#debug

[d-patch]

Unfortunately, that didn't seem to help. But when I remove the "routers" section in the config and restart faucet, the errors disappear and everything seems to work. Strange.

[anarkiwi]

I don't believe HPE support the dec TTL action, which we need to implement routing. Also, most hardware OF switches don't completely local disable VLAN processing. It would be ideal if they did, but generally they do not. At the end of the day Faucet can only program what the vendor implementation permits it to.

[anarkiwi]

https://docs.faucet.nz/en/latest/vendors/hpe/README_Aruba.html#debug will decode those errors for you. OpenFlow error messages don't have much scope for reason - as @gizmoguy mentioned, the switch is reporting out of resources. You'll have to enable debug on the Aruba to see why it says that. Fortunately its debug is very verbose and should explain what resource its lacking, which in turn will give you a clue about which table could be expanded - if possible.