| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | |||||||||||||||
2 | |||||||||||||||
3 | Test Cases List - http://doc.dpdk.org/guides/nics/overview.html | Total Missing Features: | 20 | ||||||||||||
4 | Git Tree - http://git.dpdk.org/tools/dts/tree/test_plans/ | Total UNH Finished Features: | 9 | ||||||||||||
5 | Testpmd Guide - https://doc.dpdk.org/guides/testpmd_app_ug/index.html | UNH Percent Complete: | 45 | ||||||||||||
6 | 85.92% | 85.92% | 85.92% | ||||||||||||
7 | Working: 40 | Test Coverage: 14.5 | Remaining: 10 | Remaining: 10 | Remaining: 10 | ||||||||||
8 | NIC Feature | Status at Start | Verified Status | Status Comment | Current Status | Tested on Intel | Tested on Broadcom | Tested on Mellanox | Deployed to CI | Objective | Related Test Case/Related Test Plan | Merged Into DTS | Patch Submitted | Finished Development | Assigned to |
9 | Link status | Exists | Exists | check link status at dpdk side is not cover. | Done | Yes | Check whether or not we can simulate connection in testpmd with stop/start port. | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
10 | MTU update | Does Not Exist | Exists | similiar test in tests/TestSuite_jumboframes.py/ test_jumboframes_bigger_jumbo(self) | Submitted and merged | Yes | Yes | Yes | Test whether we can set MTU value in testpmd and have it keep config. | tests/TestSuite_mtu_update.py test_plans/mtu_update_test_plan.rst | 6/19/2020 | 6/16/2020 | 6/16/2020 | Owen | |
11 | Promiscuous mode | Does Not Exist | Exists | Done | Yes | Yes | Whether we can receive packets with promiscuous mode on/off if packets are sent to different ports. | tests/TestSuite_dynamic_config.py test_plans/dynamic_config_test_plan.rs | Existed at Start | Existed at Start | Existed at Start | David | |||
12 | Hardware Checksum | Does Not Exist | Exists | Submitted for patch | Yes | FAILED: 'IP/UDP checksum error,IP/TCP checksum error,IP/SCTP checksum error' on production Intel 40G | Sending packets with good/bad IP checksum with good/bad UDP/TCP checksum. | tests/TestSuite_checksum_offload.py test_plans/checksum_offload_test_plan.rst | Waiting for DTS view | V1: 6/29/2020, V2: 7/20 | 6/29/2020 | Owen | |||
13 | Jumbo frame | Exists | Exists | Done | Yes | FAILED: 'packet pass assert error' on production Intel 40G | Port is able to receive jumbo frame packets that are larger than the standard maximum frame packet size. | tests/TestSuite_jumboframes.py test_plans/jumboframes_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
14 | Link status event | Exists | Exists | Link status update error when try to bring port down | Done | Yes | Test whether we can set link status in testpmd and have it keep config.Then check if packets can be received and sent. | tests/TestSuite_link_status_interrupt.py test_plans/link_status_interrupt_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
15 | Speed capabilities | Does Not Exist | Exists | Done, Waiting for testpmd update to access correct variable | Submitted and merged | Yes | tests/ test_plans/ | 7/20/2020 | 7/15/2020 | 7/7/2020 | Dan | ||||
16 | Removal event | Does Not Exist | No plan to implement | No Plan to Impliment | tests/ test_plans/ | N/A | N/A | N/A | |||||||
17 | Queue status event | Not Implimented | No plan to implement | Not widely implemented in the in NICs | No Plan to Impliment | tests/ test_plans/ | N/A | N/A | N/A | David | |||||
18 | Rx interrupt | Existed for iavf | Not Implimented | Not Started | tests/TestSuite_iavf.py test_plans/iavf_test_plan.rst | Dan | |||||||||
19 | Lock-free Tx queue | Not Implimented | No plan to implement | I spent several hours looking but was unable to find an application which used this capability. | No Plan to Impliment | tests/TestSuite_lock_free_tx_queue.py test_plans/lock_free_tx_queue_test_plan.rst | N/A | N/A | N/A | ||||||
20 | Fast mbuf free | Exists | Exists | Exists as c file test inside of the test suite, looks like it covers needs | Done | Yes | Yes | tests/TestSuite_unit_tests_mbuf.py test_plans/unit_tests_mbuf.rst | Existed at Start | Existed at Start | Existed at Start | ||||
21 | Free Tx mbuf on demand | Exists | Exists | Exists as c file test inside of the test suite, looks like it covers needs | Done | Yes | Yes | tests/TestSuite_unit_tests_mbuf.py test_plans/unit_tests_mbuf.rst | Existed at Start | Existed at Start | Existed at Start | ||||
22 | Queue start/stop | Exists | Exists | Done | Yes | Yes | Check whether or not we can simulate stop/start queue in testpmd. Thomas - interested in seeing re-starting of a queue during the test, slava@mellanox | tests/TestSuite_queue_start_stop.py test_plans/queue_start_stop_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
23 | Runtime Rx queue setup | Exists | Does not exist | Done | Yes | Yes | Check if stopped Rx queues will not receive packets and other will receive packets. | tests/TestSuite_dynamic_queue.py test_plans/dynamic_queue_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
24 | Runtime Tx queue setup | Exists | Does not exist | Done | Yes | Yes | Check if stopped Tx queues will transmit setted packets and other will transmit more than setted packets. | tests/TestSuite_dynamic_queue.py test_plans/dynamic_queue_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
25 | Burst mode info | Does Not Exist | No plan to implement | No Plan to Impliment | tests/TestSuite_burst_mode_info.py test_plans/burst_mode_info_test_plan.rst | N/A | N/A | N/A | |||||||
26 | Scattered Rx | Exists | Exists | Done | Yes | Yes | tests/TestSuite_scatter.py test_plans/scatter_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||||
27 | LRO | Exists | Exists | Stalled due to lack of NIC support and lack of information from testpmd | Hold | tests/TestSuite_rxtx_offload.py test_plans/rxtx_offload_test_plan.rst | N/A | N/A | N/A | Owen | |||||
28 | TSO | Exists | Exists | Done | Yes | FAILED: "the packet segmentation incorrect, [' 800', ' 100', ' 800']" on production Intel 40G | TSO is Transmit Segmentation Offload when sending data that is greater than the MTU size. The NIC will divide the data into smaller ones according to the MTU size. | tests/TestSuite_tso.py test_plans/tso_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
29 | Allmulticast mode | Exists | Exists | Done | Yes | FAILED: 'Wrong Rx bytes p1_rx=272, expect=256' on production Intel 40G | Verify rx and tx can send packet to specific set of mac addr and the rest of mac addr? | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
30 | Unicast MAC filter | Exists | Exists | Done | Yes | Needs config file | Verify rx and tx can send packet with specific mac addr. | tests/TestSuite_iavf.py test_plans/iavf_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
31 | Multicast MAC filter | Does Not Exist | Exists | Submitted and merged | Yes | Yes | Verify rx and tx can send packet to specific set of mac addr. | tests/TestSuite_mac_filter.py test_plans/mac_filter_test_plan.rst | 7/24/2020 | 7/16/2020 | 7/14/2020 | Owen | |||
32 | RSS hash | Exists | Exists | Error on number of mbufs to be allocated in the mbuf pools, change way pmd is call fix this | Done | Yes | FAILED: 'No packet received!' on production Intel 40G | Balancing the incoming packets from NIC port to multiple RX queues. | tests/TestSuite_pmdrss_hash.py test_plans/pmdrss_hash_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||
33 | RSS key update | Does Not Exist | Does Not Exist | Submitted and merged | Yes | Help make RSS more flexible. | tests/TestSuite_rss_key_update.py test_plans/rss_key_update_test_plan.rst | 8/11/2020 | 7/15/2020 | 7/15/2020 | David | ||||
34 | RSS reta update | Exists | Exists | Error on 16 queue case, call pmd with default fix this | Done | Yes | Help make RSS more flexible. | tests/TestSuite_pmdrssreta.py test_plans/pmdrssreta_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||
35 | Inner RSS Hash | Does Not Exist | No plan to implement | Not widely implemented in the in NICs | No Plan to Impliment | Supports RX RSS hashing on Inner headers. | tests/TestSuite_pmdrss_hash.py test_plans/pmdrss_hash_test_plan.rst | N/A | N/A | N/A | David | ||||
36 | VMDq | Exists | Exists | Done | Yes | Filtering functions splitting incoming packets and distribute to among of RX queues that are available. | tests/TestSuite_vmdq.py test_plans/vmdq_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||||
37 | SR-IOV | Does Not Exist | Does not exist | Not Started | tests/ test_plans/ | ||||||||||
38 | DCB | Exists | Exists | Done | Yes | tests/TestSuite_vmdq_dcb.py test_plans/vmdq_dcb_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
39 | VLAN filter | Exists | Exists | Done | Yes | tests/TestSuite_vlan_ethertype_config.py test_plans/vlan_ethertype_config_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
40 | Flow API | Exists | Exists | Done | Yes | tests/TestSuite_generic_flow_api.py test_plans/generic_flow_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
41 | Rate limitation | Does Not Exist | Does not exist | Development paused due to lack of support | Hold | Yes | Supports Tx rate limitation for a queue. | tests/ test_plans/ | N/A | N/A | N/A | ||||
42 | Traffic mirroring | Does Not Exist | Does not exist | Not Started | Supports adding traffic mirroring rules. | tests/TestSuite_sriov_kvm.py test_plans/sriov_kvm_test_plan.rst | |||||||||
43 | Inline crypto | Does Not Exist | Does not exist | Not Started | tests/ test_plans/ | ||||||||||
44 | Inline protocol | Does Not Exist | Does not exist | Not Started | tests/ test_plans/ | ||||||||||
45 | CRC offload | Exists | Exists | Sub test case of shutdown api, passed but the shutdown api has error | Done | Yes | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||||
46 | VLAN offload | Exists | Exists | Done | Yes | tests/TestSuite_vlan.py test_plans/vlan_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
47 | QinQ offload | Exists | Exists | "Test Case test_qinq_filter_PF_queues Result FAILED". Update 8/11: The test fails because i40e doesn't support the filter being applied, it gives the error message: "i40e_dev_consistent_tunnel_filter_set(): Failed to add a tunnel filter. port_flow_complain(): Caught PMD error type 2 (flow rule (handle)): Failed to create flow.: Operation not supported". I am also getting another failing test case, test_qinq_packet_filter_VF_queues, because the vf config doesn't apply. I didn't get an error message as concrete as the other test, but it looks like this is probably a similar issue with the driver not being supported since the port info that is returned contains an empty string for the portion that should contains the vf_list. | Broken | tests/TestSuite_qinq_filter.py test_plans/qinq_filter_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
48 | L3 checksum offload | Exists | Exists | Done | Yes | tests/TestSuite_checksum_offload.py test_plans/checksum_offload_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
49 | L4 checksum offload | Exists | Exists | Done | Yes | tests/TestSuite_checksum_offload.py test_plans/checksum_offload_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
50 | Timestamp offload | Does Not Exist | No plan to implement | Not widely implemented in the in NICs | Not Started | tests/ test_plans/ | |||||||||
51 | MACsec offload | Exists for ixgbe | Not Implimented | Not Started | tests/TestSuite_macsec_for_ixgbe.py test_plans/macsec_for_ixgbe_test_plan.rst | ||||||||||
52 | Inner L3 checksum | Does Not Exist | Exists | Submitted for patch | Yes | tests/TestSuite_checksum_offload.py test_plans/checksum_offload_test_plan.rst | 8/11/2020 | V1: 6/29/2020, V2: 7/20 | 7/20/2020 | Owen | |||||
53 | Inner L4 checksum | Does Not Exist | Exists | Submitted for patch | Yes | tests/TestSuite_checksum_offload.py test_plans/checksum_offload_test_plan.rst | 8/11/2020 | V1: 6/29/2020, V2: 7/20 | 7/20/2020 | Owen | |||||
54 | Packet type parsing | Exists | Exists | Done | Yes | tests/TestSuite_ptype_mapping.py test_plans/ptype_mapping_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
55 | Timesync | Exists | Exists | Done | Yes | tests/TestSuite_ieee1588.py test_plans/ieee1588_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
56 | Rx descriptor status | Exists | Exists | Done | Yes | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
57 | Tx descriptor status | Exists | Exists | Done | Yes | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
58 | Basic stats | Does Not Exist | Exists | Submitted for patch and merged | Submitted and merged | Yes | Yes | tests/TestSuite_shutdown_api.py test_plans/shutdown_api_test_plan.rst | 6/19/2020 | 6/16/2020 | 6/16/2020 | Owen | |||
59 | Extended stats - Ethtool | Exists | Exists | Failure on test case test_xstat_single_statistic | Broken | tests/TestSuit_ethtool_stats.py test_plans/ethtool_stats_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
60 | Extended stats - testpmd | Exists | Exists | Looks like this is together with the Extended stats - Ethtool test case | Broken | tests/TestSuite_ethtool_stats.py test_plans/ethtool_stats_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
61 | Stats per queue | Not implemented in testpmd | No plan to implement | I was unable to find any way to even access this functionality directly in testpmd. It seems that it is only used as side effects of other commands. | No plan to implement | tests/ test_plans/ | N/A | N/A | N/A | ||||||
62 | FW version | Not implemented in testpmd | Exists | I don't know if it's a bug or what, but it doesn't show up in testpmd when using "show port info", despite app/test-pmd/config.c::port_infos_display(portid_t port_id) printing it. | Submitted and merged | tests/TestSuite_firmware_version.py test_plans/firmware_version_test_plan.rst | 8/20/2020 | 8/12/2020 | 8/12/2020 | David | |||||
63 | EEPROM dump | Exists | Exists | Exists using EthApp tool | Done | Yes | tests/TestPlan_userspace_ethtool.py test_plans/userspace_ethtool_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||||
64 | Module EEPROM dump | Does Not Exist | Does Not Exist | Should use ethapp and "module-eeprom <port_id> <filename>". Using EthApp, got error "i40e_get_module_info(): Module EEPROM memory read not supported. Please update the NVM image." even though feature table lists it as supported | Started | Yes | tests/ test_plans/ | ||||||||
65 | Registers dump | Exists | Exists | Done | Yes | tests/TestPlan_userspace_ethtool.py test_plans/userspace_ethtool_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
66 | LED | Not implemented in testpmd | No plan to implement | I can't see any implementation in any anything I can interface with through python, although I do see the API function. | No plan to implement | tests/ test_plans/ | N/A | N/A | N/A | ||||||
67 | Multiprocess aware | Exists | Exists | Done | Yes | tests/TestPlan_multiprocess.py test_plans/multiprocess_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
68 | Usage doc | Not Testable | Exists | It's not possible to test this automatically | Not Started | tests/ test_plans/ | N/A | N/A | N/A | ||||||
69 | Design doc | Not Testable | Exists | It's not possible to test this automatically | Not Started | tests/ test_plans/ | N/A | N/A | N/A | ||||||
70 | Perf doc | Not Testable | Exists | It's not possible to test this automatically | Not Started | tests/ test_plans/ | N/A | N/A | N/A | ||||||
71 | Idem with Multicast Packets | Does Not Exist | In development | Started | tests/ test_plans/ | In development | In development | In development | Dan | ||||||
72 | RSS Checks | Exists | Exists | RSS Key Update/RSS Reta Update/RSS Hash/Inner RSS Hash | Done | tests/TestSuite_pmdrss_hash.py test_plans/pmdrss_hash_test_plan.rst | |||||||||
73 | Ptypes classification | Exists | Exists | Looks like it is similar to the Packet type parsing test | Not Started | tests/ test_plans/ | Existed at Start | Existed at Start | Existed at Start | ||||||
74 | rte_flow checks | Exists | Not Implimented | Looks like this is used by the Flow API test case which exists and the Inner RSS test case which doesn't exist and will not be implemented | Not Implimented | tests/ test_plans/ | N/A | N/A | N/A | ||||||
75 | Port restart checks | Exists | Exists | This seems similar to what TestSuite_port_control.py has | Done | tests/TestSuite_port_control.py test_plans/port_control_test_plan.rst | |||||||||
76 | Flow control | Exists | Exists | Confirm control / configuration / active status of Flow control on the NIC, based on the discussions around the Speed Capabiltieis test case. | Done | Yes | tests/TestSuite_link_flowctrl.py test_plans/link_flowctrl_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | |||||
77 | rx/tx offloads | Exists | Exists | Done | Yes | tests/TestSuite_rxtx_offload.py test_plans/rxtx_offload_test_plan.rst | Existed at Start | Existed at Start | Existed at Start | ||||||
78 | Linux VFIO | Does Not Exist | Does Not Exist | Started | Yes | tests/TestSuite_linux_modules.py test_plans/linux_modules_test_plan.rst | 8/11/2020 | 8/5/2020 | 8/4/2020 | Owen | |||||
79 | Linux UIO | Does Not Exist | Does Not Exist | Started | Yes | tests/TestSuite_linux_modules.py test_plans/linux_modules_test_plan.rst | 8/11/2020 | 8/5/2020 | 8/4/2020 | Owen | |||||
80 | |||||||||||||||
81 | |||||||||||||||
82 | |||||||||||||||
83 | |||||||||||||||
84 | |||||||||||||||
85 | |||||||||||||||
86 | |||||||||||||||
87 | |||||||||||||||
88 | |||||||||||||||
89 | |||||||||||||||
90 | |||||||||||||||
91 | |||||||||||||||
92 | |||||||||||||||
93 | |||||||||||||||
94 | |||||||||||||||
95 | |||||||||||||||
96 | |||||||||||||||
97 | |||||||||||||||
98 | |||||||||||||||
99 | |||||||||||||||
100 | |||||||||||||||