[Oct 13 21:05:34 2020]: ====================================================================== | IBERT Test - r5v2 | | | | Hub1 SN: Hub2 SN: | ====================================================================== [Oct 13 21:05:34 2020]: Cards in use: +--------+--------------+------------+----------------+--------------+---------------+ | Card | Connhub ID | Serial # | Slot Address | FW Version | FW Revision | +========+==============+============+================+==============+===============+ | hub1 | HUB14 | 14 | 193 | 2 | 3 | +--------+--------------+------------+----------------+--------------+---------------+ | hub2 | HUB05 | 5 | 194 | 2 | 3 | +--------+--------------+------------+----------------+--------------+---------------+ | rod1 | ROD2 | 0 | 0 | 0 | 10 | +--------+--------------+------------+----------------+--------------+---------------+ | htm3 | HTM01 | 1 | 67 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm4 | HTM17 | 17 | 196 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm5 | HTM18 | 18 | 69 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm6 | HTM15 | 15 | 70 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm7 | HTM04 | 4 | 199 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm8 | HTM12 | 12 | 200 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm9 | HTM03 | 3 | 73 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm10 | HTM13 | 13 | 74 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm11 | HTM07 | 10 | 203 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm12 | HTM06 | 6 | 76 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm13 | HTM09 | 9 | 205 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ | htm14 | HTM08 | 8 | 206 | 2 | 1 | +--------+--------------+------------+----------------+--------------+---------------+ [Oct 13 21:05:34 2020]: Links being tested: Hub1 Readout Aurora Lane 0 to Hub2 Hub1 Readout Aurora Lane 1 to Hub2 Hub1 Readout Aurora Lane 0 to ROD1 Hub1 Readout Aurora Lane 1 Unrouted Hub2 Readout Aurora Lane 0 to Hub1 Hub2 Readout Aurora Lane 1 to Hub1 Hub2 Readout Aurora Lane 0 to ROD1 Hub2 Readout Aurora Lane 1 Unrouted Hub1 Combined Data to FEX 03 Hub1 Combined Data to FEX 04 Hub1 Combined Data to FEX 05 Hub1 Combined Data to FEX 06 Hub1 Combined Data to FEX 07 Hub1 Combined Data to FEX 08 Hub1 Combined Data to FEX 09 Hub1 Combined Data to FEX 10 Hub1 Combined Data to FEX 11 Hub1 Combined Data to FEX 12 Hub1 Combined Data to FEX 13 Hub1 Combined Data to FEX 14 Hub1 Combined Data to Hub2 Hub2 Combined Data to FEX 03 Hub2 Combined Data to FEX 04 Hub2 Combined Data to FEX 05 Hub2 Combined Data to FEX 06 Hub2 Combined Data to FEX 07 Hub2 Combined Data to FEX 08 Hub2 Combined Data to FEX 09 Hub2 Combined Data to FEX 10 Hub2 Combined Data to FEX 11 Hub2 Combined Data to FEX 12 Hub2 Combined Data to FEX 13 Hub2 Combined Data to FEX 14 Hub2 Combined Data to Hub1 HTM3 FEX Data Lane 0 to Hub1 HTM3 FEX Data Lane 1 to Hub1 HTM3 FEX Data Lane 2 to Hub1 HTM3 FEX Data Lane 3 to Hub1 HTM3 FEX Data Lane 4 to Hub1 HTM3 FEX Data Lane 5 to Hub1 HTM3 FEX Data Lane 0 to Hub2 HTM3 FEX Data Lane 1 to Hub2 HTM3 FEX Data Lane 2 to Hub2 HTM3 FEX Data Lane 3 to Hub2 HTM3 FEX Data Lane 4 to Hub2 HTM3 FEX Data Lane 5 to Hub2 HTM4 FEX Data Lane 0 to Hub1 HTM4 FEX Data Lane 1 to Hub1 HTM4 FEX Data Lane 2 to Hub1 HTM4 FEX Data Lane 3 to Hub1 HTM4 FEX Data Lane 4 to Hub1 HTM4 FEX Data Lane 5 to Hub1 HTM4 FEX Data Lane 0 to Hub2 HTM4 FEX Data Lane 1 to Hub2 HTM4 FEX Data Lane 2 to Hub2 HTM4 FEX Data Lane 3 to Hub2 HTM4 FEX Data Lane 4 to Hub2 HTM4 FEX Data Lane 5 to Hub2 HTM5 FEX Data Lane 0 to Hub1 HTM5 FEX Data Lane 1 to Hub1 HTM5 FEX Data Lane 2 to Hub1 HTM5 FEX Data Lane 3 to Hub1 HTM5 FEX Data Lane 4 to Hub1 HTM5 FEX Data Lane 5 to Hub1 HTM5 FEX Data Lane 0 to Hub2 HTM5 FEX Data Lane 1 to Hub2 HTM5 FEX Data Lane 2 to Hub2 HTM5 FEX Data Lane 3 to Hub2 HTM5 FEX Data Lane 4 to Hub2 HTM5 FEX Data Lane 5 to Hub2 HTM6 FEX Data Lane 0 to Hub1 HTM6 FEX Data Lane 1 to Hub1 HTM6 FEX Data Lane 2 to Hub1 HTM6 FEX Data Lane 3 to Hub1 HTM6 FEX Data Lane 4 to Hub1 HTM6 FEX Data Lane 5 to Hub1 HTM6 FEX Data Lane 0 to Hub2 HTM6 FEX Data Lane 1 to Hub2 HTM6 FEX Data Lane 2 to Hub2 HTM6 FEX Data Lane 3 to Hub2 HTM6 FEX Data Lane 4 to Hub2 HTM6 FEX Data Lane 5 to Hub2 HTM7 FEX Data Lane 0 to Hub1 HTM7 FEX Data Lane 1 to Hub1 HTM7 FEX Data Lane 2 to Hub1 HTM7 FEX Data Lane 3 to Hub1 HTM7 FEX Data Lane 4 to Hub1 HTM7 FEX Data Lane 5 to Hub1 HTM7 FEX Data Lane 0 to Hub2 HTM7 FEX Data Lane 1 to Hub2 HTM7 FEX Data Lane 2 to Hub2 HTM7 FEX Data Lane 3 to Hub2 HTM7 FEX Data Lane 4 to Hub2 HTM7 FEX Data Lane 5 to Hub2 HTM8 FEX Data Lane 0 to Hub1 HTM8 FEX Data Lane 1 to Hub1 HTM8 FEX Data Lane 2 to Hub1 HTM8 FEX Data Lane 3 to Hub1 HTM8 FEX Data Lane 4 to Hub1 HTM8 FEX Data Lane 5 to Hub1 HTM8 FEX Data Lane 0 to Hub2 HTM8 FEX Data Lane 1 to Hub2 HTM8 FEX Data Lane 2 to Hub2 HTM8 FEX Data Lane 3 to Hub2 HTM8 FEX Data Lane 4 to Hub2 HTM8 FEX Data Lane 5 to Hub2 HTM9 FEX Data Lane 0 to Hub1 HTM9 FEX Data Lane 1 to Hub1 HTM9 FEX Data Lane 2 to Hub1 HTM9 FEX Data Lane 3 to Hub1 HTM9 FEX Data Lane 4 to Hub1 HTM9 FEX Data Lane 5 to Hub1 HTM9 FEX Data Lane 0 to Hub2 HTM9 FEX Data Lane 1 to Hub2 HTM9 FEX Data Lane 2 to Hub2 HTM9 FEX Data Lane 3 to Hub2 HTM9 FEX Data Lane 4 to Hub2 HTM9 FEX Data Lane 5 to Hub2 HTM10 FEX Data Lane 0 to Hub1 HTM10 FEX Data Lane 1 to Hub1 HTM10 FEX Data Lane 2 to Hub1 HTM10 FEX Data Lane 3 to Hub1 HTM10 FEX Data Lane 4 to Hub1 HTM10 FEX Data Lane 5 to Hub1 HTM10 FEX Data Lane 0 to Hub2 HTM10 FEX Data Lane 1 to Hub2 HTM10 FEX Data Lane 2 to Hub2 HTM10 FEX Data Lane 3 to Hub2 HTM10 FEX Data Lane 4 to Hub2 HTM10 FEX Data Lane 5 to Hub2 HTM11 FEX Data Lane 0 to Hub1 HTM11 FEX Data Lane 1 to Hub1 HTM11 FEX Data Lane 2 to Hub1 HTM11 FEX Data Lane 3 to Hub1 HTM11 FEX Data Lane 4 to Hub1 HTM11 FEX Data Lane 5 to Hub1 HTM11 FEX Data Lane 0 to Hub2 HTM11 FEX Data Lane 1 to Hub2 HTM11 FEX Data Lane 2 to Hub2 HTM11 FEX Data Lane 3 to Hub2 HTM11 FEX Data Lane 4 to Hub2 HTM11 FEX Data Lane 5 to Hub2 HTM12 FEX Data Lane 0 to Hub1 HTM12 FEX Data Lane 1 to Hub1 HTM12 FEX Data Lane 2 to Hub1 HTM12 FEX Data Lane 3 to Hub1 HTM12 FEX Data Lane 4 to Hub1 HTM12 FEX Data Lane 5 to Hub1 HTM12 FEX Data Lane 0 to Hub2 HTM12 FEX Data Lane 1 to Hub2 HTM12 FEX Data Lane 2 to Hub2 HTM12 FEX Data Lane 3 to Hub2 HTM12 FEX Data Lane 4 to Hub2 HTM12 FEX Data Lane 5 to Hub2 HTM13 FEX Data Lane 0 to Hub1 HTM13 FEX Data Lane 1 to Hub1 HTM13 FEX Data Lane 2 to Hub1 HTM13 FEX Data Lane 3 to Hub1 HTM13 FEX Data Lane 4 to Hub1 HTM13 FEX Data Lane 5 to Hub1 HTM13 FEX Data Lane 0 to Hub2 HTM13 FEX Data Lane 1 to Hub2 HTM13 FEX Data Lane 2 to Hub2 HTM13 FEX Data Lane 3 to Hub2 HTM13 FEX Data Lane 4 to Hub2 HTM13 FEX Data Lane 5 to Hub2 HTM14 FEX Data Lane 0 to Hub1 HTM14 FEX Data Lane 1 to Hub1 HTM14 FEX Data Lane 2 to Hub1 HTM14 FEX Data Lane 3 to Hub1 HTM14 FEX Data Lane 4 to Hub1 HTM14 FEX Data Lane 5 to Hub1 HTM14 FEX Data Lane 0 to Hub2 HTM14 FEX Data Lane 1 to Hub2 HTM14 FEX Data Lane 2 to Hub2 HTM14 FEX Data Lane 3 to Hub2 HTM14 FEX Data Lane 4 to Hub2 HTM14 FEX Data Lane 5 to Hub2 Hub1 TX MiniPOD Channel 0 to HTM3 RX MiniPOD Channel 11 Hub1 TX MiniPOD Channel 1 to HTM3 RX MiniPOD Channel 10 Hub1 TX MiniPOD Channel 2 to HTM3 RX MiniPOD Channel 9 Hub1 TX MiniPOD Channel 4 to HTM3 RX MiniPOD Channel 7 Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 Hub1 TX MiniPOD Channel 8 to HTM3 RX MiniPOD Channel 3 Hub1 TX MiniPOD Channel 10 to HTM3 RX MiniPOD Channel 1 Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 Hub2 TX MiniPOD Channel 0 to HTM4 RX MiniPOD Channel 11 Hub2 TX MiniPOD Channel 1 to HTM4 RX MiniPOD Channel 10 Hub2 TX MiniPOD Channel 2 to HTM4 RX MiniPOD Channel 9 Hub2 TX MiniPOD Channel 4 to HTM4 RX MiniPOD Channel 7 Hub2 TX MiniPOD Channel 6 to HTM4 RX MiniPOD Channel 5 Hub2 TX MiniPOD Channel 8 to HTM4 RX MiniPOD Channel 3 Hub2 TX MiniPOD Channel 10 to HTM4 RX MiniPOD Channel 1 Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 HTM4 TX MiniPOD Channel 0 to Hub2 RX MiniPOD Channel 2 HTM4 TX MiniPOD Channel 1 to Hub2 RX MiniPOD Channel 4 HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 HTM4 TX MiniPOD Channel 3 to Hub2 RX MiniPOD Channel 8 HTM3 FEX Data Lane 0 to ROD1 HTM3 FEX Data Lane 1 to ROD1 HTM3 FEX Data Lane 2 to ROD1 HTM3 FEX Data Lane 3 to ROD1 HTM3 FEX Data Lane 4 to ROD1 HTM3 FEX Data Lane 5 to ROD1 HTM4 FEX Data Lane 0 to ROD1 HTM4 FEX Data Lane 1 to ROD1 HTM4 FEX Data Lane 2 to ROD1 HTM4 FEX Data Lane 3 to ROD1 HTM4 FEX Data Lane 4 to ROD1 HTM4 FEX Data Lane 5 to ROD1 HTM5 FEX Data Lane 0 to ROD1 HTM5 FEX Data Lane 1 to ROD1 HTM5 FEX Data Lane 2 to ROD1 HTM5 FEX Data Lane 3 to ROD1 HTM5 FEX Data Lane 4 to ROD1 HTM5 FEX Data Lane 5 to ROD1 HTM6 FEX Data Lane 0 to ROD1 HTM6 FEX Data Lane 1 to ROD1 HTM6 FEX Data Lane 2 to ROD1 HTM6 FEX Data Lane 3 to ROD1 HTM6 FEX Data Lane 4 to ROD1 HTM6 FEX Data Lane 5 to ROD1 HTM7 FEX Data Lane 0 to ROD1 HTM7 FEX Data Lane 1 to ROD1 HTM7 FEX Data Lane 2 to ROD1 HTM7 FEX Data Lane 3 to ROD1 HTM7 FEX Data Lane 4 to ROD1 HTM7 FEX Data Lane 5 to ROD1 HTM8 FEX Data Lane 0 to ROD1 HTM8 FEX Data Lane 1 to ROD1 HTM8 FEX Data Lane 2 to ROD1 HTM8 FEX Data Lane 3 to ROD1 HTM8 FEX Data Lane 4 to ROD1 HTM8 FEX Data Lane 5 to ROD1 HTM9 FEX Data Lane 0 to ROD1 HTM9 FEX Data Lane 1 to ROD1 HTM9 FEX Data Lane 2 to ROD1 HTM9 FEX Data Lane 3 to ROD1 HTM9 FEX Data Lane 4 to ROD1 HTM9 FEX Data Lane 5 to ROD1 HTM10 FEX Data Lane 0 to ROD1 HTM10 FEX Data Lane 1 to ROD1 HTM10 FEX Data Lane 2 to ROD1 HTM10 FEX Data Lane 3 to ROD1 HTM10 FEX Data Lane 4 to ROD1 HTM10 FEX Data Lane 5 to ROD1 HTM11 FEX Data Lane 0 to ROD1 HTM11 FEX Data Lane 1 to ROD1 HTM11 FEX Data Lane 2 to ROD1 HTM11 FEX Data Lane 3 to ROD1 HTM11 FEX Data Lane 4 to ROD1 HTM11 FEX Data Lane 5 to ROD1 HTM12 FEX Data Lane 0 to ROD1 HTM12 FEX Data Lane 1 to ROD1 HTM12 FEX Data Lane 2 to ROD1 HTM12 FEX Data Lane 3 to ROD1 HTM12 FEX Data Lane 4 to ROD1 HTM12 FEX Data Lane 5 to ROD1 HTM13 FEX Data Lane 0 to ROD1 HTM13 FEX Data Lane 1 to ROD1 HTM13 FEX Data Lane 2 to ROD1 HTM13 FEX Data Lane 3 to ROD1 HTM13 FEX Data Lane 4 to ROD1 HTM13 FEX Data Lane 5 to ROD1 HTM14 FEX Data Lane 0 to ROD1 HTM14 FEX Data Lane 1 to ROD1 HTM14 FEX Data Lane 2 to ROD1 HTM14 FEX Data Lane 3 to ROD1 HTM14 FEX Data Lane 4 to ROD1 HTM14 FEX Data Lane 5 to ROD1 [Oct 13 21:05:34 2020]: ====================================================================== | Performing Initialization | ====================================================================== [Oct 13 21:05:34 2020]: Using the following initialization parameters: Per-Card Parameters: { "mgt equalizer": "OFF" } Per-Link Parameters: { "DFE": "OFF", "post-emphasis": "0", "pre-emphasis": "0", "prbs-select": "PRBS-31", "swing": "950" } [Oct 13 21:05:42 2020]: Performing TX MGT Resets ... [Oct 13 21:05:58 2020]: Performing RX MGT Resets ... [Oct 13 21:06:14 2020]: Checking Init Done Bit ... [Oct 13 21:06:14 2020]: WARNING - Init done bit is low on the following transmitters/receivers: Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | source Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | source Link: HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 | dest Checking Rxprbslocked Bit ... [Oct 13 21:06:14 2020]: WARNING - Rxprbslocked bit is low on the following Ultrascale GTH/Ultrascale GTY receivers: Link: HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 Resetting Error Counts ... [Oct 13 21:06:26 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 56891897 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 53387954 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 53322434 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 53167960 [Oct 13 21:06:26 2020]: Error Report Finished [Oct 13 21:06:26 2020]: ====================================================================== | Finding Link Routes | ====================================================================== [Oct 13 21:06:26 2020]: Links with initial errors: hub2_readout_AL_0_to_ROD1 hub1_optical_tx_ch6_to_htm3_rx_ch5 hub1_optical_tx_ch11_to_htm3_rx_ch0 hub2_optical_tx_ch11_to_htm4_rx_ch0 ---------------------------------------------------------------------- [Oct 13 21:06:27 2020]: Problematic Link Routes: [Oct 13 21:06:31 2020]: Source Link: hub1_readout_AL_1_unrouted Null - No errors found on any links [Oct 13 21:06:35 2020]: Source Link: hub2_readout_AL_0_to_ROD1 Mismatch - Error found on different link: hub2_readout_AL_0_to_hub1 [Oct 13 21:06:36 2020]: Source Link: hub2_readout_AL_1_unrouted Null - No errors found on any links [Oct 13 21:07:13 2020]: Source Link: htm3_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_0_to_hub1 htm3_FEX_data_lane_0_to_rod1 [Oct 13 21:07:14 2020]: Source Link: htm3_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_1_to_hub1 htm3_FEX_data_lane_1_to_rod1 [Oct 13 21:07:16 2020]: Source Link: htm3_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_2_to_hub1 htm3_FEX_data_lane_2_to_rod1 [Oct 13 21:07:17 2020]: Source Link: htm3_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_3_to_hub1 htm3_FEX_data_lane_3_to_rod1 [Oct 13 21:07:19 2020]: Source Link: htm3_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_4_to_hub1 htm3_FEX_data_lane_4_to_rod1 [Oct 13 21:07:20 2020]: Source Link: htm3_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_5_to_hub1 htm3_FEX_data_lane_5_to_rod1 [Oct 13 21:07:29 2020]: Source Link: htm4_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_0_to_hub1 htm4_FEX_data_lane_0_to_rod1 [Oct 13 21:07:31 2020]: Source Link: htm4_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_1_to_hub1 htm4_FEX_data_lane_1_to_rod1 [Oct 13 21:07:32 2020]: Source Link: htm4_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_2_to_hub1 htm4_FEX_data_lane_2_to_rod1 [Oct 13 21:07:34 2020]: Source Link: htm4_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_3_to_hub1 htm4_FEX_data_lane_3_to_rod1 [Oct 13 21:07:35 2020]: Source Link: htm4_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_4_to_hub1 htm4_FEX_data_lane_4_to_rod1 [Oct 13 21:07:36 2020]: Source Link: htm4_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_5_to_hub1 htm4_FEX_data_lane_5_to_rod1 [Oct 13 21:07:46 2020]: Source Link: htm5_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_0_to_hub1 htm5_FEX_data_lane_0_to_rod1 [Oct 13 21:07:47 2020]: Source Link: htm5_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_1_to_hub1 htm5_FEX_data_lane_1_to_rod1 [Oct 13 21:07:49 2020]: Source Link: htm5_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_2_to_hub1 htm5_FEX_data_lane_2_to_rod1 [Oct 13 21:07:50 2020]: Source Link: htm5_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_3_to_hub1 htm5_FEX_data_lane_3_to_rod1 [Oct 13 21:07:51 2020]: Source Link: htm5_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_4_to_hub1 htm5_FEX_data_lane_4_to_rod1 [Oct 13 21:07:53 2020]: Source Link: htm5_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_5_to_hub1 htm5_FEX_data_lane_5_to_rod1 [Oct 13 21:08:02 2020]: Source Link: htm6_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_0_to_hub1 htm6_FEX_data_lane_0_to_rod1 [Oct 13 21:08:04 2020]: Source Link: htm6_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_1_to_hub1 htm6_FEX_data_lane_1_to_rod1 [Oct 13 21:08:05 2020]: Source Link: htm6_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_2_to_hub1 htm6_FEX_data_lane_2_to_rod1 [Oct 13 21:08:07 2020]: Source Link: htm6_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_3_to_hub1 htm6_FEX_data_lane_3_to_rod1 [Oct 13 21:08:08 2020]: Source Link: htm6_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_4_to_hub1 htm6_FEX_data_lane_4_to_rod1 [Oct 13 21:08:09 2020]: Source Link: htm6_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_5_to_hub1 htm6_FEX_data_lane_5_to_rod1 [Oct 13 21:08:19 2020]: Source Link: htm7_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_0_to_hub1 htm7_FEX_data_lane_0_to_rod1 [Oct 13 21:08:20 2020]: Source Link: htm7_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_1_to_hub1 htm7_FEX_data_lane_1_to_rod1 [Oct 13 21:08:22 2020]: Source Link: htm7_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_2_to_hub1 htm7_FEX_data_lane_2_to_rod1 [Oct 13 21:08:23 2020]: Source Link: htm7_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_3_to_hub1 htm7_FEX_data_lane_3_to_rod1 [Oct 13 21:08:25 2020]: Source Link: htm7_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_4_to_hub1 htm7_FEX_data_lane_4_to_rod1 [Oct 13 21:08:26 2020]: Source Link: htm7_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_5_to_hub1 htm7_FEX_data_lane_5_to_rod1 [Oct 13 21:08:36 2020]: Source Link: htm8_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_0_to_hub1 htm8_FEX_data_lane_0_to_rod1 [Oct 13 21:08:37 2020]: Source Link: htm8_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_1_to_hub1 htm8_FEX_data_lane_1_to_rod1 [Oct 13 21:08:39 2020]: Source Link: htm8_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_2_to_hub1 htm8_FEX_data_lane_2_to_rod1 [Oct 13 21:08:40 2020]: Source Link: htm8_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_3_to_hub1 htm8_FEX_data_lane_3_to_rod1 [Oct 13 21:08:41 2020]: Source Link: htm8_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_4_to_hub1 htm8_FEX_data_lane_4_to_rod1 [Oct 13 21:08:43 2020]: Source Link: htm8_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_5_to_hub1 htm8_FEX_data_lane_5_to_rod1 [Oct 13 21:08:52 2020]: Source Link: htm9_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_0_to_hub1 htm9_FEX_data_lane_0_to_rod1 [Oct 13 21:08:54 2020]: Source Link: htm9_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_1_to_hub1 htm9_FEX_data_lane_1_to_rod1 [Oct 13 21:08:55 2020]: Source Link: htm9_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_2_to_hub1 htm9_FEX_data_lane_2_to_rod1 [Oct 13 21:08:57 2020]: Source Link: htm9_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_3_to_hub1 htm9_FEX_data_lane_3_to_rod1 [Oct 13 21:08:58 2020]: Source Link: htm9_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_4_to_hub1 htm9_FEX_data_lane_4_to_rod1 [Oct 13 21:08:59 2020]: Source Link: htm9_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_5_to_hub1 htm9_FEX_data_lane_5_to_rod1 [Oct 13 21:09:09 2020]: Source Link: htm10_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_0_to_hub1 htm10_FEX_data_lane_0_to_rod1 [Oct 13 21:09:10 2020]: Source Link: htm10_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_1_to_hub1 htm10_FEX_data_lane_1_to_rod1 [Oct 13 21:09:12 2020]: Source Link: htm10_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_2_to_hub1 htm10_FEX_data_lane_2_to_rod1 [Oct 13 21:09:13 2020]: Source Link: htm10_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_3_to_hub1 htm10_FEX_data_lane_3_to_rod1 [Oct 13 21:09:14 2020]: Source Link: htm10_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_4_to_hub1 htm10_FEX_data_lane_4_to_rod1 [Oct 13 21:09:16 2020]: Source Link: htm10_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_5_to_hub1 htm10_FEX_data_lane_5_to_rod1 [Oct 13 21:09:25 2020]: Source Link: htm11_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_0_to_hub1 htm11_FEX_data_lane_0_to_rod1 [Oct 13 21:09:27 2020]: Source Link: htm11_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_1_to_hub1 htm11_FEX_data_lane_1_to_rod1 [Oct 13 21:09:28 2020]: Source Link: htm11_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_2_to_hub1 htm11_FEX_data_lane_2_to_rod1 [Oct 13 21:09:30 2020]: Source Link: htm11_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_3_to_hub1 htm11_FEX_data_lane_3_to_rod1 [Oct 13 21:09:31 2020]: Source Link: htm11_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_4_to_hub1 htm11_FEX_data_lane_4_to_rod1 [Oct 13 21:09:32 2020]: Source Link: htm11_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_5_to_hub1 htm11_FEX_data_lane_5_to_rod1 [Oct 13 21:09:42 2020]: Source Link: htm12_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_0_to_hub1 htm12_FEX_data_lane_0_to_rod1 [Oct 13 21:09:43 2020]: Source Link: htm12_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_1_to_hub1 htm12_FEX_data_lane_1_to_rod1 [Oct 13 21:09:45 2020]: Source Link: htm12_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_2_to_hub1 htm12_FEX_data_lane_2_to_rod1 [Oct 13 21:09:46 2020]: Source Link: htm12_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_3_to_hub1 htm12_FEX_data_lane_3_to_rod1 [Oct 13 21:09:48 2020]: Source Link: htm12_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_4_to_hub1 htm12_FEX_data_lane_4_to_rod1 [Oct 13 21:09:49 2020]: Source Link: htm12_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_5_to_hub1 htm12_FEX_data_lane_5_to_rod1 [Oct 13 21:09:59 2020]: Source Link: htm13_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_0_to_hub1 htm13_FEX_data_lane_0_to_rod1 [Oct 13 21:10:00 2020]: Source Link: htm13_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_1_to_hub1 htm13_FEX_data_lane_1_to_rod1 [Oct 13 21:10:02 2020]: Source Link: htm13_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_2_to_hub1 htm13_FEX_data_lane_2_to_rod1 [Oct 13 21:10:03 2020]: Source Link: htm13_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_3_to_hub1 htm13_FEX_data_lane_3_to_rod1 [Oct 13 21:10:04 2020]: Source Link: htm13_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_4_to_hub1 htm13_FEX_data_lane_4_to_rod1 [Oct 13 21:10:06 2020]: Source Link: htm13_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_5_to_hub1 htm13_FEX_data_lane_5_to_rod1 [Oct 13 21:10:15 2020]: Source Link: htm14_FEX_data_lane_0_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_0_to_hub1 htm14_FEX_data_lane_0_to_rod1 [Oct 13 21:10:17 2020]: Source Link: htm14_FEX_data_lane_1_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_1_to_hub1 htm14_FEX_data_lane_1_to_rod1 [Oct 13 21:10:18 2020]: Source Link: htm14_FEX_data_lane_2_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_2_to_hub1 htm14_FEX_data_lane_2_to_rod1 [Oct 13 21:10:20 2020]: Source Link: htm14_FEX_data_lane_3_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_3_to_hub1 htm14_FEX_data_lane_3_to_rod1 [Oct 13 21:10:21 2020]: Source Link: htm14_FEX_data_lane_4_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_4_to_hub1 htm14_FEX_data_lane_4_to_rod1 [Oct 13 21:10:22 2020]: Source Link: htm14_FEX_data_lane_5_to_hub1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_5_to_hub1 htm14_FEX_data_lane_5_to_rod1 [Oct 13 21:10:38 2020]: Source Link: hub1_optical_tx_ch6_to_htm3_rx_ch5 Mismatch - Error found on different link: hub1_optical_tx_ch8_to_htm3_rx_ch3 [Oct 13 21:10:41 2020]: Source Link: hub1_optical_tx_ch11_to_htm3_rx_ch0 Null - No errors found on any links [Oct 13 21:10:52 2020]: Source Link: hub2_optical_tx_ch11_to_htm4_rx_ch0 Null - No errors found on any links [Oct 13 21:10:55 2020]: Source Link: htm4_optical_tx_ch2_to_hub2_rx_ch6 Null - No errors found on any links [Oct 13 21:10:58 2020]: Source Link: htm3_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_0_to_hub1 htm3_FEX_data_lane_0_to_rod1 [Oct 13 21:10:59 2020]: Source Link: htm3_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_1_to_hub1 htm3_FEX_data_lane_1_to_rod1 [Oct 13 21:11:01 2020]: Source Link: htm3_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_2_to_hub1 htm3_FEX_data_lane_2_to_rod1 [Oct 13 21:11:02 2020]: Source Link: htm3_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_3_to_hub1 htm3_FEX_data_lane_3_to_rod1 [Oct 13 21:11:04 2020]: Source Link: htm3_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_4_to_hub1 htm3_FEX_data_lane_4_to_rod1 [Oct 13 21:11:05 2020]: Source Link: htm3_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm3_FEX_data_lane_5_to_hub1 htm3_FEX_data_lane_5_to_rod1 [Oct 13 21:11:06 2020]: Source Link: htm4_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_0_to_hub1 htm4_FEX_data_lane_0_to_rod1 [Oct 13 21:11:08 2020]: Source Link: htm4_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_1_to_hub1 htm4_FEX_data_lane_1_to_rod1 [Oct 13 21:11:09 2020]: Source Link: htm4_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_2_to_hub1 htm4_FEX_data_lane_2_to_rod1 [Oct 13 21:11:10 2020]: Source Link: htm4_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_3_to_hub1 htm4_FEX_data_lane_3_to_rod1 [Oct 13 21:11:12 2020]: Source Link: htm4_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_4_to_hub1 htm4_FEX_data_lane_4_to_rod1 [Oct 13 21:11:13 2020]: Source Link: htm4_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm4_FEX_data_lane_5_to_hub1 htm4_FEX_data_lane_5_to_rod1 [Oct 13 21:11:15 2020]: Source Link: htm5_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_0_to_hub1 htm5_FEX_data_lane_0_to_rod1 [Oct 13 21:11:16 2020]: Source Link: htm5_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_1_to_hub1 htm5_FEX_data_lane_1_to_rod1 [Oct 13 21:11:17 2020]: Source Link: htm5_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_2_to_hub1 htm5_FEX_data_lane_2_to_rod1 [Oct 13 21:11:19 2020]: Source Link: htm5_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_3_to_hub1 htm5_FEX_data_lane_3_to_rod1 [Oct 13 21:11:20 2020]: Source Link: htm5_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_4_to_hub1 htm5_FEX_data_lane_4_to_rod1 [Oct 13 21:11:22 2020]: Source Link: htm5_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm5_FEX_data_lane_5_to_hub1 htm5_FEX_data_lane_5_to_rod1 [Oct 13 21:11:23 2020]: Source Link: htm6_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_0_to_hub1 htm6_FEX_data_lane_0_to_rod1 [Oct 13 21:11:24 2020]: Source Link: htm6_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_1_to_hub1 htm6_FEX_data_lane_1_to_rod1 [Oct 13 21:11:26 2020]: Source Link: htm6_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_2_to_hub1 htm6_FEX_data_lane_2_to_rod1 [Oct 13 21:11:27 2020]: Source Link: htm6_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_3_to_hub1 htm6_FEX_data_lane_3_to_rod1 [Oct 13 21:11:29 2020]: Source Link: htm6_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_4_to_hub1 htm6_FEX_data_lane_4_to_rod1 [Oct 13 21:11:30 2020]: Source Link: htm6_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm6_FEX_data_lane_5_to_hub1 htm6_FEX_data_lane_5_to_rod1 [Oct 13 21:11:31 2020]: Source Link: htm7_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_0_to_hub1 htm7_FEX_data_lane_0_to_rod1 [Oct 13 21:11:33 2020]: Source Link: htm7_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_1_to_hub1 htm7_FEX_data_lane_1_to_rod1 [Oct 13 21:11:34 2020]: Source Link: htm7_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_2_to_hub1 htm7_FEX_data_lane_2_to_rod1 [Oct 13 21:11:35 2020]: Source Link: htm7_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_3_to_hub1 htm7_FEX_data_lane_3_to_rod1 [Oct 13 21:11:37 2020]: Source Link: htm7_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_4_to_hub1 htm7_FEX_data_lane_4_to_rod1 [Oct 13 21:11:38 2020]: Source Link: htm7_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm7_FEX_data_lane_5_to_hub1 htm7_FEX_data_lane_5_to_rod1 [Oct 13 21:11:40 2020]: Source Link: htm8_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_0_to_hub1 htm8_FEX_data_lane_0_to_rod1 [Oct 13 21:11:41 2020]: Source Link: htm8_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_1_to_hub1 htm8_FEX_data_lane_1_to_rod1 [Oct 13 21:11:42 2020]: Source Link: htm8_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_2_to_hub1 htm8_FEX_data_lane_2_to_rod1 [Oct 13 21:11:44 2020]: Source Link: htm8_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_3_to_hub1 htm8_FEX_data_lane_3_to_rod1 [Oct 13 21:11:45 2020]: Source Link: htm8_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_4_to_hub1 htm8_FEX_data_lane_4_to_rod1 [Oct 13 21:11:47 2020]: Source Link: htm8_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm8_FEX_data_lane_5_to_hub1 htm8_FEX_data_lane_5_to_rod1 [Oct 13 21:11:48 2020]: Source Link: htm9_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_0_to_hub1 htm9_FEX_data_lane_0_to_rod1 [Oct 13 21:11:49 2020]: Source Link: htm9_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_1_to_hub1 htm9_FEX_data_lane_1_to_rod1 [Oct 13 21:11:51 2020]: Source Link: htm9_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_2_to_hub1 htm9_FEX_data_lane_2_to_rod1 [Oct 13 21:11:52 2020]: Source Link: htm9_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_3_to_hub1 htm9_FEX_data_lane_3_to_rod1 [Oct 13 21:11:53 2020]: Source Link: htm9_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_4_to_hub1 htm9_FEX_data_lane_4_to_rod1 [Oct 13 21:11:55 2020]: Source Link: htm9_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm9_FEX_data_lane_5_to_hub1 htm9_FEX_data_lane_5_to_rod1 [Oct 13 21:11:56 2020]: Source Link: htm10_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_0_to_hub1 htm10_FEX_data_lane_0_to_rod1 [Oct 13 21:11:58 2020]: Source Link: htm10_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_1_to_hub1 htm10_FEX_data_lane_1_to_rod1 [Oct 13 21:11:59 2020]: Source Link: htm10_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_2_to_hub1 htm10_FEX_data_lane_2_to_rod1 [Oct 13 21:12:00 2020]: Source Link: htm10_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_3_to_hub1 htm10_FEX_data_lane_3_to_rod1 [Oct 13 21:12:02 2020]: Source Link: htm10_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_4_to_hub1 htm10_FEX_data_lane_4_to_rod1 [Oct 13 21:12:03 2020]: Source Link: htm10_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm10_FEX_data_lane_5_to_hub1 htm10_FEX_data_lane_5_to_rod1 [Oct 13 21:12:05 2020]: Source Link: htm11_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_0_to_hub1 htm11_FEX_data_lane_0_to_rod1 [Oct 13 21:12:06 2020]: Source Link: htm11_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_1_to_hub1 htm11_FEX_data_lane_1_to_rod1 [Oct 13 21:12:07 2020]: Source Link: htm11_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_2_to_hub1 htm11_FEX_data_lane_2_to_rod1 [Oct 13 21:12:09 2020]: Source Link: htm11_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_3_to_hub1 htm11_FEX_data_lane_3_to_rod1 [Oct 13 21:12:10 2020]: Source Link: htm11_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_4_to_hub1 htm11_FEX_data_lane_4_to_rod1 [Oct 13 21:12:11 2020]: Source Link: htm11_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm11_FEX_data_lane_5_to_hub1 htm11_FEX_data_lane_5_to_rod1 [Oct 13 21:12:13 2020]: Source Link: htm12_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_0_to_hub1 htm12_FEX_data_lane_0_to_rod1 [Oct 13 21:12:14 2020]: Source Link: htm12_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_1_to_hub1 htm12_FEX_data_lane_1_to_rod1 [Oct 13 21:12:16 2020]: Source Link: htm12_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_2_to_hub1 htm12_FEX_data_lane_2_to_rod1 [Oct 13 21:12:17 2020]: Source Link: htm12_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_3_to_hub1 htm12_FEX_data_lane_3_to_rod1 [Oct 13 21:12:18 2020]: Source Link: htm12_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_4_to_hub1 htm12_FEX_data_lane_4_to_rod1 [Oct 13 21:12:20 2020]: Source Link: htm12_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm12_FEX_data_lane_5_to_hub1 htm12_FEX_data_lane_5_to_rod1 [Oct 13 21:12:21 2020]: Source Link: htm13_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_0_to_hub1 htm13_FEX_data_lane_0_to_rod1 [Oct 13 21:12:23 2020]: Source Link: htm13_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_1_to_hub1 htm13_FEX_data_lane_1_to_rod1 [Oct 13 21:12:24 2020]: Source Link: htm13_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_2_to_hub1 htm13_FEX_data_lane_2_to_rod1 [Oct 13 21:12:25 2020]: Source Link: htm13_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_3_to_hub1 htm13_FEX_data_lane_3_to_rod1 [Oct 13 21:12:27 2020]: Source Link: htm13_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_4_to_hub1 htm13_FEX_data_lane_4_to_rod1 [Oct 13 21:12:28 2020]: Source Link: htm13_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm13_FEX_data_lane_5_to_hub1 htm13_FEX_data_lane_5_to_rod1 [Oct 13 21:12:29 2020]: Source Link: htm14_FEX_data_lane_0_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_0_to_hub1 htm14_FEX_data_lane_0_to_rod1 [Oct 13 21:12:31 2020]: Source Link: htm14_FEX_data_lane_1_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_1_to_hub1 htm14_FEX_data_lane_1_to_rod1 [Oct 13 21:12:32 2020]: Source Link: htm14_FEX_data_lane_2_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_2_to_hub1 htm14_FEX_data_lane_2_to_rod1 [Oct 13 21:12:34 2020]: Source Link: htm14_FEX_data_lane_3_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_3_to_hub1 htm14_FEX_data_lane_3_to_rod1 [Oct 13 21:12:35 2020]: Source Link: htm14_FEX_data_lane_4_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_4_to_hub1 htm14_FEX_data_lane_4_to_rod1 [Oct 13 21:12:36 2020]: Source Link: htm14_FEX_data_lane_5_to_rod1 Multiple Errors - Error found on multiple links: htm14_FEX_data_lane_5_to_hub1 htm14_FEX_data_lane_5_to_rod1 [Oct 13 21:12:36 2020]: Final list of links with initial errors: hub2_readout_AL_0_to_ROD1 hub1_optical_tx_ch6_to_htm3_rx_ch5 hub1_optical_tx_ch11_to_htm3_rx_ch0 hub2_optical_tx_ch11_to_htm4_rx_ch0 [Oct 13 21:12:42 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 3822257998 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 3818985573 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 3818921857 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 3818768496 [Oct 13 21:12:42 2020]: Error Report Finished [Oct 13 22:12:42 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 1241204112 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 1237976074 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 1237916162 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 1237773036 [Oct 13 22:12:42 2020]: Error Report Finished [Oct 13 23:12:42 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 2955410806 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 2952212033 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 2952154870 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 2952009170 [Oct 13 23:12:42 2020]: Error Report Finished [Oct 14 00:12:42 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 374719214 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 371586809 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 371520679 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 371372821 [Oct 14 00:12:42 2020]: Error Report Finished [Oct 14 01:12:43 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 2088219359 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 2084855321 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 2084791620 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 2084641630 [Oct 14 01:12:43 2020]: Error Report Finished [Oct 14 02:12:43 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 3802267737 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 3798873956 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 3798807904 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 3798651075 [Oct 14 02:12:43 2020]: Error Report Finished [Oct 14 03:12:43 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 1221269030 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 1217883591 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 1217820381 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 1217670644 [Oct 14 03:12:43 2020]: Error Report Finished [Oct 14 04:12:43 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 2934914455 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 2931508925 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 2931443514 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 2931292186 [Oct 14 04:12:43 2020]: Error Report Finished [Oct 14 05:12:44 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 353892746 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 350583651 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 350519131 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 350366352 [Oct 14 05:12:44 2020]: Error Report Finished [Oct 14 06:12:44 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 2067929714 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 2064524046 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 2064461934 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 2064312591 [Oct 14 06:12:44 2020]: Error Report Finished [Oct 14 07:12:44 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 3781872448 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 3778769137 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 3778709136 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 3778565750 [Oct 14 07:12:44 2020]: Error Report Finished [Oct 14 08:12:45 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub2 Readout Aurora Lane 0 to ROD1 | Error Count: 1201261884 Link: Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 | Error Count: 1198075606 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 1198016573 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 1197879406 [Oct 14 08:12:45 2020]: Error Report Finished