[Aug 10 20:16:26 2020]: ====================================================================== | IBERT Test - r4v1p1 | | | | Hub1 SN: HUB_SLOT1 Hub2 SN: HUB_SLOT2 | ====================================================================== [Aug 10 20:16:26 2020]: Cards in use: Card | Serial/Slot Number hub1 | HUB_SLOT1 hub2 | HUB_SLOT2 htm3 | HTM01 htm4 | HTM_SLOT4 htm5 | HTM_SLOT5 htm6 | HTM_SLOT6 htm7 | HTM_SLOT7 htm8 | HTM_SLOT8 htm9 | HTM_SLOT9 htm10 | HTM_SLOT10 htm11 | HTM_SLOT11 htm12 | HTM_SLOT12 htm13 | HTM_SLOT13 htm14 | HTM_SLOT14 [Aug 10 20:16:26 2020]: Links being tested: Hub1 Readout Aurora Lane 0 to Hub2 Hub1 Readout Aurora Lane 1 to Hub2 Hub1 Readout Aurora Lane 0 to ROD Hub1 Readout Aurora Lane 1 to ROD Hub2 Readout Aurora Lane 0 to Hub1 Hub2 Readout Aurora Lane 1 to Hub1 Hub2 Readout Aurora Lane 0 to ROD Hub2 Readout Aurora Lane 1 to ROD Hub1 Combined Data to FEX 03 Hub1 Combined Data to FEX 04 Hub1 Combined Data to FEX 05 Hub1 Combined Data to FEX 06 Hub1 Combined Data to FEX 07 Hub1 Combined Data to FEX 08 Hub1 Combined Data to FEX 09 Hub1 Combined Data to FEX 10 Hub1 Combined Data to FEX 11 Hub1 Combined Data to FEX 12 Hub1 Combined Data to FEX 13 Hub1 Combined Data to FEX 14 Hub1 Combined Data to Hub2 Hub1 Combined Data to ROD Hub2 Combined Data to FEX 03 Hub2 Combined Data to FEX 04 Hub2 Combined Data to FEX 05 Hub2 Combined Data to FEX 06 Hub2 Combined Data to FEX 07 Hub2 Combined Data to FEX 08 Hub2 Combined Data to FEX 09 Hub2 Combined Data to FEX 10 Hub2 Combined Data to FEX 11 Hub2 Combined Data to FEX 12 Hub2 Combined Data to FEX 13 Hub2 Combined Data to FEX 14 Hub2 Combined Data to Hub1 Hub2 Combined Data to ROD HTM3 FEX Data Lane 0 to Hub1 HTM3 FEX Data Lane 1 to Hub1 HTM3 FEX Data Lane 2 to Hub1 HTM3 FEX Data Lane 3 to Hub1 HTM3 FEX Data Lane 4 to Hub1 HTM3 FEX Data Lane 5 to Hub1 HTM3 FEX Data Lane 0 to Hub2 HTM3 FEX Data Lane 1 to Hub2 HTM3 FEX Data Lane 2 to Hub2 HTM3 FEX Data Lane 3 to Hub2 HTM3 FEX Data Lane 4 to Hub2 HTM3 FEX Data Lane 5 to Hub2 HTM4 FEX Data Lane 0 to Hub1 HTM4 FEX Data Lane 1 to Hub1 HTM4 FEX Data Lane 2 to Hub1 HTM4 FEX Data Lane 3 to Hub1 HTM4 FEX Data Lane 4 to Hub1 HTM4 FEX Data Lane 5 to Hub1 HTM4 FEX Data Lane 0 to Hub2 HTM4 FEX Data Lane 1 to Hub2 HTM4 FEX Data Lane 2 to Hub2 HTM4 FEX Data Lane 3 to Hub2 HTM4 FEX Data Lane 4 to Hub2 HTM4 FEX Data Lane 5 to Hub2 HTM5 FEX Data Lane 0 to Hub1 HTM5 FEX Data Lane 1 to Hub1 HTM5 FEX Data Lane 2 to Hub1 HTM5 FEX Data Lane 3 to Hub1 HTM5 FEX Data Lane 4 to Hub1 HTM5 FEX Data Lane 5 to Hub1 HTM5 FEX Data Lane 0 to Hub2 HTM5 FEX Data Lane 1 to Hub2 HTM5 FEX Data Lane 2 to Hub2 HTM5 FEX Data Lane 3 to Hub2 HTM5 FEX Data Lane 4 to Hub2 HTM5 FEX Data Lane 5 to Hub2 HTM6 FEX Data Lane 0 to Hub1 HTM6 FEX Data Lane 1 to Hub1 HTM6 FEX Data Lane 2 to Hub1 HTM6 FEX Data Lane 3 to Hub1 HTM6 FEX Data Lane 4 to Hub1 HTM6 FEX Data Lane 5 to Hub1 HTM6 FEX Data Lane 0 to Hub2 HTM6 FEX Data Lane 1 to Hub2 HTM6 FEX Data Lane 2 to Hub2 HTM6 FEX Data Lane 3 to Hub2 HTM6 FEX Data Lane 4 to Hub2 HTM6 FEX Data Lane 5 to Hub2 HTM7 FEX Data Lane 0 to Hub1 HTM7 FEX Data Lane 1 to Hub1 HTM7 FEX Data Lane 2 to Hub1 HTM7 FEX Data Lane 3 to Hub1 HTM7 FEX Data Lane 4 to Hub1 HTM7 FEX Data Lane 5 to Hub1 HTM7 FEX Data Lane 0 to Hub2 HTM7 FEX Data Lane 1 to Hub2 HTM7 FEX Data Lane 2 to Hub2 HTM7 FEX Data Lane 3 to Hub2 HTM7 FEX Data Lane 4 to Hub2 HTM7 FEX Data Lane 5 to Hub2 HTM8 FEX Data Lane 0 to Hub1 HTM8 FEX Data Lane 1 to Hub1 HTM8 FEX Data Lane 2 to Hub1 HTM8 FEX Data Lane 3 to Hub1 HTM8 FEX Data Lane 4 to Hub1 HTM8 FEX Data Lane 5 to Hub1 HTM8 FEX Data Lane 0 to Hub2 HTM8 FEX Data Lane 1 to Hub2 HTM8 FEX Data Lane 2 to Hub2 HTM8 FEX Data Lane 3 to Hub2 HTM8 FEX Data Lane 4 to Hub2 HTM8 FEX Data Lane 5 to Hub2 HTM9 FEX Data Lane 0 to Hub1 HTM9 FEX Data Lane 1 to Hub1 HTM9 FEX Data Lane 2 to Hub1 HTM9 FEX Data Lane 3 to Hub1 HTM9 FEX Data Lane 4 to Hub1 HTM9 FEX Data Lane 5 to Hub1 HTM9 FEX Data Lane 0 to Hub2 HTM9 FEX Data Lane 1 to Hub2 HTM9 FEX Data Lane 2 to Hub2 HTM9 FEX Data Lane 3 to Hub2 HTM9 FEX Data Lane 4 to Hub2 HTM9 FEX Data Lane 5 to Hub2 HTM10 FEX Data Lane 0 to Hub1 HTM10 FEX Data Lane 1 to Hub1 HTM10 FEX Data Lane 2 to Hub1 HTM10 FEX Data Lane 3 to Hub1 HTM10 FEX Data Lane 4 to Hub1 HTM10 FEX Data Lane 5 to Hub1 HTM10 FEX Data Lane 0 to Hub2 HTM10 FEX Data Lane 1 to Hub2 HTM10 FEX Data Lane 2 to Hub2 HTM10 FEX Data Lane 3 to Hub2 HTM10 FEX Data Lane 4 to Hub2 HTM10 FEX Data Lane 5 to Hub2 HTM11 FEX Data Lane 0 to Hub1 HTM11 FEX Data Lane 1 to Hub1 HTM11 FEX Data Lane 2 to Hub1 HTM11 FEX Data Lane 3 to Hub1 HTM11 FEX Data Lane 4 to Hub1 HTM11 FEX Data Lane 5 to Hub1 HTM11 FEX Data Lane 0 to Hub2 HTM11 FEX Data Lane 1 to Hub2 HTM11 FEX Data Lane 2 to Hub2 HTM11 FEX Data Lane 3 to Hub2 HTM11 FEX Data Lane 4 to Hub2 HTM11 FEX Data Lane 5 to Hub2 HTM12 FEX Data Lane 0 to Hub1 HTM12 FEX Data Lane 1 to Hub1 HTM12 FEX Data Lane 2 to Hub1 HTM12 FEX Data Lane 3 to Hub1 HTM12 FEX Data Lane 4 to Hub1 HTM12 FEX Data Lane 5 to Hub1 HTM12 FEX Data Lane 0 to Hub2 HTM12 FEX Data Lane 1 to Hub2 HTM12 FEX Data Lane 2 to Hub2 HTM12 FEX Data Lane 3 to Hub2 HTM12 FEX Data Lane 4 to Hub2 HTM12 FEX Data Lane 5 to Hub2 HTM13 FEX Data Lane 0 to Hub1 HTM13 FEX Data Lane 1 to Hub1 HTM13 FEX Data Lane 2 to Hub1 HTM13 FEX Data Lane 3 to Hub1 HTM13 FEX Data Lane 4 to Hub1 HTM13 FEX Data Lane 5 to Hub1 HTM13 FEX Data Lane 0 to Hub2 HTM13 FEX Data Lane 1 to Hub2 HTM13 FEX Data Lane 2 to Hub2 HTM13 FEX Data Lane 3 to Hub2 HTM13 FEX Data Lane 4 to Hub2 HTM13 FEX Data Lane 5 to Hub2 HTM14 FEX Data Lane 0 to Hub1 HTM14 FEX Data Lane 1 to Hub1 HTM14 FEX Data Lane 2 to Hub1 HTM14 FEX Data Lane 3 to Hub1 HTM14 FEX Data Lane 4 to Hub1 HTM14 FEX Data Lane 5 to Hub1 HTM14 FEX Data Lane 0 to Hub2 HTM14 FEX Data Lane 1 to Hub2 HTM14 FEX Data Lane 2 to Hub2 HTM14 FEX Data Lane 3 to Hub2 HTM14 FEX Data Lane 4 to Hub2 HTM14 FEX Data Lane 5 to Hub2 Hub1 TX MiniPOD Channel 0 to HTM3 RX MiniPOD Channel 11 Hub1 TX MiniPOD Channel 1 to HTM3 RX MiniPOD Channel 10 Hub1 TX MiniPOD Channel 2 to HTM3 RX MiniPOD Channel 9 Hub1 TX MiniPOD Channel 4 to HTM3 RX MiniPOD Channel 7 Hub1 TX MiniPOD Channel 6 to HTM3 RX MiniPOD Channel 5 Hub1 TX MiniPOD Channel 8 to HTM3 RX MiniPOD Channel 3 Hub1 TX MiniPOD Channel 10 to HTM3 RX MiniPOD Channel 1 Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 Hub2 TX MiniPOD Channel 0 to HTM4 RX MiniPOD Channel 11 Hub2 TX MiniPOD Channel 1 to HTM4 RX MiniPOD Channel 10 Hub2 TX MiniPOD Channel 2 to HTM4 RX MiniPOD Channel 9 Hub2 TX MiniPOD Channel 4 to HTM4 RX MiniPOD Channel 7 Hub2 TX MiniPOD Channel 6 to HTM4 RX MiniPOD Channel 5 Hub2 TX MiniPOD Channel 8 to HTM4 RX MiniPOD Channel 3 Hub2 TX MiniPOD Channel 10 to HTM4 RX MiniPOD Channel 1 Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 HTM4 TX MiniPOD Channel 0 to Hub2 RX MiniPOD Channel 2 HTM4 TX MiniPOD Channel 1 to Hub2 RX MiniPOD Channel 4 HTM4 TX MiniPOD Channel 3 to Hub2 RX MiniPOD Channel 8 Readout Control Data from ROD to Hub1 Readout Control Data from ROD to Hub2 [Aug 10 20:16:26 2020]: ====================================================================== | Performing Initialization | ====================================================================== [Aug 10 20:16:26 2020]: Using the following initialization parameters: Per-Card Parameters: { "mgt equalizer": "ON" } Per-Link Parameters: { "DFE": "OFF", "post-emphasis": "0", "pre-emphasis": "0", "prbs-select": "PRBS-31", "swing": "950" } [Aug 10 20:16:31 2020]: Performing TX MGT Resets ... [Aug 10 20:16:47 2020]: Performing RX MGT Resets ... [Aug 10 20:17:03 2020]: Checking Init Done Bit ... [Aug 10 20:17:03 2020]: WARNING - Init done bit is low on the following transmitters/receivers: Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | source Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | source Link: HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 | dest Checking Rxprbslocked Bit ... WARNING - Rxprbslocked bit is low on the following Ultrascale GTH/Ultrascale GTY receivers: Link: HTM10 FEX Data Lane 5 to Hub1 Link: HTM13 FEX Data Lane 5 to Hub1 Link: HTM4 TX MiniPOD Channel 2 to Hub2 RX MiniPOD Channel 6 Link: Readout Control Data from ROD to Hub1 Link: Readout Control Data from ROD to Hub2 Resetting Error Counts ... [Aug 10 20:17:14 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: HTM10 FEX Data Lane 5 to Hub1 | Error Count: 211020352 Link: HTM13 FEX Data Lane 5 to Hub1 | Error Count: 208376176 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 51596532 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 51424253 Link: Readout Control Data from ROD to Hub1 | Error Count: 205294559 Link: Readout Control Data from ROD to Hub2 | Error Count: 205220268 [Aug 10 20:17:14 2020]: Error Report Finished [Aug 10 20:17:14 2020]: ====================================================================== | Finding Link Routes | ====================================================================== [Aug 10 20:17:14 2020]: Links with initial errors: htm10_FEX_data_lane_5_to_hub1 htm13_FEX_data_lane_5_to_hub1 hub1_tx_minipod_ch11_to_htm3_rx_minipod_ch0 hub2_tx_minipod_ch11_to_htm4_rx_minipod_ch0 readout_control_data_from_ROD_to_hub1 readout_control_data_from_ROD_to_hub2 ---------------------------------------------------------------------- [Aug 10 20:17:15 2020]: Problematic Link Routes: [Aug 10 20:17:17 2020]: Source Link: hub1_readout_AL_0_to_ROD Null - No errors found on any links [Aug 10 20:17:18 2020]: Source Link: hub1_readout_AL_1_to_ROD Null - No errors found on any links [Aug 10 20:17:21 2020]: Source Link: hub2_readout_AL_0_to_ROD Null - No errors found on any links [Aug 10 20:17:21 2020]: Source Link: hub2_readout_AL_1_to_ROD Null - No errors found on any links [Aug 10 20:17:37 2020]: Source Link: hub1_combined_data_to_ROD Null - No errors found on any links [Aug 10 20:17:53 2020]: Source Link: hub2_combined_data_to_ROD Null - No errors found on any links [Aug 10 20:18:07 2020]: Source Link: htm4_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:08 2020]: Source Link: htm4_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:09 2020]: Source Link: htm4_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:09 2020]: Source Link: htm4_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:10 2020]: Source Link: htm4_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:11 2020]: Source Link: htm4_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:11 2020]: Source Link: htm4_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:12 2020]: Source Link: htm4_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:13 2020]: Source Link: htm4_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:13 2020]: Source Link: htm4_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:14 2020]: Source Link: htm4_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:15 2020]: Source Link: htm4_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:15 2020]: Source Link: htm5_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:16 2020]: Source Link: htm5_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:16 2020]: Source Link: htm5_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:17 2020]: Source Link: htm5_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:18 2020]: Source Link: htm5_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:18 2020]: Source Link: htm5_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:19 2020]: Source Link: htm5_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:20 2020]: Source Link: htm5_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:20 2020]: Source Link: htm5_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:21 2020]: Source Link: htm5_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:22 2020]: Source Link: htm5_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:22 2020]: Source Link: htm5_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:23 2020]: Source Link: htm6_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:23 2020]: Source Link: htm6_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:24 2020]: Source Link: htm6_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:25 2020]: Source Link: htm6_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:25 2020]: Source Link: htm6_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:26 2020]: Source Link: htm6_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:27 2020]: Source Link: htm6_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:27 2020]: Source Link: htm6_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:28 2020]: Source Link: htm6_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:29 2020]: Source Link: htm6_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:29 2020]: Source Link: htm6_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:30 2020]: Source Link: htm6_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:31 2020]: Source Link: htm7_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:31 2020]: Source Link: htm7_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:32 2020]: Source Link: htm7_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:32 2020]: Source Link: htm7_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:33 2020]: Source Link: htm7_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:34 2020]: Source Link: htm7_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:34 2020]: Source Link: htm7_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:35 2020]: Source Link: htm7_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:36 2020]: Source Link: htm7_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:36 2020]: Source Link: htm7_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:37 2020]: Source Link: htm7_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:38 2020]: Source Link: htm7_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:38 2020]: Source Link: htm8_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:39 2020]: Source Link: htm8_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:39 2020]: Source Link: htm8_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:40 2020]: Source Link: htm8_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:41 2020]: Source Link: htm8_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:41 2020]: Source Link: htm8_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:42 2020]: Source Link: htm8_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:43 2020]: Source Link: htm8_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:43 2020]: Source Link: htm8_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:44 2020]: Source Link: htm8_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:45 2020]: Source Link: htm8_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:45 2020]: Source Link: htm8_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:46 2020]: Source Link: htm9_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:46 2020]: Source Link: htm9_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:47 2020]: Source Link: htm9_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:48 2020]: Source Link: htm9_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:48 2020]: Source Link: htm9_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:49 2020]: Source Link: htm9_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:50 2020]: Source Link: htm9_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:50 2020]: Source Link: htm9_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:51 2020]: Source Link: htm9_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:52 2020]: Source Link: htm9_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:18:52 2020]: Source Link: htm9_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:18:53 2020]: Source Link: htm9_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:18:53 2020]: Source Link: htm10_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:18:54 2020]: Source Link: htm10_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:18:55 2020]: Source Link: htm10_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:18:55 2020]: Source Link: htm10_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:18:56 2020]: Source Link: htm10_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:18:57 2020]: Source Link: htm10_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:18:57 2020]: Source Link: htm10_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:18:58 2020]: Source Link: htm10_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:18:59 2020]: Source Link: htm10_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:18:59 2020]: Source Link: htm10_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:19:00 2020]: Source Link: htm10_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:19:01 2020]: Source Link: htm10_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:19:01 2020]: Source Link: htm11_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:19:02 2020]: Source Link: htm11_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:19:02 2020]: Source Link: htm11_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:19:03 2020]: Source Link: htm11_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:19:04 2020]: Source Link: htm11_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:19:04 2020]: Source Link: htm11_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:19:05 2020]: Source Link: htm11_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:19:06 2020]: Source Link: htm11_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:19:06 2020]: Source Link: htm11_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:19:07 2020]: Source Link: htm11_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:19:08 2020]: Source Link: htm11_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:19:08 2020]: Source Link: htm11_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:19:09 2020]: Source Link: htm12_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:19:09 2020]: Source Link: htm12_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:19:10 2020]: Source Link: htm12_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:19:11 2020]: Source Link: htm12_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:19:11 2020]: Source Link: htm12_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:19:12 2020]: Source Link: htm12_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:19:13 2020]: Source Link: htm12_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:19:13 2020]: Source Link: htm12_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:19:14 2020]: Source Link: htm12_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:19:15 2020]: Source Link: htm12_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:19:15 2020]: Source Link: htm12_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:19:16 2020]: Source Link: htm12_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:19:16 2020]: Source Link: htm13_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:19:17 2020]: Source Link: htm13_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:19:18 2020]: Source Link: htm13_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:19:18 2020]: Source Link: htm13_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:19:19 2020]: Source Link: htm13_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:19:20 2020]: Source Link: htm13_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:19:20 2020]: Source Link: htm13_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:19:21 2020]: Source Link: htm13_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:19:22 2020]: Source Link: htm13_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:19:22 2020]: Source Link: htm13_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:19:23 2020]: Source Link: htm13_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:19:23 2020]: Source Link: htm13_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:19:24 2020]: Source Link: htm14_FEX_data_lane_0_to_hub1 Null - No errors found on any links [Aug 10 20:19:25 2020]: Source Link: htm14_FEX_data_lane_1_to_hub1 Null - No errors found on any links [Aug 10 20:19:25 2020]: Source Link: htm14_FEX_data_lane_2_to_hub1 Null - No errors found on any links [Aug 10 20:19:26 2020]: Source Link: htm14_FEX_data_lane_3_to_hub1 Null - No errors found on any links [Aug 10 20:19:27 2020]: Source Link: htm14_FEX_data_lane_4_to_hub1 Null - No errors found on any links [Aug 10 20:19:27 2020]: Source Link: htm14_FEX_data_lane_5_to_hub1 Null - No errors found on any links [Aug 10 20:19:28 2020]: Source Link: htm14_FEX_data_lane_0_to_hub2 Null - No errors found on any links [Aug 10 20:19:29 2020]: Source Link: htm14_FEX_data_lane_1_to_hub2 Null - No errors found on any links [Aug 10 20:19:29 2020]: Source Link: htm14_FEX_data_lane_2_to_hub2 Null - No errors found on any links [Aug 10 20:19:30 2020]: Source Link: htm14_FEX_data_lane_3_to_hub2 Null - No errors found on any links [Aug 10 20:19:30 2020]: Source Link: htm14_FEX_data_lane_4_to_hub2 Null - No errors found on any links [Aug 10 20:19:31 2020]: Source Link: htm14_FEX_data_lane_5_to_hub2 Null - No errors found on any links [Aug 10 20:19:37 2020]: Source Link: hub1_tx_minipod_ch6_to_htm3_rx_minipod_ch5 Mismatch - Error found on different link: hub1_tx_minipod_ch8_to_htm3_rx_minipod_ch3 [Aug 10 20:19:40 2020]: Source Link: hub1_tx_minipod_ch11_to_htm3_rx_minipod_ch0 Null - No errors found on any links [Aug 10 20:19:49 2020]: Source Link: hub2_tx_minipod_ch11_to_htm4_rx_minipod_ch0 Null - No errors found on any links [Aug 10 20:19:49 2020]: Source Link: htm4_tx_minipod_ch2_to_hub2_rx_minipod_ch6 Null - No errors found on any links [Aug 10 20:19:50 2020]: Source Link: htm4_tx_minipod_ch0_to_hub2_rx_minipod_ch2 Null - No errors found on any links [Aug 10 20:19:51 2020]: Source Link: htm4_tx_minipod_ch1_to_hub2_rx_minipod_ch4 Null - No errors found on any links [Aug 10 20:19:51 2020]: Source Link: htm4_tx_minipod_ch3_to_hub2_rx_minipod_ch8 Null - No errors found on any links [Aug 10 20:19:51 2020]: Source Link: readout_control_data_from_ROD_to_hub1 Null - No errors found on any links [Aug 10 20:19:51 2020]: Source Link: readout_control_data_from_ROD_to_hub2 Null - No errors found on any links [Aug 10 20:19:51 2020]: ====================================================================== | Inject Errors | ====================================================================== [Aug 10 20:19:54 2020]: Raising force error bits ... [Aug 10 20:19:55 2020]: Lowering force error bits ... [Aug 10 20:19:55 2020]: Error Injection Finished [Aug 10 20:19:56 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub1 Readout Aurora Lane 0 to Hub2 | Error Count: 170189205 Link: Hub1 Readout Aurora Lane 1 to Hub2 | Error Count: 170015638 Link: Hub2 Readout Aurora Lane 0 to Hub1 | Error Count: 169426790 Link: Hub2 Readout Aurora Lane 1 to Hub1 | Error Count: 169227562 Link: Hub1 Combined Data to FEX 03 | Error Count: 28631156 Link: Hub1 Combined Data to FEX 04 | Error Count: 28655175 Link: Hub1 Combined Data to FEX 05 | Error Count: 28670529 Link: Hub1 Combined Data to FEX 06 | Error Count: 28684709 Link: Hub1 Combined Data to FEX 07 | Error Count: 28692483 Link: Hub1 Combined Data to FEX 08 | Error Count: 28703459 Link: Hub1 Combined Data to FEX 09 | Error Count: 28719801 Link: Hub1 Combined Data to FEX 10 | Error Count: 28744687 Link: Hub1 Combined Data to FEX 11 | Error Count: 28749400 Link: Hub1 Combined Data to FEX 12 | Error Count: 28760530 Link: Hub1 Combined Data to FEX 13 | Error Count: 28765020 Link: Hub1 Combined Data to FEX 14 | Error Count: 28768977 Link: Hub1 Combined Data to Hub2 | Error Count: 166419463 Link: Hub2 Combined Data to FEX 03 | Error Count: 28784012 Link: Hub2 Combined Data to FEX 04 | Error Count: 28791512 Link: Hub2 Combined Data to FEX 05 | Error Count: 28798328 Link: Hub2 Combined Data to FEX 06 | Error Count: 28809268 Link: Hub2 Combined Data to FEX 07 | Error Count: 28821552 Link: Hub2 Combined Data to FEX 08 | Error Count: 28820752 Link: Hub2 Combined Data to FEX 09 | Error Count: 28810503 Link: Hub2 Combined Data to FEX 10 | Error Count: 28805069 Link: Hub2 Combined Data to FEX 11 | Error Count: 28808617 Link: Hub2 Combined Data to FEX 12 | Error Count: 28812694 Link: Hub2 Combined Data to FEX 13 | Error Count: 28793562 Link: Hub2 Combined Data to FEX 14 | Error Count: 28793188 Link: Hub2 Combined Data to Hub1 | Error Count: 163895944 Link: HTM3 FEX Data Lane 0 to Hub1 | Error Count: 63626335 Link: HTM3 FEX Data Lane 1 to Hub1 | Error Count: 63639627 Link: HTM3 FEX Data Lane 2 to Hub1 | Error Count: 63616383 Link: HTM3 FEX Data Lane 3 to Hub1 | Error Count: 63624196 Link: HTM3 FEX Data Lane 4 to Hub1 | Error Count: 63656766 Link: HTM3 FEX Data Lane 5 to Hub1 | Error Count: 63664036 Link: HTM3 FEX Data Lane 0 to Hub2 | Error Count: 63668930 Link: HTM3 FEX Data Lane 1 to Hub2 | Error Count: 63691790 Link: HTM3 FEX Data Lane 2 to Hub2 | Error Count: 63689805 Link: HTM3 FEX Data Lane 3 to Hub2 | Error Count: 63681838 Link: HTM3 FEX Data Lane 4 to Hub2 | Error Count: 63673799 Link: HTM3 FEX Data Lane 5 to Hub2 | Error Count: 63658685 Link: HTM10 FEX Data Lane 5 to Hub1 | Error Count: 243827738 Link: HTM13 FEX Data Lane 5 to Hub1 | Error Count: 241182290 Link: Hub1 TX MiniPOD Channel 0 to HTM3 RX MiniPOD Channel 11 | Error Count: 29483941 Link: Hub1 TX MiniPOD Channel 1 to HTM3 RX MiniPOD Channel 10 | Error Count: 29497111 Link: Hub1 TX MiniPOD Channel 2 to HTM3 RX MiniPOD Channel 9 | Error Count: 29494137 Link: Hub1 TX MiniPOD Channel 4 to HTM3 RX MiniPOD Channel 7 | Error Count: 29492863 Link: Hub1 TX MiniPOD Channel 8 to HTM3 RX MiniPOD Channel 3 | Error Count: 29497972 Link: Hub1 TX MiniPOD Channel 10 to HTM3 RX MiniPOD Channel 1 | Error Count: 29501056 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 1670427753 Link: Hub2 TX MiniPOD Channel 0 to HTM4 RX MiniPOD Channel 11 | Error Count: 29505838 Link: Hub2 TX MiniPOD Channel 1 to HTM4 RX MiniPOD Channel 10 | Error Count: 29506816 Link: Hub2 TX MiniPOD Channel 2 to HTM4 RX MiniPOD Channel 9 | Error Count: 29503341 Link: Hub2 TX MiniPOD Channel 4 to HTM4 RX MiniPOD Channel 7 | Error Count: 29508475 Link: Hub2 TX MiniPOD Channel 6 to HTM4 RX MiniPOD Channel 5 | Error Count: 29504464 Link: Hub2 TX MiniPOD Channel 8 to HTM4 RX MiniPOD Channel 3 | Error Count: 29502873 Link: Hub2 TX MiniPOD Channel 10 to HTM4 RX MiniPOD Channel 1 | Error Count: 29497871 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 596518743 Link: Readout Control Data from ROD to Hub1 | Error Count: 238197718 Link: Readout Control Data from ROD to Hub2 | Error Count: 238119153 [Aug 10 20:19:56 2020]: Error Report Finished [Aug 10 20:20:01 2020]: ====================================================================== | Error Report | ====================================================================== List of Channels with Errors: Link: Hub1 Readout Aurora Lane 0 to Hub2 | Error Count: 375413799 Link: Hub1 Readout Aurora Lane 1 to Hub2 | Error Count: 375254550 Link: Hub2 Readout Aurora Lane 0 to Hub1 | Error Count: 374676062 Link: Hub2 Readout Aurora Lane 1 to Hub1 | Error Count: 374492080 Link: Hub1 Combined Data to FEX 03 | Error Count: 28631156 Link: Hub1 Combined Data to FEX 04 | Error Count: 28655175 Link: Hub1 Combined Data to FEX 05 | Error Count: 28670529 Link: Hub1 Combined Data to FEX 06 | Error Count: 28684709 Link: Hub1 Combined Data to FEX 07 | Error Count: 28692483 Link: Hub1 Combined Data to FEX 08 | Error Count: 28703459 Link: Hub1 Combined Data to FEX 09 | Error Count: 28719801 Link: Hub1 Combined Data to FEX 10 | Error Count: 28744687 Link: Hub1 Combined Data to FEX 11 | Error Count: 28749400 Link: Hub1 Combined Data to FEX 12 | Error Count: 28760530 Link: Hub1 Combined Data to FEX 13 | Error Count: 28765020 Link: Hub1 Combined Data to FEX 14 | Error Count: 28768977 Link: Hub1 Combined Data to Hub2 | Error Count: 371779097 Link: Hub2 Combined Data to FEX 03 | Error Count: 28784012 Link: Hub2 Combined Data to FEX 04 | Error Count: 28791512 Link: Hub2 Combined Data to FEX 05 | Error Count: 28798328 Link: Hub2 Combined Data to FEX 06 | Error Count: 28809268 Link: Hub2 Combined Data to FEX 07 | Error Count: 28821552 Link: Hub2 Combined Data to FEX 08 | Error Count: 28820752 Link: Hub2 Combined Data to FEX 09 | Error Count: 28810503 Link: Hub2 Combined Data to FEX 10 | Error Count: 28805069 Link: Hub2 Combined Data to FEX 11 | Error Count: 28808617 Link: Hub2 Combined Data to FEX 12 | Error Count: 28812694 Link: Hub2 Combined Data to FEX 13 | Error Count: 28793562 Link: Hub2 Combined Data to FEX 14 | Error Count: 28793188 Link: Hub2 Combined Data to Hub1 | Error Count: 369276141 Link: HTM3 FEX Data Lane 0 to Hub1 | Error Count: 63626335 Link: HTM3 FEX Data Lane 1 to Hub1 | Error Count: 63639627 Link: HTM3 FEX Data Lane 2 to Hub1 | Error Count: 63616383 Link: HTM3 FEX Data Lane 3 to Hub1 | Error Count: 63624196 Link: HTM3 FEX Data Lane 4 to Hub1 | Error Count: 63656766 Link: HTM3 FEX Data Lane 5 to Hub1 | Error Count: 63664036 Link: HTM3 FEX Data Lane 0 to Hub2 | Error Count: 63668930 Link: HTM3 FEX Data Lane 1 to Hub2 | Error Count: 63691790 Link: HTM3 FEX Data Lane 2 to Hub2 | Error Count: 63689805 Link: HTM3 FEX Data Lane 3 to Hub2 | Error Count: 63681838 Link: HTM3 FEX Data Lane 4 to Hub2 | Error Count: 63673799 Link: HTM3 FEX Data Lane 5 to Hub2 | Error Count: 63658685 Link: HTM10 FEX Data Lane 5 to Hub1 | Error Count: 449251905 Link: HTM13 FEX Data Lane 5 to Hub1 | Error Count: 446693498 Link: Hub1 TX MiniPOD Channel 0 to HTM3 RX MiniPOD Channel 11 | Error Count: 29483941 Link: Hub1 TX MiniPOD Channel 1 to HTM3 RX MiniPOD Channel 10 | Error Count: 29497111 Link: Hub1 TX MiniPOD Channel 2 to HTM3 RX MiniPOD Channel 9 | Error Count: 29494137 Link: Hub1 TX MiniPOD Channel 4 to HTM3 RX MiniPOD Channel 7 | Error Count: 29492863 Link: Hub1 TX MiniPOD Channel 8 to HTM3 RX MiniPOD Channel 3 | Error Count: 29497972 Link: Hub1 TX MiniPOD Channel 10 to HTM3 RX MiniPOD Channel 1 | Error Count: 29501056 Link: Hub1 TX MiniPOD Channel 11 to HTM3 RX MiniPOD Channel 0 | Error Count: 1721790853 Link: Hub2 TX MiniPOD Channel 0 to HTM4 RX MiniPOD Channel 11 | Error Count: 29505838 Link: Hub2 TX MiniPOD Channel 1 to HTM4 RX MiniPOD Channel 10 | Error Count: 29506816 Link: Hub2 TX MiniPOD Channel 2 to HTM4 RX MiniPOD Channel 9 | Error Count: 29503341 Link: Hub2 TX MiniPOD Channel 4 to HTM4 RX MiniPOD Channel 7 | Error Count: 29508475 Link: Hub2 TX MiniPOD Channel 6 to HTM4 RX MiniPOD Channel 5 | Error Count: 29504464 Link: Hub2 TX MiniPOD Channel 8 to HTM4 RX MiniPOD Channel 3 | Error Count: 29502873 Link: Hub2 TX MiniPOD Channel 10 to HTM4 RX MiniPOD Channel 1 | Error Count: 29497871 Link: Hub2 TX MiniPOD Channel 11 to HTM4 RX MiniPOD Channel 0 | Error Count: 647873367 Link: Readout Control Data from ROD to Hub1 | Error Count: 443617816 Link: Readout Control Data from ROD to Hub2 | Error Count: 443539896 [Aug 10 20:20:01 2020]: Error Report Finished