On VFC-HD reading EEPROM was taking too long. E.g. reading SFP database through
snmp was taking ~0.5s which was enough to break the timestamps for received PTP
frames and thus the timing. See issue 1649 in wr-cores project on OHWR.