It is easy to distinguish between the source and display on HDMI/DP applications. The source is the equipment that gives the signal, and the display is the device that shows the video.
Most of fiber optic USB AOC transfer data, and power, just few of USB AOC cables allow video signal transmission. Check BKSTEC full-featured fiber optic USB to understand more.
Typically, there is only one transmitter and one receiver on each end of the cable, so the cable will indicate which end is the source and which is the display. It is easier for HDMI devices to differentiate between source devices and display devices. However, USB devices may require a dongle to be added to the configuration, making it necessary to determine how the "video" signals are transmitted.