I am thinking of buying 2 of this adapter for my Macbook Pro 2018?
By plugging the adapter from both side of the USB-C ports, can i connect it to 2 external HDMI monitors?
Yes. It is possible to connect two HDMI monitors using two adapters.
Each of the four USB-C ports (2 on either side) support connecting external display.