YouTube has clarified in a statement that users who use ad blockers will have a suboptimal experience regardless of their browser.
This delay isn't exclusive to Firefox, it's in any browser where a user has enabled adblockers including in Chrome. Disable the adblocker and this delay magically go away. This was done on purpose.