It is "極"其 (simplified: "极"其), not "及"其. Yes, it applies to every case just like 很 and 挺; however, 很 and 挺 are much more colloquially used (極其 would be much applied to when it comes to writing/composition). Here I want to note another phrase, 其極 (simplified: 其极), such as 無所不用其極, which means "(to do something) by all means".