On the commuting probability for subgroups of a finite group

Abstract

Let $K$ be a subgroup of a finite group $G$. The probability that an element of $G$ commutes with an element of $K$ is denoted by $Pr(K,G)$. Assume that $Pr(K,G)\ge \epsilon$ for some fixed $\epsilon >0$. We show that there is a normal subgroup $T\le G$ and a subgroup $B\le K$ such that the indexes $[G:T]$ and $[K:B]$ and the order of the commutator subgroup $[T,B]$ are $\epsilon$-bounded. This extends the well known theorem, due to P. M. Neumann, that covers the case where $K=G$. We deduce a number of corollaries of this result. A typical application is that if $K$ is the generalized Fitting subgroup $F^{\ast }(G)$ then $G$ has a class-2-nilpotent normal subgroup $R$ such that both the index $[G:R]$ and the order of the commutator subgroup $[R,R]$ are $\epsilon$-bounded. In the same spirit we consider the cases where $K$ is a term of the lower central series of $G$, or a Sylow subgroup, etc.

The earlier version has been considerably modified. Essentially, the present version is a new paper