Effects of the LLL reduction on the success probability of the Babai point and on the complexity of sphere decoding

Xiao-Wen Chang, Jinming Wen, Xiaohu Xie

The common method to estimate an unknown integer parameter vector in a linear model is to solve an integer least squares (ILS) problem. A typical approach to solving an ILS problem…